normalize_unicode

normalize_unicode(string str [, string form]) – Transforms `str` with the specified normalization form. The `form` takes one of NFC (default), NFD, NFKC, or NFKD

SELECT normalize_unicode(‘ﾊﾝｶｸｶﾅ’,’NFKC’);
ハンカクカナ

SELECT normalize_unicode(‘㈱㌧㌦Ⅲ’,’NFKC’);
(株)トンドルIII

Platforms: WhereOS, Spark, Hive

Class: hivemall.tools.text.NormalizeUnicodeUDF

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

View the complete guide of WhereOS functions.

No Comments

TAGS : hive spark sql

normalize_unicode

Related Post

bit_length

weight_voted_avg

truncate_array

Leave a Comment Cancel reply

Articles by Category

Recent Posts

How WhereOS and JCDecaux

Data fusion: how integra

percentile_approx

Experimentation In Produ

Open Data Utilization

WhereOS

Navigation

Contact Us