xpath_double


xpath_double(xml, xpath) – Returns a double value, the value zero if no match is found, or NaN if a match is found but the value is non-numeric.
Platforms: WhereOS, Spark, Hive
Class: org.apache.spark.sql.catalyst.expressions.xml.XPathDouble

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

xpath_boolean


xpath_boolean(xml, xpath) – Returns true if the XPath expression evaluates to true, or if a matching node is found.
Platforms: WhereOS, Spark, Hive
Class: org.apache.spark.sql.catalyst.expressions.xml.XPathBoolean

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

xpath


xpath(xml, xpath) – Returns a string array of values within the nodes of xml that match the XPath expression.
Platforms: WhereOS, Spark, Hive
Class: org.apache.spark.sql.catalyst.expressions.xml.XPathList

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

x_rank


x_rank(KEY) – Generates a pseudo sequence number starting from 1 for each key

Platforms: WhereOS, Spark, Hive
Class: hivemall.tools.RankSequenceUDF

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

write_to_tsdb


This function writes metrics to the TSDB (metics names should look like proc.loadavg.1min, http.hits while tags string is space separated collection of tags). On failiure returns ‘WRITE_FAILED’ otherwise ‘WRITE_OK’ write_to_tsdb(String hostname, int port, Map nameToValue, String tags, Long timestampInSeconds) write_to_tsdb(String hostname, int port, Map nameToValue, String tags) write_to_tsdb(String hostname, int port, Map nameToValue) write_to_tsdb(String hostname, int port, String metricName, Double metricVaule, String tags, Long timestampInSeconds) write_to_tsdb(String hostname, int port, String metricName, Double metricVaule, String tags) write_to_tsdb(String hostname, int port, String metricName, Double metricVaule)

Platforms: WhereOS, Spark, Hive
Class: brickhouse.udf.sanity.WriteToTSDBUDF

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

write_to_graphite


Writes metric or collection of metrics to graphite.write_to_graphite(String hostname, int port, Map nameToValue, Long timestampInSeconds) write_to_graphite(String hostname, int port, Map nameToValue) write_to_graphite(String hostname, int port, String metricName, Double metricVaule, Long timestampInSeconds) write_to_graphite(String hostname, int port, String metricName, Double metricVaule)

Platforms: WhereOS, Spark, Hive
Class: brickhouse.udf.sanity.WriteToGraphiteUDF

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

word_ngrams


word_ngrams(array words, int minSize, int maxSize]) – Returns list of n-grams for given words, where `minSize <= n <= maxSize` SELECT word_ngrams(tokenize('Machine learning is fun!', true), 1, 2); ["machine","machine learning","learning","learning is","is","is fun","fun"]
Platforms: WhereOS, Spark, Hive
Class: hivemall.tools.text.WordNgramsUDF

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

window


Platforms: WhereOS, Spark, Hive
Class: org.apache.spark.sql.catalyst.expressions.TimeWindow

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

when


CASE WHEN expr1 THEN expr2 [WHEN expr3 THEN expr4]* [ELSE expr5] END – When `expr1` = true, returns `expr2`; else when `expr3` = true, returns `expr4`; else returns `expr5`.
Platforms: WhereOS, Spark, Hive
Class: org.apache.spark.sql.catalyst.expressions.CaseWhen

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

weight_voted_avg


weight_voted_avg(expr) – Returns an averaged value by considering sum of positive/negative weights

Platforms: WhereOS, Spark, Hive
Class: hivemall.ensemble.bagging.WeightVotedAvgUDAF

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.