Get invited to our slack community and get access to opportunities and data science insights

arrays_overlap(a1, a2) – Returns true if a1 contains at least a non-null element present also in a2. If the arrays have no common element and they are both non-empty and either of them contains a null element null is returned, false otherwise.
Platforms: WhereOS, Spark, Hive
Class: org.apache.spark.sql.catalyst.expressions.ArraysOverlap

More functions can be added to WhereOS via Python or R bindings or as Java & Scala UDF (user-defined function), UDAF (user-defined aggregation function) and UDTF (user-defined table generating function) extensions. Custom libraries can be added on via Settings-page or installed from WhereOS Store.

Related Post

Leave a Comment