You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by AssafMendelson <as...@rsa.com> on 2017/06/20 14:02:07 UTC

spark higher order functions

Hi,
I have seen that databricks have higher order functions (https://docs.databricks.com/_static/notebooks/higher-order-functions.html, https://databricks.com/blog/2017/05/24/working-with-nested-data-using-higher-order-functions-in-sql-on-databricks.html) which basically allows to do generic operations on arrays (and I imagine on maps too).
I was wondering if there is an equivalent on vanilla spark.


Thanks,
              Assaf.





--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/spark-higher-order-functions-tp28774.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: spark higher order functions

Posted by Yanbo Liang <yb...@gmail.com>.

See reply here:

http://apache-spark-developers-list.1001551.n3.nabble.com/Will-higher-order-functions-in-spark-SQL-be-pushed-upstream-td21703.html

On Tue, Jun 20, 2017 at 10:02 PM, AssafMendelson <as...@rsa.com>
wrote:

> Hi,
>
> I have seen that databricks have higher order functions (
> https://docs.databricks.com/_static/notebooks/higher-order-functions.html,
> https://databricks.com/blog/2017/05/24/working-with-
> nested-data-using-higher-order-functions-in-sql-on-databricks.html) which
> basically allows to do generic operations on arrays (and I imagine on maps
> too).
>
> I was wondering if there is an equivalent on vanilla spark.
>
>
>
>
>
> Thanks,
>
>               Assaf.
>
>
>
> ------------------------------
> View this message in context: spark higher order functions
> <http://apache-spark-user-list.1001560.n3.nabble.com/spark-higher-order-functions-tp28774.html>
> Sent from the Apache Spark User List mailing list archive
> <http://apache-spark-user-list.1001560.n3.nabble.com/> at Nabble.com.
>