Re: Will higher order functions in spark SQL be pushed upstream?

[Mick Davies <mi...@gmail.com>]

Hi,
Regarding higher order functions

> Yes, we intend to contribute this to open source.

It doesn't look like this is in 2.3.0, at least I can't find it.

Do you know when it might reach open source.

Thanks

Mick



--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org

Re: Will higher order functions in spark SQL be pushed upstream?

[Michael Davies <mi...@gmail.com>]

Hi Herman, 

That’s great and thanks for quick reply. The JIRA has an example of transform and refers to a presto doc with lots of functions. Do you know which functions will be supported. I am interested in using filter for example.

Cheers

Mick


> On 19 Apr 2018, at 10:46, Herman van Hövell tot Westerflier <he...@databricks.com> wrote:
> 
> Hi Mick,
> 
> Higher order functions will be in the next release of Spark (2.4). See SPARK-23908 <https://issues.apache.org/jira/browse/SPARK-23908> for more information. The PR should be out in a few weeks.
> 
> - Herman
> 
> On Thu, Apr 19, 2018 at 11:20 AM, Mick Davies <michael.belldavies@gmail.com <ma...@gmail.com>> wrote:
> Hi,
> Regarding higher order functions
> 
> > Yes, we intend to contribute this to open source.
> 
> It doesn't look like this is in 2.3.0, at least I can't find it.
> 
> Do you know when it might reach open source.
> 
> Thanks
> 
> Mick
> 
> 
> 
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/ <http://apache-spark-developers-list.1001551.n3.nabble.com/>
> 
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org <ma...@spark.apache.org>
> 
>