You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@spark.apache.org by Jean Georges Perrin <jg...@jgp.net> on 2019/02/10 22:39:00 UTC

Static functions

Hey guys,

We have 381 static functions now (including the deprecated). I am trying to sort them out by group/tag them.

So far, I have:
Array
Conversion
Date
Math
Trigo (sub group of maths)
Security
Streaming
String
Technical
Do you see more categories? Tags?

Thanks!

jg

—
Jean Georges Perrin / @jgperrin

Re: Static functions

Posted by Jean Georges Perrin <jg...@jgp.net>.

Hey Jacek,

You mean:
 * @groupname udf_funcs UDF functions
 * @groupname agg_funcs Aggregate functions
 * @groupname datetime_funcs Date time functions
 * @groupname sort_funcs Sorting functions
 * @groupname normal_funcs Non-aggregate functions
 * @groupname math_funcs Math functions
 * @groupname misc_funcs Misc functions
 * @groupname window_funcs Window functions
 * @groupname string_funcs String functions
 * @groupname collection_funcs Collection functions
 * @groupname Ungrouped Support functions for DataFrames

There’s that (and thanks, I did not know), but it does not show on the Javadoc in https://spark.apache.org/docs/latest/api/java/org/apache/spark/sql/functions.html… or anywhere else (Scala doc or SQL functions).


Jean Georges Perrin
jgp@jgp.net



> On Feb 11, 2019, at 09:42, Jacek Laskowski <ja...@japila.pl> wrote:
> 
> Hi Jean,
> 
> I thought the functions have already been tagged?
> 
> Pozdrawiam,
> Jacek Laskowski
> ----
> https://about.me/JacekLaskowski <https://about.me/JacekLaskowski>
> Mastering Spark SQL https://bit.ly/mastering-spark-sql <https://bit.ly/mastering-spark-sql>
> Spark Structured Streaming https://bit.ly/spark-structured-streaming <https://bit.ly/spark-structured-streaming>
> Mastering Kafka Streams https://bit.ly/mastering-kafka-streams <https://bit.ly/mastering-kafka-streams>
> Follow me at https://twitter.com/jaceklaskowski
>  <https://twitter.com/jaceklaskowski>
> 
> On Sun, Feb 10, 2019 at 11:48 PM Jean Georges Perrin <jgp@jgp.net <ma...@jgp.net>> wrote:
> Hey guys,
> 
> We have 381 static functions now (including the deprecated). I am trying to sort them out by group/tag them.
> 
> So far, I have:
> Array
> Conversion
> Date
> Math
> Trigo (sub group of maths)
> Security
> Streaming
> String
> Technical
> Do you see more categories? Tags?
> 
> Thanks!
> 
> jg
> 
> —
> Jean Georges Perrin / @jgperrin
>

Re: Static functions

Posted by Jacek Laskowski <ja...@japila.pl>.

Hi Jean,

I thought the functions have already been tagged?

Pozdrawiam,
Jacek Laskowski
----
https://about.me/JacekLaskowski
Mastering Spark SQL https://bit.ly/mastering-spark-sql
Spark Structured Streaming https://bit.ly/spark-structured-streaming
Mastering Kafka Streams https://bit.ly/mastering-kafka-streams
Follow me at https://twitter.com/jaceklaskowski


On Sun, Feb 10, 2019 at 11:48 PM Jean Georges Perrin <jg...@jgp.net> wrote:

> Hey guys,
>
> We have 381 static functions now (including the deprecated). I am trying
> to sort them out by group/tag them.
>
> So far, I have:
>
>    - Array
>    - Conversion
>    - Date
>    - Math
>       - Trigo (sub group of maths)
>    - Security
>    - Streaming
>    - String
>    - Technical
>
> Do you see more categories? Tags?
>
> Thanks!
>
> jg
>
> —
> Jean Georges Perrin / @jgperrin
>
>