DataFrame DSL documentation

[Gerard Maas <ge...@gmail.com>]

Hi,

Where could I find good documentation on the DataFrame DSL?
I'm struggling trying to combine selects, groupBy and aggregations.
A language definition would also help.

I perused these resources, but still have some gaps in my understanding and
things are not doing what I'd expect:

https://spark.apache.org/docs/1.3.0/sql-programming-guide.html
https://spark.apache.org/docs/1.3.0/api/scala/index.html#org.apache.spark.sql.DataFrame
https://spark.apache.org/docs/1.3.0/api/scala/index.html#org.apache.spark.sql.functions$


Thanks,  Gerard.

RE: DataFrame DSL documentation

["Ulanov, Alexander" <al...@hp.com>]

+1

I had to browse spark-catalyst sources to find what is supported:
https://github.com/apache/spark/blob/master/sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/SqlParser.scala


Alexander

From: Gerard Maas [mailto:gerard.maas@gmail.com]
Sent: Wednesday, May 06, 2015 11:42 AM
To: spark users
Subject: DataFrame DSL documentation

Hi,

Where could I find good documentation on the DataFrame DSL?
I'm struggling trying to combine selects, groupBy and aggregations.
A language definition would also help.

I perused these resources, but still have some gaps in my understanding and things are not doing what I'd expect:

https://spark.apache.org/docs/1.3.0/sql-programming-guide.html
https://spark.apache.org/docs/1.3.0/api/scala/index.html#org.apache.spark.sql.DataFrame
https://spark.apache.org/docs/1.3.0/api/scala/index.html#org.apache.spark.sql.functions$

Thanks,  Gerard.