You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by dubey_a <Ab...@xoriant.com> on 2015/03/02 10:48:53 UTC

Architecture of Apache Spark SQL

What is the architecture of Apache Spark SQL? 



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Architecture-of-Apache-Spark-SQL-tp21869.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Architecture of Apache Spark SQL

Posted by Michael Armbrust <mi...@databricks.com>.

Here is a description of the optimizer:
https://docs.google.com/a/databricks.com/document/d/1Hc_Ehtr0G8SQUg69cmViZsMi55_Kf3tISD9GPGU5M1Y/edit

On Mon, Mar 2, 2015 at 10:18 PM, Akhil Das <ak...@sigmoidanalytics.com>
wrote:

> Here's the whole tech stack around it:
>
> [image: Inline image 1]
>
>
> For a bit more details you can refer this slide
> http://www.slideshare.net/jeykottalam/spark-sqlamp-camp2014?related=1
>
> Previous project was Shark (SQL over spark), you can read about it from
> here
> http://databricks.com/blog/2014/07/01/shark-spark-sql-hive-on-spark-and-the-future-of-sql-on-spark.html
>
>
>
> Thanks
> Best Regards
>
> On Mon, Mar 2, 2015 at 3:18 PM, dubey_a <Ab...@xoriant.com>
> wrote:
>
>> What is the architecture of Apache Spark SQL?
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Architecture-of-Apache-Spark-SQL-tp21869.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>

Re: Architecture of Apache Spark SQL

Posted by Akhil Das <ak...@sigmoidanalytics.com>.

Here's the whole tech stack around it:

[image: Inline image 1]


For a bit more details you can refer this slide
http://www.slideshare.net/jeykottalam/spark-sqlamp-camp2014?related=1

Previous project was Shark (SQL over spark), you can read about it from
here
http://databricks.com/blog/2014/07/01/shark-spark-sql-hive-on-spark-and-the-future-of-sql-on-spark.html



Thanks
Best Regards

On Mon, Mar 2, 2015 at 3:18 PM, dubey_a <Ab...@xoriant.com> wrote:

> What is the architecture of Apache Spark SQL?
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Architecture-of-Apache-Spark-SQL-tp21869.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>