Spark SQL on Cassandra

[cis <cr...@gmail.com>]

I am dealing with a Lambda Architecture. This means I have Hadoop on the
batch layer, Storm on the speed layer and I'm storing the precomputed views
from both layers in  Cassandra.

I understand that Spark is a substitute for Hadoop but at the moment I would
like not to change the batch layer.

I would like to execute SQL queries on Cassandra using Spark SQL. Is it
possible to get just Spark SQL to run on top of Cassandra, without Spark? My
goal is to access Cassandra data with BI tools. Spark SQL looks like the
perfect tool for this.




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-on-Cassandra-tp17812.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Spark SQL on Cassandra

[Helena Edelson <he...@datastax.com>]

You can use https://github.com/datastax/spark-cassandra-connector to integrate Cassandra using Spark SQL.

docs in progress but for now:
https://github.com/datastax/spark-cassandra-connector/blob/master/spark-cassandra-connector/src/main/scala/org/apache/spark/sql/cassandra/CassandraSQLContext.scala
Some samples:
https://github.com/datastax/spark-cassandra-connector/blob/master/spark-cassandra-connector/src/it/scala/com/datastax/spark/connector/sql/CassandraSQLSpec.scala


- Helena
@helenaedelson

On Oct 31, 2014, at 6:00 AM, cis <cr...@gmail.com> wrote:

> I am dealing with a Lambda Architecture. This means I have Hadoop on the
> batch layer, Storm on the speed layer and I'm storing the precomputed views
> from both layers in  Cassandra.
> 
> I understand that Spark is a substitute for Hadoop but at the moment I would
> like not to change the batch layer.
> 
> I would like to execute SQL queries on Cassandra using Spark SQL. Is it
> possible to get just Spark SQL to run on top of Cassandra, without Spark? My
> goal is to access Cassandra data with BI tools. Spark SQL looks like the
> perfect tool for this.
> 
> 
> 
> 
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-SQL-on-Cassandra-tp17812.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>