Spark-Cassandra-connector

[Samya <sa...@amadeus.com>]

Hi All,

I need to write an RDD to Cassandra & using the sparkCassandraConnector from
DataStax. My application is using Yarn.

*Some basic Questions :*
1.  Will a call to saveToCassandra(.....), be using the same connection
object between all task in a given executor? I mean is there 1 (one)
connection object per executor, that is shared between tasks ?
2. If the above answer is YES, is there a way to create a connectionPool for
each executor, so that multiple task can dump data to cassandra in parallel?

Regards,
Samya



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Cassandra-connector-tp24378.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Spark-Cassandra-connector

[Ted Yu <yu...@gmail.com>]

Have you considered asking this question on
https://groups.google.com/a/lists.datastax.com/forum/#!forum/spark-connector-user
?

Cheers

On Thu, Aug 20, 2015 at 10:57 PM, Samya <sa...@amadeus.com> wrote:

> Hi All,
>
> I need to write an RDD to Cassandra & using the sparkCassandraConnector
> from
> DataStax. My application is using Yarn.
>
> *Some basic Questions :*
> 1.  Will a call to saveToCassandra(.....), be using the same connection
> object between all task in a given executor? I mean is there 1 (one)
> connection object per executor, that is shared between tasks ?
> 2. If the above answer is YES, is there a way to create a connectionPool
> for
> each executor, so that multiple task can dump data to cassandra in
> parallel?
>
> Regards,
> Samya
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Cassandra-connector-tp24378.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>