You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@cassandra.apache.org by Clint Kelly <cl...@gmail.com> on 2014/02/04 21:49:59 UTC

Cassandra 2.0 with Hadoop 2.x?

Folks,

Has anyone out there used Cassandra 2.0 with Hadoop 2.x?  I saw this
discussion on the Cassandra JIRA:

    https://issues.apache.org/jira/browse/CASSANDRA-5201

but the fix (https://github.com/michaelsembwever/cassandra-hadoop)
referenced in the thread is for Cassandra 1.2.

I put together a similar patch for Cassandra 2.0 for anyone who is interested:

    https://github.com/wibiclint/cassandra2-hadoop2

but I'm wondering if there is a more official solution to this
problem.  Any help would be appreciated.  Thanks!

Best regards,
Clint

Re: Cassandra 2.0 with Hadoop 2.x?

Posted by Ben Coverston <be...@datastax.com>.
Clint, I'm hoping that
https://issues.apache.org/jira/browse/CASSANDRA-5201 will
make it into Cassandra 2.0, as it is a general purpose solution that will
work for both mapred, and mapreduce based code.


On Wed, Feb 5, 2014 at 1:33 PM, Clint Kelly <cl...@gmail.com> wrote:

> One other question: Has anyone considered taking a crack at modifying
> the CqlPagingRecordReader to use the DataStax java driver?  I am not
> sure how that kind of cross-pollination of different projects works,
> but I thought the paging mechanisms in the DataStax driver might help
> simplify the CqlPagingRecordReader code.
>
> Best regards,
> Clint
>
> On Tue, Feb 4, 2014 at 12:49 PM, Clint Kelly <cl...@gmail.com>
> wrote:
> > Folks,
> >
> > Has anyone out there used Cassandra 2.0 with Hadoop 2.x?  I saw this
> > discussion on the Cassandra JIRA:
> >
> >     https://issues.apache.org/jira/browse/CASSANDRA-5201
> >
> > but the fix (https://github.com/michaelsembwever/cassandra-hadoop)
> > referenced in the thread is for Cassandra 1.2.
> >
> > I put together a similar patch for Cassandra 2.0 for anyone who is
> interested:
> >
> >     https://github.com/wibiclint/cassandra2-hadoop2
> >
> > but I'm wondering if there is a more official solution to this
> > problem.  Any help would be appreciated.  Thanks!
> >
> > Best regards,
> > Clint
>



-- 
Ben Coverston
DataStax -- The Apache Cassandra Company

Re: Cassandra 2.0 with Hadoop 2.x?

Posted by Clint Kelly <cl...@gmail.com>.
One other question: Has anyone considered taking a crack at modifying
the CqlPagingRecordReader to use the DataStax java driver?  I am not
sure how that kind of cross-pollination of different projects works,
but I thought the paging mechanisms in the DataStax driver might help
simplify the CqlPagingRecordReader code.

Best regards,
Clint

On Tue, Feb 4, 2014 at 12:49 PM, Clint Kelly <cl...@gmail.com> wrote:
> Folks,
>
> Has anyone out there used Cassandra 2.0 with Hadoop 2.x?  I saw this
> discussion on the Cassandra JIRA:
>
>     https://issues.apache.org/jira/browse/CASSANDRA-5201
>
> but the fix (https://github.com/michaelsembwever/cassandra-hadoop)
> referenced in the thread is for Cassandra 1.2.
>
> I put together a similar patch for Cassandra 2.0 for anyone who is interested:
>
>     https://github.com/wibiclint/cassandra2-hadoop2
>
> but I'm wondering if there is a more official solution to this
> problem.  Any help would be appreciated.  Thanks!
>
> Best regards,
> Clint