You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Mukesh Jha <me...@gmail.com> on 2014/12/15 07:49:11 UTC

Spark-HBase connector

Hello Experts,

I've come across multiple posts where users want to read/write to hbase
from Spark/Spark-streaming apps and everyone has to implement the same
logic.

Does HBase has (or is there any ongoing work for the same) a spark
connector similar to the cassandra connector *[1]*?

*[1] *https://github.com/datastax/spark-cassandra-connector

-- 
Thanks & Regards,

*Mukesh Jha <me...@gmail.com>*

Re: Spark-HBase connector

Posted by Mukesh Jha <me...@gmail.com>.
Thanks Stack, looks promising will give it a try.

On Fri, Dec 19, 2014 at 3:28 AM, Stack <st...@duboce.net> wrote:
>
> On Tue, Dec 16, 2014 at 10:52 AM, Stack <st...@duboce.net> wrote:
> >
> > On Sun, Dec 14, 2014 at 10:49 PM, Mukesh Jha <me...@gmail.com>
> > wrote:
> >>
> >> Hello Experts,
> >>
> >> I've come across multiple posts where users want to read/write to hbase
> >> from Spark/Spark-streaming apps and everyone has to implement the same
> >> logic.
> >>
> >> Does HBase has (or is there any ongoing work for the same) a spark
> >> connector similar to the cassandra connector *[1]*?
> >>
> >> *[1] *https://github.com/datastax/spark-cassandra-connector
> >>
> >>
> > You might try:
> >
> > https://github.com/tmalaska/SparkOnHBase
> >
>
> On the above, Ted Malaska just posted a nice how to blog:
> http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
> (Pardon the vendor colors; we'll work on getting how to into the refguide).
>
> St.Ack
>


-- 


Thanks & Regards,

*Mukesh Jha <me...@gmail.com>*

Re: Spark-HBase connector

Posted by Stack <st...@duboce.net>.
On Tue, Dec 16, 2014 at 10:52 AM, Stack <st...@duboce.net> wrote:
>
> On Sun, Dec 14, 2014 at 10:49 PM, Mukesh Jha <me...@gmail.com>
> wrote:
>>
>> Hello Experts,
>>
>> I've come across multiple posts where users want to read/write to hbase
>> from Spark/Spark-streaming apps and everyone has to implement the same
>> logic.
>>
>> Does HBase has (or is there any ongoing work for the same) a spark
>> connector similar to the cassandra connector *[1]*?
>>
>> *[1] *https://github.com/datastax/spark-cassandra-connector
>>
>>
> You might try:
>
> https://github.com/tmalaska/SparkOnHBase
>

On the above, Ted Malaska just posted a nice how to blog:
http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
(Pardon the vendor colors; we'll work on getting how to into the refguide).

St.Ack

Re: Spark-HBase connector

Posted by Stack <st...@duboce.net>.
On Sun, Dec 14, 2014 at 10:49 PM, Mukesh Jha <me...@gmail.com>
wrote:
>
> Hello Experts,
>
> I've come across multiple posts where users want to read/write to hbase
> from Spark/Spark-streaming apps and everyone has to implement the same
> logic.
>
> Does HBase has (or is there any ongoing work for the same) a spark
> connector similar to the cassandra connector *[1]*?
>
> *[1] *https://github.com/datastax/spark-cassandra-connector
>
>
You might try:

https://github.com/tmalaska/SparkOnHBase
https://github.com/unicredit/hbase-rdd

I've not tried either myself. I know either of the above projects would
appreciate any feedback you might have.

St.Ack