You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Nikhil Gs <gs...@gmail.com> on 2015/10/09 15:17:54 UTC

Kafka and Spark combination

Has anyone worked with Kafka in a scenario where the Streaming data from
the Kafka consumer is picked by Spark (Java) functionality and directly
placed in Hbase.

Regards,
Gs.

Re: Kafka and Spark combination

Posted by Tathagata Das <td...@databricks.com>.

http://blog.cloudera.com/blog/2014/12/new-in-cloudera-labs-sparkonhbase/
Recently it has been merged into HBase
https://issues.apache.org/jira/browse/HBASE-13992

There are other options to use. See spark-packages.org.

On Fri, Oct 9, 2015 at 4:33 PM, Xiao Li <ga...@gmail.com> wrote:

> Please see the following discussion:
>
> http://search-hadoop.com/m/YGbbS0SqClMW5T1
>
> Thanks,
>
> Xiao Li
>
> 2015-10-09 6:17 GMT-07:00 Nikhil Gs <gs...@gmail.com>:
>
>> Has anyone worked with Kafka in a scenario where the Streaming data from
>> the Kafka consumer is picked by Spark (Java) functionality and directly
>> placed in Hbase.
>>
>> Regards,
>> Gs.
>>
>
>

Re: Kafka and Spark combination

Posted by Xiao Li <ga...@gmail.com>.

Please see the following discussion:

http://search-hadoop.com/m/YGbbS0SqClMW5T1

Thanks,

Xiao Li

2015-10-09 6:17 GMT-07:00 Nikhil Gs <gs...@gmail.com>:

> Has anyone worked with Kafka in a scenario where the Streaming data from
> the Kafka consumer is picked by Spark (Java) functionality and directly
> placed in Hbase.
>
> Regards,
> Gs.
>