You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Pariksheet Barapatre <pb...@gmail.com> on 2016/05/24 07:58:32 UTC

Spark Streaming with Redis

Hello All,

I am trying to use Redis as a data store for one of sensor data use cases
and I am fairly new to Redis.

I guess spark-redis module can help me, but I am not getting how to use
INCR or HINCRBY redis functions.

Could you please help me to get some example codes or any pointers to solve
this problem.

Thanks in advance.

Cheers,
Pari

Re: Spark Streaming with Redis

Posted by Pariksheet Barapatre <pb...@gmail.com>.

Thanks Sachin. Link that you mentioned uses native connection library
JedisPool.

I am looking if I can use https://github.com/RedisLabs/spark-redis for same
functionality.

Regards
Pari

On 24 May 2016 at 13:33, Sachin Aggarwal <di...@gmail.com> wrote:

> Hi,
>
> yahoo benchmark uses redis with spark,
>
> have a look at this
>
>
> https://github.com/yahoo/streaming-benchmarks/blob/master/spark-benchmarks/src/main/scala/AdvertisingSpark.scala
>
> On Tue, May 24, 2016 at 1:28 PM, Pariksheet Barapatre <
> pbarapatre@gmail.com> wrote:
>
>> Hello All,
>>
>> I am trying to use Redis as a data store for one of sensor data use cases
>> and I am fairly new to Redis.
>>
>> I guess spark-redis module can help me, but I am not getting how to use
>> INCR or HINCRBY redis functions.
>>
>> Could you please help me to get some example codes or any pointers to
>> solve this problem.
>>
>> Thanks in advance.
>>
>> Cheers,
>> Pari
>>
>
>
>
> --
>
> Thanks & Regards
>
> Sachin Aggarwal
> 7760502772
>



-- 
Cheers,
Pari

Re: Spark Streaming with Redis

Posted by Sachin Aggarwal <di...@gmail.com>.

Hi,

yahoo benchmark uses redis with spark,

have a look at this

https://github.com/yahoo/streaming-benchmarks/blob/master/spark-benchmarks/src/main/scala/AdvertisingSpark.scala

On Tue, May 24, 2016 at 1:28 PM, Pariksheet Barapatre <pb...@gmail.com>
wrote:

> Hello All,
>
> I am trying to use Redis as a data store for one of sensor data use cases
> and I am fairly new to Redis.
>
> I guess spark-redis module can help me, but I am not getting how to use
> INCR or HINCRBY redis functions.
>
> Could you please help me to get some example codes or any pointers to
> solve this problem.
>
> Thanks in advance.
>
> Cheers,
> Pari
>



-- 

Thanks & Regards

Sachin Aggarwal
7760502772