You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Siddharth Ubale <si...@syncoms.com> on 2015/02/11 15:17:53 UTC

Hive/Hbase for low latency

Hi ,

I am new to Spark . We have recently moved from Apache Storm to Apache Spark to build our OLAP tool .
Now ,earlier we were using Hbase & Phoenix.
We need to re-think what to use in case of Spark.
Should we go ahead with Hbase or Hive or Cassandra for query processing with Spark Sql.

Please share ur views.

Thanks,
Siddharth Ubale,



Re: Hive/Hbase for low latency

Posted by Ravi Kiran <ra...@gmail.com>.
Hi Siddharth,

     With v 4.3 of Phoenix, you can use the PhoenixInputFormat and
OutputFormat classes to pull/push to Phoenix from Spark.

HTH

Thanks
Ravi


On Wed, Feb 11, 2015 at 6:59 AM, Ted Yu <yu...@gmail.com> wrote:

> Connectivity to hbase is also avaliable. You can take a look at:
>
> examples//src/main/python/hbase_inputformat.py
> examples//src/main/python/hbase_outputformat.py
> examples//src/main/scala/org/apache/spark/examples/HBaseTest.scala
>
> examples//src/main/scala/org/apache/spark/examples/pythonconverters/HBaseConverters.scala
>
> Cheers
>
> On Wed, Feb 11, 2015 at 6:29 AM, VISHNU SUBRAMANIAN <
> johnfedrickenator@gmail.com> wrote:
>
>> Hi Siddarth,
>>
>> It depends on what you are trying to solve. But the connectivity for
>> cassandra and spark is good .
>>
>> The answer depends upon what exactly you are trying to solve.
>>
>> Thanks,
>> Vishnu
>>
>> On Wed, Feb 11, 2015 at 7:47 PM, Siddharth Ubale <
>> siddharth.ubale@syncoms.com> wrote:
>>
>>>  Hi ,
>>>
>>>
>>>
>>> I am new to Spark . We have recently moved from Apache Storm to Apache
>>> Spark to build our OLAP tool .
>>>
>>> Now ,earlier we were using Hbase & Phoenix.
>>>
>>> We need to re-think what to use in case of Spark.
>>>
>>> Should we go ahead with Hbase or Hive or Cassandra for query processing
>>> with Spark Sql.
>>>
>>>
>>>
>>> Please share ur views.
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Siddharth Ubale,
>>>
>>>
>>>
>>>
>>>
>>
>>
>

Re: Hive/Hbase for low latency

Posted by Ted Yu <yu...@gmail.com>.
Connectivity to hbase is also avaliable. You can take a look at:

examples//src/main/python/hbase_inputformat.py
examples//src/main/python/hbase_outputformat.py
examples//src/main/scala/org/apache/spark/examples/HBaseTest.scala
examples//src/main/scala/org/apache/spark/examples/pythonconverters/HBaseConverters.scala

Cheers

On Wed, Feb 11, 2015 at 6:29 AM, VISHNU SUBRAMANIAN <
johnfedrickenator@gmail.com> wrote:

> Hi Siddarth,
>
> It depends on what you are trying to solve. But the connectivity for
> cassandra and spark is good .
>
> The answer depends upon what exactly you are trying to solve.
>
> Thanks,
> Vishnu
>
> On Wed, Feb 11, 2015 at 7:47 PM, Siddharth Ubale <
> siddharth.ubale@syncoms.com> wrote:
>
>>  Hi ,
>>
>>
>>
>> I am new to Spark . We have recently moved from Apache Storm to Apache
>> Spark to build our OLAP tool .
>>
>> Now ,earlier we were using Hbase & Phoenix.
>>
>> We need to re-think what to use in case of Spark.
>>
>> Should we go ahead with Hbase or Hive or Cassandra for query processing
>> with Spark Sql.
>>
>>
>>
>> Please share ur views.
>>
>>
>>
>> Thanks,
>>
>> Siddharth Ubale,
>>
>>
>>
>>
>>
>
>

Re: Hive/Hbase for low latency

Posted by VISHNU SUBRAMANIAN <jo...@gmail.com>.
Hi Siddarth,

It depends on what you are trying to solve. But the connectivity for
cassandra and spark is good .

The answer depends upon what exactly you are trying to solve.

Thanks,
Vishnu

On Wed, Feb 11, 2015 at 7:47 PM, Siddharth Ubale <
siddharth.ubale@syncoms.com> wrote:

>  Hi ,
>
>
>
> I am new to Spark . We have recently moved from Apache Storm to Apache
> Spark to build our OLAP tool .
>
> Now ,earlier we were using Hbase & Phoenix.
>
> We need to re-think what to use in case of Spark.
>
> Should we go ahead with Hbase or Hive or Cassandra for query processing
> with Spark Sql.
>
>
>
> Please share ur views.
>
>
>
> Thanks,
>
> Siddharth Ubale,
>
>
>
>
>