You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Siddharth Ubale <si...@syncoms.com> on 2015/02/11 15:17:53 UTC
Hive/Hbase for low latency
Hi ,
I am new to Spark . We have recently moved from Apache Storm to Apache Spark to build our OLAP tool .
Now ,earlier we were using Hbase & Phoenix.
We need to re-think what to use in case of Spark.
Should we go ahead with Hbase or Hive or Cassandra for query processing with Spark Sql.
Please share ur views.
Thanks,
Siddharth Ubale,
Re: Hive/Hbase for low latency
Posted by Ravi Kiran <ra...@gmail.com>.
Hi Siddharth,
With v 4.3 of Phoenix, you can use the PhoenixInputFormat and
OutputFormat classes to pull/push to Phoenix from Spark.
HTH
Thanks
Ravi
On Wed, Feb 11, 2015 at 6:59 AM, Ted Yu <yu...@gmail.com> wrote:
> Connectivity to hbase is also avaliable. You can take a look at:
>
> examples//src/main/python/hbase_inputformat.py
> examples//src/main/python/hbase_outputformat.py
> examples//src/main/scala/org/apache/spark/examples/HBaseTest.scala
>
> examples//src/main/scala/org/apache/spark/examples/pythonconverters/HBaseConverters.scala
>
> Cheers
>
> On Wed, Feb 11, 2015 at 6:29 AM, VISHNU SUBRAMANIAN <
> johnfedrickenator@gmail.com> wrote:
>
>> Hi Siddarth,
>>
>> It depends on what you are trying to solve. But the connectivity for
>> cassandra and spark is good .
>>
>> The answer depends upon what exactly you are trying to solve.
>>
>> Thanks,
>> Vishnu
>>
>> On Wed, Feb 11, 2015 at 7:47 PM, Siddharth Ubale <
>> siddharth.ubale@syncoms.com> wrote:
>>
>>> Hi ,
>>>
>>>
>>>
>>> I am new to Spark . We have recently moved from Apache Storm to Apache
>>> Spark to build our OLAP tool .
>>>
>>> Now ,earlier we were using Hbase & Phoenix.
>>>
>>> We need to re-think what to use in case of Spark.
>>>
>>> Should we go ahead with Hbase or Hive or Cassandra for query processing
>>> with Spark Sql.
>>>
>>>
>>>
>>> Please share ur views.
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Siddharth Ubale,
>>>
>>>
>>>
>>>
>>>
>>
>>
>
Re: Hive/Hbase for low latency
Posted by Ted Yu <yu...@gmail.com>.
Connectivity to hbase is also avaliable. You can take a look at:
examples//src/main/python/hbase_inputformat.py
examples//src/main/python/hbase_outputformat.py
examples//src/main/scala/org/apache/spark/examples/HBaseTest.scala
examples//src/main/scala/org/apache/spark/examples/pythonconverters/HBaseConverters.scala
Cheers
On Wed, Feb 11, 2015 at 6:29 AM, VISHNU SUBRAMANIAN <
johnfedrickenator@gmail.com> wrote:
> Hi Siddarth,
>
> It depends on what you are trying to solve. But the connectivity for
> cassandra and spark is good .
>
> The answer depends upon what exactly you are trying to solve.
>
> Thanks,
> Vishnu
>
> On Wed, Feb 11, 2015 at 7:47 PM, Siddharth Ubale <
> siddharth.ubale@syncoms.com> wrote:
>
>> Hi ,
>>
>>
>>
>> I am new to Spark . We have recently moved from Apache Storm to Apache
>> Spark to build our OLAP tool .
>>
>> Now ,earlier we were using Hbase & Phoenix.
>>
>> We need to re-think what to use in case of Spark.
>>
>> Should we go ahead with Hbase or Hive or Cassandra for query processing
>> with Spark Sql.
>>
>>
>>
>> Please share ur views.
>>
>>
>>
>> Thanks,
>>
>> Siddharth Ubale,
>>
>>
>>
>>
>>
>
>
Re: Hive/Hbase for low latency
Posted by VISHNU SUBRAMANIAN <jo...@gmail.com>.
Hi Siddarth,
It depends on what you are trying to solve. But the connectivity for
cassandra and spark is good .
The answer depends upon what exactly you are trying to solve.
Thanks,
Vishnu
On Wed, Feb 11, 2015 at 7:47 PM, Siddharth Ubale <
siddharth.ubale@syncoms.com> wrote:
> Hi ,
>
>
>
> I am new to Spark . We have recently moved from Apache Storm to Apache
> Spark to build our OLAP tool .
>
> Now ,earlier we were using Hbase & Phoenix.
>
> We need to re-think what to use in case of Spark.
>
> Should we go ahead with Hbase or Hive or Cassandra for query processing
> with Spark Sql.
>
>
>
> Please share ur views.
>
>
>
> Thanks,
>
> Siddharth Ubale,
>
>
>
>
>