You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by unk1102 <um...@gmail.com> on 2015/07/17 20:16:56 UTC
Re: Store DStreams into Hive using Hive Streaming
Hi I have similar use case did you found solution for this problem of loading
DStreams in Hive using Spark Streaming. Please guide. Thanks.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Store-DStreams-into-Hive-using-Hive-Streaming-tp18307p23885.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Store DStreams into Hive using Hive Streaming
Posted by Tathagata Das <td...@databricks.com>.
Hive is not designed for OLTP workloads like data insertions and updates
you want to do with Spark Streaming. Hive is mainly for OLAP workloads
where you already have data and you want to run bulk queries on the data.
Other systems like HBase and Cassandra are more designed for OLTP. Please
think about your system architecture based on how each of these are
designed.
On Mon, Oct 5, 2015 at 3:07 AM, Umesh Kacha <um...@gmail.com> wrote:
> Hi no didn't find any solution still I need that feature of hive streaming
> using Spark please let me know if you get something. Alternative solution
> is to use storm for hive processing. I would like to stick to Spark so
> still searching.
> On Oct 5, 2015 2:51 PM, "Krzysztof Zarzycki" <k....@gmail.com> wrote:
>
>> I'm also interested in this feature. Did you guys found some information
>> about how to use Hive Streaming with Spark Streaming?
>>
>> Thanks,
>> Krzysiek
>>
>> 2015-07-17 20:16 GMT+02:00 unk1102 <um...@gmail.com>:
>>
>>> Hi I have similar use case did you found solution for this problem of
>>> loading
>>> DStreams in Hive using Spark Streaming. Please guide. Thanks.
>>>
>>>
>>>
>>> --
>>> View this message in context:
>>> http://apache-spark-user-list.1001560.n3.nabble.com/Store-DStreams-into-Hive-using-Hive-Streaming-tp18307p23885.html
>>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>>
>>
Re: Store DStreams into Hive using Hive Streaming
Posted by Umesh Kacha <um...@gmail.com>.
Hi no didn't find any solution still I need that feature of hive streaming
using Spark please let me know if you get something. Alternative solution
is to use storm for hive processing. I would like to stick to Spark so
still searching.
On Oct 5, 2015 2:51 PM, "Krzysztof Zarzycki" <k....@gmail.com> wrote:
> I'm also interested in this feature. Did you guys found some information
> about how to use Hive Streaming with Spark Streaming?
>
> Thanks,
> Krzysiek
>
> 2015-07-17 20:16 GMT+02:00 unk1102 <um...@gmail.com>:
>
>> Hi I have similar use case did you found solution for this problem of
>> loading
>> DStreams in Hive using Spark Streaming. Please guide. Thanks.
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Store-DStreams-into-Hive-using-Hive-Streaming-tp18307p23885.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>>
>
Re: Store DStreams into Hive using Hive Streaming
Posted by Krzysztof Zarzycki <k....@gmail.com>.
I'm also interested in this feature. Did you guys found some information
about how to use Hive Streaming with Spark Streaming?
Thanks,
Krzysiek
2015-07-17 20:16 GMT+02:00 unk1102 <um...@gmail.com>:
> Hi I have similar use case did you found solution for this problem of
> loading
> DStreams in Hive using Spark Streaming. Please guide. Thanks.
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Store-DStreams-into-Hive-using-Hive-Streaming-tp18307p23885.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>