You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Gaurav1809 <ga...@gmail.com> on 2017/03/09 19:37:14 UTC
Which streaming platform is best? Kafka or Spark Streaming?
Hi All, Would you please let me know which streaming platform is best. Be it
server log processing, social media feeds ot any such streaming data. I want
to know the comparison between Kafka & Spark Streaming.
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Which-streaming-platform-is-best-Kafka-or-Spark-Streaming-tp28474.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Which streaming platform is best? Kafka or Spark Streaming?
Posted by Gaurav Pandya <ga...@gmail.com>.
Thank you very much guys. My question may sound little bit off but was
somewhat confused so wanted to get some expert advice on this. I will take
a look at the links mentioned in the replies. I really appreciate your
suggestions. These are the kind of answers I needed to clear my doubts.
Have a nice day ahead.
On Fri, Mar 10, 2017 at 6:18 PM, vaquar khan <va...@gmail.com> wrote:
> Please read Spark documents at least once before asking question.
>
> http://spark.apache.org/docs/latest/streaming-programming-guide.html
>
> http://2s7gjr373w3x22jf92z99mgm5w-wpengine.netdna-ssl.com/wp-
> content/uploads/2015/11/spark-streaming-datanami.png
>
>
> Regards,
> Vaquar khan
>
>
> On Fri, Mar 10, 2017 at 6:17 AM, Sean Owen <so...@cloudera.com> wrote:
>
>> Kafka and Spark Streaming don't do the same thing. Kafka stores and
>> transports data, Spark Streaming runs computations on a stream of data.
>> Neither is itself a streaming platform in its entirety.
>>
>> It's kind of like asking whether you should build a website using just
>> MySQL, or nginx.
>>
>>
>>> On 9 Mar 2017, at 20:37, Gaurav1809 <ga...@gmail.com> wrote:
>>>
>>> Hi All, Would you please let me know which streaming platform is best.
>>> Be it
>>> server log processing, social media feeds ot any such streaming data. I
>>> want
>>> to know the comparison between Kafka & Spark Streaming.
>>>
>>>
>
>
> --
> Regards,
> Vaquar Khan
> +1 -224-436-0783
>
> IT Architect / Lead Consultant
> Greater Chicago
>
Re: Which streaming platform is best? Kafka or Spark Streaming?
Posted by vaquar khan <va...@gmail.com>.
Please read Spark documents at least once before asking question.
http://spark.apache.org/docs/latest/streaming-programming-guide.html
http://2s7gjr373w3x22jf92z99mgm5w-wpengine.netdna-ssl.com/wp-content/uploads/2015/11/spark-streaming-datanami.png
Regards,
Vaquar khan
On Fri, Mar 10, 2017 at 6:17 AM, Sean Owen <so...@cloudera.com> wrote:
> Kafka and Spark Streaming don't do the same thing. Kafka stores and
> transports data, Spark Streaming runs computations on a stream of data.
> Neither is itself a streaming platform in its entirety.
>
> It's kind of like asking whether you should build a website using just
> MySQL, or nginx.
>
>
>> On 9 Mar 2017, at 20:37, Gaurav1809 <ga...@gmail.com> wrote:
>>
>> Hi All, Would you please let me know which streaming platform is best. Be
>> it
>> server log processing, social media feeds ot any such streaming data. I
>> want
>> to know the comparison between Kafka & Spark Streaming.
>>
>>
--
Regards,
Vaquar Khan
+1 -224-436-0783
IT Architect / Lead Consultant
Greater Chicago
Re: Which streaming platform is best? Kafka or Spark Streaming?
Posted by Sean Owen <so...@cloudera.com>.
Kafka and Spark Streaming don't do the same thing. Kafka stores and
transports data, Spark Streaming runs computations on a stream of data.
Neither is itself a streaming platform in its entirety.
It's kind of like asking whether you should build a website using just
MySQL, or nginx.
> On 9 Mar 2017, at 20:37, Gaurav1809 <ga...@gmail.com> wrote:
>
> Hi All, Would you please let me know which streaming platform is best. Be
> it
> server log processing, social media feeds ot any such streaming data. I
> want
> to know the comparison between Kafka & Spark Streaming.
>
>
Re: Which streaming platform is best? Kafka or Spark Streaming?
Posted by Robin East <ro...@xense.co.uk>.
As Jorn says there is no best. I would start with https://www.oreilly.com/ideas/the-world-beyond-batch-streaming-101. This will help you form some meaningful questions about what tools suit which use cases. Most places have a selection of tools such as spark, kafka, flink, storm, flume and so on.
-------------------------------------------------------------------------------
Robin East
Spark GraphX in Action Michael Malak and Robin East
Manning Publications Co.
http://www.manning.com/books/spark-graphx-in-action <http://www.manning.com/books/spark-graphx-in-action>
> On 9 Mar 2017, at 20:04, Jörn Franke <jo...@gmail.com> wrote:
>
> I find this question strange. There is no best tool for every use case. For example, both tools mentioned below are suitable for different purposes, sometimes also complementary.
>
>> On 9 Mar 2017, at 20:37, Gaurav1809 <ga...@gmail.com> wrote:
>>
>> Hi All, Would you please let me know which streaming platform is best. Be it
>> server log processing, social media feeds ot any such streaming data. I want
>> to know the comparison between Kafka & Spark Streaming.
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Which-streaming-platform-is-best-Kafka-or-Spark-Streaming-tp28474.html
>> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>>
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
Re: Which streaming platform is best? Kafka or Spark Streaming?
Posted by Jörn Franke <jo...@gmail.com>.
I find this question strange. There is no best tool for every use case. For example, both tools mentioned below are suitable for different purposes, sometimes also complementary.
> On 9 Mar 2017, at 20:37, Gaurav1809 <ga...@gmail.com> wrote:
>
> Hi All, Would you please let me know which streaming platform is best. Be it
> server log processing, social media feeds ot any such streaming data. I want
> to know the comparison between Kafka & Spark Streaming.
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Which-streaming-platform-is-best-Kafka-or-Spark-Streaming-tp28474.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscribe@spark.apache.org
>
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org