You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by shyla <de...@gmail.com> on 2016/11/07 01:13:17 UTC
Structured Streaming with Kafka Source, does it work??
I am trying to do Structured Streaming with Kafka Source. Please let me know
where I can find some sample code for this. Thanks
--
View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Structured-Streaming-with-Kafka-Source-does-it-work-tp19748.html
Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Structured Streaming with Kafka Source, does it work??
Posted by Matei Zaharia <ma...@gmail.com>.
The Kafka source will only appear in 2.0.2 -- see this thread for the current release candidate: https://lists.apache.org/thread.html/597d630135e9eb3ede54bb0cc0b61a2b57b189588f269a64b58c9243@%3Cdev.spark.apache.org%3E . You can try that right now if you want from the staging Maven repo shown there. The vote looks likely to pass so an actual release should hopefully also be out soon.
Matei
> On Nov 6, 2016, at 5:25 PM, shyla deshpande <de...@gmail.com> wrote:
>
> Hi Jaya!
>
> Thanks for the reply. Structured streaming works fine for me with socket text stream . I think structured streaming with kafka source not yet supported.
>
> Please if anyone has got it working with kafka source, please provide me some sample code or direction.
>
> Thanks
>
>
> On Sun, Nov 6, 2016 at 5:17 PM, Jayaradha Natarajan <jayaradhaa@gmail.com <ma...@gmail.com>> wrote:
> Shyla!
>
> Check
> https://databricks.com/blog/2016/07/28/structured-streaming-in-apache-spark.html <https://databricks.com/blog/2016/07/28/structured-streaming-in-apache-spark.html>
>
> Thanks,
> Jayaradha
>
> On Sun, Nov 6, 2016 at 5:13 PM, shyla <deshpandeshyla@gmail.com <ma...@gmail.com>> wrote:
> I am trying to do Structured Streaming with Kafka Source. Please let me know
> where I can find some sample code for this. Thanks
>
>
>
> --
> View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Structured-Streaming-with-Kafka-Source-does-it-work-tp19748.html <http://apache-spark-developers-list.1001551.n3.nabble.com/Structured-Streaming-with-Kafka-Source-does-it-work-tp19748.html>
> Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org <ma...@spark.apache.org>
>
>
>
Re: Structured Streaming with Kafka Source, does it work??
Posted by Matei Zaharia <ma...@gmail.com>.
The Kafka source will only appear in 2.0.2 -- see this thread for the current release candidate: https://lists.apache.org/thread.html/597d630135e9eb3ede54bb0cc0b61a2b57b189588f269a64b58c9243@%3Cdev.spark.apache.org%3E . You can try that right now if you want from the staging Maven repo shown there. The vote looks likely to pass so an actual release should hopefully also be out soon.
Matei
> On Nov 6, 2016, at 5:25 PM, shyla deshpande <de...@gmail.com> wrote:
>
> Hi Jaya!
>
> Thanks for the reply. Structured streaming works fine for me with socket text stream . I think structured streaming with kafka source not yet supported.
>
> Please if anyone has got it working with kafka source, please provide me some sample code or direction.
>
> Thanks
>
>
> On Sun, Nov 6, 2016 at 5:17 PM, Jayaradha Natarajan <jayaradhaa@gmail.com <ma...@gmail.com>> wrote:
> Shyla!
>
> Check
> https://databricks.com/blog/2016/07/28/structured-streaming-in-apache-spark.html <https://databricks.com/blog/2016/07/28/structured-streaming-in-apache-spark.html>
>
> Thanks,
> Jayaradha
>
> On Sun, Nov 6, 2016 at 5:13 PM, shyla <deshpandeshyla@gmail.com <ma...@gmail.com>> wrote:
> I am trying to do Structured Streaming with Kafka Source. Please let me know
> where I can find some sample code for this. Thanks
>
>
>
> --
> View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Structured-Streaming-with-Kafka-Source-does-it-work-tp19748.html <http://apache-spark-developers-list.1001551.n3.nabble.com/Structured-Streaming-with-Kafka-Source-does-it-work-tp19748.html>
> Sent from the Apache Spark Developers List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org <ma...@spark.apache.org>
>
>
>
Re: Structured Streaming with Kafka Source, does it work??
Posted by shyla deshpande <de...@gmail.com>.
Hi Jaya!
Thanks for the reply. Structured streaming works fine for me with socket
text stream . I think structured streaming with kafka source not yet
supported.
Please if anyone has got it working with kafka source, please provide me
some sample code or direction.
Thanks
On Sun, Nov 6, 2016 at 5:17 PM, Jayaradha Natarajan <ja...@gmail.com>
wrote:
> Shyla!
>
> Check
> https://databricks.com/blog/2016/07/28/structured-
> streaming-in-apache-spark.html
>
> Thanks,
> Jayaradha
>
> On Sun, Nov 6, 2016 at 5:13 PM, shyla <de...@gmail.com> wrote:
>
>> I am trying to do Structured Streaming with Kafka Source. Please let me
>> know
>> where I can find some sample code for this. Thanks
>>
>>
>>
>> --
>> View this message in context: http://apache-spark-developers
>> -list.1001551.n3.nabble.com/Structured-Streaming-with-
>> Kafka-Source-does-it-work-tp19748.html
>> Sent from the Apache Spark Developers List mailing list archive at
>> Nabble.com.
>>
>> ---------------------------------------------------------------------
>> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>>
>>
>
Re: Structured Streaming with Kafka Source, does it work??
Posted by Jayaradha Natarajan <ja...@gmail.com>.
Shyla!
Check
https://databricks.com/blog/2016/07/28/structured-streaming-in-apache-spark.html
Thanks,
Jayaradha
On Sun, Nov 6, 2016 at 5:13 PM, shyla <de...@gmail.com> wrote:
> I am trying to do Structured Streaming with Kafka Source. Please let me
> know
> where I can find some sample code for this. Thanks
>
>
>
> --
> View this message in context: http://apache-spark-
> developers-list.1001551.n3.nabble.com/Structured-
> Streaming-with-Kafka-Source-does-it-work-tp19748.html
> Sent from the Apache Spark Developers List mailing list archive at
> Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>