You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spark.apache.org by sujith chacko <su...@gmail.com> on 2019/02/10 09:33:01 UTC
Re: Support SqlStreaming in spark
Hi All,
I think there are few more updates are added in the design document
compare to last document where few folks has reviewed and provided inputs.,
requesting all experts to review the design document and help us to
baseline the design for the SPIP
'Support SQL streaming' in spark structured streaming, few more sections is
been added in-order to handle some scenarios as below
1) Passing the stream level configurations to the sql command instead of
setting it in session/application level.
2) Supporting Multiple Streams in single application,. etc
Link to the design document
https://docs.google.com/document/d/19degwnIIcuMSELv6BQ_1VQI5AIVcvGeqOm5xE2-aRA0/edit#
Few Questions are already clarified by Jacky, please find through below link
https://docs.google.com/document/d/19degwnIIcuMSELv6BQ_1VQI5AIVcvGeqOm5xE2-aRA0/edit#heading=h.t96f9l205fk1
Regards,
Sujith
On Thu, Dec 27, 2018 at 6:39 PM JackyLee <qc...@163.com> wrote:
> Hi, Wenchen
>
> Thank you for your recognition of Streaming on sql. I have written the
> SQLStreaming design document:
>
> https://docs.google.com/document/d/19degwnIIcuMSELv6BQ_1VQI5AIVcvGeqOm5xE2-aRA0/edit#
>
> Your Questions are answered in here:
>
> https://docs.google.com/document/d/19degwnIIcuMSELv6BQ_1VQI5AIVcvGeqOm5xE2-aRA0/edit#heading=h.t96f9l205fk1
>
> There may be some details that I have not considered, we can discuss it in
> more depth.
>
> Thanks
>
>
>
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
Re: Support SqlStreaming in spark
Posted by Stavros Kontopoulos <st...@lightbend.com>.
Hi all,
From what I read there is an effort here to globally standardize SQL
Streaming (Flink people, Google at others are working with SQL
standardization body) https://arxiv.org/abs/1905.12133v1
<https://www.google.com/url?q=https://arxiv.org/abs/1905.12133v1&sa=D&ust=1559573953957000&usg=AFQjCNHcTO5X-qWxa_4Na5Q4VIgxdzPnuQ>should
Spark community be part of it?
Best,
Stavros
On Thu, Mar 28, 2019 at 12:03 PM uncleGen <hu...@gmail.com> wrote:
> Hi all,
>
> I have rewritten the design doc based on previous discussing.
>
> https://docs.google.com/document/d/19degwnIIcuMSELv6BQ_1VQI5AIVcvGeqOm5xE2-aRA0
>
> Would be interested to hear what others think.
>
> Regards,
> Genmao Yu
>
>
>
> --
> Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
>
> ---------------------------------------------------------------------
> To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
>
>
Re: Support SqlStreaming in spark
Posted by uncleGen <hu...@gmail.com>.
Hi all,
I have rewritten the design doc based on previous discussing.
https://docs.google.com/document/d/19degwnIIcuMSELv6BQ_1VQI5AIVcvGeqOm5xE2-aRA0
Would be interested to hear what others think.
Regards,
Genmao Yu
--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org
Re: Support SqlStreaming in spark
Posted by uncleGen <hu...@gmail.com>.
Hi all,
I have rewritten the design doc based on previous discussing.
https://docs.google.com/document/d/19degwnIIcuMSELv6BQ_1VQI5AIVcvGeqOm5xE2-aRA0
Would be interested to hear what others think.
Regards,
Genmao Yu
--
Sent from: http://apache-spark-developers-list.1001551.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: dev-unsubscribe@spark.apache.org