You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/04/05 09:25:28 UTC
[GitHub] [spark] gaborgsomogyi commented on issue #24283: [SPARK-27355][SS]
Make query execution more sensitive to epoch message late or lost
gaborgsomogyi commented on issue #24283: [SPARK-27355][SS] Make query execution more sensitive to epoch message late or lost
URL: https://github.com/apache/spark/pull/24283#issuecomment-480209443
As Attila pointed out it contains unnecessary changes which maybe distracted me but at the first glance I don't see the main value.
> There is no need to wait for such a long time before query fail if there maybe some message LATE/LOST.
Not sure if I understand the main reasoning. If one Kafka partition have some problem because that specific server is slower than other after 10 epoch just kill the query? If it's an intermittent problem not sure it's the right thing to do.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org