You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/02/22 04:45:22 UTC
[GitHub] [spark] HeartSaVioR edited a comment on pull request #31600: [SPARK-34482][SS] Correct the active SparkSession for streaming query
HeartSaVioR edited a comment on pull request #31600:
URL: https://github.com/apache/spark/pull/31600#issuecomment-783057670
Given we assume that the code might have a bug, it may not be safe if we try to answer the question based on current code. Probably we'd need to try to ask and figure about the "historical" information what sparkSessionForStream is for, and why sparkSession should be co-used even after cloning the session. Once we figure out and make clear, we would have to document it into StreamExecution for further references.
cc. @mukulmurthy @zsxwing @jose-torres who authored/reviewed SPARK-26586. also @tdas who is likely having context.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org