You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/12/05 04:40:50 UTC

[GitHub] [spark] HeartSaVioR commented on pull request #38906: [SPARK-41379][SS][PYTHON] Provide cloned spark session in DataFrame in user function for foreachBatch sink in PySpark

HeartSaVioR commented on PR #38906:
URL: https://github.com/apache/spark/pull/38906#issuecomment-1336743969

   Yes, as long as they use `DF.sparkSession`. Although this is still not 100% covering the case as there is no way to prevent end users to access sparkSession outside of user function (maybe not feasible for PySpark API but still feasible with Scala/Java API).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org