[GitHub] [spark] chakravarthiT opened a new pull request #24189: [SPARK-27253][SQL]SparkSession clone discards SQLConf overrides in favor of SparkConf defaults

[GitBox <gi...@apache.org>]

chakravarthiT opened a new pull request #24189: [SPARK-27253][SQL]SparkSession clone discards SQLConf overrides in favor of SparkConf defaults
URL: https://github.com/apache/spark/pull/24189
 
 
   
   
   ## What changes were proposed in this pull request?
   
   SparkSession.cloneSession() is normally supposed to create a child session which inherits all the SQLConf values of its parent session. But when a SQL conf is given a global default through the SparkConf, this does not happen; the child session will receive the SparkConf default rather than its parent's SQLConf override.
   
   This is particularly impactful in structured streaming, as the microbatches run in a cloned child session.
   
   ## How was this patch tested?
   Added UT.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org