You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/05/16 12:34:59 UTC

[GitHub] [spark] onursatici opened a new pull request #24625: [SPARK-27744][SQL] preserve spark properties on async subquery tasks

onursatici opened a new pull request #24625: [SPARK-27744][SQL] preserve spark properties on async subquery tasks
URL: https://github.com/apache/spark/pull/24625
 
 
   ## What changes were proposed in this pull request?
   
   Add a new future helper method that copies over spark properties before submitting to a new thread, and sets the original properties back on exit. SubqueryExec now uses this method to create futures. Any task that is submitted to its thread pool will now use the spark properties of the submitting thread, instead of the spark properties that were on the thread pool worker thread
   
   ## How was this patch tested?
   
   Added a test, which fails with current master but passes with this patch
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org