[GitHub] [spark] uncleGen opened a new pull request #24323: keep the same epoch pace between driver and executor.

[GitBox <gi...@apache.org>]

uncleGen opened a new pull request #24323: keep the same epoch pace between driver and executor.
URL: https://github.com/apache/spark/pull/24323
 
 
   ## What changes were proposed in this pull request?
   
   The pace of epoch generation in driver and epoch pulling in executor is different. It will result in many empty epochs for partition if the epoch pulling interval is larger than epoch generation.
   
   ## How was this patch tested?
   
   update existing unit tests.
   
   Please review http://spark.apache.org/contributing.html before opening a pull request.
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org