[GitHub] [spark] pgandhi999 opened a new pull request #24498: [SPARK-27605] : Add new column "Partition ID" to the tasks table in s…

[GitBox <gi...@apache.org>]

pgandhi999 opened a new pull request #24498: [SPARK-27605] : Add new column "Partition ID" to the tasks table in s…
URL: https://github.com/apache/spark/pull/24498
 
 
   …tages page
   
   If you have more than one stage attempt in a Spark job, the task index will not equal partition id. Thus, adding a column for partition id would be a useful feature to have.
   
   ## What changes were proposed in this pull request?
   
   To get the data for partition id in UI, it has to be logged into the event files while the job is running. So, the code changes mainly focus on that. Also, backward compatibility with old history files has been ensured as well here.
   
   ## How was this patch tested?
   
   <img width="553" alt="Screen Shot 2019-04-30 at 9 13 58 AM" src="https://user-images.githubusercontent.com/22228190/56968248-72c6b600-6b28-11e9-96ab-245611dfd685.png">
   
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org