You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Aihua Xu (JIRA)" <ji...@apache.org> on 2018/12/03 20:21:00 UTC
[jira] [Updated] (SPARK-26258) Include JobGroupId in the
callerContext
[ https://issues.apache.org/jira/browse/SPARK-26258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aihua Xu updated SPARK-26258:
-----------------------------
Description:
SPARK-15857 adds the support of callerContext for HDFS and Yarn. Currently, Spark callerContext prints Job Id, Stage Id, Task Id in the callerContext. It would be useful to include JobGroup Id as well since such JobGroup Id could be meaningful from the Spark Client point of view to group the jobs by JobGroup.
callerContext=SPARK_CLIENT_application_1541467098185_0008
callerContext=SPARK_TASK_application_1541702365678_0005_1_JId_1_SId_3_0_TId_3_0
was:
Currently, Spark callerContext prints Job Id, Stage Id, Task Id in the callerContext. It would be useful to include JobGroup Id as well since such JobGroup Id could be meaningful from the Spark Client point of view to group the jobs by JobGroup.
callerContext=SPARK_CLIENT_application_1541467098185_0008
callerContext=SPARK_TASK_application_1541702365678_0005_1_JId_1_SId_3_0_TId_3_0
> Include JobGroupId in the callerContext
> ----------------------------------------
>
> Key: SPARK-26258
> URL: https://issues.apache.org/jira/browse/SPARK-26258
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.1.0
> Reporter: Aihua Xu
> Priority: Major
>
> SPARK-15857 adds the support of callerContext for HDFS and Yarn. Currently, Spark callerContext prints Job Id, Stage Id, Task Id in the callerContext. It would be useful to include JobGroup Id as well since such JobGroup Id could be meaningful from the Spark Client point of view to group the jobs by JobGroup.
> callerContext=SPARK_CLIENT_application_1541467098185_0008
> callerContext=SPARK_TASK_application_1541702365678_0005_1_JId_1_SId_3_0_TId_3_0
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org