[spark] branch master updated: [MINOR][CORE] Update taskName in PythonRunner

[ji...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

jiangxb1987 pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new f950e53  [MINOR][CORE] Update taskName in PythonRunner
f950e53 is described below

commit f950e539304dffc01c3f3c48c2d369e54e301587
Author: Xingbo Jiang <xi...@databricks.com>
AuthorDate: Thu May 2 15:37:25 2019 -0700

    [MINOR][CORE] Update taskName in PythonRunner
    
    ## What changes were proposed in this pull request?
    
    Update taskName in PythonRunner so it keeps align with that in Executor.
    
    ## How was this patch tested?
    
    N/A
    
    Closes #24510 from jiangxb1987/pylog.
    
    Authored-by: Xingbo Jiang <xi...@databricks.com>
    Signed-off-by: Xingbo Jiang <xi...@databricks.com>
---
 core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala b/core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala
index b7f14e0..fabd6fd 100644
--- a/core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala
+++ b/core/src/main/scala/org/apache/spark/api/python/PythonRunner.scala
@@ -511,7 +511,7 @@ private[spark] abstract class BasePythonRunner[IN, OUT](
         if (!context.isCompleted) {
           try {
             // Mimic the task name used in `Executor` to help the user find out the task to blame.
-            val taskName = s"${context.partitionId}.${context.taskAttemptId} " +
+            val taskName = s"${context.partitionId}.${context.attemptNumber} " +
               s"in stage ${context.stageId} (TID ${context.taskAttemptId})"
             logWarning(s"Incomplete task $taskName interrupted: Attempting to kill Python Worker")
             env.destroyPythonWorker(pythonExec, envVars.asScala.toMap, worker)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org