You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "ulysses you (Jira)" <ji...@apache.org> on 2021/02/04 09:27:00 UTC

[jira] [Created] (SPARK-34355) Add log and time cost for commit job

ulysses you created SPARK-34355:
-----------------------------------

             Summary: Add log and time cost for commit job
                 Key: SPARK-34355
                 URL: https://issues.apache.org/jira/browse/SPARK-34355
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 3.2.0
            Reporter: ulysses you


Th commit job is a heavy option and we have seen many times Spark block at this code place due to the slow rpc with namenode or other.

 

It's better to record the time that commit job cost.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org