You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "yuweixiao (Jira)" <ji...@apache.org> on 2021/11/24 08:57:00 UTC

[jira] [Created] (HUDI-2849) Improve job/stage description in spark UI for hudi write

yuweixiao created HUDI-2849:
-------------------------------

             Summary: Improve job/stage description in spark UI for hudi write
                 Key: HUDI-2849
                 URL: https://issues.apache.org/jira/browse/HUDI-2849
             Project: Apache Hudi
          Issue Type: Improvement
          Components: DeltaStreamer, Spark Integration
            Reporter: yuweixiao
         Attachments: image-2021-11-24-16-52-32-781.png

The following image shows upsert process using deltastreamer. The job description is unclear and sometimes misleading. E.g., there are two jobs with name 'isEmpty' and one of them actually can be removed. The job 8 does the partition and write task, but it is named as 'Getting small files from partitions'.

!image-2021-11-24-16-52-32-781.png!



--
This message was sent by Atlassian Jira
(v8.20.1#820001)