You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "sivabalan narayanan (Jira)" <ji...@apache.org> on 2022/09/04 21:57:00 UTC

[jira] [Assigned] (HUDI-4761) Test using spark listeners that guards any changes to DAG

     [ https://issues.apache.org/jira/browse/HUDI-4761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

sivabalan narayanan reassigned HUDI-4761:
-----------------------------------------

    Assignee: sivabalan narayanan

> Test using spark listeners that guards any changes to DAG
> ---------------------------------------------------------
>
>                 Key: HUDI-4761
>                 URL: https://issues.apache.org/jira/browse/HUDI-4761
>             Project: Apache Hudi
>          Issue Type: Task
>            Reporter: Sagar Sumit
>            Assignee: sivabalan narayanan
>            Priority: Major
>
> For major write operations and table services, we should guard the DAG by making use of spark listeners. Some basic things can be validated such as no. of stages, tasks, executor runtime, records written.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)