[jira] [Commented] (GOBBLIN-1045) Emit more events in compaction job

["Zhixiong Chen (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/GOBBLIN-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17035769#comment-17035769 ] 

Zhixiong Chen commented on GOBBLIN-1045:
----------------------------------------

Generalize it in `MRCompactionTask`?
- We have to standardize the compaction destination dataset definition given a compaction dataset, so that it can apply to all MRCompactionTask use cases. It's a major work. So far, we don't know such use cases. I'll hold on standardization and add the events to our main compaction suite.

> Emit more events in compaction job
> ----------------------------------
>
>                 Key: GOBBLIN-1045
>                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1045
>             Project: Apache Gobblin
>          Issue Type: Task
>            Reporter: Zhixiong Chen
>            Assignee: Zhixiong Chen
>            Priority: Major
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> Emit count event for the following item in compaction job
> - number of files, corresponding to hive metadata "numFiles"
> - record count, corresponding to hive metadata "numRows"
> - bytes written, corresponding to hive metadata "totalSize"



--
This message was sent by Atlassian Jira
(v8.3.4#803005)