[jira] [Updated] (MAPREDUCE-7002) Shows processed record count with _SUCCESS file

["Shilun Fan (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-7002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shilun Fan updated MAPREDUCE-7002:
----------------------------------
    Target Version/s: 3.5.0  (was: 3.4.0)

> Shows processed record count with _SUCCESS file
> -----------------------------------------------
>
>                 Key: MAPREDUCE-7002
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7002
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: task
>    Affects Versions: 3.0.0-beta1
>            Reporter: Mehul Garnara (MG)
>            Assignee: Mehul Garnara (MG)
>            Priority: Minor
>
> I'm using spark jobs for processing files and found requirement for getting number of records process after spark submit ran successfully. After analyze it we realized spark using hadoop underline where hadoop is generating the _SUCCESS file as an indicator of the successful completion. I would like to propose requirement for adding number of count with the file name, for example for 100 record processed it would generate like "100_SUCCESS" this will give ability to know how many records get processed on completion of job. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-issues-help@hadoop.apache.org