[jira] [Created] (MAPREDUCE-7002) Shows processed record count with _SUCCESS file

["Mehul Garnara (MG) (JIRA)" <ji...@apache.org>]

Mehul Garnara (MG) created MAPREDUCE-7002:
---------------------------------------------

             Summary: Shows processed record count with _SUCCESS file
                 Key: MAPREDUCE-7002
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-7002
             Project: Hadoop Map/Reduce
          Issue Type: Improvement
          Components: task
    Affects Versions: 3.0.0-beta1
            Reporter: Mehul Garnara (MG)
            Assignee: Mehul Garnara (MG)
            Priority: Minor


I'm using spark jobs for processing files and found requirement for getting number of records process after spark submit ran successfully. After analyze it we realized spark using hadoop underline where hadoop is generating the _SUCCESS file as an indicator of the successful completion. I would like to propose requirement for adding number of count with the file name, for example for 100 record processed it would generate like "100_SUCCESS" this will give ability to know how many records get processed on completion of job. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org