You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Renukaprasad C (Jira)" <ji...@apache.org> on 2020/02/13 11:55:00 UTC

[jira] [Created] (HIVE-22887) MR Job cannot set custom OutputCommitter during job execution.

Renukaprasad C created HIVE-22887:
-------------------------------------

             Summary: MR Job cannot set custom OutputCommitter during job execution.
                 Key: HIVE-22887
                 URL: https://issues.apache.org/jira/browse/HIVE-22887
             Project: Hive
          Issue Type: Bug
            Reporter: Renukaprasad C
            Assignee: Renukaprasad C


MapRedTask set jobs OutputCommitter to NullOutputCommitter.
org.apache.hadoop.hive.ql.io.HiveFileFormatUtils.prepareJobOutput(JobConf) this  sets the OutputCommitter to NullOutputCommitter always.
conf.setOutputCommitter(NullOutputCommitter.class);

There are some cases where we need to customize the OutputCommitter. 
Like on SUCCESS, they need to write some file or do some custom operation in theie own OutputCommitter
If someone wants to provide their own OutputCommitter then its not possible in the current implementation.

Related issues: MR - MAPREDUCE-1802, Hive - HIVE-1355.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)