You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Ming Ma (JIRA)" <ji...@apache.org> on 2017/05/11 19:16:04 UTC

[jira] [Created] (TEZ-3722) Have MultiMROutput support different configurations for different writers

Ming Ma created TEZ-3722:
----------------------------

             Summary: Have MultiMROutput support different configurations for different writers
                 Key: TEZ-3722
                 URL: https://issues.apache.org/jira/browse/TEZ-3722
             Project: Apache Tez
          Issue Type: Improvement
            Reporter: Ming Ma


TEZ-3215 added the support for MultiMROutput so that a task can write its output to different HDFS files depending on the data. Internally MultiMROutput creates different writers keyed by the path. All writers use the same configuration.

We have use cases that different writers need to have different configurations, it can be used to specify different output formats, or different configuration values for the same output format. So it will be useful to allow applications to specify different configuration for different writers.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)