[jira] [Commented] (TEZ-529) Hive communicates state from RecordReader to Processor via JobConf

["Hitesh Shah (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/TEZ-529?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14254902#comment-14254902 ] 

Hitesh Shah commented on TEZ-529:
---------------------------------

[~sseth] [~hagleitn] Is this still a valid issue? 

> Hive communicates state from RecordReader to Processor via JobConf
> ------------------------------------------------------------------
>
>                 Key: TEZ-529
>                 URL: https://issues.apache.org/jira/browse/TEZ-529
>             Project: Apache Tez
>          Issue Type: Bug
>    Affects Versions: 0.2.0
>            Reporter: Gunther Hagleitner
>            Assignee: Siddharth Seth
>
> Hive currently switches between operator pipelines + partition descriptors via a map.input.file
> In the CombineFileInputFormat case Hive relies on the fact that CombineFileRecordReader sets this field every time a new file is processed. This file will then be read in the processor to setup the correct processing pipeline.
> After the Tez refactor RecordReader and TezProcessor use different job conf instances. Because of that Hive will fail since map.input.file isn't set and updated in the processor's conf.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)