You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Rajat Khandelwal (JIRA)" <ji...@apache.org> on 2015/08/07 07:10:46 UTC
[jira] [Updated] (HIVE-11376) CombineHiveInputFormat is falling
back to HiveInputFormat in case codecs are found for one of the input files
[ https://issues.apache.org/jira/browse/HIVE-11376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rajat Khandelwal updated HIVE-11376:
------------------------------------
Attachment: HIVE-11376.02.patch
> CombineHiveInputFormat is falling back to HiveInputFormat in case codecs are found for one of the input files
> -------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-11376
> URL: https://issues.apache.org/jira/browse/HIVE-11376
> Project: Hive
> Issue Type: Bug
> Reporter: Rajat Khandelwal
> Assignee: Rajat Khandelwal
> Attachments: HIVE-11376.02.patch
>
>
> https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java#L379
> This is the exact code snippet:
> {noformat}
> / Since there is no easy way of knowing whether MAPREDUCE-1597 is present in the tree or not,
> // we use a configuration variable for the same
> if (this.mrwork != null && !this.mrwork.getHadoopSupportsSplittable()) {
> // The following code should be removed, once
> // https://issues.apache.org/jira/browse/MAPREDUCE-1597 is fixed.
> // Hadoop does not handle non-splittable files correctly for CombineFileInputFormat,
> // so don't use CombineFileInputFormat for non-splittable files
> //ie, dont't combine if inputformat is a TextInputFormat and has compression turned on
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)