[jira] [Created] (HIVE-11376) CombineHiveInputFormat is falling back to HiveInputFormat in case codecs are found for one of the input files

["Rajat Khandelwal (JIRA)" <ji...@apache.org>]

Rajat Khandelwal created HIVE-11376:
---------------------------------------

             Summary: CombineHiveInputFormat is falling back to HiveInputFormat in case codecs are found for one of the input files
                 Key: HIVE-11376
                 URL: https://issues.apache.org/jira/browse/HIVE-11376
             Project: Hive
          Issue Type: Bug
            Reporter: Rajat Khandelwal


https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/io/CombineHiveInputFormat.java#L379

This is the exact code snippet:

{noformat}

/ Since there is no easy way of knowing whether MAPREDUCE-1597 is present in the tree or not,
      // we use a configuration variable for the same
      if (this.mrwork != null && !this.mrwork.getHadoopSupportsSplittable()) {
        // The following code should be removed, once
        // https://issues.apache.org/jira/browse/MAPREDUCE-1597 is fixed.
        // Hadoop does not handle non-splittable files correctly for CombineFileInputFormat,
        // so don't use CombineFileInputFormat for non-splittable files

        //ie, dont't combine if inputformat is a TextInputFormat and has compression turned on

{noformat}




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)