[jira] [Updated] (HIVE-11117) Hive external table - skip header and trailer property issue

["Janarthanan (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-11117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Janarthanan updated HIVE-11117:
-------------------------------
    Environment: Production
       Priority: Critical  (was: Major)

> Hive external table - skip header and trailer property issue
> ------------------------------------------------------------
>
>                 Key: HIVE-11117
>                 URL: https://issues.apache.org/jira/browse/HIVE-11117
>             Project: Hive
>          Issue Type: Bug
>         Environment: Production
>            Reporter: Janarthanan
>            Priority: Critical
>
> I am using an external hive table pointing to a HDFS location. The external table is partitioned on year/mm/dd folders. When there are more than one partition folder (ex: /2015/01/02/file.txt & /2015/01/03/file2.txt), the select on external table, skips the DATA RECORD instead of skipping the header/trailer record from one of the file). 
> tblproperties ("skip.header.line.count"="1");
> Resolution: On enabling hive.input format instead of text input format and execution using TEZ engine instead of MapReduce resovled the issue. 
> How to resolve the problem without setting these parameters ? I don't want to run the hive query using TEZ.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)