[jira] [Resolved] (HIVE-25505) Incorrect results with header. skip.header.line.count if first line is blank

["Panagiotis Garefalakis (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-25505?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Panagiotis Garefalakis resolved HIVE-25505.
-------------------------------------------
    Resolution: Fixed

> Incorrect results with header. skip.header.line.count if first line is blank
> ----------------------------------------------------------------------------
>
>                 Key: HIVE-25505
>                 URL: https://issues.apache.org/jira/browse/HIVE-25505
>             Project: Hive
>          Issue Type: Bug
>          Components: HiveServer2
>            Reporter: Steve Carlin
>            Assignee: Panagiotis Garefalakis
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>          Time Spent: 1h 50m
>  Remaining Estimate: 0h
>
> aAtable with header. skip.header.line.count=1 does not skip the first line if it is blank, except in a fetch task.
> To reproduce, create a csv table, ans set header. skip.header.line.count=1 in table properties.
> In the table location, create a single file, with a blank (empty) first line, and say 2 further lines.
> If you do a select * on it, you see 2 rows (correct)
>  If you do select count(*) on it, you get 3 (incorrect)
> {code:java}
> CREATE EXTERNAL TABLE `testcase1`(id int, name string) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.OpenCSVSerde'
>   LOCATION '${system:test.tmp.dir}/testcase1'
>   TBLPROPERTIES ("skip.header.line.count"="1");
> SET hive.fetch.task.conversion = more;
> select * from testcase1;
> select count(*) from testcase1;
> set hive.fetch.task.conversion=none;
> select * from testcase1;
> select count(*) from testcase1;
> Test file:
> 1,2019-12-31
> 2,2019-12-31
> 3,2019-12-31
> Should both yield (with the above test file):
> #### A masked pattern was here ####
> 1	2019-12-31
> 2	2019-12-31
> 3	2019-12-31
> 3
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)