You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Attila Magyar (JIRA)" <ji...@apache.org> on 2019/07/26 11:53:00 UTC

[jira] [Updated] (HIVE-22055) select count gives incorrect result after loading data from text file

     [ https://issues.apache.org/jira/browse/HIVE-22055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Attila Magyar updated HIVE-22055:
---------------------------------
    Description: 
Add one more load to mm_loaddata.q:

Load data 3 times (both kv1.txt and kv2.txt contains 500 records)
{code:java}
create table load0_mm (key string, value string) stored as textfile tblproperties("transactional"="true", "transactional_properties"="insert_only");
load data local inpath '../../data/files/kv1.txt' into table load0_mm;
select count(1) from load0_mm;
load data local inpath '../../data/files/kv2.txt' into table load0_mm;
select count(1) from load0_mm;
load data local inpath '../../data/files/kv2.txt' into table load0_mm;
select count(1) from load0_mm;{code}
Expected output
{code:java}
PREHOOK: query: load data local inpath '../../data/files/kv2.txt' into table load0_mm
PREHOOK: type: LOAD
#### A masked pattern was here ####
PREHOOK: Output: default@load0_mm
POSTHOOK: query: load data local inpath '../../data/files/kv2.txt' into table load0_mm
POSTHOOK: type: LOAD
#### A masked pattern was here ####
POSTHOOK: Output: default@load0_mm
PREHOOK: query: select count(1) from load0_mm
PREHOOK: type: QUERY
PREHOOK: Input: default@load0_mm
#### A masked pattern was here ####
POSTHOOK: query: select count(1) from load0_mm
POSTHOOK: type: QUERY
POSTHOOK: Input: default@load0_mm
#### A masked pattern was here ####
1500{code}
Got:

[ERROR]   TestMiniLlapLocalCliDriver.testCliDriver:59 Client Execution succeeded but contained differences (error code = 1) after executing mm_loaddata.q

63c63

< 1480

—

> 1500

 

  was:
Load data 3 times (both kv1.txt and kv2.txt contains 500 records)
{code:java}
create table load0_mm (key string, value string) stored as textfile tblproperties("transactional"="true", "transactional_properties"="insert_only");
load data local inpath '../../data/files/kv1.txt' into table load0_mm;
select count(1) from load0_mm;
load data local inpath '../../data/files/kv2.txt' into table load0_mm;
select count(1) from load0_mm;
load data local inpath '../../data/files/kv2.txt' into table load0_mm;
select count(1) from load0_mm;{code}
Expected output


{code:java}
PREHOOK: query: load data local inpath '../../data/files/kv2.txt' into table load0_mm
PREHOOK: type: LOAD
#### A masked pattern was here ####
PREHOOK: Output: default@load0_mm
POSTHOOK: query: load data local inpath '../../data/files/kv2.txt' into table load0_mm
POSTHOOK: type: LOAD
#### A masked pattern was here ####
POSTHOOK: Output: default@load0_mm
PREHOOK: query: select count(1) from load0_mm
PREHOOK: type: QUERY
PREHOOK: Input: default@load0_mm
#### A masked pattern was here ####
POSTHOOK: query: select count(1) from load0_mm
POSTHOOK: type: QUERY
POSTHOOK: Input: default@load0_mm
#### A masked pattern was here ####
1500{code}
Got:

[ERROR]   TestMiniLlapLocalCliDriver.testCliDriver:59 Client Execution succeeded but contained differences (error code = 1) after executing mm_loaddata.q 

63c63

< 1480

---

> 1500

 


> select count gives incorrect result after loading data from text file
> ---------------------------------------------------------------------
>
>                 Key: HIVE-22055
>                 URL: https://issues.apache.org/jira/browse/HIVE-22055
>             Project: Hive
>          Issue Type: Task
>          Components: Hive
>            Reporter: Attila Magyar
>            Assignee: Attila Magyar
>            Priority: Major
>
> Add one more load to mm_loaddata.q:
> Load data 3 times (both kv1.txt and kv2.txt contains 500 records)
> {code:java}
> create table load0_mm (key string, value string) stored as textfile tblproperties("transactional"="true", "transactional_properties"="insert_only");
> load data local inpath '../../data/files/kv1.txt' into table load0_mm;
> select count(1) from load0_mm;
> load data local inpath '../../data/files/kv2.txt' into table load0_mm;
> select count(1) from load0_mm;
> load data local inpath '../../data/files/kv2.txt' into table load0_mm;
> select count(1) from load0_mm;{code}
> Expected output
> {code:java}
> PREHOOK: query: load data local inpath '../../data/files/kv2.txt' into table load0_mm
> PREHOOK: type: LOAD
> #### A masked pattern was here ####
> PREHOOK: Output: default@load0_mm
> POSTHOOK: query: load data local inpath '../../data/files/kv2.txt' into table load0_mm
> POSTHOOK: type: LOAD
> #### A masked pattern was here ####
> POSTHOOK: Output: default@load0_mm
> PREHOOK: query: select count(1) from load0_mm
> PREHOOK: type: QUERY
> PREHOOK: Input: default@load0_mm
> #### A masked pattern was here ####
> POSTHOOK: query: select count(1) from load0_mm
> POSTHOOK: type: QUERY
> POSTHOOK: Input: default@load0_mm
> #### A masked pattern was here ####
> 1500{code}
> Got:
> [ERROR]   TestMiniLlapLocalCliDriver.testCliDriver:59 Client Execution succeeded but contained differences (error code = 1) after executing mm_loaddata.q
> 63c63
> < 1480
> —
> > 1500
>  



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)