You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafodion.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2016/05/31 18:23:14 UTC
[jira] [Commented] (TRAFODION-2006) hive table structure and data
modification is not detected
[ https://issues.apache.org/jira/browse/TRAFODION-2006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15308285#comment-15308285 ]
ASF GitHub Bot commented on TRAFODION-2006:
-------------------------------------------
GitHub user anoopsharma00 opened a pull request:
https://github.com/apache/incubator-trafodion/pull/511
JIRA TRAFODION-2006 Hive table structure and data changes are now detected correctly.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/anoopsharma00/incubator-trafodion ansharma_hivets_br
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-trafodion/pull/511.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #511
----
commit f4728220c7a21f06c5c295e7a4c515a09a1a219d
Author: Anoop Sharma <an...@esgyn.com>
Date: 2016-05-22T04:26:45Z
hive data modification detection: commit #1
commit cb6a75c63f7cfa0ed211dfe22f733ab0fedd4383
Author: Anoop Sharma <an...@esgyn.com>
Date: 2016-05-23T15:33:29Z
Merge remote branch 'origin/master' into ansharma_hivets_br
Conflicts:
core/sql/sqlcomp/DefaultConstants.h
commit 772b4a3410821f8dda0ce2cad10cc81c31ff6f1d
Author: Anoop Sharma <an...@esgyn.com>
Date: 2016-05-27T14:01:09Z
Merge remote branch 'origin/master' into ansharma_hivets_br
commit 1820da1cf3776a318951c241814e92a4980ccd34
Author: Anoop Sharma <an...@esgyn.com>
Date: 2016-05-28T01:10:23Z
hive data modification detection: commit #2
commit fa70e6831470cccfd86887f9607591f242512fa7
Author: Anoop Sharma <an...@esgyn.com>
Date: 2016-05-28T01:19:42Z
Merge remote branch 'origin/master' into ansharma_hivets_br
Conflicts:
core/sql/comexe/ComTdbHdfsScan.h
core/sql/generator/GenRelScan.cpp
core/sql/regress/hive/EXPECTED005
commit b1a8f024b5a3d4db368b51bbd2b6aac7035b9571
Author: Anoop Sharma <an...@esgyn.com>
Date: 2016-05-30T13:48:16Z
hive data modification detection: commit #3
commit 51a9c73ed37c3711178483c4a200f17a92d1c08d
Author: Anoop Sharma <an...@esgyn.com>
Date: 2016-05-31T18:03:40Z
hive data modification detection: commit #4
----
> hive table structure and data modification is not detected
> ----------------------------------------------------------
>
> Key: TRAFODION-2006
> URL: https://issues.apache.org/jira/browse/TRAFODION-2006
> Project: Apache Trafodion
> Issue Type: Bug
> Reporter: Anoop Sharma
> Assignee: Anoop Sharma
>
> If a hive table ddl structure changes or data is inserted/deleted
> after a query has been compiled, then that change is not detected.
> That results in inconsistent behavior or incorrect data to be returned.
> Examples:
> Inserted data is not returned:
> >>select * from hive.hive.th;
> --- 0 row(s) selected.
> >>insert into hive.hive.th values (1);
> --- 1 row(s) inserted.
> >>select * from hive.hive.th;
> --- 0 row(s) selected.
> Example 2: Table definition change is not detected:
> From hive shell:
> hive> drop table th;
> OK
> Time taken: 0.196 seconds
> hive> create table th (a int);
> OK
> Time taken: 0.087 seconds
> hive> insert into th values (1);
> From sqlci session:
> >>select * from hive.hive.th;
> A
> -----------
> 1
> --- 1 row(s) selected.
> Table definition is now changed from hive shell:
> hive> drop table th;
> OK
> Time taken: 0.109 seconds
> hive> create table th (a int, b int);
> OK
> Time taken: 0.091 seconds
> hive>
> Back to the previous sqlci session.
> Error is returned when the select stmt is reissued.
> It doesn't detect that table definition has changed.
> >>select * from hive.hive.th;
> *** ERROR[8442] Unable to access HDFS interface. Call to ExpLOBInterfaceSelectCursor/open returned error LOB_DATA_FILE_OPEN_ERROR(508). Error detail 0.
> --- 0 row(s) selected.
> >>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)