You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Hive QA (JIRA)" <ji...@apache.org> on 2019/08/09 06:33:00 UTC
[jira] [Commented] (HIVE-22092) Fetch is failing with
IllegalArgumentException: No ValidTxnList when refetch is done
[ https://issues.apache.org/jira/browse/HIVE-22092?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903594#comment-16903594 ]
Hive QA commented on HIVE-22092:
--------------------------------
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m 0s{color} | {color:green} The patch does not contain any @author tags. {color} |
|| || || || {color:brown} master Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 42s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 8m 24s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 50s{color} | {color:green} master passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 59s{color} | {color:green} master passed {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 4m 5s{color} | {color:blue} ql in master has 2250 extant Findbugs warnings. {color} |
| {color:blue}0{color} | {color:blue} findbugs {color} | {color:blue} 0m 39s{color} | {color:blue} itests/hive-unit in master has 2 extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 24s{color} | {color:green} master passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m 27s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 2m 8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m 43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 1m 43s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m 59s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m 0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 4m 11s{color} | {color:red} ql generated 1 new + 2250 unchanged - 0 fixed = 2251 total (was 2250) {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m 26s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m 14s{color} | {color:green} The patch does not generate ASF License warnings. {color} |
| {color:black}{color} | {color:black} {color} | {color:black} 30m 33s{color} | {color:black} {color} |
\\
\\
|| Reason || Tests ||
| FindBugs | module:ql |
| | Class org.apache.hadoop.hive.ql.exec.FetchTask defines non-transient non-serializable instance field job In FetchTask.java:instance field job In FetchTask.java |
\\
\\
|| Subsystem || Report/Notes ||
| Optional Tests | asflicense javac javadoc findbugs checkstyle compile |
| uname | Linux hiveptest-server-upstream 3.16.0-4-amd64 #1 SMP Debian 3.16.43-2+deb8u5 (2017-09-19) x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /data/hiveptest/working/yetus_PreCommit-HIVE-Build-18292/dev-support/hive-personality.sh |
| git revision | master / 96f7960 |
| Default Java | 1.8.0_111 |
| findbugs | v3.0.0 |
| findbugs | http://104.198.109.242/logs//PreCommit-HIVE-Build-18292/yetus/new-findbugs-ql.html |
| modules | C: ql itests/hive-unit U: . |
| Console output | http://104.198.109.242/logs//PreCommit-HIVE-Build-18292/yetus.txt |
| Powered by | Apache Yetus http://yetus.apache.org |
This message was automatically generated.
> Fetch is failing with IllegalArgumentException: No ValidTxnList when refetch is done
> ------------------------------------------------------------------------------------
>
> Key: HIVE-22092
> URL: https://issues.apache.org/jira/browse/HIVE-22092
> Project: Hive
> Issue Type: Bug
> Reporter: mahesh kumar behera
> Assignee: mahesh kumar behera
> Priority: Major
> Attachments: HIVE-22092.01.patch
>
>
> The fetch task is created during query compilation with the config of the driver. That config will have the valid txn list set. Thus the fetch task will have valid txn list set while doing fetch for ACID tables. But when user does a refetch with cusrsor set to first position it reinitializes the fetch task with the driver config (cached in task config). But by that time, the select query would have cleaned up the valid txn list from the config and the fetch will happen with valid txn list as null. This will cause illegal argument exception.
>
> Caused by: java.lang.IllegalArgumentException: No ValidTxnList fo
> at org.apache.hadoop.hive.ql.io.AcidUtils.isDirUsable(AcidUtils.java:1418) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.io.AcidUtils.getChildState(AcidUtils.java:1393) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.io.AcidUtils.getAcidState(AcidUtils.java:1205) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.io.HiveInputFormat.processForWriteIds(HiveInputFormat.java:633) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.io.HiveInputFormat.processPathsForMmRead(HiveInputFormat.java:597) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.exec.FetchOperator.processCurrPathForMmWriteIds(FetchOperator.java:469) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:396) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:322) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:563) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:532) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:146) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:2362) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hadoop.hive.ql.reexec.ReExecDriver.getResults(ReExecDriver.java:229) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:473) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:328) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:952) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:565) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:792) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1837) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
> at org.apache.hive.service.rpc.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1822) ~[data_analytics_studio-webapp-1.3.1.1.3.1.0-12.jar:?]
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)