You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Prasanth Jayachandran (JIRA)" <ji...@apache.org> on 2018/06/29 23:51:00 UTC
[jira] [Updated] (HIVE-20038) Update queries on non-bucketed +
partitioned tables throws NPE
[ https://issues.apache.org/jira/browse/HIVE-20038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Prasanth Jayachandran updated HIVE-20038:
-----------------------------------------
Description:
With HIVE-19890 delete deltas of non-bucketed tables are computed from ROW__ID. This can create holes in output paths (and final paths) in FSOp.commit() resulting in NPE.
Following is the exception
{code:java}
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:246)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:235)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:168)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1325)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:733)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:383){code}
was:
With HIVE-19890 delete deltas of non-bucketed tables are computed from ROW__ID. This can create holes in output paths in FSOp.commit() resulting in NPE.
Following is the exception
{code:java}
Caused by: java.lang.NullPointerException
at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:246)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:235)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:168)
at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1325)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:733)
at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:383){code}
> Update queries on non-bucketed + partitioned tables throws NPE
> --------------------------------------------------------------
>
> Key: HIVE-20038
> URL: https://issues.apache.org/jira/browse/HIVE-20038
> Project: Hive
> Issue Type: Bug
> Components: Transactions
> Affects Versions: 4.0.0, 3.2.0
> Reporter: Kavan Suresh
> Assignee: Prasanth Jayachandran
> Priority: Major
>
> With HIVE-19890 delete deltas of non-bucketed tables are computed from ROW__ID. This can create holes in output paths (and final paths) in FSOp.commit() resulting in NPE.
> Following is the exception
> {code:java}
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commitOneOutPath(FileSinkOperator.java:246)
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.commit(FileSinkOperator.java:235)
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator$FSPaths.access$400(FileSinkOperator.java:168)
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator.closeOp(FileSinkOperator.java:1325)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:733)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
> at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.close(ReduceRecordProcessor.java:383){code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)