You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Rajesh Balamohan (Jira)" <ji...@apache.org> on 2019/11/12 13:12:00 UTC
[jira] [Commented] (HIVE-22482)
o.a.h.hive.q.i.AcidUtils.isInsertOnlyTable should not computed in
FileSinkOperator for every record
[ https://issues.apache.org/jira/browse/HIVE-22482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972380#comment-16972380 ]
Rajesh Balamohan commented on HIVE-22482:
-----------------------------------------
This was observed when copying data from an ORC table to Parq table.
> o.a.h.hive.q.i.AcidUtils.isInsertOnlyTable should not computed in FileSinkOperator for every record
> ---------------------------------------------------------------------------------------------------
>
> Key: HIVE-22482
> URL: https://issues.apache.org/jira/browse/HIVE-22482
> Project: Hive
> Issue Type: Improvement
> Reporter: Rajesh Balamohan
> Priority: Major
>
>
>
> {noformat}
> at java.util.Hashtable.get(Hashtable.java:367)
> - locked <0x00000006f4827098> (a java.util.Properties)
> at java.util.Properties.getProperty(Properties.java:969)
> at org.apache.hadoop.hive.ql.io.AcidUtils.isInsertOnlyTable(AcidUtils.java:2104)
> at org.apache.hadoop.hive.ql.plan.FileSinkDesc.isMmTable(FileSinkDesc.java:333)
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator.areAllTrue(FileSinkOperator.java:1047)
> at org.apache.hadoop.hive.ql.exec.FileSinkOperator.process(FileSinkOperator.java:966)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:938)
> at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:95)
> at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:938)
> at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:128)
> at org.apache.hadoop.hive.ql.exec.MapOperator$MapOpCtx.forward(MapOperator.java:152)
> at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:552)
> at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.processRow(MapRecordSource.java:92)
> at org.apache.hadoop.hive.ql.exec.tez.MapRecordSource.pushRecord(MapRecordSource.java:76)
> at org.apache.hadoop.hive.ql.exec.tez.MapRecordProcessor.run(MapRecordProcessor.java:426)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:267)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:250) {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)