You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/07/28 15:15:00 UTC
[jira] [Work logged] (HIVE-26436) Hive on MR NullPointerException
[ https://issues.apache.org/jira/browse/HIVE-26436?focusedWorklogId=796095&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-796095 ]
ASF GitHub Bot logged work on HIVE-26436:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 28/Jul/22 15:14
Start Date: 28/Jul/22 15:14
Worklog Time Spent: 10m
Work Description: ganlute opened a new pull request, #3485:
URL: https://github.com/apache/hive/pull/3485
… been called and close called.
### What changes were proposed in this pull request?
When the operator has not been called to initialize, and it is called to close, exception will happen.
I fix it by check conf is null so that the close could be finished. It work well in my cluster.
However, I am not sure, it may be a better way to skip close if the operator has not been initialized ?
### Why are the changes needed?
I think it may be a bug.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
1. unit test passed.
2. apply the patch to cluster and task passed.
Issue Time Tracking
-------------------
Worklog Id: (was: 796095)
Remaining Estimate: 0h
Time Spent: 10m
> Hive on MR NullPointerException
> -------------------------------
>
> Key: HIVE-26436
> URL: https://issues.apache.org/jira/browse/HIVE-26436
> Project: Hive
> Issue Type: Bug
> Components: Query Planning
> Affects Versions: 3.1.2
> Reporter: TE
> Priority: Minor
> Time Spent: 10m
> Remaining Estimate: 0h
>
> 2022-07-27 11:23:26,337 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1658508427196_17228_m_000000_3: Error: java.lang.RuntimeException: Hive Runtime Error while closing operators
> at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:211)
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:61)
> at org.apache.hadoop.hive.ql.exec.mr.ExecMapRunner.run(ExecMapRunner.java:37)
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:465)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:349)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:174)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1762)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:168)
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.hive.ql.exec.Operator.getCounterName(Operator.java:502)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:742)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
> at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:757)
> at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.close(ExecMapper.java:193)
> ... 9 more
>
> Hive on MR run failed and the error details is above.
> Hive version: 3.1.2
>
> When initializeOp has not been called and close called, this exception will happen.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)