You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/11/10 20:38:00 UTC
[jira] [Work logged] (HIVE-26724) Mask UDF failing with NPE
[ https://issues.apache.org/jira/browse/HIVE-26724?focusedWorklogId=825080&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-825080 ]
ASF GitHub Bot logged work on HIVE-26724:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 10/Nov/22 20:37
Start Date: 10/Nov/22 20:37
Worklog Time Spent: 10m
Work Description: ayushtkn opened a new pull request, #3750:
URL: https://github.com/apache/hive/pull/3750
### What changes were proposed in this pull request?
Fetch the conf from the job context
### Why are the changes needed?
In Actual Prod the session conf isn't available, it stays NULL, which leads to NPE
### Does this PR introduce _any_ user-facing change?
Makes the code works.
### How was this patch tested?
Tested the actual scenario in the prod cluster. Conf objects are shared in Unit Tests, Added a basic test for sanity to ensure nothing else breaks
Issue Time Tracking
-------------------
Worklog Id: (was: 825080)
Remaining Estimate: 0h
Time Spent: 10m
> Mask UDF failing with NPE
> -------------------------
>
> Key: HIVE-26724
> URL: https://issues.apache.org/jira/browse/HIVE-26724
> Project: Hive
> Issue Type: Bug
> Reporter: Ayush Saxena
> Assignee: Ayush Saxena
> Priority: Major
> Time Spent: 10m
> Remaining Estimate: 0h
>
> The mask UDF fails with NPE in prod, due to unavailability of the session conf.
> Trace:
> {noformat}
> ... 20 more
> Caused by: java.lang.NullPointerException
> at org.apache.hadoop.hive.ql.udf.generic.MaskHashTransformer.transform(GenericUDFMaskHash.java:50)
> at org.apache.hadoop.hive.ql.udf.generic.StringTransformerAdapter.getTransformedWritable(BaseMaskUDF.java:459)
> at org.apache.hadoop.hive.ql.udf.generic.BaseMaskUDF.evaluate(BaseMaskUDF.java:84)
> at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator._evaluate(ExprNodeGenericFuncEvaluator.java:235)
> at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:80)
> at org.apache.hadoop.hive.ql.exec.ExprNodeEvaluator.evaluate(ExprNodeEvaluator.java:68)
> at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:88)
> ... 24 more
> ], TaskAttempt 1 failed, info=[Error: Error while running task ( failure ) : attempt_1667823513257_0010_2_00_000000_1:java.lang.RuntimeException: java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.initializeAndRunProcessor(TezProcessor.java:351)
> at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:280)
> at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:374){noformat}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)