You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "caixiaofeng (Jira)" <ji...@apache.org> on 2019/12/27 01:52:00 UTC

[jira] [Commented] (HIVE-13745) UDF current_date、current_timestamp、unix_timestamp NPE

    [ https://issues.apache.org/jira/browse/HIVE-13745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17003831#comment-17003831 ] 

caixiaofeng commented on HIVE-13745:
------------------------------------

Problem occur in hive-3.1.0

SQL:  select unix_timestamp  (max('2019-09-09'),'YYYY-MM-DD') ;

ERROR LOG:

2019-12-27 09:45:56,286 INFO [main] org.apache.hadoop.hive.ql.exec.SerializationUtilities: Deserializing ReduceWork using kryo
2019-12-27 09:45:56,539 INFO [main] org.apache.hadoop.hive.ql.exec.Utilities: Deserialized plan (via FILE) - name: null size: 3.13KB
2019-12-27 09:45:56,562 INFO [main] ExecReducer: 
<GBY>Id =3
  <Children>
    <FS>Id =8
      <Children>
      <\Children>
      <Parent>Id = 3 null<\Parent>
    <\FS>
  <\Children>
  <Parent><\Parent>
<\GBY>
2019-12-27 09:45:56,562 INFO [main] org.apache.hadoop.hive.ql.exec.GroupByOperator: Initializing operator GBY[3]
2019-12-27 09:45:56,583 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.RuntimeException: Error in configuring object
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:113)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:79)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:137)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:411)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:393)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:178)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1729)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:172)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:110)
	... 9 more
Caused by: java.lang.RuntimeException: Reduce operator initialization failed
	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.configure(ExecReducer.java:155)
	... 14 more
Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDFToUnixTimeStamp.initializeInput(GenericUDFToUnixTimeStamp.java:87)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDFUnixTimeStamp.initializeInput(GenericUDFUnixTimeStamp.java:44)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDFToUnixTimeStamp.initialize(GenericUDFToUnixTimeStamp.java:71)
	at org.apache.hadoop.hive.ql.udf.generic.GenericUDF.initializeAndFoldConstants(GenericUDF.java:148)
	at org.apache.hadoop.hive.ql.exec.ExprNodeGenericFuncEvaluator.initialize(ExprNodeGenericFuncEvaluator.java:146)
	at org.apache.hadoop.hive.ql.exec.GroupByOperator.initializeOp(GroupByOperator.java:295)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:376)
	at org.apache.hadoop.hive.ql.exec.mr.ExecReducer.configure(ExecReducer.java:148)
	... 14 more

2019-12-27 09:45:56,591 INFO [main] org.apache.hadoop.mapred.Task: Running cleanup for the task
2019-12-27 09:45:56,697 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Stopping ReduceTask metrics system...
2019-12-27 09:45:56,697 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ReduceTask metrics system stopped.
2019-12-27 09:45:56,698 INFO [main] org.apache.hadoop.metrics2.impl.MetricsSystemImpl: ReduceTask metrics system shutdown complete.

> UDF current_date、current_timestamp、unix_timestamp NPE
> -----------------------------------------------------
>
>                 Key: HIVE-13745
>                 URL: https://issues.apache.org/jira/browse/HIVE-13745
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 2.0.0
>            Reporter: Biao Wu
>            Assignee: Biao Wu
>            Priority: Major
>         Attachments: HIVE-13745.1.patch, HIVE-13745.2-branch-2.patch, HIVE-13745.patch
>
>
> NullPointerException when current_date is used in mapreduce



--
This message was sent by Atlassian Jira
(v8.3.4#803005)