[jira] [Commented] (HIVE-4019) Ability to create and drop temporary partition function

["Ashutosh Chauhan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-4019?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13577843#comment-13577843 ] 

Ashutosh Chauhan commented on HIVE-4019:
----------------------------------------

Stack-trace:
{code}
java.lang.RuntimeException: Error in configuring object
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:93)
	at org.apache.hadoop.util.ReflectionUtils.setConf(ReflectionUtils.java:64)
	at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:117)
	at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:484)
	at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:419)
	at org.apache.hadoop.mapred.Child$4.run(Child.java:259)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:396)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
	at org.apache.hadoop.mapred.Child.main(Child.java:253)
Caused by: java.lang.reflect.InvocationTargetException
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.util.ReflectionUtils.setJobConf(ReflectionUtils.java:88)
	... 9 more
Caused by: java.lang.RuntimeException: Reduce operator initialization failed
	at org.apache.hadoop.hive.ql.exec.ExecReducer.configure(ExecReducer.java:160)
	... 14 more
Caused by: java.lang.NullPointerException
	at org.apache.hadoop.hive.ql.exec.FunctionRegistry.getTableFunctionResolver(FunctionRegistry.java:1462)
	at org.apache.hadoop.hive.ql.parse.PTFTranslator$PTFDefDeserializer.preVisit(PTFTranslator.java:2568)
	at org.apache.hadoop.hive.ql.parse.PTFTranslator$PTFDefWalker.walk(PTFTranslator.java:2329)
	at org.apache.hadoop.hive.ql.parse.PTFTranslator$PTFDefWalker.walkInputChain(PTFTranslator.java:2305)
	at org.apache.hadoop.hive.ql.parse.PTFTranslator$PTFDefWalker.walk(PTFTranslator.java:2268)
	at org.apache.hadoop.hive.ql.exec.PTFOperator.reconstructQueryDef(PTFOperator.java:159)
	at org.apache.hadoop.hive.ql.exec.PTFOperator.initializeOp(PTFOperator.java:70)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:377)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:481)
	at org.apache.hadoop.hive.ql.exec.Operator.initializeChildren(Operator.java:409)
	at org.apache.hadoop.hive.ql.exec.ExtractOperator.initializeOp(ExtractOperator.java:40)
	at org.apache.hadoop.hive.ql.exec.Operator.initialize(Operator.java:377)
	at org.apache.hadoop.hive.ql.exec.ExecReducer.configure(ExecReducer.java:152)
	... 14 more
{code}

Since the way how PTFOperator is initialized in map/reduce tasks at runtime is refactored by Harish at the moment, I will wait till that refactoring completes to see if this issue still exists after that work is complete.
                
> Ability to create and drop temporary partition function
> -------------------------------------------------------
>
>                 Key: HIVE-4019
>                 URL: https://issues.apache.org/jira/browse/HIVE-4019
>             Project: Hive
>          Issue Type: New Feature
>          Components: PTF-Windowing
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: hive-4019.q
>
>
> Just like udf/udaf/udtf functions, user should be able to add and drop custom partitioning functions.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira