You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2012/12/06 05:09:02 UTC

[jira] [Commented] (HIVE-3594) When Group by Partition Column Type is Timestamp or STRING Which Format contains "HH:MM:SS", It will occur URISyntaxException

    [ https://issues.apache.org/jira/browse/HIVE-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13511084#comment-13511084 ] 

Namit Jain commented on HIVE-3594:
----------------------------------

+1
                
> When Group by Partition Column Type is Timestamp or STRING Which Format contains "HH:MM:SS", It will occur URISyntaxException
> -----------------------------------------------------------------------------------------------------------------------------
>
>                 Key: HIVE-3594
>                 URL: https://issues.apache.org/jira/browse/HIVE-3594
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Daisy.Yuan
>            Assignee: Navis
>         Attachments: HIVE-3594.D6081.1.patch, HIVE-3594.D6081.2.patch
>
>
> create table test (no int, name string) partitioned by (pts string) row format delimited fields terminated by ' '; 
> load data local inpath '/opt/files/groupbyts1.txt' into table test partition(pts='12:11:30');
> load data local inpath '/opt/files/groupbyts2.txt' into table test partition(pts='21:25:12');
> load data local inpath '/opt/files/groupbyts3.txt' into table test partition(pts='12:11:30');
> load data local inpath '/opt/files/groupbyts4.txt' into table test partition(pts='21:25:12');
> when I execute “select * from test group by pts;”, it will occur as follows exception.
>  at org.apache.hadoop.fs.Path.initialize(Path.java:157)
>         at org.apache.hadoop.fs.Path.<init>(Path.java:135)
>         at org.apache.hadoop.hive.ql.exec.Utilities.getInputSummary(Utilities.java:1667)
>         at org.apache.hadoop.hive.ql.exec.MapRedTask.estimateNumberOfReducers(MapRedTask.java:432)
>         at org.apache.hadoop.hive.ql.exec.MapRedTask.setNumberOfReducers(MapRedTask.java:400)
>         at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:93)
>         at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:135)
>         at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
>         at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1329)
>         at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1121)
>         at org.apache.hadoop.hive.ql.Driver.run(Driver.java:954)
>         at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:198)
>         at org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:630)
>         at org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:618)
>         at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
>         at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
>         at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:176)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:662)
> Caused by: java.net.URISyntaxException: Relative path in absolute URI: fake-path-metadata-only-query-default.test{pts=12:11:30%7D
>         at java.net.URI.checkPath(URI.java:1788)
>         at java.net.URI.<init>(URI.java:734)
>         at org.apache.hadoop.fs.Path.initialize(Path.java:154)
>         ... 19 more
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
> When PhysicalOptimizer optimizes GroupByOperator, according to default parameters "hive.optimize.metadataonly = true", MetadataOnlyOptimizer will be enabled. The MetadataOnlyOptimizer will change the partition alias desc. The partition alies "hdfs://ip:9000/user/hive/warehouse/test/pts=12%3A11%3A30" is changed into " 
> fake-path-metadata-only-query-default.test{pts=12:11:30}". When construct uri through new partition alies, it must occur java.net.URISyntaxException. 
>  

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira