You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Navis (JIRA)" <ji...@apache.org> on 2012/12/05 09:16:59 UTC
[jira] [Updated] (HIVE-3594) When Group by Partition Column Type is
Timestamp or STRING Which Format contains "HH:MM:SS", It will occur
URISyntaxException
[ https://issues.apache.org/jira/browse/HIVE-3594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Navis updated HIVE-3594:
------------------------
Affects Version/s: (was: 0.9.0)
Status: Patch Available (was: Open)
> When Group by Partition Column Type is Timestamp or STRING Which Format contains "HH:MM:SS", It will occur URISyntaxException
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-3594
> URL: https://issues.apache.org/jira/browse/HIVE-3594
> Project: Hive
> Issue Type: Bug
> Components: Query Processor
> Reporter: Daisy.Yuan
> Assignee: Navis
> Attachments: HIVE-3594.D6081.1.patch, HIVE-3594.D6081.2.patch
>
>
> create table test (no int, name string) partitioned by (pts string) row format delimited fields terminated by ' ';
> load data local inpath '/opt/files/groupbyts1.txt' into table test partition(pts='12:11:30');
> load data local inpath '/opt/files/groupbyts2.txt' into table test partition(pts='21:25:12');
> load data local inpath '/opt/files/groupbyts3.txt' into table test partition(pts='12:11:30');
> load data local inpath '/opt/files/groupbyts4.txt' into table test partition(pts='21:25:12');
> when I execute “select * from test group by pts;”, it will occur as follows exception.
> at org.apache.hadoop.fs.Path.initialize(Path.java:157)
> at org.apache.hadoop.fs.Path.<init>(Path.java:135)
> at org.apache.hadoop.hive.ql.exec.Utilities.getInputSummary(Utilities.java:1667)
> at org.apache.hadoop.hive.ql.exec.MapRedTask.estimateNumberOfReducers(MapRedTask.java:432)
> at org.apache.hadoop.hive.ql.exec.MapRedTask.setNumberOfReducers(MapRedTask.java:400)
> at org.apache.hadoop.hive.ql.exec.MapRedTask.execute(MapRedTask.java:93)
> at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:135)
> at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:57)
> at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:1329)
> at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1121)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:954)
> at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.execute(HiveServer.java:198)
> at org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:630)
> at org.apache.hadoop.hive.service.ThriftHive$Processor$execute.getResult(ThriftHive.java:618)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:32)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:34)
> at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:176)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.net.URISyntaxException: Relative path in absolute URI: fake-path-metadata-only-query-default.test{pts=12:11:30%7D
> at java.net.URI.checkPath(URI.java:1788)
> at java.net.URI.<init>(URI.java:734)
> at org.apache.hadoop.fs.Path.initialize(Path.java:154)
> ... 19 more
> FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.MapRedTask
> When PhysicalOptimizer optimizes GroupByOperator, according to default parameters "hive.optimize.metadataonly = true", MetadataOnlyOptimizer will be enabled. The MetadataOnlyOptimizer will change the partition alias desc. The partition alies "hdfs://ip:9000/user/hive/warehouse/test/pts=12%3A11%3A30" is changed into "
> fake-path-metadata-only-query-default.test{pts=12:11:30}". When construct uri through new partition alies, it must occur java.net.URISyntaxException.
>
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira