You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by "Hyunsik Choi (JIRA)" <ji...@apache.org> on 2014/07/28 07:02:38 UTC
[jira] [Commented] (TAJO-947) ColPartitionStoreExec can cause
URISyntaxException due to special characters
[ https://issues.apache.org/jira/browse/TAJO-947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14075902#comment-14075902 ]
Hyunsik Choi commented on TAJO-947:
-----------------------------------
Hi Mai,
Thank you for your contribution! Column partition is designed for a partition type compatible to Apache Hive partition. So, we should follow their rule. I've just investigated the solution. It would be useful for your work.
They had the same issues to us, but it is too old one.
https://issues.apache.org/jira/browse/HIVE-883
Their current code is as follows:
https://github.com/apache/hive/blob/trunk/metastore/src/java/org/apache/hadoop/hive/metastore/Warehouse.java#L301
I hope that it would be helpful to your work.
> ColPartitionStoreExec can cause URISyntaxException due to special characters
> ----------------------------------------------------------------------------
>
> Key: TAJO-947
> URL: https://issues.apache.org/jira/browse/TAJO-947
> Project: Tajo
> Issue Type: Bug
> Components: physical operator
> Reporter: Hyunsik Choi
> Assignee: Mai Hai Thanh
> Fix For: 0.9.0
>
> Attachments: TAJO-947.Mai.140728.patch.txt
>
>
> When partition keys includes some special characters which cannot be represented in URI, ColPartitionStoreExec::getData can cause URISyntaxException. Please see the following stack trace:
> {noformat}
> Progress: 62%, response time: 106.344 sec
> Progress: 62%, response time: 107.345 sec
> Progress: 62%, response time: 108.347 sec
> ERROR: java.net.URISyntaxException: Relative path in absolute URI: l_returnflag=yly:%20furiously%20ev/part-02-000002-000
> java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: l_returnflag=yly:%20furiously%20ev/part-02-000002-000
> at org.apache.hadoop.fs.Path.initialize(Path.java:206)
> at org.apache.hadoop.fs.Path.<init>(Path.java:172)
> at org.apache.hadoop.fs.Path.<init>(Path.java:94)
> at org.apache.tajo.storage.StorageUtil.concatPath(StorageUtil.java:104)
> at org.apache.tajo.engine.planner.physical.ColPartitionStoreExec.getDataFile(ColPartitionStoreExec.java:112)
> at org.apache.tajo.engine.planner.physical.SortBasedColPartitionStoreExec.getAppenderForNewPartition(SortBasedColPartitionStoreExec.java:86)
> at org.apache.tajo.engine.planner.physical.SortBasedColPartitionStoreExec.next(SortBasedColPartitionStoreExec.java:156)
> at org.apache.tajo.worker.Task.run(Task.java:425)
> at org.apache.tajo.worker.TaskRunner$1.run(TaskRunner.java:406)
> at java.lang.Thread.run(Thread.java:744)
> Caused by: java.net.URISyntaxException: Relative path in absolute URI: l_returnflag=yly:%20furiously%20ev/part-02-000002-000
> at java.net.URI.checkPath(URI.java:1804)
> at java.net.URI.<init>(URI.java:752)
> at org.apache.hadoop.fs.Path.initialize(Path.java:203)
> ... 9 more
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.2#6252)