You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Zheng Shao (JIRA)" <ji...@apache.org> on 2010/02/26 00:38:27 UTC
[jira] Created: (HIVE-1200) Fix CombineHiveInputFormat to work with
multi-level of directories in a single table/partition
Fix CombineHiveInputFormat to work with multi-level of directories in a single table/partition
----------------------------------------------------------------------------------------------
Key: HIVE-1200
URL: https://issues.apache.org/jira/browse/HIVE-1200
Project: Hadoop Hive
Issue Type: Bug
Affects Versions: 0.5.1, 0.6.0
Reporter: Zheng Shao
Assignee: Zheng Shao
The CombineHiveInputFormat does not work with multi-level of directories in a single table/partition, because it uses an exact match logic, instead of the relativize logic as in MapOperator
{code}
MapOperator.java:
if (!onepath.toUri().relativize(fpath.toUri()).equals(fpath.toUri())) {
{code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HIVE-1200) Fix CombineHiveInputFormat to work
with multi-level of directories in a single table/partition
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12838730#action_12838730 ]
Namit Jain commented on HIVE-1200:
----------------------------------
+1
looks good - will commit if the tests pass
> Fix CombineHiveInputFormat to work with multi-level of directories in a single table/partition
> ----------------------------------------------------------------------------------------------
>
> Key: HIVE-1200
> URL: https://issues.apache.org/jira/browse/HIVE-1200
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.5.1, 0.6.0
> Reporter: Zheng Shao
> Assignee: Zheng Shao
> Attachments: HIVE-1200.1.branch-0.5.patch, HIVE-1200.1.patch
>
>
> The CombineHiveInputFormat does not work with multi-level of directories in a single table/partition, because it uses an exact match logic, instead of the relativize logic as in MapOperator
> {code}
> MapOperator.java:
> if (!onepath.toUri().relativize(fpath.toUri()).equals(fpath.toUri())) {
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1200) Fix CombineHiveInputFormat to work with
multi-level of directories in a single table/partition
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zheng Shao updated HIVE-1200:
-----------------------------
Status: Patch Available (was: Open)
> Fix CombineHiveInputFormat to work with multi-level of directories in a single table/partition
> ----------------------------------------------------------------------------------------------
>
> Key: HIVE-1200
> URL: https://issues.apache.org/jira/browse/HIVE-1200
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.5.1, 0.6.0
> Reporter: Zheng Shao
> Assignee: Zheng Shao
> Attachments: HIVE-1200.1.branch-0.5.patch, HIVE-1200.1.patch
>
>
> The CombineHiveInputFormat does not work with multi-level of directories in a single table/partition, because it uses an exact match logic, instead of the relativize logic as in MapOperator
> {code}
> MapOperator.java:
> if (!onepath.toUri().relativize(fpath.toUri()).equals(fpath.toUri())) {
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1200) Fix CombineHiveInputFormat to work with
multi-level of directories in a single table/partition
Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Zheng Shao updated HIVE-1200:
-----------------------------
Attachment: HIVE-1200.1.branch-0.5.patch
HIVE-1200.1.patch
> Fix CombineHiveInputFormat to work with multi-level of directories in a single table/partition
> ----------------------------------------------------------------------------------------------
>
> Key: HIVE-1200
> URL: https://issues.apache.org/jira/browse/HIVE-1200
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.5.1, 0.6.0
> Reporter: Zheng Shao
> Assignee: Zheng Shao
> Attachments: HIVE-1200.1.branch-0.5.patch, HIVE-1200.1.patch
>
>
> The CombineHiveInputFormat does not work with multi-level of directories in a single table/partition, because it uses an exact match logic, instead of the relativize logic as in MapOperator
> {code}
> MapOperator.java:
> if (!onepath.toUri().relativize(fpath.toUri()).equals(fpath.toUri())) {
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1200) Fix CombineHiveInputFormat to work with
multi-level of directories in a single table/partition
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-1200:
---------------------------------
Fix Version/s: (was: 0.5.1)
Affects Version/s: (was: 0.6.0)
(was: 0.5.1)
Component/s: Serializers/Deserializers
> Fix CombineHiveInputFormat to work with multi-level of directories in a single table/partition
> ----------------------------------------------------------------------------------------------
>
> Key: HIVE-1200
> URL: https://issues.apache.org/jira/browse/HIVE-1200
> Project: Hadoop Hive
> Issue Type: Bug
> Components: Serializers/Deserializers
> Reporter: Zheng Shao
> Assignee: Zheng Shao
> Fix For: 0.6.0
>
> Attachments: HIVE-1200.1.branch-0.5.patch, HIVE-1200.1.patch
>
>
> The CombineHiveInputFormat does not work with multi-level of directories in a single table/partition, because it uses an exact match logic, instead of the relativize logic as in MapOperator
> {code}
> MapOperator.java:
> if (!onepath.toUri().relativize(fpath.toUri()).equals(fpath.toUri())) {
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HIVE-1200) Fix CombineHiveInputFormat to work with
multi-level of directories in a single table/partition
Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-1200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Namit Jain updated HIVE-1200:
-----------------------------
Resolution: Fixed
Fix Version/s: 0.6.0
0.5.1
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
Committed to both trunk and 0.5. Thanks Zheng
> Fix CombineHiveInputFormat to work with multi-level of directories in a single table/partition
> ----------------------------------------------------------------------------------------------
>
> Key: HIVE-1200
> URL: https://issues.apache.org/jira/browse/HIVE-1200
> Project: Hadoop Hive
> Issue Type: Bug
> Affects Versions: 0.5.1, 0.6.0
> Reporter: Zheng Shao
> Assignee: Zheng Shao
> Fix For: 0.5.1, 0.6.0
>
> Attachments: HIVE-1200.1.branch-0.5.patch, HIVE-1200.1.patch
>
>
> The CombineHiveInputFormat does not work with multi-level of directories in a single table/partition, because it uses an exact match logic, instead of the relativize logic as in MapOperator
> {code}
> MapOperator.java:
> if (!onepath.toUri().relativize(fpath.toUri()).equals(fpath.toUri())) {
> {code}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.