You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2009/09/18 23:17:16 UTC

[jira] Created: (HIVE-844) remove ASTPartitionPruner from genmapredTasks

remove ASTPartitionPruner from genmapredTasks
---------------------------------------------

                 Key: HIVE-844
                 URL: https://issues.apache.org/jira/browse/HIVE-844
             Project: Hadoop Hive
          Issue Type: Bug
          Components: Query Processor
            Reporter: Namit Jain
            Assignee: Namit Jain
             Fix For: 0.5.0


Currently, ASTPartitionPruner is used in genmapredtasks() it figure out whether a map-reduce job is needed for a select star query. 
Use the new partition pruner for that

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-844) remove ASTPartitionPruner from genmapredTasks

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-844:
----------------------------

    Status: Patch Available  (was: Open)

> remove ASTPartitionPruner from genmapredTasks
> ---------------------------------------------
>
>                 Key: HIVE-844
>                 URL: https://issues.apache.org/jira/browse/HIVE-844
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.5.0
>
>         Attachments: hive.844.1.patch
>
>
> Currently, ASTPartitionPruner is used in genmapredtasks() it figure out whether a map-reduce job is needed for a select star query. 
> Use the new partition pruner for that

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-844) remove ASTPartitionPruner from genmapredTasks

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-844:
----------------------------

    Attachment: hive.844.2.patch

some test fixes

> remove ASTPartitionPruner from genmapredTasks
> ---------------------------------------------
>
>                 Key: HIVE-844
>                 URL: https://issues.apache.org/jira/browse/HIVE-844
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.5.0
>
>         Attachments: hive.844.1.patch, hive.844.2.patch
>
>
> Currently, ASTPartitionPruner is used in genmapredtasks() it figure out whether a map-reduce job is needed for a select star query. 
> Use the new partition pruner for that

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-844) remove ASTPartitionPruner from genmapredTasks

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zheng Shao updated HIVE-844:
----------------------------

      Resolution: Fixed
    Release Note: HIVE-844. Remove ASTPartitionPruner from genmapredTasks. (Namit Jain via zshao)
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed. Thanks Namit!

> remove ASTPartitionPruner from genmapredTasks
> ---------------------------------------------
>
>                 Key: HIVE-844
>                 URL: https://issues.apache.org/jira/browse/HIVE-844
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.5.0
>
>         Attachments: hive.844.1.patch, hive.844.2.patch
>
>
> Currently, ASTPartitionPruner is used in genmapredtasks() it figure out whether a map-reduce job is needed for a select star query. 
> Use the new partition pruner for that

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-844) remove ASTPartitionPruner from genmapredTasks

Posted by "Zheng Shao (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-844?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12757591#action_12757591 ] 

Zheng Shao commented on HIVE-844:
---------------------------------

@hive.844.1.patch:

Reviewed with Namit offline:
1.ppr.PartitionPruner.onlyContainsPartnCols should look for nondeterministic functions as well. (Please add a test for that);
2. We can do the FetchTask logic before splitting the plans instead of while splitting.


> remove ASTPartitionPruner from genmapredTasks
> ---------------------------------------------
>
>                 Key: HIVE-844
>                 URL: https://issues.apache.org/jira/browse/HIVE-844
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.5.0
>
>         Attachments: hive.844.1.patch, hive.844.2.patch
>
>
> Currently, ASTPartitionPruner is used in genmapredtasks() it figure out whether a map-reduce job is needed for a select star query. 
> Use the new partition pruner for that

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-844) remove ASTPartitionPruner from genmapredTasks

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-844:
----------------------------

    Attachment: hive.844.1.patch

> remove ASTPartitionPruner from genmapredTasks
> ---------------------------------------------
>
>                 Key: HIVE-844
>                 URL: https://issues.apache.org/jira/browse/HIVE-844
>             Project: Hadoop Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>             Fix For: 0.5.0
>
>         Attachments: hive.844.1.patch
>
>
> Currently, ASTPartitionPruner is used in genmapredtasks() it figure out whether a map-reduce job is needed for a select star query. 
> Use the new partition pruner for that

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.