You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Namit Jain (JIRA)" <ji...@apache.org> on 2010/12/14 00:58:01 UTC

[jira] Created: (HIVE-1849) add more logging to partition pruning

add more logging to partition pruning
-------------------------------------

                 Key: HIVE-1849
                 URL: https://issues.apache.org/jira/browse/HIVE-1849
             Project: Hive
          Issue Type: Bug
          Components: Query Processor
            Reporter: Namit Jain
            Assignee: Namit Jain


In facebook, we are seeing some intermittent errors, where it seems that either all the partitions are not returned by the metastore
or some of them are pruned wrongly.

This patch adds more logging for debugging such scenarios.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1849) add more logging to partition pruning

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12971352#action_12971352 ] 

Ashutosh Chauhan commented on HIVE-1849:
----------------------------------------

bq. In facebook, we are seeing some intermittent errors, where it seems that either all the partitions are not returned by the metastore or some of them are pruned wrongly. 

It would be good to know if the errors you were seeing were indeed because of partition pruning code in Metastore.

> add more logging to partition pruning
> -------------------------------------
>
>                 Key: HIVE-1849
>                 URL: https://issues.apache.org/jira/browse/HIVE-1849
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1849.1.patch
>
>
> In facebook, we are seeing some intermittent errors, where it seems that either all the partitions are not returned by the metastore
> or some of them are pruned wrongly.
> This patch adds more logging for debugging such scenarios.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1849) add more logging to partition pruning

Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12971348#action_12971348 ] 

He Yongqiang commented on HIVE-1849:
------------------------------------

+1, running test

> add more logging to partition pruning
> -------------------------------------
>
>                 Key: HIVE-1849
>                 URL: https://issues.apache.org/jira/browse/HIVE-1849
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1849.1.patch
>
>
> In facebook, we are seeing some intermittent errors, where it seems that either all the partitions are not returned by the metastore
> or some of them are pruned wrongly.
> This patch adds more logging for debugging such scenarios.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1849) add more logging to partition pruning

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12971425#action_12971425 ] 

Namit Jain commented on HIVE-1849:
----------------------------------

We need this log to confirm that

> add more logging to partition pruning
> -------------------------------------
>
>                 Key: HIVE-1849
>                 URL: https://issues.apache.org/jira/browse/HIVE-1849
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1849.1.patch
>
>
> In facebook, we are seeing some intermittent errors, where it seems that either all the partitions are not returned by the metastore
> or some of them are pruned wrongly.
> This patch adds more logging for debugging such scenarios.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1849) add more logging to partition pruning

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-1849:
-----------------------------

    Status: Patch Available  (was: Open)

> add more logging to partition pruning
> -------------------------------------
>
>                 Key: HIVE-1849
>                 URL: https://issues.apache.org/jira/browse/HIVE-1849
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1849.1.patch
>
>
> In facebook, we are seeing some intermittent errors, where it seems that either all the partitions are not returned by the metastore
> or some of them are pruned wrongly.
> This patch adds more logging for debugging such scenarios.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1849) add more logging to partition pruning

Posted by "He Yongqiang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

He Yongqiang updated HIVE-1849:
-------------------------------

    Resolution: Fixed
        Status: Resolved  (was: Patch Available)

Committed! Thanks namit!

> add more logging to partition pruning
> -------------------------------------
>
>                 Key: HIVE-1849
>                 URL: https://issues.apache.org/jira/browse/HIVE-1849
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1849.1.patch
>
>
> In facebook, we are seeing some intermittent errors, where it seems that either all the partitions are not returned by the metastore
> or some of them are pruned wrongly.
> This patch adds more logging for debugging such scenarios.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1849) add more logging to partition pruning

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-1849:
-----------------------------

    Attachment: hive.1849.1.patch

> add more logging to partition pruning
> -------------------------------------
>
>                 Key: HIVE-1849
>                 URL: https://issues.apache.org/jira/browse/HIVE-1849
>             Project: Hive
>          Issue Type: Bug
>          Components: Query Processor
>            Reporter: Namit Jain
>            Assignee: Namit Jain
>         Attachments: hive.1849.1.patch
>
>
> In facebook, we are seeing some intermittent errors, where it seems that either all the partitions are not returned by the metastore
> or some of them are pruned wrongly.
> This patch adds more logging for debugging such scenarios.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.