You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Ning Zhang (JIRA)" <ji...@apache.org> on 2011/01/22 00:14:44 UTC

[jira] Created: (HIVE-1923) Allow any type of stats publisher and aggregator in addition to HBase and JDBC

Allow any type of stats publisher and aggregator in addition to HBase and JDBC
------------------------------------------------------------------------------

                 Key: HIVE-1923
                 URL: https://issues.apache.org/jira/browse/HIVE-1923
             Project: Hive
          Issue Type: Improvement
            Reporter: Ning Zhang
            Assignee: Ning Zhang


Stats Publisher and Aggregator should be configurable to take any class that implement the publisher and aggregator interface. Currently we only allow HBase and JDBC. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1923) Allow any type of stats publisher and aggregator in addition to HBase and JDBC

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Namit Jain updated HIVE-1923:
-----------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

Committed. Thanks  Ning

> Allow any type of stats publisher and aggregator in addition to HBase and JDBC
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1923
>                 URL: https://issues.apache.org/jira/browse/HIVE-1923
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1923.2.patch, HIVE-1923.patch
>
>
> Stats Publisher and Aggregator should be configurable to take any class that implement the publisher and aggregator interface. Currently we only allow HBase and JDBC. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1923) Allow any type of stats publisher and aggregator in addition to HBase and JDBC

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang updated HIVE-1923:
-----------------------------

    Attachment: HIVE-1923.patch

Introduced 2 Hive parameters as default publisher/aggregagor class names. They will be loaded if HBase or JDBC is not specified. 

> Allow any type of stats publisher and aggregator in addition to HBase and JDBC
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1923
>                 URL: https://issues.apache.org/jira/browse/HIVE-1923
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1923.patch
>
>
> Stats Publisher and Aggregator should be configurable to take any class that implement the publisher and aggregator interface. Currently we only allow HBase and JDBC. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1923) Allow any type of stats publisher and aggregator in addition to HBase and JDBC

Posted by "Namit Jain (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12985012#action_12985012 ] 

Namit Jain commented on HIVE-1923:
----------------------------------

+1

> Allow any type of stats publisher and aggregator in addition to HBase and JDBC
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1923
>                 URL: https://issues.apache.org/jira/browse/HIVE-1923
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1923.2.patch, HIVE-1923.patch
>
>
> Stats Publisher and Aggregator should be configurable to take any class that implement the publisher and aggregator interface. Currently we only allow HBase and JDBC. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1923) Allow any type of stats publisher and aggregator in addition to HBase and JDBC

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang updated HIVE-1923:
-----------------------------

    Status: Patch Available  (was: Open)

> Allow any type of stats publisher and aggregator in addition to HBase and JDBC
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1923
>                 URL: https://issues.apache.org/jira/browse/HIVE-1923
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1923.patch
>
>
> Stats Publisher and Aggregator should be configurable to take any class that implement the publisher and aggregator interface. Currently we only allow HBase and JDBC. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1923) Allow any type of stats publisher and aggregator in addition to HBase and JDBC

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12985035#action_12985035 ] 

Ning Zhang commented on HIVE-1923:
----------------------------------

@ashutosh, the design doc is at http://wiki.apache.org/hadoop/Hive/StatsDev. 

> Allow any type of stats publisher and aggregator in addition to HBase and JDBC
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1923
>                 URL: https://issues.apache.org/jira/browse/HIVE-1923
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1923.2.patch, HIVE-1923.patch
>
>
> Stats Publisher and Aggregator should be configurable to take any class that implement the publisher and aggregator interface. Currently we only allow HBase and JDBC. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HIVE-1923) Allow any type of stats publisher and aggregator in addition to HBase and JDBC

Posted by "Ning Zhang (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HIVE-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Zhang updated HIVE-1923:
-----------------------------

    Attachment: HIVE-1923.2.patch

fixed a simple typo.

> Allow any type of stats publisher and aggregator in addition to HBase and JDBC
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1923
>                 URL: https://issues.apache.org/jira/browse/HIVE-1923
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1923.2.patch, HIVE-1923.patch
>
>
> Stats Publisher and Aggregator should be configurable to take any class that implement the publisher and aggregator interface. Currently we only allow HBase and JDBC. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HIVE-1923) Allow any type of stats publisher and aggregator in addition to HBase and JDBC

Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HIVE-1923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12985018#action_12985018 ] 

Ashutosh Chauhan commented on HIVE-1923:
----------------------------------------

This sounds like a useful feature. 
When exactly are the stats published/aggregated ? Is it at the end of query from Hive Client as one of the task? Is it also possible to generate/aggregate stats from CLI for a particular table ? I suspect these questions are already answered in some wiki page. Can someone point me to stats publication document, if there is one ?

> Allow any type of stats publisher and aggregator in addition to HBase and JDBC
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-1923
>                 URL: https://issues.apache.org/jira/browse/HIVE-1923
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ning Zhang
>            Assignee: Ning Zhang
>         Attachments: HIVE-1923.2.patch, HIVE-1923.patch
>
>
> Stats Publisher and Aggregator should be configurable to take any class that implement the publisher and aggregator interface. Currently we only allow HBase and JDBC. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.