You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Kevin Wilfong (JIRA)" <ji...@apache.org> on 2012/04/21 02:55:32 UTC
[jira] [Created] (HIVE-2969) Log Time To Submit metric with
PerfLogger
Kevin Wilfong created HIVE-2969:
-----------------------------------
Summary: Log Time To Submit metric with PerfLogger
Key: HIVE-2969
URL: https://issues.apache.org/jira/browse/HIVE-2969
Project: Hive
Issue Type: Wish
Components: Logging
Affects Versions: 0.10
Reporter: Kevin Wilfong
Assignee: Kevin Wilfong
Priority: Minor
Logging the time from when Driver.run starts to when we begin submitting jobs to map reduce would be helpful in determining how much of the lag in starting a query is due to Hive vs. Hadoop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2969) Log Time To Submit metric with
PerfLogger
Posted by "Phabricator (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Phabricator updated HIVE-2969:
------------------------------
Attachment: HIVE-2969.D2919.1.patch
kevinwilfong requested code review of "HIVE-2969 [jira] Log Time To Submit metric with PerfLogger".
Reviewers: JIRA
https://issues.apache.org/jira/browse/HIVE-2969
Added Time To Submit to the PerfLogger, beginning just after the PerfLogger is first initialized, and ending just before the loop which starts submitting jobs to map reduce.
Logging the time from when Driver.run starts to when we begin submitting jobs to map reduce would be helpful in determining how much of the lag in starting a query is due to Hive vs. Hadoop.
TEST PLAN
EMPTY
REVISION DETAIL
https://reviews.facebook.net/D2919
AFFECTED FILES
ql/src/java/org/apache/hadoop/hive/ql/log/PerfLogger.java
ql/src/java/org/apache/hadoop/hive/ql/Driver.java
MANAGE HERALD DIFFERENTIAL RULES
https://reviews.facebook.net/herald/view/differential/
WHY DID I GET THIS EMAIL?
https://reviews.facebook.net/herald/transcript/6651/
Tip: use the X-Herald-Rules header to filter Herald messages in your client.
> Log Time To Submit metric with PerfLogger
> -----------------------------------------
>
> Key: HIVE-2969
> URL: https://issues.apache.org/jira/browse/HIVE-2969
> Project: Hive
> Issue Type: Wish
> Components: Logging
> Affects Versions: 0.10
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Priority: Minor
> Attachments: HIVE-2969.D2919.1.patch
>
>
> Logging the time from when Driver.run starts to when we begin submitting jobs to map reduce would be helpful in determining how much of the lag in starting a query is due to Hive vs. Hadoop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2969) Log Time To Submit metric with
PerfLogger
Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kevin Wilfong updated HIVE-2969:
--------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed
> Log Time To Submit metric with PerfLogger
> -----------------------------------------
>
> Key: HIVE-2969
> URL: https://issues.apache.org/jira/browse/HIVE-2969
> Project: Hive
> Issue Type: Wish
> Components: Logging
> Affects Versions: 0.10.0
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Priority: Minor
> Attachments: HIVE-2969.D2919.1.patch
>
>
> Logging the time from when Driver.run starts to when we begin submitting jobs to map reduce would be helpful in determining how much of the lag in starting a query is due to Hive vs. Hadoop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2969) Log Time To Submit metric with
PerfLogger
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13291626#comment-13291626 ]
Hudson commented on HIVE-2969:
------------------------------
Integrated in Hive-trunk-h0.21 #1474 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1474/])
HIVE-2969. Log Time To Submit metric with PerfLogger. (kevinwilfong reviewed by ashutoshc) (Revision 1347870)
Result = FAILURE
kevinwilfong : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1347870
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/Driver.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/log/PerfLogger.java
> Log Time To Submit metric with PerfLogger
> -----------------------------------------
>
> Key: HIVE-2969
> URL: https://issues.apache.org/jira/browse/HIVE-2969
> Project: Hive
> Issue Type: Wish
> Components: Logging
> Affects Versions: 0.10.0
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Priority: Minor
> Attachments: HIVE-2969.D2919.1.patch
>
>
> Logging the time from when Driver.run starts to when we begin submitting jobs to map reduce would be helpful in determining how much of the lag in starting a query is due to Hive vs. Hadoop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2969) Log Time To Submit metric with
PerfLogger
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-2969:
-----------------------------------
Affects Version/s: (was: 0.10.0)
Fix Version/s: 0.10.0
> Log Time To Submit metric with PerfLogger
> -----------------------------------------
>
> Key: HIVE-2969
> URL: https://issues.apache.org/jira/browse/HIVE-2969
> Project: Hive
> Issue Type: Wish
> Components: Logging
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Priority: Minor
> Fix For: 0.10.0
>
> Attachments: HIVE-2969.D2919.1.patch
>
>
> Logging the time from when Driver.run starts to when we begin submitting jobs to map reduce would be helpful in determining how much of the lag in starting a query is due to Hive vs. Hadoop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2969) Log Time To Submit metric with
PerfLogger
Posted by "Kevin Wilfong (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kevin Wilfong updated HIVE-2969:
--------------------------------
Status: Patch Available (was: Open)
> Log Time To Submit metric with PerfLogger
> -----------------------------------------
>
> Key: HIVE-2969
> URL: https://issues.apache.org/jira/browse/HIVE-2969
> Project: Hive
> Issue Type: Wish
> Components: Logging
> Affects Versions: 0.10
> Reporter: Kevin Wilfong
> Assignee: Kevin Wilfong
> Priority: Minor
> Attachments: HIVE-2969.D2919.1.patch
>
>
> Logging the time from when Driver.run starts to when we begin submitting jobs to map reduce would be helpful in determining how much of the lag in starting a query is due to Hive vs. Hadoop.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira