You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Suhas Gogate (JIRA)" <ji...@apache.org> on 2008/09/16 01:57:44 UTC
[jira] Created: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
--------------------------------------------------------------------------
Key: HADOOP-4179
URL: https://issues.apache.org/jira/browse/HADOOP-4179
Project: Hadoop Core
Issue Type: New Feature
Components: contrib/chukwa
Affects Versions: 0.18.0
Environment: ALL
Reporter: Suhas Gogate
Fix For: 0.19.0
Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Mac Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12635920#action_12635920 ]
Mac Yang commented on HADOOP-4179:
----------------------------------
Looks good over all. But the @author tags should probably be removed.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: (was: hadoop-vaidya-0.2.patch)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Cameron Pope
> Fix For: 0.19.0
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Status: Patch Available (was: Open)
patch submitted
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200-1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: (was: hadoop_vaidya_branch.0.19.0.patch)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Affects Version/s: (was: 0.18.0)
0.18.1
Status: Patch Available (was: Open)
patch submitted along with documentation.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12653897#action_12653897 ]
Suhas Gogate commented on HADOOP-4179:
--------------------------------------
Can we commit this patch? some folks inquiring for it.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200-1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-4179:
----------------------------------
Status: Open (was: Patch Available)
I believe that the right solution is to make this project a stand-alone contrib project and handle the chukwa dependencies dynamically. Otherwise, users that aren't using chukwa won't see this tool.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: (was: hadoop-vaidya-0.1.patch)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Cameron Pope
> Fix For: 0.19.0
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: (was: hadoop_vaidya_0200.patch)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200-1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: hadoop-vaidya-0.2.patch
Thanks Lohit, Mac & Devraj for providing the comments. Attaching the new patch incorporating comments to make it comply with hadoop coding conventions.
Thanks.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: hadoop_vaidya_0200.patch
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650996#action_12650996 ]
Hadoop QA commented on HADOOP-4179:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12394648/hadoop_vaidya_0200-1.patch
against trunk revision 720698.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 21 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3653/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3653/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3653/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3653/console
This message is automatically generated.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200-1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Status: Open (was: Patch Available)
error applying patch. adding new patch.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650266#action_12650266 ]
Suhas Gogate commented on HADOOP-4179:
--------------------------------------
failed unit test is NOT related to this patch.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: hadoop_vaidya_trunk.patch
Added patch for trunk
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Arun C Murthy
> Fix For: 0.19.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: hadoop_vaidya_0200-1.patch
New file attached hadoop_vaidya_0200-1.patch with changes making the module named vaidya under contrib (instead of hadoop-vaidya). Corresponding changes also made in the source and documentation.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200-1.patch, hadoop_vaidya_0200.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642342#action_12642342 ]
Suhas Gogate commented on HADOOP-4179:
--------------------------------------
Hi Sachin, I sent you a detailed reply to your email couple of days back. Yes there is a possibility, although need to know few details about your familiarity with hadoop M/R and what is the start date for your project etc. We can discuss it off-line to keep JIRA updates related to technical discussion. will send you the email again today. thx. --Suhas
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: hadoop_vaidya.0.3.patch
latest patch file (hadoop_vaidya.0.3.patch) attached.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Cameron Pope
> Fix For: 0.19.0
>
> Attachments: hadoop_vaidya.0.3.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642336#action_12642336 ]
Milind Bhandarkar commented on HADOOP-4179:
-------------------------------------------
Enis, I believe the feature freeze applies to hadoop core, and not contrib, right ?
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12632353#action_12632353 ]
Milind Bhandarkar commented on HADOOP-4179:
-------------------------------------------
Lohit,
This is the first version of Hadoop Vaidya, which works only in the postmortem analysis mode. Later, as needed, it can be extended to do analysis of a running job too.
P.S. Can you review the patch ? Thanks.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Milind Bhandarkar reassigned HADOOP-4179:
-----------------------------------------
Assignee: Suhas Gogate
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12643736#action_12643736 ]
Hadoop QA commented on HADOOP-4179:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12392443/hadoop-vaidya-0.2.patch
against trunk revision 709040.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 23 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3509/console
This message is automatically generated.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: (was: hadoop_vaidya_trunk.patch)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-4179:
----------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Suhas!
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200-1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Assignee: Arun C Murthy (was: Cameron Pope)
Status: Patch Available (was: Open)
making it patch available.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Arun C Murthy
> Fix For: 0.19.0
>
> Attachments: hadoop_vaidya.0.3.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644875#action_12644875 ]
Suhas Gogate commented on HADOOP-4179:
--------------------------------------
Owen, Sorry, I did not mean that Hadoop Vaidya would loose its independent identity after integration with Chukwa. Optionally It should also run outside Chukwa framework, and so I agree with you. Although based on prior discussions between Me, Runping, Mac and Milind, it appears to have better fit and more potential with Chukwa framework and so was decided to be part of Chukwa project.
Milind/Mac/Runping, comments?
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644865#action_12644865 ]
Owen O'Malley commented on HADOOP-4179:
---------------------------------------
1. I think it would add value outside of Chukwa and be usable without Chukwa. Maybe the right place is another contrib project?
2. No. 0.19 is closed for both core and contrib.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Sachin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12642332#action_12642332 ]
Sachin commented on HADOOP-4179:
--------------------------------
Hi Suhas, Lohith
We are students from University of Minnesota looking for a project for our distributed systems class. We found this project to be quite interesting. We would like to work on the extension for run time analysis. How feasible is that considering we have a time frame of 4 weeks to complete our project.
Thanks
Sachin
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Assignee: Cameron Pope (was: Suhas Gogate)
Status: Open (was: Patch Available)
cancelled
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Cameron Pope
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644965#action_12644965 ]
Hadoop QA commented on HADOOP-4179:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12393268/hadoop_vaidya_trunk.patch
against trunk revision 709609.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 20 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3525/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3525/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3525/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3525/console
This message is automatically generated.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649606#action_12649606 ]
Hadoop QA commented on HADOOP-4179:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12394120/hadoop-vaidya-trunk.patch
against trunk revision 719431.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 20 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3615/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3615/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3615/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3615/console
This message is automatically generated.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop-vaidya-trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12654829#action_12654829 ]
Hudson commented on HADOOP-4179:
--------------------------------
Integrated in Hadoop-trunk #683 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/683/])
. Add Vaidya tool to analyze map/reduce job logs for performanc
problems. (Suhas Gogate via omalley)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200-1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Devaraj Das updated HADOOP-4179:
--------------------------------
Fix Version/s: (was: 0.19.0)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649994#action_12649994 ]
Hadoop QA commented on HADOOP-4179:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12394453/hadoop_vaidya_0200.patch
against trunk revision 719787.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 21 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3636/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3636/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3636/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3636/console
This message is automatically generated.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: (was: hadoop_vaidya.0.3.patch)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Arun C Murthy
> Fix For: 0.19.0
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Fix Version/s: (was: 0.19.0)
0.20.0
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop-vaidya-trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Status: Patch Available (was: Open)
Making patch available
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Arun C Murthy
> Fix For: 0.19.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Devaraj Das (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638546#action_12638546 ]
Devaraj Das commented on HADOOP-4179:
-------------------------------------
Comments on the coding style - Indentation needs to be fixed to conform to hadoop's coding conventions. Also the variable names are better read without the underscore prefix.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: hadoop-vaidya-0.1.patch
patch added
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Status: Open (was: Patch Available)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Arun C Murthy
> Fix For: 0.19.0
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler updated HADOOP-4179:
------------------------------------
Release Note: Introduced Vaidya rule based performance diagnostic tool for Map/Reduce jobs.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200-1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Milind Bhandarkar updated HADOOP-4179:
--------------------------------------
Fix Version/s: 0.19.0
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: hadoop_vaidya_branch.0.19.0.patch
Patch added for branch 0.19.0
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Arun C Murthy
> Fix For: 0.19.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644863#action_12644863 ]
Suhas Gogate commented on HADOOP-4179:
--------------------------------------
1. Although it is an independent tool right now, eventually would be integrated with Chukwa (part of health care center), providing rule based analysis of the data it collects for M/R jobs. At this time it does not use any Chukwa interface/library etc.
2. As Milind mentioned in one of his earlier comments, I was under impression that feature freeze applies to hadoop core and not "contrib". Is it true?
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: (was: hadoop-vaidya-trunk.patch)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Status: Open (was: Patch Available)
Found a bug.. so canceling the patch and will be resubmitting the fixed version soon.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop-vaidya-trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12644764#action_12644764 ]
Hadoop QA commented on HADOOP-4179:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12393197/hadoop_vaidya.0.3.patch
against trunk revision 709609.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 20 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3517/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3517/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3517/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3517/console
This message is automatically generated.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Arun C Murthy
> Fix For: 0.19.0
>
> Attachments: hadoop_vaidya.0.3.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Attachment: hadoop-vaidya-trunk.patch
making a patch available for hadoop-vaidya in the contrib (moved it outside the chukwa as thought initially).
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop-vaidya-trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Enis Soztutar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Enis Soztutar updated HADOOP-4179:
----------------------------------
Fix Version/s: (was: 0.19.0)
moving this from 0.19 due to feature freeze.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12648655#action_12648655 ]
Suhas Gogate commented on HADOOP-4179:
--------------------------------------
changed the fixed version to 0.20.0 (by mistake was selected 0.19 )
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop-vaidya-trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Status: Patch Available (was: Open)
submitting the patch
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Status: Open (was: Patch Available)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Lohit Vijayarenu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12631219#action_12631219 ]
Lohit Vijayarenu commented on HADOOP-4179:
------------------------------------------
This would be very useful to have. Can jobdetails.jsp or jobtracker.jsp (may be via StatusHttpServlet) serve this analysis after the job is done? That will help users to check how job performed directly from webUI.
PS : Definition of [Vaidya|http://www.experiencefestival.com/a/Vaidya/id/62740]
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650404#action_12650404 ]
Owen O'Malley commented on HADOOP-4179:
---------------------------------------
Sorry, I've only glanced at the patch, but it would be better to make the contrib module 'vaidya' instead of 'hadoop-vaidya' since the hadoop is implied.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_0200.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Milind Bhandarkar (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Milind Bhandarkar updated HADOOP-4179:
--------------------------------------
Fix Version/s: 0.19.0
Status: Patch Available (was: Open)
Making it patch available.
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.0
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-0.1.patch, hadoop-vaidya-0.2.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Suhas Gogate (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Suhas Gogate updated HADOOP-4179:
---------------------------------
Fix Version/s: (was: 0.20.0)
0.19.0
Status: Patch Available (was: Open)
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.19.0
>
> Attachments: hadoop-vaidya-trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-4179) Hadoop-Vaidya : Rule based
performance diagnostic tool for Map/Reduce jobs
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-4179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-4179:
----------------------------------
Fix Version/s: (was: 0.19.0)
0.20.0
Assignee: Suhas Gogate (was: Arun C Murthy)
This can't go into 0.19, because it is new functionality.
Why is it in chukwa, rather than some where more global? Does it depend on chukwa?
> Hadoop-Vaidya : Rule based performance diagnostic tool for Map/Reduce jobs
> --------------------------------------------------------------------------
>
> Key: HADOOP-4179
> URL: https://issues.apache.org/jira/browse/HADOOP-4179
> Project: Hadoop Core
> Issue Type: New Feature
> Components: contrib/chukwa
> Affects Versions: 0.18.1
> Environment: ALL
> Reporter: Suhas Gogate
> Assignee: Suhas Gogate
> Fix For: 0.20.0
>
> Attachments: hadoop_vaidya_branch.0.19.0.patch, hadoop_vaidya_trunk.patch
>
>
> Hadoop-Vaidya is a rule based performance diagnostic tool for Map/Reduce jobs. It performs a post execution analysis of map/reduce job by parsing and collecting execution statistics through job history log and job configuration files. It runs a set of predefined tests/rules against job execution statistics to diagnose various performance problems. Each test rule detects a specific performance problem with job and provides a targeted advice to the user. This tool generates an XML report based on the evaluation results of individual test rules.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.