You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@chukwa.apache.org by "Jiaqi Tan (JIRA)" <ji...@apache.org> on 2009/06/08 23:48:07 UTC
[jira] Created: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Swimlanes visualization for Hadoop job progress
-----------------------------------------------
Key: CHUKWA-279
URL: https://issues.apache.org/jira/browse/CHUKWA-279
Project: Hadoop Chukwa
Issue Type: New Feature
Components: Data Processors, User Interface
Affects Versions: 0.2.0
Reporter: Jiaqi Tan
Fix For: 0.2.0
"Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiaqi Tan updated CHUKWA-279:
-----------------------------
Attachment: CHUKWA-279.patch
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch, CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (CHUKWA-279) Swimlanes visualization for Hadoop
job progress
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang reassigned CHUKWA-279:
--------------------------------
Assignee: Jiaqi Tan
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Assignee: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiaqi Tan updated CHUKWA-279:
-----------------------------
Attachment: CHUKWA-279.patch
Includes: 1. updates to database schema (new table for SALSA state-machine states) and MDL schema for loading data from SALSA state-machines stored in ChukwaRecords, 2. JSP for widget that generates Swimlanes charts by reading from database.
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Yang updated CHUKWA-279:
-----------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
The visualization is done. It works fine. Initially, I had problem pin point the data because I forgot my time zone isn't UTC and the time selection widget needs to be offset by my time zone.
There will be a follow up patch to include the backend analysis part in another JIRA.
My fault for not closing this bug. This should be closed as fixed.
Thanks Jiaqi.
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Assignee: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiaqi Tan updated CHUKWA-279:
-----------------------------
Attachment: (was: CHUKWA-279.patch)
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiaqi Tan updated CHUKWA-279:
-----------------------------
Status: Patch Available (was: Open)
Includes: 1. updates to database schema (new table for SALSA state-machine states) and MDL schema for loading data from SALSA state-machines stored in ChukwaRecords, 2. JSP for widget that generates Swimlanes charts by reading from database.
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Fix For: 0.2.0
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiaqi Tan updated CHUKWA-279:
-----------------------------
Description:
"Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
was:
"Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-279) Swimlanes visualization for Hadoop
job progress
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717847#action_12717847 ]
Hudson commented on CHUKWA-279:
-------------------------------
Integrated in Chukwa-trunk #48 (See [http://hudson.zones.apache.org/hudson/job/Chukwa-trunk/48/])
. Added swim lane visualization for Hadoop job progress. (Jiaqi Tan via Eric Yang)
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Assignee: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-279) Swimlanes visualization for Hadoop
job progress
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717889#action_12717889 ]
Ari Rabkin commented on CHUKWA-279:
-----------------------------------
What's the status of this issue? I see that some code has been committed [r783066], but the issue isn't closed. Should it be? New visualizations sounds pretty awesome, but it's probably not ideal to commit things that don't work to the repository...
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Assignee: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-279) Swimlanes visualization for Hadoop
job progress
Posted by "Paul Baclace (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12719073#action_12719073 ]
Paul Baclace commented on CHUKWA-279:
-------------------------------------
Take a tip from aviation, Unix, and Java: time values should always be stored in UTC because TimeZones are viewer dependent.
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Assignee: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiaqi Tan updated CHUKWA-279:
-----------------------------
Attachment: CHUKWA-279.patch
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-279) Swimlanes visualization for Hadoop
job progress
Posted by "Ari Rabkin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717911#action_12717911 ]
Ari Rabkin commented on CHUKWA-279:
-----------------------------------
*giggle* Glad I'm not the only one who keeps getting bitten by the timezone bug. Is there a clean way to fix it? Owen suggests that we impose UTC on all stored data.
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Assignee: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (CHUKWA-279) Swimlanes visualization for Hadoop
job progress
Posted by "Eric Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12717581#action_12717581 ]
Eric Yang commented on CHUKWA-279:
----------------------------------
Applied the patch, there is no error message, however, the chart shows empty. There is a javascript error clearSelection being null. Added check for null condition, but the visualization still doesn't work. Output of swimlanes-event-data-js.jsp might not be syntactically correct.
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Assignee: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
> Description of [Swimlanes|http://www.pdl.cmu.edu/PDL-FTP/stray/mochi_tan_hotcloud09_abs.html] visualization.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (CHUKWA-279) Swimlanes visualization for Hadoop job
progress
Posted by "Jiaqi Tan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/CHUKWA-279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jiaqi Tan updated CHUKWA-279:
-----------------------------
Comment: was deleted
(was: Includes: 1. updates to database schema (new table for SALSA state-machine states) and MDL schema for loading data from SALSA state-machines stored in ChukwaRecords, 2. JSP for widget that generates Swimlanes charts by reading from database.)
> Swimlanes visualization for Hadoop job progress
> -----------------------------------------------
>
> Key: CHUKWA-279
> URL: https://issues.apache.org/jira/browse/CHUKWA-279
> Project: Hadoop Chukwa
> Issue Type: New Feature
> Components: Data Processors, User Interface
> Affects Versions: 0.2.0
> Reporter: Jiaqi Tan
> Fix For: 0.2.0
>
> Attachments: CHUKWA-279.patch
>
>
> "Swimlanes" visualization (Tan09, HotCloud) for showing job progress in terms of SALSA (Tan08, WASL) states by using data from JobHistory logs. Initial version to show job progress in time across all nodes that worked on the job.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.