You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ravi Prakash (JIRA)" <ji...@apache.org> on 2012/10/24 22:18:12 UTC
[jira] [Created] (MAPREDUCE-4747) Fancy graphs for visualizing task
progress
Ravi Prakash created MAPREDUCE-4747:
---------------------------------------
Summary: Fancy graphs for visualizing task progress
Key: MAPREDUCE-4747
URL: https://issues.apache.org/jira/browse/MAPREDUCE-4747
Project: Hadoop Map/Reduce
Issue Type: Improvement
Components: mrv2
Affects Versions: 0.23.4
Reporter: Ravi Prakash
We should think about what kind of map / reduce graphs we want to see in MRv2 to visualize all the task progress / completion information we have.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4747) Fancy graphs for visualizing
task progress
Posted by "Ravi Prakash (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13483631#comment-13483631 ]
Ravi Prakash commented on MAPREDUCE-4747:
-----------------------------------------
Some ideas for visualization have been presented in :
# Mochi : www.usenix.org/event/hotcloud09/tech/full_papers/tan.pdf : Figure 2 shows a swimlanes graphic.
# Terabyte sort on Hadoop : sortbenchmark.org/YahooHadoop.pdf : Figure 1 and 2
# MR-Scope grid.hust.edu.cn/xhshi/paper/MR-Scope.pdf : Figure 4 shows a task progress graphic.
Please let me know if you know of others.
> Fancy graphs for visualizing task progress
> ------------------------------------------
>
> Key: MAPREDUCE-4747
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4747
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2
> Affects Versions: 0.23.4
> Reporter: Ravi Prakash
>
> We should think about what kind of map / reduce graphs we want to see in MRv2 to visualize all the task progress / completion information we have.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-4747) Fancy graphs for visualizing
task progress
Posted by "Ravi Prakash (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash reassigned MAPREDUCE-4747:
---------------------------------------
Assignee: Ravi Prakash
> Fancy graphs for visualizing task progress
> ------------------------------------------
>
> Key: MAPREDUCE-4747
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4747
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2
> Affects Versions: 0.23.4
> Reporter: Ravi Prakash
> Assignee: Ravi Prakash
>
> We should think about what kind of map / reduce graphs we want to see in MRv2 to visualize all the task progress / completion information we have.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-4747) Fancy graphs for visualizing
task progress
Posted by "Robert Joseph Evans (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-4747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13484162#comment-13484162 ]
Robert Joseph Evans commented on MAPREDUCE-4747:
------------------------------------------------
Figure 1 of #2 Terabyte sort on Hadoop, looks like an improved version of what we had originally. I like it, and it looks like it would scale fairly well with the number of tasks, but it does not give you the same information that the swim lanes would do. It tends to give more of a view of resource utilization, it is hard to see the long tail tasks, and what might have caused them. It would be great if we could support both, but I would want us to concentrate on the swim lanes first. Although we do need to be careful and verify that this will work for jobs with 60,000+ tasks. Even if we have to reduce the granularity of the images produced.
> Fancy graphs for visualizing task progress
> ------------------------------------------
>
> Key: MAPREDUCE-4747
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-4747
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: mrv2
> Affects Versions: 0.23.4
> Reporter: Ravi Prakash
>
> We should think about what kind of map / reduce graphs we want to see in MRv2 to visualize all the task progress / completion information we have.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira