You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amar Kamat (JIRA)" <ji...@apache.org> on 2007/10/25 12:51:50 UTC
[jira] Created: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Pending, running, completed tasks should also be shown as percentage
--------------------------------------------------------------------
Key: HADOOP-2099
URL: https://issues.apache.org/jira/browse/HADOOP-2099
Project: Hadoop
Issue Type: Improvement
Affects Versions: 0.16.0
Reporter: Amar Kamat
Assignee: Amar Kamat
Priority: Minor
Fix For: 0.16.0
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Shuguang Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shuguang Liu updated HADOOP-2099:
---------------------------------
Affects Version/s: (was: 0.16.0)
0.14.0
Status: Patch Available (was: Open)
New Enhancements for HADOOP on big clusters.
I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
Enhancements:
1. Add Some commands to make it easy to monitor the cluster.
hhosts -- Display hosts status in the cluster.
hload -- Display host load information including cpu usage, cpu usage and so on.
hslot -- Change host available slot to improve efficiency.
hopen -- Enable a host on the fly.
hclose -- Disable a host on the fly
2. Add Some commands to improve efficiency for a "Big Cluster"
htop -- Bring a job specified to the top prirority on the fly.
hbot -- Bring a job specified to the lowest priority on the fly.
hjobkill -- Kill a job
hjobs -- List job information in detailed format.
3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
4. Improved job submitting efficiency asuring right priority
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2099:
----------------------------------
Comment: was deleted
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2099:
----------------------------------
Status: Open (was: Patch Available)
Shuguang, please open a separate jira and attach your patch there.
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, hadoop.0.14-pro.tgz, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2099:
----------------------------------
Attachment: (was: hadoop.0.14-pro.tgz)
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-2099:
-------------------------------
Attachment: HADOOP-2099.patch
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.16.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated HADOOP-2099:
-------------------------------
Attachment: percent.png
Along with the numbers a percentage would also make more sense in knowing how better the job is performing.
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.16.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2099:
----------------------------------
Comment: was deleted
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Shuguang Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shuguang Liu updated HADOOP-2099:
---------------------------------
Attachment: hadoop.0.14-pro.tgz
New Enhancements for HADOOP on big clusters.
I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
Enhancements:
1. Add Some commands to make it easy to monitor the cluster.
hhosts - Display hosts status in the cluster.
hload - Display host load information including cpu usage, cpu usage and so on.
hslot - Change host available slot to improve efficiency.
hopen - Enable a host on the fly.
hclose - Disable a host on the fly
2. Add Some commands to improve efficiency for a "Big Cluster"
htop - Bring a job specified to the top prirority on the fly.
hbot - Bring a job specified to the lowest priority on the fly.
hjobkill - Kill a job
hjobs - List job information in detailed format.
3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
4. Improved job submitting efficiency asuring right priority
[ Show ยป ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, hadoop.0.14-pro.tgz, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2099:
----------------------------------
Component/s: mapred
I'm marking this for 0.17.0.
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538714 ]
Hadoop QA commented on HADOOP-2099:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12368658/hadoop.0.14-pro.tgz
against trunk revision r589879.
@author +1. The patch does not contain any @author tags.
patch -1. The patch command could not apply the patch.
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1026/console
This message is automatically generated.
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.16.0
>
> Attachments: HADOOP-2099.patch, hadoop.0.14-pro.tgz, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2099) Pending, running, completed tasks
should also be shown as percentage
Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Arun C Murthy updated HADOOP-2099:
----------------------------------
Fix Version/s: (was: 0.16.0)
0.17.0
> Pending, running, completed tasks should also be shown as percentage
> --------------------------------------------------------------------
>
> Key: HADOOP-2099
> URL: https://issues.apache.org/jira/browse/HADOOP-2099
> Project: Hadoop
> Issue Type: Improvement
> Components: mapred
> Affects Versions: 0.14.0
> Reporter: Amar Kamat
> Assignee: Amar Kamat
> Priority: Minor
> Fix For: 0.17.0
>
> Attachments: HADOOP-2099.patch, percent.png
>
>
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.