You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Shuguang Liu (JIRA)" <ji...@apache.org> on 2007/10/30 09:31:50 UTC

[jira] Updated: (HADOOP-2123) Enhancements and Improvement for Host monitor in a big cluster

     [ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Shuguang Liu updated HADOOP-2123:
---------------------------------

    Attachment: hadoop.0.14-pro.tgz

New Enhancements for HADOOP on big clusters. 
I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. 

Enhancements:

1. Add Some commands to make it easy to monitor the cluster. 
hhosts - Display hosts status in the cluster.
hload - Display host load information including cpu usage, cpu usage and so on.
hslot - Change host available slot to improve efficiency. 
hopen - Enable a host on the fly.
hclose - Disable a host on the fly
2. Add Some commands to improve efficiency for a "Big Cluster"
htop - Bring a job specified to the top prirority on the fly.
hbot - Bring a job specified to the lowest priority on the fly.
hjobkill - Kill a job
hjobs - List job information in detailed format. 
3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.

4. Improved job submitting efficiency asuring right priority

[ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority 


> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
>                 Key: HADOOP-2123
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2123
>             Project: Hadoop
>          Issue Type: Improvement
>          Components: dfs, mapred
>    Affects Versions: 0.14.0
>            Reporter: Shuguang Liu
>             Fix For: 0.14.1
>
>         Attachments: hadoop.0.14-pro.tgz
>
>
> New Enhancements for HADOOP on big clusters. 
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. 
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster. 
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency. 
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format. 
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.