You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Shuguang Liu (JIRA)" <ji...@apache.org> on 2007/10/30 09:24:51 UTC
[jira] Created: (HADOOP-2123) Enhancements and Improvement for Host
monitor in a big cluster
Enhancements and Improvement for Host monitor in a big cluster
--------------------------------------------------------------
Key: HADOOP-2123
URL: https://issues.apache.org/jira/browse/HADOOP-2123
Project: Hadoop
Issue Type: Improvement
Components: dfs, mapred
Affects Versions: 0.14.0
Reporter: Shuguang Liu
Fix For: 0.14.1
New Enhancements for HADOOP on big clusters.
I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
Enhancements:
1. Add Some commands to make it easy to monitor the cluster.
hhosts - Display hosts status in the cluster.
hload - Display host load information including cpu usage, cpu usage and so on.
hslot - Change host available slot to improve efficiency.
hopen - Enable a host on the fly.
hclose - Disable a host on the fly
2. Add Some commands to improve efficiency for a "Big Cluster"
htop - Bring a job specified to the top prirority on the fly.
hbot - Bring a job specified to the lowest priority on the fly.
hjobkill - Kill a job
hjobs - List job information in detailed format.
3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
4. Improved job submitting efficiency asuring right priority
[ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-2123) Enhancements and Improvement for
Host monitor in a big cluster
Posted by "Edward Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Yoon resolved HADOOP-2123.
---------------------------------
Resolution: Won't Fix
Closing.
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Assignee: Edward Yoon
> Fix For: 0.16.0
>
> Attachments: hadoop.0.14-pro.tgz, new_commands_v01.patch
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2123) Enhancements and Improvement for Host
monitor in a big cluster
Posted by "Edward Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Yoon updated HADOOP-2123:
--------------------------------
Attachment: new_commands_v01.patch
Liu, I have received your source code and looks like good.
First, You should learn how to use Subversion. (It's Easy.)
And then, See the attached patch file(new_commands_v01.patch) and check the changed codes.
(I didn't put it all)
Also, See this document : http://wiki.apache.org/lucene-hadoop/CodeReviewChecklist
Hope this helps.
Thanks.
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Fix For: 0.14.1
>
> Attachments: hadoop.0.14-pro.tgz, new_commands_v01.patch
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2123) Enhancements and Improvement for Host
monitor in a big cluster
Posted by "Shuguang Liu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Shuguang Liu updated HADOOP-2123:
---------------------------------
Attachment: hadoop.0.14-pro.tgz
New Enhancements for HADOOP on big clusters.
I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
Enhancements:
1. Add Some commands to make it easy to monitor the cluster.
hhosts - Display hosts status in the cluster.
hload - Display host load information including cpu usage, cpu usage and so on.
hslot - Change host available slot to improve efficiency.
hopen - Enable a host on the fly.
hclose - Disable a host on the fly
2. Add Some commands to improve efficiency for a "Big Cluster"
htop - Bring a job specified to the top prirority on the fly.
hbot - Bring a job specified to the lowest priority on the fly.
hjobkill - Kill a job
hjobs - List job information in detailed format.
3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
4. Improved job submitting efficiency asuring right priority
[ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Fix For: 0.14.1
>
> Attachments: hadoop.0.14-pro.tgz
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-2123) Enhancements and Improvement for
Host monitor in a big cluster
Posted by "Edward Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward Yoon reassigned HADOOP-2123:
-----------------------------------
Assignee: Edward Yoon
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Assignee: Edward Yoon
> Fix For: 0.16.0
>
> Attachments: hadoop.0.14-pro.tgz, new_commands_v01.patch
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2123) Enhancements and Improvement for
Host monitor in a big cluster
Posted by "Edward Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12549255 ]
Edward Yoon commented on HADOOP-2123:
-------------------------------------
I think I can improve this feature and submit to hadoop.
If you have any ideas or suggestions on how do i this issue, then please feel free to post them.
(I think He is gone after entrusted the matter to me.)
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Assignee: Edward Yoon
> Fix For: 0.16.0
>
> Attachments: hadoop.0.14-pro.tgz, new_commands_v01.patch
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2123) Enhancements and Improvement for Host
monitor in a big cluster
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-2123:
----------------------------------
Fix Version/s: (was: 0.14.1)
0.16.0
This is not a bug fix and thus won't be applied to the release branches.
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Fix For: 0.16.0
>
> Attachments: hadoop.0.14-pro.tgz, new_commands_v01.patch
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2123) Enhancements and Improvement for
Host monitor in a big cluster
Posted by "Edward Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12544637 ]
Edward Yoon commented on HADOOP-2123:
-------------------------------------
Hey Liu, Do you need more help?
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Fix For: 0.16.0
>
> Attachments: hadoop.0.14-pro.tgz, new_commands_v01.patch
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2123) Enhancements and Improvement for
Host monitor in a big cluster
Posted by "Edward Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12538734 ]
Edward Yoon commented on HADOOP-2123:
-------------------------------------
I can't find the source code from your attachment. (only jar)
see this document : http://wiki.apache.org/lucene-hadoop/HowToContribute
Otherwise, please re-upload them with source code if you want to continue contributing them.
I'll help you.
Thanks, Edward.
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Fix For: 0.14.1
>
> Attachments: hadoop.0.14-pro.tgz
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2123) Enhancements and Improvement for
Host monitor in a big cluster
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12540363 ]
Allen Wittenauer commented on HADOOP-2123:
------------------------------------------
Given that this reads /proc, this patch likely won't work on anything but Linux as written.
> Enhancements and Improvement for Host monitor in a big cluster
> --------------------------------------------------------------
>
> Key: HADOOP-2123
> URL: https://issues.apache.org/jira/browse/HADOOP-2123
> Project: Hadoop
> Issue Type: Improvement
> Components: dfs, mapred
> Affects Versions: 0.14.0
> Reporter: Shuguang Liu
> Fix For: 0.16.0
>
> Attachments: hadoop.0.14-pro.tgz, new_commands_v01.patch
>
>
> New Enhancements for HADOOP on big clusters.
> I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part.
> Enhancements:
> 1. Add Some commands to make it easy to monitor the cluster.
> hhosts - Display hosts status in the cluster.
> hload - Display host load information including cpu usage, cpu usage and so on.
> hslot - Change host available slot to improve efficiency.
> hopen - Enable a host on the fly.
> hclose - Disable a host on the fly
> 2. Add Some commands to improve efficiency for a "Big Cluster"
> htop - Bring a job specified to the top prirority on the fly.
> hbot - Bring a job specified to the lowest priority on the fly.
> hjobkill - Kill a job
> hjobs - List job information in detailed format.
> 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks.
> 4. Improved job submitting efficiency asuring right priority
> [ Show » ] Shuguang Liu - 30/Oct/07 01:15 AM New Enhancements for HADOOP on big clusters. I put some new commands into HADOOP based on 0.14.0 and modified some bugs especially in the scheduling part. Enhancements: 1. Add Some commands to make it easy to monitor the cluster. hhosts - Display hosts status in the cluster. hload - Display host load information including cpu usage, cpu usage and so on. hslot - Change host available slot to improve efficiency. hopen - Enable a host on the fly. hclose - Disable a host on the fly 2. Add Some commands to improve efficiency for a "Big Cluster" htop - Bring a job specified to the top prirority on the fly. hbot - Bring a job specified to the lowest priority on the fly. hjobkill - Kill a job hjobs - List job information in detailed format. 3. Enhance the task trunk dispatching method to make it more efficient when a job has many tasks. 4. Improved job submitting efficiency asuring right priority
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.