You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Jonathan Hsieh (JIRA)" <ji...@apache.org> on 2012/06/27 22:06:44 UTC
[jira] [Created] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Jonathan Hsieh created HBASE-6283:
-------------------------------------
Summary: [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
Key: HBASE-6283
URL: https://issues.apache.org/jira/browse/HBASE-6283
Project: HBase
Issue Type: Improvement
Reporter: Jonathan Hsieh
Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13408397#comment-13408397 ]
Jonathan Hsieh commented on HBASE-6283:
---------------------------------------
Created HBASE-6344 with the follow up work.
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Fix For: 0.90.7, 0.92.2, 0.96.0, 0.94.1
>
> Attachments: hbase-6283-v2.patch, hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Gregory Chanan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404332#comment-13404332 ]
Gregory Chanan commented on HBASE-6283:
---------------------------------------
Looks good to me, but I am not a ruby expert :).
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh reassigned HBASE-6283:
-------------------------------------
Assignee: Jonathan Hsieh
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-6283:
----------------------------------
Attachment: hbase-6283-v2.patch
This it the version I applied to 0.90/0.92/0.94/trunk. Thanks for the review stack.
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Fix For: 0.90.7, 0.92.2, 0.96.0, 0.94.1
>
> Attachments: hbase-6283-v2.patch, hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-6283:
----------------------------------
Attachment: hbase-6283.patch
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-6283:
----------------------------------
Attachment: region_mover.rb
Patch for trunk. Was originally developed and tested against 0.90 (should apply to all active branches).
Manually tested by having TestLoadAndVerify running and executing region_mover.rb unloads while running.
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: region_mover.rb
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh resolved HBASE-6283.
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.94.1
0.96.0
0.92.2
0.90.7
Hadoop Flags: Reviewed
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Fix For: 0.90.7, 0.92.2, 0.96.0, 0.94.1
>
> Attachments: hbase-6283-v2.patch, hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406301#comment-13406301 ]
stack commented on HBASE-6283:
------------------------------
bq. Thanks for the pointer to Aravind's work – this is the first I've seen the blog. Have we encouraged Aravind to contribute his work?
He has contrib'd the non-SU stuff: i.e. the bit where can register in zk what regionservers are being rolled.
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406712#comment-13406712 ]
stack commented on HBASE-6283:
------------------------------
Other versions, yes.
Aravind doesn't work on this stuff any more. If you open new issue, one of the two of us can take in the diff. Good on you J.
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13408486#comment-13408486 ]
Hudson commented on HBASE-6283:
-------------------------------
Integrated in HBase-0.92 #469 (See [https://builds.apache.org/job/HBase-0.92/469/])
HBASE-6283 [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node (Revision 1358450)
Result = FAILURE
jmhsieh :
Files :
* /hbase/branches/0.92/CHANGES.txt
* /hbase/branches/0.92/bin/region_mover.rb
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Fix For: 0.90.7, 0.92.2, 0.96.0, 0.94.1
>
> Attachments: hbase-6283-v2.patch, hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406189#comment-13406189 ]
Jonathan Hsieh commented on HBASE-6283:
---------------------------------------
@Stack I'll look into making it throw an exn or at least print a nice warning message.
Thanks for the pointer to Aravind's work -- this is the first I've seen the blog. Have we encouraged Aravind to contribute his work?
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13411155#comment-13411155 ]
Hudson commented on HBASE-6283:
-------------------------------
Integrated in HBase-0.94-security #39 (See [https://builds.apache.org/job/HBase-0.94-security/39/])
HBASE-6283 [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node (Revision 1358449)
Result = SUCCESS
jmhsieh :
Files :
* /hbase/branches/0.94/bin/region_mover.rb
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Fix For: 0.90.7, 0.92.2, 0.96.0, 0.94.1
>
> Attachments: hbase-6283-v2.patch, hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404526#comment-13404526 ]
stack commented on HBASE-6283:
------------------------------
This should IOError or whatever the ruby equiv of FNFE is:
{code}
+ if ! File.exist?(filename)
+ return java.util.ArrayList.new()
..
{code}
... rather than just return empty array?
Else looks good to me.
Does this change relate to Aravind's work? See down in his blog where he says:
"The region_mover.rb script is an extension of the standard region_mover.rb that ships with stock HBase. I hacked it a little to add slow balancing support and automatic region balancing while unloading regions from a server. This version is also aware of draining servers and avoids them during region assignment and balancing. Again, look for the older commit if you want to use this with 0.90.x HBase releases. The latest version is for the 0.92 release."
http://inchoate-clatter.blogspot.com.es/2012/03/hbase-ops-automation.html
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Lars Hofhansl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl closed HBASE-6283.
--------------------------------
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Fix For: 0.90.7, 0.92.2, 0.94.1, 0.96.0
>
> Attachments: hbase-6283.patch, hbase-6283-v2.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13406614#comment-13406614 ]
Jonathan Hsieh commented on HBASE-6283:
---------------------------------------
bq. He has contrib'd the non-SU stuff: i.e. the bit where can register in zk what regionservers are being rolled.
I diffed his region_mover.rb script from trunk's and they are still some significant differences between the two related to the zk bits in the ruby script side. In my case, I'm trying to help a customer in a particular situation who is still on 0.90 (didn't get included as part of HBASE-4298) so the draining zk bit isn't going to be helpful.
For this patch, I think I'll tweak to address you comments, commit to trunk (should I do the other versions too?), and then we should encourage aravind to contribute/port the jruby bits as well.
Sound good?
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-6283:
----------------------------------
Attachment: (was: region_mover.rb)
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Attachments: hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6283) [region_mover.rb] Add option to
exclude list of hosts on unload instead of just assuming the source node.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13428713#comment-13428713 ]
Hudson commented on HBASE-6283:
-------------------------------
Integrated in HBase-0.94-security-on-Hadoop-23 #6 (See [https://builds.apache.org/job/HBase-0.94-security-on-Hadoop-23/6/])
HBASE-6283 [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node (Revision 1358449)
Result = FAILURE
jmhsieh :
Files :
* /hbase/branches/0.94/bin/region_mover.rb
> [region_mover.rb] Add option to exclude list of hosts on unload instead of just assuming the source node.
> ---------------------------------------------------------------------------------------------------------
>
> Key: HBASE-6283
> URL: https://issues.apache.org/jira/browse/HBASE-6283
> Project: HBase
> Issue Type: Improvement
> Reporter: Jonathan Hsieh
> Assignee: Jonathan Hsieh
> Labels: jruby
> Fix For: 0.90.7, 0.92.2, 0.96.0, 0.94.1
>
> Attachments: hbase-6283-v2.patch, hbase-6283.patch
>
>
> Currently, the region_mover.rb script excludes a single host, the host offloading data, as a region move target. This essentially limits the number of machines that can be shutdown at a time to one. For larger clusters, it is manageable to have several nodes down at a time and desirable to get this process done more quickly.
> The proposed patch adds an exclude file option, that allows multiple hosts to be excluded as targets.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira