You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@slider.apache.org by "Ted Yu (JIRA)" <ji...@apache.org> on 2014/12/22 18:58:13 UTC
[jira] [Commented] (SLIDER-734) Create wrapper script for hbase
which retrieves hbase-site.xml from running cluster
[ https://issues.apache.org/jira/browse/SLIDER-734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14255980#comment-14255980 ]
Ted Yu commented on SLIDER-734:
-------------------------------
Here is one sample run:
{code}
python hbase-wrapper.py hbasesliderapp
2014-12-22 17:44:08,461 [main] DEBUG main.ServiceLauncher (ServiceLauncher.java:serviceMain(619)) - STARTUP_MSG:
...
STARTUP_MSG: build = git@github.com:hortonworks/hadoop.git -r 7f0b147660a771cff139be7f2aba0f3d9aca1163; compiled by 'jenkins' on 2014-12-19T04:34Z
STARTUP_MSG: java = 1.7.0_67
************************************************************/
2014-12-22 17:44:08,464 [main] DEBUG main.ServiceLauncher (ServiceLauncher.java:serviceMain(624)) - "org.apache.slider.Slider" "registry" "--getconf" "hbase-site" "--user" "hbase" "--format" "xml" "--dest" "/tmp/hbase-site.xml" "--name" "hbasesliderapp"
2014-12-22 17:44:08,508 [main] DEBUG utility.LaunchedWorkflowCompositeService (LaunchedWorkflowCompositeService.java:bindArgs(80)) - Binding 11 Arguments:
2014-12-22 17:44:08,509 [main] DEBUG utility.LaunchedWorkflowCompositeService (LaunchedWorkflowCompositeService.java:bindArgs(86)) - "registry" "--getconf" "hbase-site" "--user" "hbase" "--format" "xml" "--dest" "/tmp/hbase-site.xml" "--name" "hbasesliderapp"
2014-12-22 17:44:08,628 [main] DEBUG params.CommonArgs (CommonArgs.java:validate(241)) - action=registry
2014-12-22 17:44:08,962 [main] DEBUG tools.ConfigHelper (ConfigHelper.java:loadFromResource(511)) - loaded resources from file:/etc/hdp/2.2.0.0-1647/slider/slider-client.xml
2014-12-22 17:44:09,745 [main] INFO impl.TimelineClientImpl (TimelineClientImpl.java:serviceInit(285)) - Timeline service address: http://hor11n14.gq1.ygridcore.net:8188/ws/v1/timeline/
2014-12-22 17:44:10,362 [main] WARN shortcircuit.DomainSocketFactory (DomainSocketFactory.java:<init>(116)) - The short-circuit local reads feature cannot be used because libhadoop cannot be loaded.
2014-12-22 17:44:10,370 [main] INFO client.RMProxy (RMProxy.java:createRMProxy(98)) - Connecting to ResourceManager at hor11n14.gq1.ygridcore.net/68.142.247.161:8032
2014-12-22 17:44:10,503 [main] INFO imps.CuratorFrameworkImpl (CuratorFrameworkImpl.java:start(223)) - Starting
2014-12-22 17:44:10,575 [main-EventThread] INFO state.ConnectionStateManager (ConnectionStateManager.java:postState(194)) - State change: CONNECTED
2014-12-22 17:44:10,575 [ConnectionStateManager-0] WARN state.ConnectionStateManager (ConnectionStateManager.java:processEvents(212)) - There are no ConnectionStateListeners registered.
2014-12-22 17:44:11,773 [main] DEBUG retrieve.RegistryRetriever (RegistryRetriever.java:getConfigurations(215)) - GET http://hor15n22.gq1.ygridcore.net:44221/ws/v1/slider/publisher/slider
2014-12-22 17:44:11,837 [main] DEBUG client.SliderClient (SliderClient.java:outputConfig(3181)) - Destination path: /tmp/hbase-site.xml
2014-12-22 17:44:11,911 [main] DEBUG main.ServiceLauncher (ServiceLauncher.java:launchService(189)) - Service exited with exit code 0
2014-12-22 17:44:11,913 [main] INFO util.ExitUtil (ExitUtil.java:terminate(124)) - Exiting with status 0
2014-12-22 17:44:15,732 INFO [main] Configuration.deprecation: hadoop.native.lib is deprecated. Instead, use io.native.lib.available
HBase Shell; enter 'help<RETURN>' for list of supported commands.
Type "exit<RETURN>" to leave the HBase Shell
Version 0.98.4.2.2.1.0-2135-hadoop2, rc073b7932d00bf7c27980d7581b071891f12234f, Fri Dec 19 00:07:18 EST 2014
hbase(main):001:0> list
TABLE
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/usr/hdp/2.2.1.0-2135/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/usr/hdp/2.2.1.0-2135/zookeeper/lib/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
0 row(s) in 1.5220 seconds
=> []
hbase(main):002:0> status 'detailed'
version 0.98.4.2.2.1.0-2135-hadoop2
0 regionsInTransition
master coprocessors: []
4 live servers
hor15n09.gq1.ygridcore.net:59277 1419021705763
requestsPerSecond=0.0, numberOfOnlineRegions=0, usedHeapMB=159, maxHeapMB=1004, numberOfStores=0, numberOfStorefiles=0, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0, rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
hor15n12.gq1.ygridcore.net:33899 1419021705311
requestsPerSecond=0.0, numberOfOnlineRegions=1, usedHeapMB=19, maxHeapMB=1004, numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=831, writeRequestsCount=2, rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
"hbase:meta,,1"
numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=831, writeRequestsCount=2, rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
hor15n22.gq1.ygridcore.net:57754 1419021704639
requestsPerSecond=0.0, numberOfOnlineRegions=0, usedHeapMB=59, maxHeapMB=1004, numberOfStores=0, numberOfStorefiles=0, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=0, writeRequestsCount=0, rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
hor15n11.gq1.ygridcore.net:57488 1419021704587
requestsPerSecond=0.0, numberOfOnlineRegions=1, usedHeapMB=143, maxHeapMB=1004, numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=6, writeRequestsCount=2, rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN, coprocessors=[]
"hbase:namespace,,1419021710724.990f96cd1264f8995e567a2c9a148006."
numberOfStores=1, numberOfStorefiles=1, storefileUncompressedSizeMB=0, storefileSizeMB=0, memstoreSizeMB=0, storefileIndexSizeMB=0, readRequestsCount=6, writeRequestsCount=2, rootIndexSizeKB=0, totalStaticIndexSizeKB=0, totalStaticBloomSizeKB=0, totalCompactingKVs=0, currentCompactedKVs=0, compactionProgressPct=NaN
0 dead servers
hbase(main):003:0> quit
{code}
> Create wrapper script for hbase which retrieves hbase-site.xml from running cluster
> -----------------------------------------------------------------------------------
>
> Key: SLIDER-734
> URL: https://issues.apache.org/jira/browse/SLIDER-734
> Project: Slider
> Issue Type: Task
> Reporter: Ted Yu
> Assignee: Ted Yu
>
> The wrapper accepts slider-instance-name as parameter and does the following:
> Clone hbase conf directory to $HOME/slider-instance-name/conf
> Retrieve hbase-site.xml from Slider registry and save into the above directory
> Activate hbase shell using the above directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)