You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Guido Serra aka Zeph (JIRA)" <ji...@apache.org> on 2012/12/13 18:08:12 UTC
[jira] [Resolved] (WHIRR-686) hbase cluster answers (to a client
connecting from the internet) with internal AWS addresses
[ https://issues.apache.org/jira/browse/WHIRR-686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Guido Serra aka Zeph resolved WHIRR-686.
----------------------------------------
Resolution: Won't Fix
k, closing as Won't Fix
it is not an issue related to WHIRR
It is known, and solely related to HBase :(
- http://hbase.apache.org/book.html#trouble.ec2.connection
> hbase cluster answers (to a client connecting from the internet) with internal AWS addresses
> --------------------------------------------------------------------------------------------
>
> Key: WHIRR-686
> URL: https://issues.apache.org/jira/browse/WHIRR-686
> Project: Whirr
> Issue Type: Bug
> Environment: Pentaho's pdi-ce-4.4.0
> CDH4 on AWS's infrastructure
> Reporter: Guido Serra aka Zeph
> Attachments: debug_dump.log
>
>
> I created a cluster with the default settings from https://svn.apache.org/repos/asf/whirr/trunk/recipes/hbase-cdh.properties
> Then, opened the Data-Integration client from Pentaho,
> and created a New Transformation > Big Data > Hbase Output
> - http://wiki.pentaho.com/display/BAD/Loading+Data+into+HBase
> (I had started the client via command line, to obtain the logs below)
> bq. INFO 13-12 15:34:08,408 - Session establishment complete on server ec2-XX-XX-XX-XX.eu-west-1.compute.amazonaws.com/XXX.XXX.XXX.XXX:2181, sessionid = 0x13b947912cf003b, negotiated timeout = 40000
> bq. java.net.UnknownHostException: unknown host: ip-XX-XX-XX-XX.eu-west-1.compute.internal
> ...the full stacktrace:
> {code}
> INFO 13-12 15:34:08,284 - Initiating client connection, connectString=ec2-XX-XX-XX-XX.eu-west-1.compute.amazonaws.com:2181 sessionTimeout=180000 watcher=hconnection
> INFO 13-12 15:34:08,285 - Opening socket connection to server /176.34.212.37:2181
> INFO 13-12 15:34:08,285 - The identifier of this process is 97895@v1.local
> WARN 13-12 15:34:08,321 - SecurityException: java.lang.SecurityException: Unable to locate a login configuration occurred when trying to find JAAS configuration.
> INFO 13-12 15:34:08,321 - Client will not SASL-authenticate because the default JAAS configuration section 'Client' could not be found. If you are not using SASL, you may ignore this. On the other hand, if you expected SASL to work, please fix your JAAS configuration.
> INFO 13-12 15:34:08,363 - Socket connection established to ec2-XX-XX-XX-XX.eu-west-1.compute.amazonaws.com/XXX.XXX.XXX.XXX:2181, initiating session
> INFO 13-12 15:34:08,408 - Session establishment complete on server ec2-XX-XX-XX-XX.eu-west-1.compute.amazonaws.com/XXX.XXX.XXX.XXX:2181, sessionid = 0x13b947912cf003b, negotiated timeout = 40000
> INFO 13-12 15:34:24,670 - getMaster attempt 0 of 10 failed; retrying after sleep of 1000
> java.net.UnknownHostException: unknown host: ip-XX-XX-XX-XX.eu-west-1.compute.internal
> at org.apache.hadoop.hbase.ipc.HBaseClient$Connection.<init>(HBaseClient.java:227)
> at org.apache.hadoop.hbase.ipc.HBaseClient.getConnection(HBaseClient.java:1035)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:897)
> at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
> at $Proxy20.getProtocolVersion(Unknown Source)
> at org.apache.hadoop.hbase.ipc.WritableRpcEngine.getProxy(WritableRpcEngine.java:183)
> at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:303)
> at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:280)
> at org.apache.hadoop.hbase.ipc.HBaseRPC.getProxy(HBaseRPC.java:332)
> at org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation.getMaster(HConnectionManager.java:642)
> at org.apache.hadoop.hbase.client.HBaseAdmin.<init>(HBaseAdmin.java:106)
> at org.pentaho.hbase.shim.common.CommonHBaseConnection.configureConnection(CommonHBaseConnection.java:135)
> at org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputData.getHBaseConnection(HBaseOutputData.java:102)
> at org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog.getHBaseConnection(HBaseOutputDialog.java:784)
> at org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog.setupMappedTableNames(HBaseOutputDialog.java:796)
> at org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog.access$1300(HBaseOutputDialog.java:77)
> at org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog$9.widgetSelected(HBaseOutputDialog.java:436)
> at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:240)
> at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
> at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4128)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1457)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1480)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1465)
> at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1270)
> at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3974)
> at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3613)
> at org.pentaho.di.trans.steps.hbaseoutput.HBaseOutputDialog.open(HBaseOutputDialog.java:628)
> at org.pentaho.di.ui.spoon.delegates.SpoonStepsDelegate.editStep(SpoonStepsDelegate.java:136)
> at org.pentaho.di.ui.spoon.Spoon.editStep(Spoon.java:7835)
> at org.pentaho.di.ui.spoon.trans.TransGraph.editStep(TransGraph.java:2749)
> at org.pentaho.di.ui.spoon.trans.TransGraph.mouseDoubleClick(TransGraph.java:705)
> at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:195)
> at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
> at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4128)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1457)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1480)
> at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1465)
> at org.eclipse.swt.widgets.Widget.notifyListeners(Widget.java:1270)
> at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:3974)
> at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3613)
> at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1221)
> at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7044)
> at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8304)
> at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:580)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at apple.launcher.LaunchRunner.run(LaunchRunner.java:116)
> at apple.launcher.LaunchRunner.callMain(LaunchRunner.java:51)
> at apple.launcher.JavaApplicationLauncher.launch(JavaApplicationLauncher.java:52)
> {code}
> is it a configuration issue? (of the configuration created by WHIRR?)
> p.s. "zkCli -server public-ip:2181" works like a charme... but not the hbase shell
> bq. ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times
> {code}
> v1:Desktop zeph$ export HBASE_CONF_DIR=$(pwd)
> v1:Desktop zeph$ hbase shell
> HBase Shell; enter 'help<RETURN>' for list of supported commands.
> Type "exit<RETURN>" to leave the HBase Shell
> Version 0.94.2, r1395367, Sun Oct 7 19:11:01 UTC 2012
> 1.9.3-p194 :001 > status
> 2012-12-13 17:55:01.952 java[98520:1903] Unable to load realm info from SCDynamicStore
> ERROR: org.apache.hadoop.hbase.MasterNotRunningException: Retried 7 times
> Here is some help for this command:
> Show cluster status. Can be 'summary', 'simple', or 'detailed'. The
> default is 'summary'. Examples:
> hbase> status
> hbase> status 'simple'
> hbase> status 'summary'
> hbase> status 'detailed'
> 1.9.3-p194 :002 >
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira