You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@whirr.apache.org by pr...@nokia.com on 2011/01/19 15:32:31 UTC
Starting up hadoop cluster programatically
Hi all,
I am trying to create a cluster dynamically using a Java Program. I wrote a program similar to HadoopServiceController in trunk code. I also added proxy information as system property (since I am inside my company network). I saw the cluster got created but the configuration fails. Here is the output. I am sure I am missing the proxy details somewhere else.
I set proxy details as follows:
System.setProperty("http.proxyHost", "xxx.xxx.com");
System.setProperty("http.proxyPort", "xxxx");
System.setProperty("https.proxyHost", "xxx.xxx.com");
System.setProperty("https.proxyPort", "xxxx");
Here is the output:
INFO: Starting up cluster...
Jan 18, 2011 3:29:02 PM org.apache.whirr.cluster.actions.BootstrapClusterAction doAction
INFO: Bootstrapping cluster
Jan 18, 2011 3:29:03 PM org.apache.whirr.cluster.actions.BootstrapClusterAction buildTemplate
INFO: Configuring template
Jan 18, 2011 3:29:08 PM org.apache.whirr.cluster.actions.BootstrapClusterAction$1 call
INFO: Starting 1 node(s) with roles [tt, dn]
Jan 18, 2011 3:29:08 PM org.apache.whirr.cluster.actions.BootstrapClusterAction buildTemplate
INFO: Configuring template
Jan 18, 2011 3:29:11 PM org.apache.whirr.cluster.actions.BootstrapClusterAction$1 call
INFO: Starting 1 node(s) with roles [jt, nn]
<< problem applying options to node(556284):
org.jclouds.ssh.SshException: root@184.106.155.148:22: Error connecting to session.
at org.jclouds.ssh.jsch.JschSshClient.propagate(JschSshClient.java:250)
at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:200)
at org.jclouds.compute.util.ComputeUtils.runCallablesOnNode(ComputeUtils.java:202)
at org.jclouds.compute.util.ComputeUtils.runOptionsOnNode(ComputeUtils.java:151)
at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:116)
at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:112)
at org.jclouds.compute.strategy.impl.EncodeTagIntoNameRunNodesAndAddToSetStrategy$1.call(EncodeTagIntoNameRunNodesAndAddToSetStrategy.java:93)
at org.jclouds.compute.strategy.impl.EncodeTagIntoNameRunNodesAndAddToSetStrategy$1.call(EncodeTagIntoNameRunNodesAndAddToSetStrategy.java:86)
at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
at java.util.concurrent.FutureTask.run(FutureTask.java:138)
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
at java.lang.Thread.run(Thread.java:619)
Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out
at com.jcraft.jsch.Util.createSocket(Util.java:386)
at com.jcraft.jsch.Session.connect(Session.java:182)
at com.jcraft.jsch.Session.connect(Session.java:150)
at org.jclouds.ssh.jsch.JschSshClient.newSession(JschSshClient.java:245)
at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:184)
... 11 more