You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@whirr.apache.org by pr...@nokia.com on 2011/01/19 15:32:31 UTC

Starting up hadoop cluster programatically

Hi all,
I am trying to create a cluster dynamically using a Java Program. I wrote a program similar to HadoopServiceController in trunk code. I also added proxy information as system property (since I am inside my company network). I saw the cluster got created but the configuration fails. Here is the output. I am sure I am missing the proxy details somewhere else.

I set proxy details as follows:
System.setProperty("http.proxyHost", "xxx.xxx.com");
        System.setProperty("http.proxyPort", "xxxx");
        System.setProperty("https.proxyHost", "xxx.xxx.com");
        System.setProperty("https.proxyPort", "xxxx");

Here is the output:

INFO: Starting up cluster...
Jan 18, 2011 3:29:02 PM org.apache.whirr.cluster.actions.BootstrapClusterAction doAction
INFO: Bootstrapping cluster
Jan 18, 2011 3:29:03 PM org.apache.whirr.cluster.actions.BootstrapClusterAction buildTemplate
INFO: Configuring template
Jan 18, 2011 3:29:08 PM org.apache.whirr.cluster.actions.BootstrapClusterAction$1 call
INFO: Starting 1 node(s) with roles [tt, dn]
Jan 18, 2011 3:29:08 PM org.apache.whirr.cluster.actions.BootstrapClusterAction buildTemplate
INFO: Configuring template
Jan 18, 2011 3:29:11 PM org.apache.whirr.cluster.actions.BootstrapClusterAction$1 call
INFO: Starting 1 node(s) with roles [jt, nn]
<< problem applying options to node(556284):
org.jclouds.ssh.SshException: root@184.106.155.148:22: Error connecting to session.
        at org.jclouds.ssh.jsch.JschSshClient.propagate(JschSshClient.java:250)
        at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:200)
        at org.jclouds.compute.util.ComputeUtils.runCallablesOnNode(ComputeUtils.java:202)
        at org.jclouds.compute.util.ComputeUtils.runOptionsOnNode(ComputeUtils.java:151)
        at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:116)
        at org.jclouds.compute.util.ComputeUtils$1.call(ComputeUtils.java:112)
        at org.jclouds.compute.strategy.impl.EncodeTagIntoNameRunNodesAndAddToSetStrategy$1.call(EncodeTagIntoNameRunNodesAndAddToSetStrategy.java:93)
        at org.jclouds.compute.strategy.impl.EncodeTagIntoNameRunNodesAndAddToSetStrategy$1.call(EncodeTagIntoNameRunNodesAndAddToSetStrategy.java:86)
        at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
        at java.util.concurrent.FutureTask.run(FutureTask.java:138)
        at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
        at java.lang.Thread.run(Thread.java:619)
Caused by: com.jcraft.jsch.JSchException: java.net.ConnectException: Connection timed out
        at com.jcraft.jsch.Util.createSocket(Util.java:386)
        at com.jcraft.jsch.Session.connect(Session.java:182)
        at com.jcraft.jsch.Session.connect(Session.java:150)
        at org.jclouds.ssh.jsch.JschSshClient.newSession(JschSshClient.java:245)
        at org.jclouds.ssh.jsch.JschSshClient.connect(JschSshClient.java:184)
        ... 11 more