You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by Akash Ashok <th...@gmail.com> on 2012/01/01 18:01:53 UTC

Re: Error starting HBase cluster thru Whirr !

Hi Andrei,
Does it try to connect back to the system from which Whirr is run by any
chance? I am not aware as to why reverse DNS resolution happens in this
case. But if its tries to connect back that doesn't work as my system is
behind a NAT.

I am asking this because the cluster launch fails during
"Authorizing firewall ingress to [us-east-1/i-aec053cc] on ports [2181] for
[122.172.3.56/32]"

If its trying to establish  a connection then even if the DNS resolution
part is fixed, it would fail when it tries to connect during the subsequent
steps right ?

Cheers,
Akash A


On Sat, Dec 31, 2011 at 1:50 PM, Andrei Savu <sa...@gmail.com> wrote:

> I think that when reverse DNS resolution fails we should just return the
> raw IP address. What do you think?
> On Dec 31, 2011 2:08 AM, "Akash Ashok" <th...@gmail.com> wrote:
>
> > I have filed an issue for this
> >
> > https://issues.apache.org/jira/browse/WHIRR-459
> >
> > Cheers,
> > AKash A
> >
> > On Fri, Dec 30, 2011 at 11:12 AM, Andrei Savu <
> > andrei.savu@cloudsoftcorp.com
> > > wrote:
> >
> > > Please file an issue. It looks like a DNS failure and we should do a
> > better
> > > job at handling this.
> > > On Dec 30, 2011 5:37 AM, "Akash Ashok" <th...@gmail.com> wrote:
> > >
> > > > Looping In Whirr Dev.
> > > > Is there a patch available for the below issue ? If not can I file a
> > > JIRA ?
> > > >
> > > > Cheers,
> > > > Akash A
> > > >
> > > > On Tue, Dec 27, 2011 at 10:44 AM, Akash Ashok <
> thehellmaker@gmail.com
> > > > >wrote:
> > > >
> > > > > Hi All,
> > > > > I am trying to launch a hbase cluter. It creates the cluster but
> > fails
> > > > > which configuring the security configurations. Could some1 please
> > help
> > > me
> > > > > out with this ?
> > > > >
> > > > > [akash@localhost whirr-0.7.0]$ bin/whirr launch-cluster --config
> > > > > hbase-ec2.properties
> > > > > Bootstrapping cluster
> > > > > Configuring template
> > > > > Configuring template
> > > > > Starting 1 node(s) with roles [zookeeper, hadoop-namenode,
> > > > > hadoop-jobtracker, hbase-master]
> > > > > Starting 2 node(s) with roles [hadoop-datanode, hadoop-tasktracker,
> > > > > hbase-regionserver]
> > > > > Nodes started: [[id=us-east-1/i-5890203a, providerId=i-5890203a,
> > > > > group=hbase, name=hbase-5890203a, location=[id=us-east-1c,
> > scope=ZONE,
> > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > os=[name=null,
> > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > >
> > > >
> > >
> >
> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > state=RUNNING, loginPort=22, hostname=domU-12-31-39-0F-94-D1,
> > > > > privateAddresses=[10.193.151.31],
> publicAddresses=[204.236.208.250],
> > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > processors=[[cores=8.0, speed=2.5]], ram=7168, volumes=[[id=null,
> > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > isBootDevice=true],
> > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false,
> > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > device=/dev/sdc,
> > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> size=420.0,
> > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > type=LOCAL,
> > > > > size=420.0, device=/dev/sde, durable=false, isBootDevice=false]],
> > > > >
> > > >
> > >
> >
> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-5890203a},
> > > tags=[]]]
> > > > > Nodes started: [[id=us-east-1/i-54902036, providerId=i-54902036,
> > > > > group=hbase, name=hbase-54902036, location=[id=us-east-1c,
> > scope=ZONE,
> > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > os=[name=null,
> > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > >
> > > >
> > >
> >
> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > state=RUNNING, loginPort=22, hostname=ip-10-7-29-242,
> > > > > privateAddresses=[10.7.29.242], publicAddresses=[75.101.240.254],
> > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > processors=[[cores=8.0, speed=2.5]], ram=7168, volumes=[[id=null,
> > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > isBootDevice=true],
> > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false,
> > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > device=/dev/sdc,
> > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> size=420.0,
> > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > type=LOCAL,
> > > > > size=420.0, device=/dev/sde, durable=false, isBootDevice=false]],
> > > > >
> > > >
> > >
> >
> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-54902036},
> > > tags=[]],
> > > > > [id=us-east-1/i-5a902038, providerId=i-5a902038, group=hbase,
> > > > > name=hbase-5a902038, location=[id=us-east-1c, scope=ZONE,
> > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > os=[name=null,
> > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > >
> > > >
> > >
> >
> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > state=RUNNING, loginPort=22, hostname=ip-10-108-182-53,
> > > > > privateAddresses=[10.108.182.53], publicAddresses=[50.16.48.211],
> > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > processors=[[cores=8.0, speed=2.5]], ram=7168, volumes=[[id=null,
> > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > isBootDevice=true],
> > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false,
> > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > device=/dev/sdc,
> > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> size=420.0,
> > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > type=LOCAL,
> > > > > size=420.0, device=/dev/sde, durable=false, isBootDevice=false]],
> > > > >
> > > >
> > >
> >
> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-5a902038},
> > > tags=[]]]
> > > > > Authorizing firewall ingress to [us-east-1/i-5890203a] on ports
> > [2181]
> > > > for
> > > > > [122.172.0.45/32]
> > > > > Unable to start the cluster. Terminating all nodes.
> > > > > org.apache.whirr.net.DnsException: java.net.ConnectException:
> > > Connection
> > > > > refused
> > > > >     at
> > > > org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:83)
> > > > >     at
> > > > org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:40)
> > > > >     at
> > > > >
> org.apache.whirr.Cluster$Instance.getPublicHostName(Cluster.java:112)
> > > > >     at
> > > > org.apache.whirr.Cluster$Instance.getPublicAddress(Cluster.java:94)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler.doBeforeConfigure(HadoopNameNodeClusterActionHandler.java:58)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:86)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > Caused by: java.net.ConnectException: Connection refused
> > > > >     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > > > >     at
> > > > >
> > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
> > > > >     at org.xbill.DNS.TCPClient.connect(TCPClient.java:30)
> > > > >     at org.xbill.DNS.TCPClient.sendrecv(TCPClient.java:118)
> > > > >     at org.xbill.DNS.SimpleResolver.send(SimpleResolver.java:254)
> > > > >     at
> > > > >
> > >
> org.xbill.DNS.ExtendedResolver$Resolution.start(ExtendedResolver.java:95)
> > > > >     at
> org.xbill.DNS.ExtendedResolver.send(ExtendedResolver.java:358)
> > > > >     at
> > > > org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:69)
> > > > >     ... 11 more
> > > > > Unable to load cluster state, assuming it has no running nodes.
> > > > > java.io.FileNotFoundException: /home/akash/.whirr/hbase/instances
> (No
> > > > such
> > > > > file or directory)
> > > > >     at java.io.FileInputStream.open(Native Method)
> > > > >     at java.io.FileInputStream.<init>(FileInputStream.java:137)
> > > > >     at com.google.common.io.Files$1.getInput(Files.java:100)
> > > > >     at com.google.common.io.Files$1.getInput(Files.java:97)
> > > > >     at
> > com.google.common.io.CharStreams$2.getInput(CharStreams.java:91)
> > > > >     at
> > com.google.common.io.CharStreams$2.getInput(CharStreams.java:88)
> > > > >     at
> > com.google.common.io.CharStreams.readLines(CharStreams.java:306)
> > > > >     at com.google.common.io.Files.readLines(Files.java:580)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.state.FileClusterStateStore.load(FileClusterStateStore.java:54)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.state.ClusterStateStore.tryLoadOrEmpty(ClusterStateStore.java:58)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.ClusterController.destroyCluster(ClusterController.java:143)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:118)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > Starting to run scripts on cluster for phase destroyinstances:
> > > > > Starting to run scripts on cluster for phase destroyinstances:
> > > > > Finished running destroy phase scripts on all cluster instances
> > > > > Destroying hbase cluster
> > > > > Cluster hbase destroyed
> > > > > Exception in thread "main" java.lang.RuntimeException:
> > > > > org.apache.whirr.net.DnsException: java.net.ConnectException:
> > > Connection
> > > > > refused
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:125)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > Caused by: org.apache.whirr.net.DnsException:
> > > java.net.ConnectException:
> > > > > Connection refused
> > > > >     at
> > > > org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:83)
> > > > >     at
> > > > org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:40)
> > > > >     at
> > > > >
> org.apache.whirr.Cluster$Instance.getPublicHostName(Cluster.java:112)
> > > > >     at
> > > > org.apache.whirr.Cluster$Instance.getPublicAddress(Cluster.java:94)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler.doBeforeConfigure(HadoopNameNodeClusterActionHandler.java:58)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:86)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
> > > > >     at
> > > > >
> > > >
> > >
> >
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
> > > > >     ... 3 more
> > > > > Caused by: java.net.ConnectException: Connection refused
> > > > >     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > > > >     at
> > > > >
> > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
> > > > >     at org.xbill.DNS.TCPClient.connect(TCPClient.java:30)
> > > > >     at org.xbill.DNS.TCPClient.sendrecv(TCPClient.java:118)
> > > > >     at org.xbill.DNS.SimpleResolver.send(SimpleResolver.java:254)
> > > > >     at
> > > > >
> > >
> org.xbill.DNS.ExtendedResolver$Resolution.start(ExtendedResolver.java:95)
> > > > >     at
> org.xbill.DNS.ExtendedResolver.send(ExtendedResolver.java:358)
> > > > >     at
> > > > org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:69)
> > > > >     ... 11 more
> > > > >
> > > > > Cheers,
> > > > > Akash A
> > > > >
> > > >
> > >
> >
>

Re: Error starting HBase cluster thru Whirr !

Posted by Andrei Savu <sa...@gmail.com>.
Attached a patch to https://issues.apache.org/jira/browse/WHIRR-421 that
removes the NullPointerException.

-- Andrei Savu

On Wed, Jan 4, 2012 at 9:40 PM, Andrei Savu <sa...@gmail.com> wrote:

> Quick update: I'm getting the NullPointerException on trunk when running
> the Hadoop integration tests. I will start to track down the change that
> added this bug.
>
> -- Andrei Savu
>
>
> On Wed, Jan 4, 2012 at 5:51 PM, Andrei Savu <sa...@gmail.com> wrote:
>
>> FYI I am now running the integration tests for Hadoop & HBase - I suspect
>> something is broken in trunk.
>>
>>
>> On Wed, Jan 4, 2012 at 12:29 PM, Akash Ashok <th...@gmail.com>wrote:
>>
>>> I am using Amazon. And I have absolutely no other code changes. Yes
>>> getNodeMetadata is returning null as u said. Any idea ?
>>>
>>> On Wed, Jan 4, 2012 at 3:52 PM, Andrei Savu <sa...@gmail.com>
>>> wrote:
>>>
>>> > On Wed, Jan 4, 2012 at 4:30 AM, Akash Ashok <th...@gmail.com>
>>> > wrote:
>>> >
>>> > > Unable to start the cluster. Terminating all nodes.
>>> > > java.lang.NullPointerException
>>> > >        at
>>> > >
>>> > >
>>> >
>>> org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduceConfiguration(HadoopConfigurationBuilder.java:113)
>>> >
>>> >
>>> > It should be impossible to get this exception. Do you have other code
>>> > changes? I think getNodeMetadata() returns null. Are you testing on
>>> Amazon
>>> > or using BYON?
>>> >
>>>
>>
>>
>

Re: Error starting HBase cluster thru Whirr !

Posted by Andrei Savu <sa...@gmail.com>.
Quick update: I'm getting the NullPointerException on trunk when running
the Hadoop integration tests. I will start to track down the change that
added this bug.

-- Andrei Savu

On Wed, Jan 4, 2012 at 5:51 PM, Andrei Savu <sa...@gmail.com> wrote:

> FYI I am now running the integration tests for Hadoop & HBase - I suspect
> something is broken in trunk.
>
>
> On Wed, Jan 4, 2012 at 12:29 PM, Akash Ashok <th...@gmail.com>wrote:
>
>> I am using Amazon. And I have absolutely no other code changes. Yes
>> getNodeMetadata is returning null as u said. Any idea ?
>>
>> On Wed, Jan 4, 2012 at 3:52 PM, Andrei Savu <sa...@gmail.com>
>> wrote:
>>
>> > On Wed, Jan 4, 2012 at 4:30 AM, Akash Ashok <th...@gmail.com>
>> > wrote:
>> >
>> > > Unable to start the cluster. Terminating all nodes.
>> > > java.lang.NullPointerException
>> > >        at
>> > >
>> > >
>> >
>> org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduceConfiguration(HadoopConfigurationBuilder.java:113)
>> >
>> >
>> > It should be impossible to get this exception. Do you have other code
>> > changes? I think getNodeMetadata() returns null. Are you testing on
>> Amazon
>> > or using BYON?
>> >
>>
>
>

Re: Error starting HBase cluster thru Whirr !

Posted by Andrei Savu <sa...@gmail.com>.
FYI I am now running the integration tests for Hadoop & HBase - I suspect
something is broken in trunk.

On Wed, Jan 4, 2012 at 12:29 PM, Akash Ashok <th...@gmail.com> wrote:

> I am using Amazon. And I have absolutely no other code changes. Yes
> getNodeMetadata is returning null as u said. Any idea ?
>
> On Wed, Jan 4, 2012 at 3:52 PM, Andrei Savu <sa...@gmail.com> wrote:
>
> > On Wed, Jan 4, 2012 at 4:30 AM, Akash Ashok <th...@gmail.com>
> > wrote:
> >
> > > Unable to start the cluster. Terminating all nodes.
> > > java.lang.NullPointerException
> > >        at
> > >
> > >
> >
> org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduceConfiguration(HadoopConfigurationBuilder.java:113)
> >
> >
> > It should be impossible to get this exception. Do you have other code
> > changes? I think getNodeMetadata() returns null. Are you testing on
> Amazon
> > or using BYON?
> >
>

Re: Error starting HBase cluster thru Whirr !

Posted by Akash Ashok <th...@gmail.com>.
I am using Amazon. And I have absolutely no other code changes. Yes
getNodeMetadata is returning null as u said. Any idea ?

On Wed, Jan 4, 2012 at 3:52 PM, Andrei Savu <sa...@gmail.com> wrote:

> On Wed, Jan 4, 2012 at 4:30 AM, Akash Ashok <th...@gmail.com>
> wrote:
>
> > Unable to start the cluster. Terminating all nodes.
> > java.lang.NullPointerException
> >        at
> >
> >
> org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduceConfiguration(HadoopConfigurationBuilder.java:113)
>
>
> It should be impossible to get this exception. Do you have other code
> changes? I think getNodeMetadata() returns null. Are you testing on Amazon
> or using BYON?
>

Re: Error starting HBase cluster thru Whirr !

Posted by Andrei Savu <sa...@gmail.com>.
On Wed, Jan 4, 2012 at 4:30 AM, Akash Ashok <th...@gmail.com> wrote:

> Unable to start the cluster. Terminating all nodes.
> java.lang.NullPointerException
>        at
>
> org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduceConfiguration(HadoopConfigurationBuilder.java:113)


It should be impossible to get this exception. Do you have other code
changes? I think getNodeMetadata() returns null. Are you testing on Amazon
or using BYON?

Re: Error starting HBase cluster thru Whirr !

Posted by Akash Ashok <th...@gmail.com>.
Hi Andrei,
I changed it to return the hostIP if the DNSResolution fails. The
Authorization went fine after that but another exception was thrown. Just
figuring out if the issue is because of this change.

Authorizing firewall ingress to [us-east-1/i-7e9af91c] on ports [2181] for [
122.172.3.56/32]
Authorizing firewall ingress to [us-east-1/i-7e9af91c] on ports [50070] for
[122.172.3.56/32]
Authorizing firewall ingress to [us-east-1/i-7e9af91c] on ports [8020,
8021] for [50.16.100.176/32]
Unable to start the cluster. Terminating all nodes.
java.lang.NullPointerException
        at
org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduceConfiguration(HadoopConfigurationBuilder.java:113)
        at
org.apache.whirr.service.hadoop.HadoopConfigurationBuilder.buildMapReduce(HadoopConfigurationBuilder.java:71)
        at
org.apache.whirr.service.hadoop.HadoopClusterActionHandler.createHadoopConfigFiles(HadoopClusterActionHandler.java:102)
        at
org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:88)
        at
org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
        at
org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
        at
org.apache.whirr.ClusterController.configureServices(ClusterController.java:148)
        at
org.apache.whirr.ClusterController.launchCluster(ClusterController.java:110)
        at
org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
        at org.apache.whirr.cli.Main.run(Main.java:64)
        at org.apache.whirr.cli.Main.main(Main.java:97)
Finished running destroy phase scripts on all cluster instances

Cheers,
Akash A

On Mon, Jan 2, 2012 at 9:50 PM, Akash Ashok <th...@gmail.com> wrote:

>
>
> On Mon, Jan 2, 2012 at 12:45 AM, Andrei Savu <sa...@gmail.com>wrote:
>
>> On Jan 1, 2012 7:02 PM, "Akash Ashok" <th...@gmail.com> wrote:
>> >
>> > Hi Andrei,
>> > Does it try to connect back to the system from which Whirr is run by any
>> > chance? I am not aware as to why reverse DNS resolution happens in this
>> > case. But if its tries to connect back that doesn't work as my system is
>> > behind a NAT.
>>
>> No. We are using the hostnames only for configuration.
>>
>> >
>> > I am asking this because the cluster launch fails during
>> > "Authorizing firewall ingress to [us-east-1/i-aec053cc] on ports [2181]
>> for
>> > [122.172.3.56/32]"
>>
>> It should not fail.
>>
>> >
>> > If its trying to establish  a connection then even if the DNS resolution
>> > part is fixed, it would fail when it tries to connect during the
>> subsequent
>> > steps right ?
>>
>> If there is no known hostname Hbase may not start (not sure)
>>
>> Hmmm. HBase cluster is starting fine. But after creating the cluster,
> because of the exception it is destroying the cluster. Will take a deeper
> look into this.
>
>> >
>> > Cheers,
>> > Akash A
>> >
>> >
>> > On Sat, Dec 31, 2011 at 1:50 PM, Andrei Savu <sa...@gmail.com>
>> wrote:
>> >
>> > > I think that when reverse DNS resolution fails we should just return
>> the
>> > > raw IP address. What do you think?
>> > > On Dec 31, 2011 2:08 AM, "Akash Ashok" <th...@gmail.com>
>> wrote:
>> > >
>> > > > I have filed an issue for this
>> > > >
>> > > > https://issues.apache.org/jira/browse/WHIRR-459
>> > > >
>> > > > Cheers,
>> > > > AKash A
>> > > >
>> > > > On Fri, Dec 30, 2011 at 11:12 AM, Andrei Savu <
>> > > > andrei.savu@cloudsoftcorp.com
>> > > > > wrote:
>> > > >
>> > > > > Please file an issue. It looks like a DNS failure and we should
>> do a
>> > > > better
>> > > > > job at handling this.
>> > > > > On Dec 30, 2011 5:37 AM, "Akash Ashok" <th...@gmail.com>
>> wrote:
>> > > > >
>> > > > > > Looping In Whirr Dev.
>> > > > > > Is there a patch available for the below issue ? If not can I
>> file a
>> > > > > JIRA ?
>> > > > > >
>> > > > > > Cheers,
>> > > > > > Akash A
>> > > > > >
>> > > > > > On Tue, Dec 27, 2011 at 10:44 AM, Akash Ashok <
>> > > thehellmaker@gmail.com
>> > > > > > >wrote:
>> > > > > >
>> > > > > > > Hi All,
>> > > > > > > I am trying to launch a hbase cluter. It creates the cluster
>> but
>> > > > fails
>> > > > > > > which configuring the security configurations. Could some1
>> please
>> > > > help
>> > > > > me
>> > > > > > > out with this ?
>> > > > > > >
>> > > > > > > [akash@localhost whirr-0.7.0]$ bin/whirr launch-cluster
>> --config
>> > > > > > > hbase-ec2.properties
>> > > > > > > Bootstrapping cluster
>> > > > > > > Configuring template
>> > > > > > > Configuring template
>> > > > > > > Starting 1 node(s) with roles [zookeeper, hadoop-namenode,
>> > > > > > > hadoop-jobtracker, hbase-master]
>> > > > > > > Starting 2 node(s) with roles [hadoop-datanode,
>> hadoop-tasktracker,
>> > > > > > > hbase-regionserver]
>> > > > > > > Nodes started: [[id=us-east-1/i-5890203a,
>> providerId=i-5890203a,
>> > > > > > > group=hbase, name=hbase-5890203a, location=[id=us-east-1c,
>> > > > scope=ZONE,
>> > > > > > > description=us-east-1c, parent=us-east-1,
>> iso3166Codes=[US-VA],
>> > > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
>> > > > os=[name=null,
>> > > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
>> > > > > > > state=RUNNING, loginPort=22, hostname=domU-12-31-39-0F-94-D1,
>> > > > > > > privateAddresses=[10.193.151.31],
>> > > publicAddresses=[204.236.208.250],
>> > > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
>> > > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
>> volumes=[[id=null,
>> > > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
>> > > > > > isBootDevice=true],
>> > > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
>> durable=false,
>> > > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
>> > > > device=/dev/sdc,
>> > > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
>> > > size=420.0,
>> > > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
>> > > > > > type=LOCAL,
>> > > > > > > size=420.0, device=/dev/sde, durable=false,
>> isBootDevice=false]],
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
>> > > > > > > tags=[]], loginUser=ubuntu,
>> userMetadata={Name=hbase-5890203a},
>> > > > > tags=[]]]
>> > > > > > > Nodes started: [[id=us-east-1/i-54902036,
>> providerId=i-54902036,
>> > > > > > > group=hbase, name=hbase-54902036, location=[id=us-east-1c,
>> > > > scope=ZONE,
>> > > > > > > description=us-east-1c, parent=us-east-1,
>> iso3166Codes=[US-VA],
>> > > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
>> > > > os=[name=null,
>> > > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
>> > > > > > > state=RUNNING, loginPort=22, hostname=ip-10-7-29-242,
>> > > > > > > privateAddresses=[10.7.29.242],
>> publicAddresses=[75.101.240.254],
>> > > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
>> > > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
>> volumes=[[id=null,
>> > > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
>> > > > > > isBootDevice=true],
>> > > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
>> durable=false,
>> > > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
>> > > > device=/dev/sdc,
>> > > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
>> > > size=420.0,
>> > > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
>> > > > > > type=LOCAL,
>> > > > > > > size=420.0, device=/dev/sde, durable=false,
>> isBootDevice=false]],
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
>> > > > > > > tags=[]], loginUser=ubuntu,
>> userMetadata={Name=hbase-54902036},
>> > > > > tags=[]],
>> > > > > > > [id=us-east-1/i-5a902038, providerId=i-5a902038, group=hbase,
>> > > > > > > name=hbase-5a902038, location=[id=us-east-1c, scope=ZONE,
>> > > > > > > description=us-east-1c, parent=us-east-1,
>> iso3166Codes=[US-VA],
>> > > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
>> > > > os=[name=null,
>> > > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
>> > > > > > > state=RUNNING, loginPort=22, hostname=ip-10-108-182-53,
>> > > > > > > privateAddresses=[10.108.182.53],
>> publicAddresses=[50.16.48.211],
>> > > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
>> > > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
>> volumes=[[id=null,
>> > > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
>> > > > > > isBootDevice=true],
>> > > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
>> durable=false,
>> > > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
>> > > > device=/dev/sdc,
>> > > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
>> > > size=420.0,
>> > > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
>> > > > > > type=LOCAL,
>> > > > > > > size=420.0, device=/dev/sde, durable=false,
>> isBootDevice=false]],
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
>> > > > > > > tags=[]], loginUser=ubuntu,
>> userMetadata={Name=hbase-5a902038},
>> > > > > tags=[]]]
>> > > > > > > Authorizing firewall ingress to [us-east-1/i-5890203a] on
>> ports
>> > > > [2181]
>> > > > > > for
>> > > > > > > [122.172.0.45/32]
>> > > > > > > Unable to start the cluster. Terminating all nodes.
>> > > > > > > org.apache.whirr.net.DnsException: java.net.ConnectException:
>> > > > > Connection
>> > > > > > > refused
>> > > > > > >     at
>> > > > > >
>> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:83)
>> > > > > > >     at
>> > > > > >
>> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:40)
>> > > > > > >     at
>> > > > > > >
>> > > org.apache.whirr.Cluster$Instance.getPublicHostName(Cluster.java:112)
>> > > > > > >     at
>> > > > > >
>> org.apache.whirr.Cluster$Instance.getPublicAddress(Cluster.java:94)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler.doBeforeConfigure(HadoopNameNodeClusterActionHandler.java:58)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:86)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
>> > > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
>> > > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
>> > > > > > > Caused by: java.net.ConnectException: Connection refused
>> > > > > > >     at sun.nio.ch.SocketChannelImpl.checkConnect(Native
>> Method)
>> > > > > > >     at
>> > > > > > >
>> > > >
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
>> > > > > > >     at org.xbill.DNS.TCPClient.connect(TCPClient.java:30)
>> > > > > > >     at org.xbill.DNS.TCPClient.sendrecv(TCPClient.java:118)
>> > > > > > >     at
>> org.xbill.DNS.SimpleResolver.send(SimpleResolver.java:254)
>> > > > > > >     at
>> > > > > > >
>> > > > >
>> > >
>> org.xbill.DNS.ExtendedResolver$Resolution.start(ExtendedResolver.java:95)
>> > > > > > >     at
>> > > org.xbill.DNS.ExtendedResolver.send(ExtendedResolver.java:358)
>> > > > > > >     at
>> > > > > >
>> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:69)
>> > > > > > >     ... 11 more
>> > > > > > > Unable to load cluster state, assuming it has no running
>> nodes.
>> > > > > > > java.io.FileNotFoundException:
>> /home/akash/.whirr/hbase/instances
>> > > (No
>> > > > > > such
>> > > > > > > file or directory)
>> > > > > > >     at java.io.FileInputStream.open(Native Method)
>> > > > > > >     at
>> java.io.FileInputStream.<init>(FileInputStream.java:137)
>> > > > > > >     at com.google.common.io.Files$1.getInput(Files.java:100)
>> > > > > > >     at com.google.common.io.Files$1.getInput(Files.java:97)
>> > > > > > >     at
>> > > > com.google.common.io.CharStreams$2.getInput(CharStreams.java:91)
>> > > > > > >     at
>> > > > com.google.common.io.CharStreams$2.getInput(CharStreams.java:88)
>> > > > > > >     at
>> > > > com.google.common.io.CharStreams.readLines(CharStreams.java:306)
>> > > > > > >     at com.google.common.io.Files.readLines(Files.java:580)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.state.FileClusterStateStore.load(FileClusterStateStore.java:54)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.state.ClusterStateStore.tryLoadOrEmpty(ClusterStateStore.java:58)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.ClusterController.destroyCluster(ClusterController.java:143)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:118)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
>> > > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
>> > > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
>> > > > > > > Starting to run scripts on cluster for phase destroyinstances:
>> > > > > > > Starting to run scripts on cluster for phase destroyinstances:
>> > > > > > > Finished running destroy phase scripts on all cluster
>> instances
>> > > > > > > Destroying hbase cluster
>> > > > > > > Cluster hbase destroyed
>> > > > > > > Exception in thread "main" java.lang.RuntimeException:
>> > > > > > > org.apache.whirr.net.DnsException: java.net.ConnectException:
>> > > > > Connection
>> > > > > > > refused
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:125)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
>> > > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
>> > > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
>> > > > > > > Caused by: org.apache.whirr.net.DnsException:
>> > > > > java.net.ConnectException:
>> > > > > > > Connection refused
>> > > > > > >     at
>> > > > > >
>> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:83)
>> > > > > > >     at
>> > > > > >
>> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:40)
>> > > > > > >     at
>> > > > > > >
>> > > org.apache.whirr.Cluster$Instance.getPublicHostName(Cluster.java:112)
>> > > > > > >     at
>> > > > > >
>> org.apache.whirr.Cluster$Instance.getPublicAddress(Cluster.java:94)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler.doBeforeConfigure(HadoopNameNodeClusterActionHandler.java:58)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:86)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
>> > > > > > >     at
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
>> > > > > > >     ... 3 more
>> > > > > > > Caused by: java.net.ConnectException: Connection refused
>> > > > > > >     at sun.nio.ch.SocketChannelImpl.checkConnect(Native
>> Method)
>> > > > > > >     at
>> > > > > > >
>> > > >
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
>> > > > > > >     at org.xbill.DNS.TCPClient.connect(TCPClient.java:30)
>> > > > > > >     at org.xbill.DNS.TCPClient.sendrecv(TCPClient.java:118)
>> > > > > > >     at
>> org.xbill.DNS.SimpleResolver.send(SimpleResolver.java:254)
>> > > > > > >     at
>> > > > > > >
>> > > > >
>> > >
>> org.xbill.DNS.ExtendedResolver$Resolution.start(ExtendedResolver.java:95)
>> > > > > > >     at
>> > > org.xbill.DNS.ExtendedResolver.send(ExtendedResolver.java:358)
>> > > > > > >     at
>> > > > > >
>> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:69)
>> > > > > > >     ... 11 more
>> > > > > > >
>> > > > > > > Cheers,
>> > > > > > > Akash A
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>>
>
>

Re: Error starting HBase cluster thru Whirr !

Posted by Akash Ashok <th...@gmail.com>.
On Mon, Jan 2, 2012 at 12:45 AM, Andrei Savu <sa...@gmail.com> wrote:

> On Jan 1, 2012 7:02 PM, "Akash Ashok" <th...@gmail.com> wrote:
> >
> > Hi Andrei,
> > Does it try to connect back to the system from which Whirr is run by any
> > chance? I am not aware as to why reverse DNS resolution happens in this
> > case. But if its tries to connect back that doesn't work as my system is
> > behind a NAT.
>
> No. We are using the hostnames only for configuration.
>
> >
> > I am asking this because the cluster launch fails during
> > "Authorizing firewall ingress to [us-east-1/i-aec053cc] on ports [2181]
> for
> > [122.172.3.56/32]"
>
> It should not fail.
>
> >
> > If its trying to establish  a connection then even if the DNS resolution
> > part is fixed, it would fail when it tries to connect during the
> subsequent
> > steps right ?
>
> If there is no known hostname Hbase may not start (not sure)
>
> Hmmm. HBase cluster is starting fine. But after creating the cluster,
because of the exception it is destroying the cluster. Will take a deeper
look into this.

> >
> > Cheers,
> > Akash A
> >
> >
> > On Sat, Dec 31, 2011 at 1:50 PM, Andrei Savu <sa...@gmail.com>
> wrote:
> >
> > > I think that when reverse DNS resolution fails we should just return
> the
> > > raw IP address. What do you think?
> > > On Dec 31, 2011 2:08 AM, "Akash Ashok" <th...@gmail.com> wrote:
> > >
> > > > I have filed an issue for this
> > > >
> > > > https://issues.apache.org/jira/browse/WHIRR-459
> > > >
> > > > Cheers,
> > > > AKash A
> > > >
> > > > On Fri, Dec 30, 2011 at 11:12 AM, Andrei Savu <
> > > > andrei.savu@cloudsoftcorp.com
> > > > > wrote:
> > > >
> > > > > Please file an issue. It looks like a DNS failure and we should do
> a
> > > > better
> > > > > job at handling this.
> > > > > On Dec 30, 2011 5:37 AM, "Akash Ashok" <th...@gmail.com>
> wrote:
> > > > >
> > > > > > Looping In Whirr Dev.
> > > > > > Is there a patch available for the below issue ? If not can I
> file a
> > > > > JIRA ?
> > > > > >
> > > > > > Cheers,
> > > > > > Akash A
> > > > > >
> > > > > > On Tue, Dec 27, 2011 at 10:44 AM, Akash Ashok <
> > > thehellmaker@gmail.com
> > > > > > >wrote:
> > > > > >
> > > > > > > Hi All,
> > > > > > > I am trying to launch a hbase cluter. It creates the cluster
> but
> > > > fails
> > > > > > > which configuring the security configurations. Could some1
> please
> > > > help
> > > > > me
> > > > > > > out with this ?
> > > > > > >
> > > > > > > [akash@localhost whirr-0.7.0]$ bin/whirr launch-cluster
> --config
> > > > > > > hbase-ec2.properties
> > > > > > > Bootstrapping cluster
> > > > > > > Configuring template
> > > > > > > Configuring template
> > > > > > > Starting 1 node(s) with roles [zookeeper, hadoop-namenode,
> > > > > > > hadoop-jobtracker, hbase-master]
> > > > > > > Starting 2 node(s) with roles [hadoop-datanode,
> hadoop-tasktracker,
> > > > > > > hbase-regionserver]
> > > > > > > Nodes started: [[id=us-east-1/i-5890203a,
> providerId=i-5890203a,
> > > > > > > group=hbase, name=hbase-5890203a, location=[id=us-east-1c,
> > > > scope=ZONE,
> > > > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > > > os=[name=null,
> > > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > > > state=RUNNING, loginPort=22, hostname=domU-12-31-39-0F-94-D1,
> > > > > > > privateAddresses=[10.193.151.31],
> > > publicAddresses=[204.236.208.250],
> > > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
> volumes=[[id=null,
> > > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > > > isBootDevice=true],
> > > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
> durable=false,
> > > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > > > device=/dev/sdc,
> > > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> > > size=420.0,
> > > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > > > type=LOCAL,
> > > > > > > size=420.0, device=/dev/sde, durable=false,
> isBootDevice=false]],
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-5890203a},
> > > > > tags=[]]]
> > > > > > > Nodes started: [[id=us-east-1/i-54902036,
> providerId=i-54902036,
> > > > > > > group=hbase, name=hbase-54902036, location=[id=us-east-1c,
> > > > scope=ZONE,
> > > > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > > > os=[name=null,
> > > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > > > state=RUNNING, loginPort=22, hostname=ip-10-7-29-242,
> > > > > > > privateAddresses=[10.7.29.242],
> publicAddresses=[75.101.240.254],
> > > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
> volumes=[[id=null,
> > > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > > > isBootDevice=true],
> > > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
> durable=false,
> > > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > > > device=/dev/sdc,
> > > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> > > size=420.0,
> > > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > > > type=LOCAL,
> > > > > > > size=420.0, device=/dev/sde, durable=false,
> isBootDevice=false]],
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-54902036},
> > > > > tags=[]],
> > > > > > > [id=us-east-1/i-5a902038, providerId=i-5a902038, group=hbase,
> > > > > > > name=hbase-5a902038, location=[id=us-east-1c, scope=ZONE,
> > > > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > > > os=[name=null,
> > > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > > > state=RUNNING, loginPort=22, hostname=ip-10-108-182-53,
> > > > > > > privateAddresses=[10.108.182.53],
> publicAddresses=[50.16.48.211],
> > > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
> volumes=[[id=null,
> > > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > > > isBootDevice=true],
> > > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
> durable=false,
> > > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > > > device=/dev/sdc,
> > > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> > > size=420.0,
> > > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > > > type=LOCAL,
> > > > > > > size=420.0, device=/dev/sde, durable=false,
> isBootDevice=false]],
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-5a902038},
> > > > > tags=[]]]
> > > > > > > Authorizing firewall ingress to [us-east-1/i-5890203a] on ports
> > > > [2181]
> > > > > > for
> > > > > > > [122.172.0.45/32]
> > > > > > > Unable to start the cluster. Terminating all nodes.
> > > > > > > org.apache.whirr.net.DnsException: java.net.ConnectException:
> > > > > Connection
> > > > > > > refused
> > > > > > >     at
> > > > > >
> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:83)
> > > > > > >     at
> > > > > >
> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:40)
> > > > > > >     at
> > > > > > >
> > > org.apache.whirr.Cluster$Instance.getPublicHostName(Cluster.java:112)
> > > > > > >     at
> > > > > >
> org.apache.whirr.Cluster$Instance.getPublicAddress(Cluster.java:94)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler.doBeforeConfigure(HadoopNameNodeClusterActionHandler.java:58)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:86)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > > > Caused by: java.net.ConnectException: Connection refused
> > > > > > >     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > > > > > >     at
> > > > > > >
> > > >
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
> > > > > > >     at org.xbill.DNS.TCPClient.connect(TCPClient.java:30)
> > > > > > >     at org.xbill.DNS.TCPClient.sendrecv(TCPClient.java:118)
> > > > > > >     at
> org.xbill.DNS.SimpleResolver.send(SimpleResolver.java:254)
> > > > > > >     at
> > > > > > >
> > > > >
> > >
> org.xbill.DNS.ExtendedResolver$Resolution.start(ExtendedResolver.java:95)
> > > > > > >     at
> > > org.xbill.DNS.ExtendedResolver.send(ExtendedResolver.java:358)
> > > > > > >     at
> > > > > >
> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:69)
> > > > > > >     ... 11 more
> > > > > > > Unable to load cluster state, assuming it has no running nodes.
> > > > > > > java.io.FileNotFoundException:
> /home/akash/.whirr/hbase/instances
> > > (No
> > > > > > such
> > > > > > > file or directory)
> > > > > > >     at java.io.FileInputStream.open(Native Method)
> > > > > > >     at java.io.FileInputStream.<init>(FileInputStream.java:137)
> > > > > > >     at com.google.common.io.Files$1.getInput(Files.java:100)
> > > > > > >     at com.google.common.io.Files$1.getInput(Files.java:97)
> > > > > > >     at
> > > > com.google.common.io.CharStreams$2.getInput(CharStreams.java:91)
> > > > > > >     at
> > > > com.google.common.io.CharStreams$2.getInput(CharStreams.java:88)
> > > > > > >     at
> > > > com.google.common.io.CharStreams.readLines(CharStreams.java:306)
> > > > > > >     at com.google.common.io.Files.readLines(Files.java:580)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.state.FileClusterStateStore.load(FileClusterStateStore.java:54)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.state.ClusterStateStore.tryLoadOrEmpty(ClusterStateStore.java:58)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.ClusterController.destroyCluster(ClusterController.java:143)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:118)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > > > Starting to run scripts on cluster for phase destroyinstances:
> > > > > > > Starting to run scripts on cluster for phase destroyinstances:
> > > > > > > Finished running destroy phase scripts on all cluster instances
> > > > > > > Destroying hbase cluster
> > > > > > > Cluster hbase destroyed
> > > > > > > Exception in thread "main" java.lang.RuntimeException:
> > > > > > > org.apache.whirr.net.DnsException: java.net.ConnectException:
> > > > > Connection
> > > > > > > refused
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:125)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > > > Caused by: org.apache.whirr.net.DnsException:
> > > > > java.net.ConnectException:
> > > > > > > Connection refused
> > > > > > >     at
> > > > > >
> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:83)
> > > > > > >     at
> > > > > >
> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:40)
> > > > > > >     at
> > > > > > >
> > > org.apache.whirr.Cluster$Instance.getPublicHostName(Cluster.java:112)
> > > > > > >     at
> > > > > >
> org.apache.whirr.Cluster$Instance.getPublicAddress(Cluster.java:94)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler.doBeforeConfigure(HadoopNameNodeClusterActionHandler.java:58)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:86)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
> > > > > > >     at
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
> > > > > > >     ... 3 more
> > > > > > > Caused by: java.net.ConnectException: Connection refused
> > > > > > >     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > > > > > >     at
> > > > > > >
> > > >
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
> > > > > > >     at org.xbill.DNS.TCPClient.connect(TCPClient.java:30)
> > > > > > >     at org.xbill.DNS.TCPClient.sendrecv(TCPClient.java:118)
> > > > > > >     at
> org.xbill.DNS.SimpleResolver.send(SimpleResolver.java:254)
> > > > > > >     at
> > > > > > >
> > > > >
> > >
> org.xbill.DNS.ExtendedResolver$Resolution.start(ExtendedResolver.java:95)
> > > > > > >     at
> > > org.xbill.DNS.ExtendedResolver.send(ExtendedResolver.java:358)
> > > > > > >     at
> > > > > >
> org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:69)
> > > > > > >     ... 11 more
> > > > > > >
> > > > > > > Cheers,
> > > > > > > Akash A
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
>

Re: Error starting HBase cluster thru Whirr !

Posted by Andrei Savu <sa...@gmail.com>.
On Jan 1, 2012 7:02 PM, "Akash Ashok" <th...@gmail.com> wrote:
>
> Hi Andrei,
> Does it try to connect back to the system from which Whirr is run by any
> chance? I am not aware as to why reverse DNS resolution happens in this
> case. But if its tries to connect back that doesn't work as my system is
> behind a NAT.

No. We are using the hostnames only for configuration.

>
> I am asking this because the cluster launch fails during
> "Authorizing firewall ingress to [us-east-1/i-aec053cc] on ports [2181]
for
> [122.172.3.56/32]"

It should not fail.

>
> If its trying to establish  a connection then even if the DNS resolution
> part is fixed, it would fail when it tries to connect during the
subsequent
> steps right ?

If there is no known hostname Hbase may not start (not sure)

>
> Cheers,
> Akash A
>
>
> On Sat, Dec 31, 2011 at 1:50 PM, Andrei Savu <sa...@gmail.com>
wrote:
>
> > I think that when reverse DNS resolution fails we should just return the
> > raw IP address. What do you think?
> > On Dec 31, 2011 2:08 AM, "Akash Ashok" <th...@gmail.com> wrote:
> >
> > > I have filed an issue for this
> > >
> > > https://issues.apache.org/jira/browse/WHIRR-459
> > >
> > > Cheers,
> > > AKash A
> > >
> > > On Fri, Dec 30, 2011 at 11:12 AM, Andrei Savu <
> > > andrei.savu@cloudsoftcorp.com
> > > > wrote:
> > >
> > > > Please file an issue. It looks like a DNS failure and we should do a
> > > better
> > > > job at handling this.
> > > > On Dec 30, 2011 5:37 AM, "Akash Ashok" <th...@gmail.com>
wrote:
> > > >
> > > > > Looping In Whirr Dev.
> > > > > Is there a patch available for the below issue ? If not can I
file a
> > > > JIRA ?
> > > > >
> > > > > Cheers,
> > > > > Akash A
> > > > >
> > > > > On Tue, Dec 27, 2011 at 10:44 AM, Akash Ashok <
> > thehellmaker@gmail.com
> > > > > >wrote:
> > > > >
> > > > > > Hi All,
> > > > > > I am trying to launch a hbase cluter. It creates the cluster but
> > > fails
> > > > > > which configuring the security configurations. Could some1
please
> > > help
> > > > me
> > > > > > out with this ?
> > > > > >
> > > > > > [akash@localhost whirr-0.7.0]$ bin/whirr launch-cluster --config
> > > > > > hbase-ec2.properties
> > > > > > Bootstrapping cluster
> > > > > > Configuring template
> > > > > > Configuring template
> > > > > > Starting 1 node(s) with roles [zookeeper, hadoop-namenode,
> > > > > > hadoop-jobtracker, hbase-master]
> > > > > > Starting 2 node(s) with roles [hadoop-datanode,
hadoop-tasktracker,
> > > > > > hbase-regionserver]
> > > > > > Nodes started: [[id=us-east-1/i-5890203a, providerId=i-5890203a,
> > > > > > group=hbase, name=hbase-5890203a, location=[id=us-east-1c,
> > > scope=ZONE,
> > > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > > os=[name=null,
> > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > > >
> > > > >
> > > >
> > >
> >
description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > > state=RUNNING, loginPort=22, hostname=domU-12-31-39-0F-94-D1,
> > > > > > privateAddresses=[10.193.151.31],
> > publicAddresses=[204.236.208.250],
> > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
volumes=[[id=null,
> > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > > isBootDevice=true],
> > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
durable=false,
> > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > > device=/dev/sdc,
> > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> > size=420.0,
> > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > > type=LOCAL,
> > > > > > size=420.0, device=/dev/sde, durable=false,
isBootDevice=false]],
> > > > > >
> > > > >
> > > >
> > >
> >
supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-5890203a},
> > > > tags=[]]]
> > > > > > Nodes started: [[id=us-east-1/i-54902036, providerId=i-54902036,
> > > > > > group=hbase, name=hbase-54902036, location=[id=us-east-1c,
> > > scope=ZONE,
> > > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > > os=[name=null,
> > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > > >
> > > > >
> > > >
> > >
> >
description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > > state=RUNNING, loginPort=22, hostname=ip-10-7-29-242,
> > > > > > privateAddresses=[10.7.29.242],
publicAddresses=[75.101.240.254],
> > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
volumes=[[id=null,
> > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > > isBootDevice=true],
> > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
durable=false,
> > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > > device=/dev/sdc,
> > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> > size=420.0,
> > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > > type=LOCAL,
> > > > > > size=420.0, device=/dev/sde, durable=false,
isBootDevice=false]],
> > > > > >
> > > > >
> > > >
> > >
> >
supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-54902036},
> > > > tags=[]],
> > > > > > [id=us-east-1/i-5a902038, providerId=i-5a902038, group=hbase,
> > > > > > name=hbase-5a902038, location=[id=us-east-1c, scope=ZONE,
> > > > > > description=us-east-1c, parent=us-east-1, iso3166Codes=[US-VA],
> > > > > > metadata={}], uri=null, imageId=us-east-1/ami-da0cf8b3,
> > > os=[name=null,
> > > > > > family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true,
> > > > > >
> > > > >
> > > >
> > >
> >
description=ubuntu-images-us/ubuntu-lucid-10.04-amd64-server-20101020.manifest.xml],
> > > > > > state=RUNNING, loginPort=22, hostname=ip-10-108-182-53,
> > > > > > privateAddresses=[10.108.182.53],
publicAddresses=[50.16.48.211],
> > > > > > hardware=[id=c1.xlarge, providerId=c1.xlarge, name=null,
> > > > > > processors=[[cores=8.0, speed=2.5]], ram=7168,
volumes=[[id=null,
> > > > > > type=LOCAL, size=10.0, device=/dev/sda1, durable=false,
> > > > > isBootDevice=true],
> > > > > > [id=null, type=LOCAL, size=420.0, device=/dev/sdb,
durable=false,
> > > > > > isBootDevice=false], [id=null, type=LOCAL, size=420.0,
> > > device=/dev/sdc,
> > > > > > durable=false, isBootDevice=false], [id=null, type=LOCAL,
> > size=420.0,
> > > > > > device=/dev/sdd, durable=false, isBootDevice=false], [id=null,
> > > > > type=LOCAL,
> > > > > > size=420.0, device=/dev/sde, durable=false,
isBootDevice=false]],
> > > > > >
> > > > >
> > > >
> > >
> >
supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()),
> > > > > > tags=[]], loginUser=ubuntu, userMetadata={Name=hbase-5a902038},
> > > > tags=[]]]
> > > > > > Authorizing firewall ingress to [us-east-1/i-5890203a] on ports
> > > [2181]
> > > > > for
> > > > > > [122.172.0.45/32]
> > > > > > Unable to start the cluster. Terminating all nodes.
> > > > > > org.apache.whirr.net.DnsException: java.net.ConnectException:
> > > > Connection
> > > > > > refused
> > > > > >     at
> > > > >
org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:83)
> > > > > >     at
> > > > >
org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:40)
> > > > > >     at
> > > > > >
> > org.apache.whirr.Cluster$Instance.getPublicHostName(Cluster.java:112)
> > > > > >     at
> > > > >
org.apache.whirr.Cluster$Instance.getPublicAddress(Cluster.java:94)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler.doBeforeConfigure(HadoopNameNodeClusterActionHandler.java:58)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:86)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > > Caused by: java.net.ConnectException: Connection refused
> > > > > >     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > > > > >     at
> > > > > >
> > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
> > > > > >     at org.xbill.DNS.TCPClient.connect(TCPClient.java:30)
> > > > > >     at org.xbill.DNS.TCPClient.sendrecv(TCPClient.java:118)
> > > > > >     at
org.xbill.DNS.SimpleResolver.send(SimpleResolver.java:254)
> > > > > >     at
> > > > > >
> > > >
> >
org.xbill.DNS.ExtendedResolver$Resolution.start(ExtendedResolver.java:95)
> > > > > >     at
> > org.xbill.DNS.ExtendedResolver.send(ExtendedResolver.java:358)
> > > > > >     at
> > > > >
org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:69)
> > > > > >     ... 11 more
> > > > > > Unable to load cluster state, assuming it has no running nodes.
> > > > > > java.io.FileNotFoundException:
/home/akash/.whirr/hbase/instances
> > (No
> > > > > such
> > > > > > file or directory)
> > > > > >     at java.io.FileInputStream.open(Native Method)
> > > > > >     at java.io.FileInputStream.<init>(FileInputStream.java:137)
> > > > > >     at com.google.common.io.Files$1.getInput(Files.java:100)
> > > > > >     at com.google.common.io.Files$1.getInput(Files.java:97)
> > > > > >     at
> > > com.google.common.io.CharStreams$2.getInput(CharStreams.java:91)
> > > > > >     at
> > > com.google.common.io.CharStreams$2.getInput(CharStreams.java:88)
> > > > > >     at
> > > com.google.common.io.CharStreams.readLines(CharStreams.java:306)
> > > > > >     at com.google.common.io.Files.readLines(Files.java:580)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.state.FileClusterStateStore.load(FileClusterStateStore.java:54)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.state.ClusterStateStore.tryLoadOrEmpty(ClusterStateStore.java:58)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.ClusterController.destroyCluster(ClusterController.java:143)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.ClusterController.launchCluster(ClusterController.java:118)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > > Starting to run scripts on cluster for phase destroyinstances:
> > > > > > Starting to run scripts on cluster for phase destroyinstances:
> > > > > > Finished running destroy phase scripts on all cluster instances
> > > > > > Destroying hbase cluster
> > > > > > Cluster hbase destroyed
> > > > > > Exception in thread "main" java.lang.RuntimeException:
> > > > > > org.apache.whirr.net.DnsException: java.net.ConnectException:
> > > > Connection
> > > > > > refused
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.ClusterController.launchCluster(ClusterController.java:125)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.java:63)
> > > > > >     at org.apache.whirr.cli.Main.run(Main.java:64)
> > > > > >     at org.apache.whirr.cli.Main.main(Main.java:97)
> > > > > > Caused by: org.apache.whirr.net.DnsException:
> > > > java.net.ConnectException:
> > > > > > Connection refused
> > > > > >     at
> > > > >
org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:83)
> > > > > >     at
> > > > >
org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:40)
> > > > > >     at
> > > > > >
> > org.apache.whirr.Cluster$Instance.getPublicHostName(Cluster.java:112)
> > > > > >     at
> > > > >
org.apache.whirr.Cluster$Instance.getPublicAddress(Cluster.java:94)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler.doBeforeConfigure(HadoopNameNodeClusterActionHandler.java:58)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.service.hadoop.HadoopClusterActionHandler.beforeConfigure(HadoopClusterActionHandler.java:86)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.service.ClusterActionHandlerSupport.beforeAction(ClusterActionHandlerSupport.java:53)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedClusterAction.java:100)
> > > > > >     at
> > > > > >
> > > > >
> > > >
> > >
> >
org.apache.whirr.ClusterController.launchCluster(ClusterController.java:109)
> > > > > >     ... 3 more
> > > > > > Caused by: java.net.ConnectException: Connection refused
> > > > > >     at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> > > > > >     at
> > > > > >
> > > sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:592)
> > > > > >     at org.xbill.DNS.TCPClient.connect(TCPClient.java:30)
> > > > > >     at org.xbill.DNS.TCPClient.sendrecv(TCPClient.java:118)
> > > > > >     at
org.xbill.DNS.SimpleResolver.send(SimpleResolver.java:254)
> > > > > >     at
> > > > > >
> > > >
> >
org.xbill.DNS.ExtendedResolver$Resolution.start(ExtendedResolver.java:95)
> > > > > >     at
> > org.xbill.DNS.ExtendedResolver.send(ExtendedResolver.java:358)
> > > > > >     at
> > > > >
org.apache.whirr.net.FastDnsResolver.apply(FastDnsResolver.java:69)
> > > > > >     ... 11 more
> > > > > >
> > > > > > Cheers,
> > > > > > Akash A
> > > > > >
> > > > >
> > > >
> > >
> >