You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@whirr.apache.org by Chiradeep Vittal <Ch...@citrix.com> on 2012/05/12 03:23:12 UTC

using Whirr against a private CloudStack cloud

I downloaded whirr-0.7.1 and am trying to use it against my local
CloudStack cloud

Using the following properties:
whirr.cluster-name=myhadoopcluster
whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode,1
hadoop-datanode+hadoop-tasktracker
whirr.provider=cloudstack
whirr.identity=g18eyMc_jFmUE_O_oUUAU0robciruCL2y3spxfrTX0nB7fXpcFMW8FT8I_IX
kzkwoA0aczSS7vpXvZ-xPh_Pbw
whirr.credential=I2wJdAaT43FTkOvcVPj6LSVnvOaUN1mqOYzaJnSjzFnPRHcCjL9GDZh8sR
SiFSpDWtLaA8z7x-aedA7it5EmHA
whirr.private-key-file=${sys:user.home}/.ssh/id_rsa
whirr.public-key-file=${sys:user.home}/.ssh/id_rsa.pub
whirr.cluster-user=hadooper
whirr.image-id=f1c4f628-9ad1-415a-b3a5-0755cdc507b0
whirr.hardware-id=1d5d2b53-428d-46d2-b3e8-3c0ba5d7e555
jclouds.endpoint=10.10.10.10:8080/client

I get an exception
Unable to start the cluster. Terminating all nodes.
com.google.common.collect.ComputationException:
java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.jclouds.cloudstack.CloudStackContextBuilder
	at 
com.google.common.collect.ComputingConcurrentHashMap$ComputingMapAdapter.ge
t(ComputingConcurrentHashMap.java:397)
	at org.apache.whirr.service.ComputeCache.apply(ComputeCache.java:66)
	at org.apache.whirr.service.ComputeCache.apply(ComputeCache.java:58)
	at 
org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedCluste
rAction.java:89)
	at 
org.apache.whirr.ClusterController.launchCluster(ClusterController.java:106
)
	at 
org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.
java:63)
	at org.apache.whirr.cli.Main.run(Main.java:64)
	at org.apache.whirr.cli.Main.main(Main.java:97)



Clearly jclouds made the mapping from "cloudstack" -> CloudStack, so it
has some knowledge of CloudStack.
Any further tips on debugging this issue?
Classpath looks like this:
~/source/apache-whirr/whirr-0.7.1/bin/../conf/:~/source/apache-whirr/whirr-
0.7.1/bin/..:~/source/apache-whirr/whirr-0.7.1/bin/../lib/*

I can't install trunk -- a bunch of tests (starting with HadoopDryRunTest)
fail on mvn install.
But I guess that's a separate email.
--
Chiradeep





Re: using Whirr against a private CloudStack cloud

Posted by Andrei Savu <sa...@gmail.com>.
You are right. Another option is to use the BYON (bring your own nodes)
provider.
On May 12, 2012 6:19 PM, "Chiradeep Vittal" <Ch...@citrix.com>
wrote:

> CloudStack 3.0
> I finally got trunk to install. It looks like jclouds does not support
> CloudStack 3.0 yet
>
> --
> Chiradeep
>
> On May 12, 2012, at 5:26, "Andrei Savu" <sa...@gmail.com> wrote:
>
> What version of Cloudstack are you running?
>
> Also you are going to need Whirr trunk with jclouds 1.4.0.
>
> We've done no testing on Cloudstack but with a few changes it should work.
>
> -- Andrei Savu / axemblr.com / Tools for Clouds
>
> On Sat, May 12, 2012 at 4:23 AM, Chiradeep Vittal <
> Chiradeep.Vittal@citrix.com> wrote:
>
>> I downloaded whirr-0.7.1 and am trying to use it against my local
>> CloudStack cloud
>>
>> Using the following properties:
>> whirr.cluster-name=myhadoopcluster
>> whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode,1
>> hadoop-datanode+hadoop-tasktracker
>> whirr.provider=cloudstack
>>
>> whirr.identity=g18eyMc_jFmUE_O_oUUAU0robciruCL2y3spxfrTX0nB7fXpcFMW8FT8I_IX
>> kzkwoA0aczSS7vpXvZ-xPh_Pbw
>>
>> whirr.credential=I2wJdAaT43FTkOvcVPj6LSVnvOaUN1mqOYzaJnSjzFnPRHcCjL9GDZh8sR
>> SiFSpDWtLaA8z7x-aedA7it5EmHA
>> whirr.private-key-file=${sys:user.home}/.ssh/id_rsa
>> whirr.public-key-file=${sys:user.home}/.ssh/id_rsa.pub
>> whirr.cluster-user=hadooper
>> whirr.image-id=f1c4f628-9ad1-415a-b3a5-0755cdc507b0
>> whirr.hardware-id=1d5d2b53-428d-46d2-b3e8-3c0ba5d7e555
>> jclouds.endpoint=10.10.10.10:8080/client
>>
>> I get an exception
>> Unable to start the cluster. Terminating all nodes.
>> com.google.common.collect.ComputationException:
>> java.lang.RuntimeException: java.lang.ClassNotFoundException:
>> org.jclouds.cloudstack.CloudStackContextBuilder
>>        at
>>
>> com.google.common.collect.ComputingConcurrentHashMap$ComputingMapAdapter.ge
>> t(ComputingConcurrentHashMap.java:397)
>>        at
>> org.apache.whirr.service.ComputeCache.apply(ComputeCache.java:66)
>>        at
>> org.apache.whirr.service.ComputeCache.apply(ComputeCache.java:58)
>>        at
>>
>> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedCluste
>> rAction.java:89)
>>        at
>>
>> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:106
>> )
>>        at
>>
>> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.
>> java:63)
>>        at org.apache.whirr.cli.Main.run(Main.java:64)
>>        at org.apache.whirr.cli.Main.main(Main.java:97)
>>
>>
>>
>> Clearly jclouds made the mapping from "cloudstack" -> CloudStack, so it
>> has some knowledge of CloudStack.
>> Any further tips on debugging this issue?
>> Classpath looks like this:
>>
>> ~/source/apache-whirr/whirr-0.7.1/bin/../conf/:~/source/apache-whirr/whirr-
>> 0.7.1/bin/..:~/source/apache-whirr/whirr-0.7.1/bin/../lib/*
>>
>> I can't install trunk -- a bunch of tests (starting with HadoopDryRunTest)
>> fail on mvn install.
>> But I guess that's a separate email.
>> --
>> Chiradeep
>>
>>
>>
>>
>>
>

Re: using Whirr against a private CloudStack cloud

Posted by Chiradeep Vittal <Ch...@citrix.com>.
CloudStack 3.0
I finally got trunk to install. It looks like jclouds does not support CloudStack 3.0 yet

--
Chiradeep

On May 12, 2012, at 5:26, "Andrei Savu" <sa...@gmail.com>> wrote:

What version of Cloudstack are you running?

Also you are going to need Whirr trunk with jclouds 1.4.0.

We've done no testing on Cloudstack but with a few changes it should work.

-- Andrei Savu / axemblr.com<http://axemblr.com/> / Tools for Clouds

On Sat, May 12, 2012 at 4:23 AM, Chiradeep Vittal <Ch...@citrix.com>> wrote:
I downloaded whirr-0.7.1 and am trying to use it against my local
CloudStack cloud

Using the following properties:
whirr.cluster-name=myhadoopcluster
whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode,1
hadoop-datanode+hadoop-tasktracker
whirr.provider=cloudstack
whirr.identity=g18eyMc_jFmUE_O_oUUAU0robciruCL2y3spxfrTX0nB7fXpcFMW8FT8I_IX
kzkwoA0aczSS7vpXvZ-xPh_Pbw
whirr.credential=I2wJdAaT43FTkOvcVPj6LSVnvOaUN1mqOYzaJnSjzFnPRHcCjL9GDZh8sR
SiFSpDWtLaA8z7x-aedA7it5EmHA
whirr.private-key-file=${sys:user.home}/.ssh/id_rsa
whirr.public-key-file=${sys:user.home}/.ssh/id_rsa.pub
whirr.cluster-user=hadooper
whirr.image-id=f1c4f628-9ad1-415a-b3a5-0755cdc507b0
whirr.hardware-id=1d5d2b53-428d-46d2-b3e8-3c0ba5d7e555
jclouds.endpoint=10.10.10.10:8080/client<http://10.10.10.10:8080/client>

I get an exception
Unable to start the cluster. Terminating all nodes.
com.google.common.collect.ComputationException:
java.lang.RuntimeException: java.lang.ClassNotFoundException:
org.jclouds.cloudstack.CloudStackContextBuilder
       at
com.google.common.collect.ComputingConcurrentHashMap$ComputingMapAdapter.ge
t(ComputingConcurrentHashMap.java:397)
       at org.apache.whirr.service.ComputeCache.apply(ComputeCache.java:66)
       at org.apache.whirr.service.ComputeCache.apply(ComputeCache.java:58)
       at
org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedCluste
rAction.java:89)
       at
org.apache.whirr.ClusterController.launchCluster(ClusterController.java:106
)
       at
org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.
java:63)
       at org.apache.whirr.cli.Main.run(Main.java:64)
       at org.apache.whirr.cli.Main.main(Main.java:97)



Clearly jclouds made the mapping from "cloudstack" -> CloudStack, so it
has some knowledge of CloudStack.
Any further tips on debugging this issue?
Classpath looks like this:
~/source/apache-whirr/whirr-0.7.1/bin/../conf/:~/source/apache-whirr/whirr-
0.7.1/bin/..:~/source/apache-whirr/whirr-0.7.1/bin/../lib/*

I can't install trunk -- a bunch of tests (starting with HadoopDryRunTest)
fail on mvn install.
But I guess that's a separate email.
--
Chiradeep






Re: using Whirr against a private CloudStack cloud

Posted by Andrei Savu <sa...@gmail.com>.
What version of Cloudstack are you running?

Also you are going to need Whirr trunk with jclouds 1.4.0.

We've done no testing on Cloudstack but with a few changes it should work.

-- Andrei Savu / axemblr.com / Tools for Clouds

On Sat, May 12, 2012 at 4:23 AM, Chiradeep Vittal <
Chiradeep.Vittal@citrix.com> wrote:

> I downloaded whirr-0.7.1 and am trying to use it against my local
> CloudStack cloud
>
> Using the following properties:
> whirr.cluster-name=myhadoopcluster
> whirr.instance-templates=1 hadoop-jobtracker+hadoop-namenode,1
> hadoop-datanode+hadoop-tasktracker
> whirr.provider=cloudstack
> whirr.identity=g18eyMc_jFmUE_O_oUUAU0robciruCL2y3spxfrTX0nB7fXpcFMW8FT8I_IX
> kzkwoA0aczSS7vpXvZ-xPh_Pbw
> whirr.credential=I2wJdAaT43FTkOvcVPj6LSVnvOaUN1mqOYzaJnSjzFnPRHcCjL9GDZh8sR
> SiFSpDWtLaA8z7x-aedA7it5EmHA
> whirr.private-key-file=${sys:user.home}/.ssh/id_rsa
> whirr.public-key-file=${sys:user.home}/.ssh/id_rsa.pub
> whirr.cluster-user=hadooper
> whirr.image-id=f1c4f628-9ad1-415a-b3a5-0755cdc507b0
> whirr.hardware-id=1d5d2b53-428d-46d2-b3e8-3c0ba5d7e555
> jclouds.endpoint=10.10.10.10:8080/client
>
> I get an exception
> Unable to start the cluster. Terminating all nodes.
> com.google.common.collect.ComputationException:
> java.lang.RuntimeException: java.lang.ClassNotFoundException:
> org.jclouds.cloudstack.CloudStackContextBuilder
>        at
> com.google.common.collect.ComputingConcurrentHashMap$ComputingMapAdapter.ge
> t(ComputingConcurrentHashMap.java:397)
>        at org.apache.whirr.service.ComputeCache.apply(ComputeCache.java:66)
>        at org.apache.whirr.service.ComputeCache.apply(ComputeCache.java:58)
>        at
> org.apache.whirr.actions.ScriptBasedClusterAction.execute(ScriptBasedCluste
> rAction.java:89)
>        at
> org.apache.whirr.ClusterController.launchCluster(ClusterController.java:106
> )
>        at
> org.apache.whirr.cli.command.LaunchClusterCommand.run(LaunchClusterCommand.
> java:63)
>        at org.apache.whirr.cli.Main.run(Main.java:64)
>        at org.apache.whirr.cli.Main.main(Main.java:97)
>
>
>
> Clearly jclouds made the mapping from "cloudstack" -> CloudStack, so it
> has some knowledge of CloudStack.
> Any further tips on debugging this issue?
> Classpath looks like this:
> ~/source/apache-whirr/whirr-0.7.1/bin/../conf/:~/source/apache-whirr/whirr-
> 0.7.1/bin/..:~/source/apache-whirr/whirr-0.7.1/bin/../lib/*
>
> I can't install trunk -- a bunch of tests (starting with HadoopDryRunTest)
> fail on mvn install.
> But I guess that's a separate email.
> --
> Chiradeep
>
>
>
>
>