You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Adrian Cole (JIRA)" <ji...@apache.org> on 2011/08/05 13:19:27 UTC
[jira] [Commented] (WHIRR-354) Upgrade to jclouds 1.1.0
[ https://issues.apache.org/jira/browse/WHIRR-354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13079908#comment-13079908 ]
Adrian Cole commented on WHIRR-354:
-----------------------------------
tested with HBase090ServiceTest
2011-08-05 12:04:15,953 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Starting up cluster...
2011-08-05 12:04:27,215 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Bootstrapping cluster
2011-08-05 12:04:28,803 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template
2011-08-05 12:04:35,784 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-2) Starting 1 node(s) with roles [hadoop-datanode, hadoop-tasktracker, hbase-regionserver]
2011-08-05 12:04:37,411 INFO [org.apache.whirr.actions.BootstrapClusterAction] (main) Configuring template
2011-08-05 12:04:44,015 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-4) Starting 1 node(s) with roles [hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver]
2011-08-05 12:09:40,804 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-2) Nodes started: [[id=us-east-1/i-87bcd9e6, providerId=i-87bcd9e6, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-04-2D-81, privateAddresses=[10.240.50.111], publicAddresses=[50.19.163.65], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-b42addde, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]]
2011-08-05 12:10:15,690 INFO [org.apache.whirr.actions.NodeStarter] (pool-5-thread-4) Nodes started: [[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]]
2011-08-05 12:10:22,008 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [50070, 50030] for [129.215.2.125/32]
2011-08-05 12:10:22,431 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [8020, 8021] for [50.17.126.6/32]
2011-08-05 12:10:22,967 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [2181] for [129.215.2.125/32]
2011-08-05 12:10:23,175 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Authorizing firewall
2011-08-05 12:10:23,265 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60010, 60000] for [129.215.2.125/32]
2011-08-05 12:10:23,732 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [9090] for [129.215.2.125/32]
2011-08-05 12:10:26,976 INFO [org.apache.whirr.service.FirewallManager] (main) Authorizing firewall ingress to [Instance{roles=[hadoop-namenode, hadoop-jobtracker, zookeeper, hbase-master, hbase-thriftserver], publicIp=50.17.126.6, privateIp=10.206.17.156, id=us-east-1/i-61bfda00, nodeMetadata=[id=us-east-1/i-61bfda00, providerId=i-61bfda00, group=hbaseclustertest, name=null, location=[id=us-east-1b, scope=ZONE, description=us-east-1b, parent=us-east-1, iso3166Codes=[US-VA], metadata={}], uri=null, imageId=us-east-1/ami-aef607c7, os=[name=null, family=ubuntu, version=10.04, arch=paravirtual, is64Bit=true, description=411009282317/RightImage_Ubuntu_10.04_x64_v5.6.8.1_EBS], state=RUNNING, loginPort=22, hostname=domU-12-31-39-14-12-52, privateAddresses=[10.206.17.156], publicAddresses=[50.17.126.6], hardware=[id=m1.large, providerId=m1.large, name=null, processors=[[cores=2.0, speed=2.0]], ram=7680, volumes=[[id=null, type=LOCAL, size=420.0, device=/dev/sdb, durable=false, isBootDevice=false], [id=null, type=LOCAL, size=420.0, device=/dev/sdc, durable=false, isBootDevice=false], [id=vol-822adde8, type=SAN, size=null, device=/dev/sda1, durable=true, isBootDevice=true]], supportsImage=And(ALWAYS_TRUE,Or(isWindows(),requiresVirtualizationType(paravirtual)),ALWAYS_TRUE,is64Bit()), tags=[]], loginUser=root, userMetadata={}, tags=[]]}] on ports [60030, 60020] for [129.215.2.125/32]
2011-08-05 12:10:29,036 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script
2011-08-05 12:10:49,802 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed
2011-08-05 12:10:53,871 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Running configuration script
2011-08-05 12:11:15,020 INFO [org.apache.whirr.actions.ConfigureClusterAction] (main) Configuration script run completed
2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Completed configuration of hbaseclustertest
2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Namenode web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com:50070
2011-08-05 12:11:15,020 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Jobtracker web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com:50030
2011-08-05 12:11:15,039 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop site file /Users/adriancole/.whirr/hbaseclustertest/hadoop-site.xml
2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hadoop.HadoopNameNodeClusterActionHandler] (main) Wrote Hadoop proxy script /Users/adriancole/.whirr/hbaseclustertest/hadoop-proxy.sh
2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Completed configuration of hbaseclustertest
2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.zookeeper.ZooKeeperClusterActionHandler] (main) Hosts: ec2-50-17-126-6.compute-1.amazonaws.com:2181
2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Completed configuration of hbaseclustertest
2011-08-05 12:11:15,042 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Web UI available at http://ec2-50-17-126-6.compute-1.amazonaws.com
2011-08-05 12:11:15,043 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase site file /Users/adriancole/.whirr/hbaseclustertest/hbase-site.xml
2011-08-05 12:11:15,043 INFO [org.apache.whirr.service.hbase.HBaseMasterClusterActionHandler] (main) Wrote HBase proxy script /Users/adriancole/.whirr/hbaseclustertest/hbase-proxy.sh
2011-08-05 12:11:15,236 INFO [org.apache.whirr.service.FileClusterStateStore] (main) Wrote instances file /Users/adriancole/.whirr/hbaseclustertest/instances
2011-08-05 12:11:15,313 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for master...
.Warning: Permanently added 'ec2-50-17-126-6.compute-1.amazonaws.com,50.17.126.6' (RSA) to the list of known hosts.
2011-08-05 12:11:16,569 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Connected to thrift server.
2011-08-05 12:11:16,570 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for .META. table...
2011-08-05 12:11:22,779 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Master reported in. Continuing.
2011-08-05 12:11:25,273 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Shutting down cluster...
2011-08-05 12:11:25,276 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Destroying hbaseclustertest cluster
2011-08-05 12:11:54,428 INFO [org.apache.whirr.actions.DestroyClusterAction] (main) Cluster hbaseclustertest destroyed
> Upgrade to jclouds 1.1.0
> ------------------------
>
> Key: WHIRR-354
> URL: https://issues.apache.org/jira/browse/WHIRR-354
> Project: Whirr
> Issue Type: Improvement
> Components: core
> Affects Versions: 0.6.0
> Reporter: Adrian Cole
> Assignee: Adrian Cole
> Fix For: 0.6.0
>
> Attachments: WHIRR-354.patch
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> jclouds 1.1.0 includes many features interesting to whirr including: a new provider (greenhousedata-element-vcloud), hostname support on nodes, stabilized ssh via the new sshj driver, new ec2 ingress rule syntax that allows you to specify group + port combinations, and templateBuilder parameter to prefer S3-backed amis.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira