You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@cloudstack.apache.org by Юрий Карпель <yu...@karpel.su> on 2016/01/19 14:57:37 UTC
S3, rados-gw error
CentOS7 + KVM + Ceph (RadosGW + RBD )
Endpoint: rgw-lb01.test.****.**
2016-01-19 16:56:11,099 INFO [c.a.h.AmazonHttpClient]
(s3-transfer-manager-worker-5:null) (logid:18c0d81c) Unable to execute HTTP
request: images.rgw-lb01.test.****.**: unknown error
java.net.UnknownHostException: images.rgw-lb01.cloud.bstelecom.ru: unknown
error
at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
at
java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
at java.net.InetAddress.getAllByName(InetAddress.java:1192)
at java.net.InetAddress.getAllByName(InetAddress.java:1126)
at
com.amazonaws.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:27)
at
com.amazonaws.http.DelegatingDnsResolver.resolve(DelegatingDnsResolver.java:38)
at
org.apache.http.impl.conn.DefaultClientConnectionOperator.resolveHostname(DefaultClientConnectionOperator.java:259)
at
org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:159)
at
org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
at
org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
at
org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
at
org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
at
org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
at
com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:769)
at
com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:506)
at
com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:318)
at
com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3595)
at
com.amazonaws.services.s3.AmazonS3Client.initiateMultipartUpload(AmazonS3Client.java:2588)
at
com.amazonaws.services.s3.transfer.internal.UploadCallable.initiateMultipartUpload(UploadCallable.java:350)
at
com.amazonaws.services.s3.transfer.internal.UploadCallable.uploadInParts(UploadCallable.java:178)
at
com.amazonaws.services.s3.transfer.internal.UploadCallable.call(UploadCallable.java:121)
at
com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:139)
at
com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:47)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745
Run s3test.py:
import boto
import boto.s3.connection
access_key = 'X08R0Z0O7WJWE18W95GB'
secret_key = 'bsc0wwH9nD5LEuiEi2EERQaGlTgUECD70cZQTlpA'
conn = boto.connect_s3(
aws_access_key_id = access_key,
aws_secret_access_key = secret_key,
host = 'rgw-lb01',
is_secure=False,
calling_format = boto.s3.connection.OrdinaryCallingFormat(),
)
buckets = conn.get_all_buckets()
for bucket in buckets:
print "{name}\t{created}".format(
name=bucket.name,
created=bucket.creation_date,
)
for key in bucket.list():
print "{name}\t{size}\t{modified}".format(
name=(key.name).encode('utf8'),
size=key.size,
modified=key.last_modified,
[ceph@ceph-adm ~]$ python s3test.py
images 2016-01-19T08:54:27.000Z
ps: swift (radosgw) work in cloudstack?
Re: S3, rados-gw error
Posted by Gabriel Beims Bräscher <ga...@gmail.com>.
Yes, NFS is mounted in SSVM.
Not all hypervisors supports NFS (Hyper-V is an example). This link gives
you the full picture (
http://docs.cloudstack.apache.org/projects/cloudstack-administration/en/4.6/storage.html
).
For better understanding in SSVM you can access this link (
http://docs.cloudstack.apache.org/en/latest/concepts.html#about-secondary-storage
).
Regards,
Gabriel.
2016-01-19 16:30 GMT-02:00 ilya <il...@gmail.com>:
> From my limited understanding of S3 support with CloudStack, CloudStack
> requires NFS backing store.
>
> Can you confirm NFS is mountable in SSVM as well as other hypervisors?
> Also, i'd check to see if host and SSVM can get to S3 bucket.
>
> Regards
> ilya
>
> On 1/19/16 6:00 AM, Erik Weber wrote:
> > Does images.rgw-lb01.cloud.bstelecom.ru resolve on your hosts?
> >
> > do a 'dig images.rgw-lb01.cloud.bstelecom.ru' and paste the output (you
> can
> > obfuscate the ip if you want to)
> >
>
Re: S3, rados-gw error
Posted by ilya <il...@gmail.com>.
>From my limited understanding of S3 support with CloudStack, CloudStack
requires NFS backing store.
Can you confirm NFS is mountable in SSVM as well as other hypervisors?
Also, i'd check to see if host and SSVM can get to S3 bucket.
Regards
ilya
On 1/19/16 6:00 AM, Erik Weber wrote:
> Does images.rgw-lb01.cloud.bstelecom.ru resolve on your hosts?
>
> do a 'dig images.rgw-lb01.cloud.bstelecom.ru' and paste the output (you can
> obfuscate the ip if you want to)
>
Re: S3, rados-gw error
Posted by Юрий Карпель <yu...@karpel.su>.
My settings:
s3 endpoint: 10.30.15.2
Bucket: images
NFS
server: 10.30.15.2
patch:/nfs
2016-01-19 18:33:38,139 DEBUG [c.c.a.ApiServlet]
(catalina-exec-6:ctx-859e2c4e) (logid:d4ea4a37) ===START=== 192.168.7.29
-- GET
command=addImageStore&response=json&name=Images&provider=S3&details%5B2%5D.key=bucket&details%5B2%5D.value=images&details%5B3%5D.key=usehttps&details%5B3%5D.value=false&details%5B4%5D.key=endpoint&details%5B4%5D.value=10.30.15.2&_=1453217617367
2016-01-19 18:33:38,145 DEBUG [c.c.a.ApiServlet]
(catalina-exec-1:ctx-85867896) (logid:76ed68b0) ===START=== 192.168.7.29
-- GET
command=createSecondaryStagingStore&response=json&provider=NFS&zoneid=0472cc5b-3748-4bd2-980c-f2b867ee13b2&url=nfs%3A%2F%2F10.30.15.2%2Fnfs&_=1453217617368
2016-01-19 18:33:38,173 INFO [o.a.c.s.d.l.S3ImageStoreLifeCycleImpl]
(catalina-exec-6:ctx-859e2c4e ctx-81a413e6) (logid:d4ea4a37) Trying to add
a S3 store with endpoint: 10.30.15.2
2016-01-19 18:33:38,184 INFO
[o.a.c.s.d.l.CloudStackImageStoreLifeCycleImpl]
(catalina-exec-1:ctx-85867896 ctx-4c0f06a4) (logid:76ed68b0) Trying to add
a new data store at nfs://10.30.15.2/nfs to data center 4
2016-01-19 18:33:38,227 DEBUG [c.c.a.ApiServlet]
(catalina-exec-1:ctx-85867896 ctx-4c0f06a4) (logid:76ed68b0) ===END===
192.168.7.29 -- GET
command=createSecondaryStagingStore&response=json&provider=NFS&zoneid=0472cc5b-3748-4bd2-980c-f2b867ee13b2&url=nfs%3A%2F%2F10.30.15.2%2Fnfs&_=1453217617368
2016-01-19 18:33:38,348 DEBUG [o.a.c.s.i.TemplateDataFactoryImpl]
(catalina-exec-6:ctx-859e2c4e ctx-81a413e6) (logid:d4ea4a37) template 3 is
already in store:70, type:Image
2016-01-19 18:33:38,363 DEBUG [o.a.c.s.i.BaseImageStoreDriverImpl]
(catalina-exec-6:ctx-859e2c4e ctx-81a413e6) (logid:d4ea4a37) Downloading
template to data store 70
2016-01-19 18:33:38,415 DEBUG [o.a.c.s.i.BaseImageStoreDriverImpl]
(catalina-exec-6:ctx-859e2c4e ctx-81a413e6) (logid:d4ea4a37) Performing
image store createTemplate async callback
2016-01-19 18:33:38,507 INFO [o.a.c.s.i.d.TemplateDataStoreDaoImpl]
(catalina-exec-6:ctx-859e2c4e ctx-81a413e6) (logid:d4ea4a37) Duplicate 0
template cache store records to region store
2016-01-19 18:33:38,512 INFO [o.a.c.s.i.d.SnapshotDataStoreDaoImpl]
(catalina-exec-6:ctx-859e2c4e ctx-81a413e6) (logid:d4ea4a37) Duplicate 0
snapshot cache store records to region store
2016-01-19 18:33:38,542 INFO [o.a.c.s.i.d.VolumeDataStoreDaoImpl]
(catalina-exec-6:ctx-859e2c4e ctx-81a413e6) (logid:d4ea4a37) Duplicate 0
volume cache store records to region store
2016-01-19 18:33:38,554 DEBUG [c.c.a.ApiServlet]
(catalina-exec-6:ctx-859e2c4e ctx-81a413e6) (logid:d4ea4a37) ===END===
192.168.7.29 -- GET
command=addImageStore&response=json&name=Images&provider=S3&details%5B2%5D.key=bucket&details%5B2%5D.value=images&details%5B3%5D.key=usehttps&details%5B3%5D.value=false&details%5B4%5D.key=endpoint&details%5B4%5D.value=10.30.15.2&_=1453217617367
2016-01-19 18:33:44,184 DEBUG [c.c.s.StatsCollector]
(StatsCollector-4:ctx-f615c40e) (logid:f4c5ac21) VmStatsCollector is
running...
2016-01-19 18:33:47,079 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-4dc2d865) (logid:b534b7b0) Begin cleanup
expired async-jobs
2016-01-19 18:33:47,111 INFO [o.a.c.f.j.i.AsyncJobManagerImpl]
(AsyncJobMgr-Heartbeat-1:ctx-4dc2d865) (logid:b534b7b0) End cleanup expired
async-jobs
2016-01-19 18:33:48,433 DEBUG [c.c.u.n.HTTPUtils]
(pool-32-thread-1:ctx-3b9e209c) (logid:ca14e656) Initializing new
HttpMethodRetryHandler with retry count 5
2016-01-19 18:33:48,563 INFO [c.c.s.t.S3TemplateDownloader]
(pool-31-thread-1:ctx-607e8735) (logid:cb289bc4) Starting download from
http://cloudstack.apt-get.eu/systemvm/4.6/systemvm64template-4.6.0-kvm.qcow2.bz2
to S3 bucket images and size 319401369 bytes
2016-01-19 18:33:48,563 DEBUG [c.c.u.s.S.S3Utils]
(pool-31-thread-1:ctx-607e8735) (logid:cb289bc4) Sending stream as S3
object template/tmpl/1/3/routing-3/systemvm64template-4.6.0-kvm.qcow2.bz2
in bucket images using PutObjectRequest
2016-01-19 18:33:51,434 DEBUG [o.a.c.s.i.BaseImageStoreDriverImpl]
(pool-32-thread-1:ctx-3b9e209c) (logid:ca14e656) Performing image store
createTemplate async callback
2016-01-19 18:33:51,486 WARN [o.a.c.alerts]
(pool-32-thread-1:ctx-3b9e209c) (logid:ca14e656) alertType:: 28 //
dataCenterId:: 4 // podId:: null // clusterId:: null // message:: Failed to
register template: 3619bdf8-41c8-46cb-bb63-3bd41164d0f8 with error:
2016-01-19 18:33:51,502 ERROR [o.a.c.s.i.BaseImageStoreDriverImpl]
(pool-32-thread-1:ctx-3b9e209c) (logid:ca14e656) Failed to register
template: 3619bdf8-41c8-46cb-bb63-3bd41164d0f8 with error:
2016-01-19 18:33:56,608 DEBUG [c.c.s.StatsCollector]
(StatsCollector-2:ctx-57e55c43) (logid:e11b5cfa) StorageCollector is
running...
2016-01-19 18:33:56,634 DEBUG [c.c.h.o.r.Ovm3HypervisorGuru]
(StatsCollector-2:ctx-57e55c43) (logid:e11b5cfa) getCommandHostDelegation:
class com.cloud.agent.api.GetStorageStatsCommand
2016-01-19 17:00 GMT+03:00 Erik Weber <te...@gmail.com>:
> Does images.rgw-lb01.cloud.bstelecom.ru resolve on your hosts?
>
> do a 'dig images.rgw-lb01.cloud.bstelecom.ru' and paste the output (you
> can
> obfuscate the ip if you want to)
>
> --
> Erik
>
> On Tue, Jan 19, 2016 at 2:57 PM, Юрий Карпель <yu...@karpel.su> wrote:
>
> > CentOS7 + KVM + Ceph (RadosGW + RBD )
> > Endpoint: rgw-lb01.test.****.**
> >
> > 2016-01-19 16:56:11,099 INFO [c.a.h.AmazonHttpClient]
> > (s3-transfer-manager-worker-5:null) (logid:18c0d81c) Unable to execute
> HTTP
> > request: images.rgw-lb01.test.****.**: unknown error
> > java.net.UnknownHostException: images.rgw-lb01.cloud.bstelecom.ru:
> unknown
> > error
> > at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
> > at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
> > at
> > java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
> > at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
> > at java.net.InetAddress.getAllByName(InetAddress.java:1192)
> > at java.net.InetAddress.getAllByName(InetAddress.java:1126)
> > at
> >
> >
> com.amazonaws.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:27)
> > at
> >
> >
> com.amazonaws.http.DelegatingDnsResolver.resolve(DelegatingDnsResolver.java:38)
> > at
> >
> >
> org.apache.http.impl.conn.DefaultClientConnectionOperator.resolveHostname(DefaultClientConnectionOperator.java:259)
> > at
> >
> >
> org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:159)
> > at
> >
> >
> org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
> > at
> >
> >
> org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
> > at
> >
> >
> org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
> > at
> >
> >
> org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
> > at
> >
> >
> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
> > at
> >
> >
> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
> > at
> >
> >
> com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:769)
> > at
> >
> >
> com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:506)
> > at
> > com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:318)
> > at
> > com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3595)
> > at
> >
> >
> com.amazonaws.services.s3.AmazonS3Client.initiateMultipartUpload(AmazonS3Client.java:2588)
> > at
> >
> >
> com.amazonaws.services.s3.transfer.internal.UploadCallable.initiateMultipartUpload(UploadCallable.java:350)
> > at
> >
> >
> com.amazonaws.services.s3.transfer.internal.UploadCallable.uploadInParts(UploadCallable.java:178)
> > at
> >
> >
> com.amazonaws.services.s3.transfer.internal.UploadCallable.call(UploadCallable.java:121)
> > at
> >
> >
> com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:139)
> > at
> >
> >
> com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:47)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> > at
> >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745
> >
> > Run s3test.py:
> > import boto
> > import boto.s3.connection
> > access_key = 'X08R0Z0O7WJWE18W95GB'
> > secret_key = 'bsc0wwH9nD5LEuiEi2EERQaGlTgUECD70cZQTlpA'
> > conn = boto.connect_s3(
> > aws_access_key_id = access_key,
> > aws_secret_access_key = secret_key,
> > host = 'rgw-lb01',
> > is_secure=False,
> > calling_format = boto.s3.connection.OrdinaryCallingFormat(),
> >
> > )
> >
> > buckets = conn.get_all_buckets()
> > for bucket in buckets:
> > print "{name}\t{created}".format(
> > name=bucket.name,
> > created=bucket.creation_date,
> > )
> > for key in bucket.list():
> > print "{name}\t{size}\t{modified}".format(
> > name=(key.name).encode('utf8'),
> > size=key.size,
> > modified=key.last_modified,
> >
> >
> > [ceph@ceph-adm ~]$ python s3test.py
> > images 2016-01-19T08:54:27.000Z
> >
> >
> > ps: swift (radosgw) work in cloudstack?
> >
>
Re: S3, rados-gw error
Posted by Erik Weber <te...@gmail.com>.
Does images.rgw-lb01.cloud.bstelecom.ru resolve on your hosts?
do a 'dig images.rgw-lb01.cloud.bstelecom.ru' and paste the output (you can
obfuscate the ip if you want to)
--
Erik
On Tue, Jan 19, 2016 at 2:57 PM, Юрий Карпель <yu...@karpel.su> wrote:
> CentOS7 + KVM + Ceph (RadosGW + RBD )
> Endpoint: rgw-lb01.test.****.**
>
> 2016-01-19 16:56:11,099 INFO [c.a.h.AmazonHttpClient]
> (s3-transfer-manager-worker-5:null) (logid:18c0d81c) Unable to execute HTTP
> request: images.rgw-lb01.test.****.**: unknown error
> java.net.UnknownHostException: images.rgw-lb01.cloud.bstelecom.ru: unknown
> error
> at java.net.Inet6AddressImpl.lookupAllHostAddr(Native Method)
> at java.net.InetAddress$2.lookupAllHostAddr(InetAddress.java:928)
> at
> java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1323)
> at java.net.InetAddress.getAllByName0(InetAddress.java:1276)
> at java.net.InetAddress.getAllByName(InetAddress.java:1192)
> at java.net.InetAddress.getAllByName(InetAddress.java:1126)
> at
>
> com.amazonaws.SystemDefaultDnsResolver.resolve(SystemDefaultDnsResolver.java:27)
> at
>
> com.amazonaws.http.DelegatingDnsResolver.resolve(DelegatingDnsResolver.java:38)
> at
>
> org.apache.http.impl.conn.DefaultClientConnectionOperator.resolveHostname(DefaultClientConnectionOperator.java:259)
> at
>
> org.apache.http.impl.conn.DefaultClientConnectionOperator.openConnection(DefaultClientConnectionOperator.java:159)
> at
>
> org.apache.http.impl.conn.ManagedClientConnectionImpl.open(ManagedClientConnectionImpl.java:304)
> at
>
> org.apache.http.impl.client.DefaultRequestDirector.tryConnect(DefaultRequestDirector.java:611)
> at
>
> org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:446)
> at
>
> org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:882)
> at
>
> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
> at
>
> org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
> at
>
> com.amazonaws.http.AmazonHttpClient.executeOneRequest(AmazonHttpClient.java:769)
> at
>
> com.amazonaws.http.AmazonHttpClient.executeHelper(AmazonHttpClient.java:506)
> at
> com.amazonaws.http.AmazonHttpClient.execute(AmazonHttpClient.java:318)
> at
> com.amazonaws.services.s3.AmazonS3Client.invoke(AmazonS3Client.java:3595)
> at
>
> com.amazonaws.services.s3.AmazonS3Client.initiateMultipartUpload(AmazonS3Client.java:2588)
> at
>
> com.amazonaws.services.s3.transfer.internal.UploadCallable.initiateMultipartUpload(UploadCallable.java:350)
> at
>
> com.amazonaws.services.s3.transfer.internal.UploadCallable.uploadInParts(UploadCallable.java:178)
> at
>
> com.amazonaws.services.s3.transfer.internal.UploadCallable.call(UploadCallable.java:121)
> at
>
> com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:139)
> at
>
> com.amazonaws.services.s3.transfer.internal.UploadMonitor.call(UploadMonitor.java:47)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
>
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745
>
> Run s3test.py:
> import boto
> import boto.s3.connection
> access_key = 'X08R0Z0O7WJWE18W95GB'
> secret_key = 'bsc0wwH9nD5LEuiEi2EERQaGlTgUECD70cZQTlpA'
> conn = boto.connect_s3(
> aws_access_key_id = access_key,
> aws_secret_access_key = secret_key,
> host = 'rgw-lb01',
> is_secure=False,
> calling_format = boto.s3.connection.OrdinaryCallingFormat(),
>
> )
>
> buckets = conn.get_all_buckets()
> for bucket in buckets:
> print "{name}\t{created}".format(
> name=bucket.name,
> created=bucket.creation_date,
> )
> for key in bucket.list():
> print "{name}\t{size}\t{modified}".format(
> name=(key.name).encode('utf8'),
> size=key.size,
> modified=key.last_modified,
>
>
> [ceph@ceph-adm ~]$ python s3test.py
> images 2016-01-19T08:54:27.000Z
>
>
> ps: swift (radosgw) work in cloudstack?
>