You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@jclouds.apache.org by Shital Patil <sh...@gslab.com> on 2014/04/16 06:49:20 UTC
Chunked upload with glance
Hi,
I am trying to upload big images using *jclouds glance labs 1.8.0 and jdk
1.7*. With jclouds glance we can upload small images. But when we try large
images it throws -
java.lang.IllegalArgumentException: Cannot transfer 2 GB or larger chunks
due to JDK 1.6 limitations. Use chunked encoding or multi-part upload, if
possible. For more information:
http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
EXception Cannot transfer 2 GB or larger chunks due to JDK 1.6 limitations.
Use chunked encoding or multi-part upload, if possible. For more
information: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
How to specify chunked upload option ?
How to do multi-part upload?
Thank you
Re: Chunked upload with glance
Posted by Shital Patil <sh...@gslab.com>.
Hi,
After debugging the openstack glance labs 1.8.0 code we came across a code
in JavaUrlHttpCommandExecutorService.java
checkArgument(length <= Integer.MAX_VALUE,
"Cannot transfer 2 GB or larger chunks due to JDK 1.6
limitations." +
" Use chunked encoding or multi-part upload, if
possible." +
" For more information:
http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625");
Which gets executed and it is responsible for throwing illegalArgument
exception
We added a field Transfer-Encoding=[chunked] into hashmap inside
updateImageOptions it does not go into headers
On Wed, Apr 16, 2014 at 8:24 PM, Andrew Gaul <ga...@apache.org> wrote:
> Can you open a JIRA issue with a more specific example of the glance
> calls that fail and a stack trace of the failure? Also can you look at
> the jclouds glance code; it probably just needs a similar multipart
> option (although perhaps via the Swift-specific interface). This is
> something that you could probably send a GitHub pull request for.
>
> On Wed, Apr 16, 2014 at 11:30:42AM +0530, Shital Patil wrote:
> > I am using jclouds openstack specific APIs to create, upload and reserve
> > images. To my knowledge Blobstore is generic API.
> >
> >
> > On Wed, Apr 16, 2014 at 11:20 AM, Andrew Gaul <ga...@apache.org> wrote:
> >
> > > You can enable multi-part upload on a per-blob basis with:
> > >
> > > BlobStore.putBlob(containerName, blob, new PutOptions().multipart());
> > >
> > > On Wed, Apr 16, 2014 at 10:19:20AM +0530, Shital Patil wrote:
> > > > Hi,
> > > > I am trying to upload big images using *jclouds glance labs 1.8.0
> and jdk
> > > > 1.7*. With jclouds glance we can upload small images. But when we try
> > > large
> > > > images it throws -
> > > >
> > > > java.lang.IllegalArgumentException: Cannot transfer 2 GB or larger
> chunks
> > > > due to JDK 1.6 limitations. Use chunked encoding or multi-part
> upload, if
> > > > possible. For more information:
> > > > http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
> > > > EXception Cannot transfer 2 GB or larger chunks due to JDK 1.6
> > > limitations.
> > > > Use chunked encoding or multi-part upload, if possible. For more
> > > > information:
> http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
> > > >
> > > >
> > > > How to specify chunked upload option ?
> > > > How to do multi-part upload?
> > > >
> > > > Thank you
> > >
> > > --
> > > Andrew Gaul
> > > http://gaul.org/
> > >
>
> --
> Andrew Gaul
> http://gaul.org/
>
Re: Chunked upload with glance
Posted by Andrew Gaul <ga...@apache.org>.
Can you open a JIRA issue with a more specific example of the glance
calls that fail and a stack trace of the failure? Also can you look at
the jclouds glance code; it probably just needs a similar multipart
option (although perhaps via the Swift-specific interface). This is
something that you could probably send a GitHub pull request for.
On Wed, Apr 16, 2014 at 11:30:42AM +0530, Shital Patil wrote:
> I am using jclouds openstack specific APIs to create, upload and reserve
> images. To my knowledge Blobstore is generic API.
>
>
> On Wed, Apr 16, 2014 at 11:20 AM, Andrew Gaul <ga...@apache.org> wrote:
>
> > You can enable multi-part upload on a per-blob basis with:
> >
> > BlobStore.putBlob(containerName, blob, new PutOptions().multipart());
> >
> > On Wed, Apr 16, 2014 at 10:19:20AM +0530, Shital Patil wrote:
> > > Hi,
> > > I am trying to upload big images using *jclouds glance labs 1.8.0 and jdk
> > > 1.7*. With jclouds glance we can upload small images. But when we try
> > large
> > > images it throws -
> > >
> > > java.lang.IllegalArgumentException: Cannot transfer 2 GB or larger chunks
> > > due to JDK 1.6 limitations. Use chunked encoding or multi-part upload, if
> > > possible. For more information:
> > > http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
> > > EXception Cannot transfer 2 GB or larger chunks due to JDK 1.6
> > limitations.
> > > Use chunked encoding or multi-part upload, if possible. For more
> > > information: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
> > >
> > >
> > > How to specify chunked upload option ?
> > > How to do multi-part upload?
> > >
> > > Thank you
> >
> > --
> > Andrew Gaul
> > http://gaul.org/
> >
--
Andrew Gaul
http://gaul.org/
Re: Chunked upload with glance
Posted by Shital Patil <sh...@gslab.com>.
I am using jclouds openstack specific APIs to create, upload and reserve
images. To my knowledge Blobstore is generic API.
On Wed, Apr 16, 2014 at 11:20 AM, Andrew Gaul <ga...@apache.org> wrote:
> You can enable multi-part upload on a per-blob basis with:
>
> BlobStore.putBlob(containerName, blob, new PutOptions().multipart());
>
> On Wed, Apr 16, 2014 at 10:19:20AM +0530, Shital Patil wrote:
> > Hi,
> > I am trying to upload big images using *jclouds glance labs 1.8.0 and jdk
> > 1.7*. With jclouds glance we can upload small images. But when we try
> large
> > images it throws -
> >
> > java.lang.IllegalArgumentException: Cannot transfer 2 GB or larger chunks
> > due to JDK 1.6 limitations. Use chunked encoding or multi-part upload, if
> > possible. For more information:
> > http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
> > EXception Cannot transfer 2 GB or larger chunks due to JDK 1.6
> limitations.
> > Use chunked encoding or multi-part upload, if possible. For more
> > information: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
> >
> >
> > How to specify chunked upload option ?
> > How to do multi-part upload?
> >
> > Thank you
>
> --
> Andrew Gaul
> http://gaul.org/
>
Re: Chunked upload with glance
Posted by Andrew Gaul <ga...@apache.org>.
You can enable multi-part upload on a per-blob basis with:
BlobStore.putBlob(containerName, blob, new PutOptions().multipart());
On Wed, Apr 16, 2014 at 10:19:20AM +0530, Shital Patil wrote:
> Hi,
> I am trying to upload big images using *jclouds glance labs 1.8.0 and jdk
> 1.7*. With jclouds glance we can upload small images. But when we try large
> images it throws -
>
> java.lang.IllegalArgumentException: Cannot transfer 2 GB or larger chunks
> due to JDK 1.6 limitations. Use chunked encoding or multi-part upload, if
> possible. For more information:
> http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
> EXception Cannot transfer 2 GB or larger chunks due to JDK 1.6 limitations.
> Use chunked encoding or multi-part upload, if possible. For more
> information: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6755625
>
>
> How to specify chunked upload option ?
> How to do multi-part upload?
>
> Thank you
--
Andrew Gaul
http://gaul.org/