You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@jclouds.apache.org by Heshan Jayasinghe <sh...@gmail.com> on 2015/08/31 12:16:29 UTC
[Dev] Add Content-Encoding to Google Cloud Storage
Hi All,
I'm contributing to the issue jclouds 885 [1].I am new to jclouds
contribution and i am reading documentations and do all the things.Up to
now I clone and setup jclouds labs google [2] project in IDEA developer
environment.I am activated google cloud storage and going through their
steps.Google cloud platform gives only 60days free trial.
I think I need mentor in this point to find correct path because I'm new to
jclouds.I can find the way how to do Content-Encoding with gzip but i need
help from Jclouds to solve this issue.
Could you please tell me the steps I should follow to contribute this issue?
[1]-https://issues.apache.org/jira/browse/JCLOUDS-885
[2]-https://github.com/jclouds/jclouds-labs-google
Thank You!
regards,
Heshan Jayasinghe
Undergraduate of university of moratuwa,
Re: [Dev] Add Content-Encoding to Google Cloud Storage
Posted by Daniel Broudy <br...@google.com.INVALID>.
Hi Heshan jayasinghe,
Thanks for reaching out!
To run the GCS live tests you need to set up a Google Compute Engine
project, enable the Google Cloud Storage JSON Api, set up a service account
and download the JSON key for that service account. Setting up a service
account on your project is described in better detail here:
https://jclouds.apache.org/guides/google/
Once you have a JSON key file on your local machine, that file contains
both the identity and credentials for a service account on your project.
You can run tests by passing in the path to that file. Use the below
commands substituting in the path to your JSON file for
"path/to/json/key/file.json"
The following would run all live tests. Run these commands from the cloned
jclouds-labs-google directory
mvn -Plive clean install
-Dtest.google-cloud.json-key=path/to/json/key/file.json
To run one one specific test, in this case the ObjectApiLiveTest, run the
following from the locally cloned jclouds-labs-google directory
mvn -Dtest=ObjectApiLiveTest test
-Dtest.google-cloud.json-key=path/to/json/key/file.json
Also to run the unit tests simply run the following from the
jclouds-labs-google directory
mvn clean install
I recommend that you first try to get the ObjectApiLiveTest passing because
it is quick to run, consistent, and will prove you have authentication set
up correctly.
HTH and feel free to keep reaching out with questions!
-Danny
On Sat, Sep 5, 2015 at 10:45 AM, Heshan Jayasinghe <sh...@gmail.com>
wrote:
> Hi,
> I run current failing test.It skiped
> GoogleCloudStorageBlobIntegrationLiveTest
> and gives java.io.FileNotFoundException.
>
> Starting test
>
> testPutObjectStream(org.jclouds.googlecloudstorage.blobstore.integration.GoogleCloudStorageBlobIntegrationLiveTest)
>
> [TestNG] Test
>
> testPutObjectStream(org.jclouds.googlecloudstorage.blobstore.integration.GoogleCloudStorageBlobIntegrationLiveTest)
> skipped.
>
> Test suite progress: tests succeeded: 0, failed: 0, skipped: 1.
>
> Tests run: 5, Failures: 1, Errors: 0, Skipped: 4, Time elapsed: 0.861 sec
> <<< FAILURE! - in
>
> org.jclouds.googlecloudstorage.blobstore.integration.GoogleCloudStorageBlobIntegrationLiveTest
>
>
>
> Do i need to live test in google cloud storage to find this error?I do Live
> test using this command [1]
>
> mvn -Plive clean install -Dtest.trmk-vcloudexpress.identity=user@jclouds.
> apache.org -Dtest.trmk-vcloudexpress.endpoint=https://
> services.vcloudexpress.terremark.com/api
> -Dtest.trmk-vcloudexpress.credential=12312412
>
> And it give
>
> jclouds Google Cloud Storage provider .............. FAILURE
>
> I didnt use GCS before and didn't Live test jclouds projects.can you please
> tell me how to live test this project in GCS?
>
> Is there any debug method available for me to find this bug generating
> point?i am still searching that point according to previous mail guid
> lines.
>
>
> [1]-https://cwiki.apache.org/confluence/display/JCLOUDS/Testing
>
> Thanks!
>
> regards,
> Heshan jayasinghe
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> On Tue, Sep 1, 2015 at 3:59 AM, Andrew Gaul <ga...@apache.org> wrote:
>
> > You can reproduce the symptoms in JCLOUDS-885 by modifying
> > addContentMetadata and checkContentMetadata in
> > GoogleCloudStorageBlobIntegrationLiveTest.java. Note that jclouds has
> > abstracted both its implementation and tests so crawling through this
> > code might confuse you at first. You can run a currently failing test
> > via:
> >
> > mvn integration-test -pl google-cloud-storage -Plive \
> > -Dtest.google-cloud-storage.identity="${JCLOUDS_IDENTITY}" \
> >
> -Dtest.google-cloud-storage.credential="${JCLOUDS_CREDENTIAL}"
> > \
> > -Dtest.blobstore.container-count=3 \
> >
> > -Dtest=GoogleCloudStorageBlobIntegrationLiveTest#testPutObjectStream
> >
> > I have not looked at this in depth, but Google documents 503 Service
> > Unavailable as a request rate issue which does not make much sense:
> >
> > https://cloud.google.com/storage/docs/reference-status
> >
> > The actual error comes not from putBlob, but the subsequent getBlob, so
> > perhaps we need to modify GoogleCloudStorageErrorHandler to work around
> > some quirk?
> >
> > On Mon, Aug 31, 2015 at 03:46:29PM +0530, Heshan Jayasinghe wrote:
> > > Hi All,
> > >
> > > I'm contributing to the issue jclouds 885 [1].I am new to jclouds
> > > contribution and i am reading documentations and do all the things.Up
> to
> > > now I clone and setup jclouds labs google [2] project in IDEA
> developer
> > > environment.I am activated google cloud storage and going through their
> > > steps.Google cloud platform gives only 60days free trial.
> > >
> > > I think I need mentor in this point to find correct path because I'm
> new
> > to
> > > jclouds.I can find the way how to do Content-Encoding with gzip but i
> > need
> > > help from Jclouds to solve this issue.
> > >
> > > Could you please tell me the steps I should follow to contribute this
> > issue?
> > >
> > >
> > > [1]-https://issues.apache.org/jira/browse/JCLOUDS-885
> > > [2]-https://github.com/jclouds/jclouds-labs-google
> > >
> > > Thank You!
> > > regards,
> > > Heshan Jayasinghe
> > > Undergraduate of university of moratuwa,
> >
> > --
> > Andrew Gaul
> > http://gaul.org/
> >
>
Re: [Dev] Add Content-Encoding to Google Cloud Storage
Posted by Heshan Jayasinghe <sh...@gmail.com>.
Hi,
I run current failing test.It skiped GoogleCloudStorageBlobIntegrationLiveTest
and gives java.io.FileNotFoundException.
Starting test
testPutObjectStream(org.jclouds.googlecloudstorage.blobstore.integration.GoogleCloudStorageBlobIntegrationLiveTest)
[TestNG] Test
testPutObjectStream(org.jclouds.googlecloudstorage.blobstore.integration.GoogleCloudStorageBlobIntegrationLiveTest)
skipped.
Test suite progress: tests succeeded: 0, failed: 0, skipped: 1.
Tests run: 5, Failures: 1, Errors: 0, Skipped: 4, Time elapsed: 0.861 sec
<<< FAILURE! - in
org.jclouds.googlecloudstorage.blobstore.integration.GoogleCloudStorageBlobIntegrationLiveTest
Do i need to live test in google cloud storage to find this error?I do Live
test using this command [1]
mvn -Plive clean install -Dtest.trmk-vcloudexpress.identity=user@jclouds.
apache.org -Dtest.trmk-vcloudexpress.endpoint=https://
services.vcloudexpress.terremark.com/api
-Dtest.trmk-vcloudexpress.credential=12312412
And it give
jclouds Google Cloud Storage provider .............. FAILURE
I didnt use GCS before and didn't Live test jclouds projects.can you please
tell me how to live test this project in GCS?
Is there any debug method available for me to find this bug generating
point?i am still searching that point according to previous mail guid lines.
[1]-https://cwiki.apache.org/confluence/display/JCLOUDS/Testing
Thanks!
regards,
Heshan jayasinghe
On Tue, Sep 1, 2015 at 3:59 AM, Andrew Gaul <ga...@apache.org> wrote:
> You can reproduce the symptoms in JCLOUDS-885 by modifying
> addContentMetadata and checkContentMetadata in
> GoogleCloudStorageBlobIntegrationLiveTest.java. Note that jclouds has
> abstracted both its implementation and tests so crawling through this
> code might confuse you at first. You can run a currently failing test
> via:
>
> mvn integration-test -pl google-cloud-storage -Plive \
> -Dtest.google-cloud-storage.identity="${JCLOUDS_IDENTITY}" \
> -Dtest.google-cloud-storage.credential="${JCLOUDS_CREDENTIAL}"
> \
> -Dtest.blobstore.container-count=3 \
>
> -Dtest=GoogleCloudStorageBlobIntegrationLiveTest#testPutObjectStream
>
> I have not looked at this in depth, but Google documents 503 Service
> Unavailable as a request rate issue which does not make much sense:
>
> https://cloud.google.com/storage/docs/reference-status
>
> The actual error comes not from putBlob, but the subsequent getBlob, so
> perhaps we need to modify GoogleCloudStorageErrorHandler to work around
> some quirk?
>
> On Mon, Aug 31, 2015 at 03:46:29PM +0530, Heshan Jayasinghe wrote:
> > Hi All,
> >
> > I'm contributing to the issue jclouds 885 [1].I am new to jclouds
> > contribution and i am reading documentations and do all the things.Up to
> > now I clone and setup jclouds labs google [2] project in IDEA developer
> > environment.I am activated google cloud storage and going through their
> > steps.Google cloud platform gives only 60days free trial.
> >
> > I think I need mentor in this point to find correct path because I'm new
> to
> > jclouds.I can find the way how to do Content-Encoding with gzip but i
> need
> > help from Jclouds to solve this issue.
> >
> > Could you please tell me the steps I should follow to contribute this
> issue?
> >
> >
> > [1]-https://issues.apache.org/jira/browse/JCLOUDS-885
> > [2]-https://github.com/jclouds/jclouds-labs-google
> >
> > Thank You!
> > regards,
> > Heshan Jayasinghe
> > Undergraduate of university of moratuwa,
>
> --
> Andrew Gaul
> http://gaul.org/
>
Re: [Dev] Add Content-Encoding to Google Cloud Storage
Posted by Andrew Gaul <ga...@apache.org>.
You can reproduce the symptoms in JCLOUDS-885 by modifying
addContentMetadata and checkContentMetadata in
GoogleCloudStorageBlobIntegrationLiveTest.java. Note that jclouds has
abstracted both its implementation and tests so crawling through this
code might confuse you at first. You can run a currently failing test
via:
mvn integration-test -pl google-cloud-storage -Plive \
-Dtest.google-cloud-storage.identity="${JCLOUDS_IDENTITY}" \
-Dtest.google-cloud-storage.credential="${JCLOUDS_CREDENTIAL}" \
-Dtest.blobstore.container-count=3 \
-Dtest=GoogleCloudStorageBlobIntegrationLiveTest#testPutObjectStream
I have not looked at this in depth, but Google documents 503 Service
Unavailable as a request rate issue which does not make much sense:
https://cloud.google.com/storage/docs/reference-status
The actual error comes not from putBlob, but the subsequent getBlob, so
perhaps we need to modify GoogleCloudStorageErrorHandler to work around
some quirk?
On Mon, Aug 31, 2015 at 03:46:29PM +0530, Heshan Jayasinghe wrote:
> Hi All,
>
> I'm contributing to the issue jclouds 885 [1].I am new to jclouds
> contribution and i am reading documentations and do all the things.Up to
> now I clone and setup jclouds labs google [2] project in IDEA developer
> environment.I am activated google cloud storage and going through their
> steps.Google cloud platform gives only 60days free trial.
>
> I think I need mentor in this point to find correct path because I'm new to
> jclouds.I can find the way how to do Content-Encoding with gzip but i need
> help from Jclouds to solve this issue.
>
> Could you please tell me the steps I should follow to contribute this issue?
>
>
> [1]-https://issues.apache.org/jira/browse/JCLOUDS-885
> [2]-https://github.com/jclouds/jclouds-labs-google
>
> Thank You!
> regards,
> Heshan Jayasinghe
> Undergraduate of university of moratuwa,
--
Andrew Gaul
http://gaul.org/