You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Jean-Baptiste Onofré <jb...@nanthrax.net> on 2017/05/29 06:05:53 UTC

[INFO] Build fails on GCP IO (Spanner)

Hi team,

Since last week, the build is broken due to tests failure on the GCP/Spanner IO:

java.lang.IllegalArgumentException: A project ID is required for this service 
but could not be determined from the builder or the environment.  Please set a 
project ID using the builder.

However, Jenkins seems OK on this. I checked and I don't see anything special in 
the system variables or JVM arguments.

I started a change on the SpannerIO to get the project ID in the code in order 
to have the tests OK (fixing SpannerIO write). Depending of the answers on this 
e-mail, I will create a pull request.

Do you think it's reasonable ? I don't see anything special in the READMEr about 
new prerequisites for SpannerIO.

Does anyone else notice this tests failure ?

Thanks,
Regards
JB
-- 
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Re: [INFO] Build fails on GCP IO (Spanner)

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Got it.

Thanks for the details Luke !

Regards
JB

On 05/30/2017 09:30 PM, Lukasz Cwik wrote:
> JB, the issue is that we have been careful so far to not require a GCP
> project or credentials as part of a test until SpannerIO broke this.
> BEAM-2131 is about having a stronger precommit if Jenkins ran in an
> environment which better modeled a users machine (e.g. no GCP
> project/credentials can be inferred automatically).
> 
> On Tue, May 30, 2017 at 12:00 PM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> 
>> Yeah, however I didn't have any issue with the other GCP IOs. Only
>> SpannerIO has this issue and "blocks" the build locally.
>>
>> (it's a simple mvn clean install on my machine)
>>
>> Thanks !
>> Regards
>> JB
>>
>>
>> On 05/30/2017 08:40 PM, Lukasz Cwik wrote:
>>
>>> This is a known issue (https://issues.apache.org/jira/browse/BEAM-2131)
>>> where our Jenkins runs use a machine GCP VM which allows for credentials
>>> and project to be inferred automatically.
>>>
>>>
>>> On Mon, May 29, 2017 at 9:48 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
>>> wrote:
>>>
>>> Yup, it seems so.
>>>>
>>>> I created:
>>>>
>>>> https://issues.apache.org/jira/browse/BEAM-2379
>>>>
>>>> for the tracking and I gonna take a look waiting Mairbek's feedback.
>>>>
>>>> Thanks !
>>>> Regards
>>>> JB
>>>>
>>>>
>>>> On 05/29/2017 06:43 PM, Dan Halperin wrote:
>>>>
>>>> This looks like somewhere the unit tests are inferring a project from the
>>>>> environment when they should not be doing so.
>>>>>
>>>>> On Mon, May 29, 2017 at 8:38 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
>>>>> wrote:
>>>>>
>>>>> Gonna try to purge my local m2 repo.
>>>>>
>>>>>>
>>>>>> Regards
>>>>>> JB
>>>>>>
>>>>>>
>>>>>> On 05/29/2017 08:05 AM, Jean-Baptiste Onofré wrote:
>>>>>>
>>>>>> Hi team,
>>>>>>
>>>>>>>
>>>>>>> Since last week, the build is broken due to tests failure on the
>>>>>>> GCP/Spanner IO:
>>>>>>>
>>>>>>> java.lang.IllegalArgumentException: A project ID is required for this
>>>>>>> service but could not be determined from the builder or the
>>>>>>> environment.
>>>>>>> Please set a project ID using the builder.
>>>>>>>
>>>>>>> However, Jenkins seems OK on this. I checked and I don't see anything
>>>>>>> special in the system variables or JVM arguments.
>>>>>>>
>>>>>>> I started a change on the SpannerIO to get the project ID in the code
>>>>>>> in
>>>>>>> order to have the tests OK (fixing SpannerIO write). Depending of the
>>>>>>> answers on this e-mail, I will create a pull request.
>>>>>>>
>>>>>>> Do you think it's reasonable ? I don't see anything special in the
>>>>>>> READMEr about new prerequisites for SpannerIO.
>>>>>>>
>>>>>>> Does anyone else notice this tests failure ?
>>>>>>>
>>>>>>> Thanks,
>>>>>>> Regards
>>>>>>> JB
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>> Jean-Baptiste Onofré
>>>>>> jbonofre@apache.org
>>>>>> http://blog.nanthrax.net
>>>>>> Talend - http://www.talend.com
>>>>>>
>>>>>>
>>>>>>
>>>>> --
>>>> Jean-Baptiste Onofré
>>>> jbonofre@apache.org
>>>> http://blog.nanthrax.net
>>>> Talend - http://www.talend.com
>>>>
>>>>
>>>
>> --
>> Jean-Baptiste Onofré
>> jbonofre@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
> 

-- 
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Re: [INFO] Build fails on GCP IO (Spanner)

Posted by Lukasz Cwik <lc...@google.com.INVALID>.
JB, the issue is that we have been careful so far to not require a GCP
project or credentials as part of a test until SpannerIO broke this.
BEAM-2131 is about having a stronger precommit if Jenkins ran in an
environment which better modeled a users machine (e.g. no GCP
project/credentials can be inferred automatically).

On Tue, May 30, 2017 at 12:00 PM, Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:

> Yeah, however I didn't have any issue with the other GCP IOs. Only
> SpannerIO has this issue and "blocks" the build locally.
>
> (it's a simple mvn clean install on my machine)
>
> Thanks !
> Regards
> JB
>
>
> On 05/30/2017 08:40 PM, Lukasz Cwik wrote:
>
>> This is a known issue (https://issues.apache.org/jira/browse/BEAM-2131)
>> where our Jenkins runs use a machine GCP VM which allows for credentials
>> and project to be inferred automatically.
>>
>>
>> On Mon, May 29, 2017 at 9:48 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
>> wrote:
>>
>> Yup, it seems so.
>>>
>>> I created:
>>>
>>> https://issues.apache.org/jira/browse/BEAM-2379
>>>
>>> for the tracking and I gonna take a look waiting Mairbek's feedback.
>>>
>>> Thanks !
>>> Regards
>>> JB
>>>
>>>
>>> On 05/29/2017 06:43 PM, Dan Halperin wrote:
>>>
>>> This looks like somewhere the unit tests are inferring a project from the
>>>> environment when they should not be doing so.
>>>>
>>>> On Mon, May 29, 2017 at 8:38 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
>>>> wrote:
>>>>
>>>> Gonna try to purge my local m2 repo.
>>>>
>>>>>
>>>>> Regards
>>>>> JB
>>>>>
>>>>>
>>>>> On 05/29/2017 08:05 AM, Jean-Baptiste Onofré wrote:
>>>>>
>>>>> Hi team,
>>>>>
>>>>>>
>>>>>> Since last week, the build is broken due to tests failure on the
>>>>>> GCP/Spanner IO:
>>>>>>
>>>>>> java.lang.IllegalArgumentException: A project ID is required for this
>>>>>> service but could not be determined from the builder or the
>>>>>> environment.
>>>>>> Please set a project ID using the builder.
>>>>>>
>>>>>> However, Jenkins seems OK on this. I checked and I don't see anything
>>>>>> special in the system variables or JVM arguments.
>>>>>>
>>>>>> I started a change on the SpannerIO to get the project ID in the code
>>>>>> in
>>>>>> order to have the tests OK (fixing SpannerIO write). Depending of the
>>>>>> answers on this e-mail, I will create a pull request.
>>>>>>
>>>>>> Do you think it's reasonable ? I don't see anything special in the
>>>>>> READMEr about new prerequisites for SpannerIO.
>>>>>>
>>>>>> Does anyone else notice this tests failure ?
>>>>>>
>>>>>> Thanks,
>>>>>> Regards
>>>>>> JB
>>>>>>
>>>>>>
>>>>>> --
>>>>> Jean-Baptiste Onofré
>>>>> jbonofre@apache.org
>>>>> http://blog.nanthrax.net
>>>>> Talend - http://www.talend.com
>>>>>
>>>>>
>>>>>
>>>> --
>>> Jean-Baptiste Onofré
>>> jbonofre@apache.org
>>> http://blog.nanthrax.net
>>> Talend - http://www.talend.com
>>>
>>>
>>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>

Re: [INFO] Build fails on GCP IO (Spanner)

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Yeah, however I didn't have any issue with the other GCP IOs. Only SpannerIO has 
this issue and "blocks" the build locally.

(it's a simple mvn clean install on my machine)

Thanks !
Regards
JB

On 05/30/2017 08:40 PM, Lukasz Cwik wrote:
> This is a known issue (https://issues.apache.org/jira/browse/BEAM-2131)
> where our Jenkins runs use a machine GCP VM which allows for credentials
> and project to be inferred automatically.
> 
> 
> On Mon, May 29, 2017 at 9:48 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> 
>> Yup, it seems so.
>>
>> I created:
>>
>> https://issues.apache.org/jira/browse/BEAM-2379
>>
>> for the tracking and I gonna take a look waiting Mairbek's feedback.
>>
>> Thanks !
>> Regards
>> JB
>>
>>
>> On 05/29/2017 06:43 PM, Dan Halperin wrote:
>>
>>> This looks like somewhere the unit tests are inferring a project from the
>>> environment when they should not be doing so.
>>>
>>> On Mon, May 29, 2017 at 8:38 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
>>> wrote:
>>>
>>> Gonna try to purge my local m2 repo.
>>>>
>>>> Regards
>>>> JB
>>>>
>>>>
>>>> On 05/29/2017 08:05 AM, Jean-Baptiste Onofré wrote:
>>>>
>>>> Hi team,
>>>>>
>>>>> Since last week, the build is broken due to tests failure on the
>>>>> GCP/Spanner IO:
>>>>>
>>>>> java.lang.IllegalArgumentException: A project ID is required for this
>>>>> service but could not be determined from the builder or the environment.
>>>>> Please set a project ID using the builder.
>>>>>
>>>>> However, Jenkins seems OK on this. I checked and I don't see anything
>>>>> special in the system variables or JVM arguments.
>>>>>
>>>>> I started a change on the SpannerIO to get the project ID in the code in
>>>>> order to have the tests OK (fixing SpannerIO write). Depending of the
>>>>> answers on this e-mail, I will create a pull request.
>>>>>
>>>>> Do you think it's reasonable ? I don't see anything special in the
>>>>> READMEr about new prerequisites for SpannerIO.
>>>>>
>>>>> Does anyone else notice this tests failure ?
>>>>>
>>>>> Thanks,
>>>>> Regards
>>>>> JB
>>>>>
>>>>>
>>>> --
>>>> Jean-Baptiste Onofré
>>>> jbonofre@apache.org
>>>> http://blog.nanthrax.net
>>>> Talend - http://www.talend.com
>>>>
>>>>
>>>
>> --
>> Jean-Baptiste Onofré
>> jbonofre@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
> 

-- 
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Re: [INFO] Build fails on GCP IO (Spanner)

Posted by Lukasz Cwik <lc...@google.com.INVALID>.
This is a known issue (https://issues.apache.org/jira/browse/BEAM-2131)
where our Jenkins runs use a machine GCP VM which allows for credentials
and project to be inferred automatically.


On Mon, May 29, 2017 at 9:48 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:

> Yup, it seems so.
>
> I created:
>
> https://issues.apache.org/jira/browse/BEAM-2379
>
> for the tracking and I gonna take a look waiting Mairbek's feedback.
>
> Thanks !
> Regards
> JB
>
>
> On 05/29/2017 06:43 PM, Dan Halperin wrote:
>
>> This looks like somewhere the unit tests are inferring a project from the
>> environment when they should not be doing so.
>>
>> On Mon, May 29, 2017 at 8:38 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
>> wrote:
>>
>> Gonna try to purge my local m2 repo.
>>>
>>> Regards
>>> JB
>>>
>>>
>>> On 05/29/2017 08:05 AM, Jean-Baptiste Onofré wrote:
>>>
>>> Hi team,
>>>>
>>>> Since last week, the build is broken due to tests failure on the
>>>> GCP/Spanner IO:
>>>>
>>>> java.lang.IllegalArgumentException: A project ID is required for this
>>>> service but could not be determined from the builder or the environment.
>>>> Please set a project ID using the builder.
>>>>
>>>> However, Jenkins seems OK on this. I checked and I don't see anything
>>>> special in the system variables or JVM arguments.
>>>>
>>>> I started a change on the SpannerIO to get the project ID in the code in
>>>> order to have the tests OK (fixing SpannerIO write). Depending of the
>>>> answers on this e-mail, I will create a pull request.
>>>>
>>>> Do you think it's reasonable ? I don't see anything special in the
>>>> READMEr about new prerequisites for SpannerIO.
>>>>
>>>> Does anyone else notice this tests failure ?
>>>>
>>>> Thanks,
>>>> Regards
>>>> JB
>>>>
>>>>
>>> --
>>> Jean-Baptiste Onofré
>>> jbonofre@apache.org
>>> http://blog.nanthrax.net
>>> Talend - http://www.talend.com
>>>
>>>
>>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>

Re: [INFO] Build fails on GCP IO (Spanner)

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Yup, it seems so.

I created:

https://issues.apache.org/jira/browse/BEAM-2379

for the tracking and I gonna take a look waiting Mairbek's feedback.

Thanks !
Regards
JB

On 05/29/2017 06:43 PM, Dan Halperin wrote:
> This looks like somewhere the unit tests are inferring a project from the
> environment when they should not be doing so.
> 
> On Mon, May 29, 2017 at 8:38 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
> wrote:
> 
>> Gonna try to purge my local m2 repo.
>>
>> Regards
>> JB
>>
>>
>> On 05/29/2017 08:05 AM, Jean-Baptiste Onofré wrote:
>>
>>> Hi team,
>>>
>>> Since last week, the build is broken due to tests failure on the
>>> GCP/Spanner IO:
>>>
>>> java.lang.IllegalArgumentException: A project ID is required for this
>>> service but could not be determined from the builder or the environment.
>>> Please set a project ID using the builder.
>>>
>>> However, Jenkins seems OK on this. I checked and I don't see anything
>>> special in the system variables or JVM arguments.
>>>
>>> I started a change on the SpannerIO to get the project ID in the code in
>>> order to have the tests OK (fixing SpannerIO write). Depending of the
>>> answers on this e-mail, I will create a pull request.
>>>
>>> Do you think it's reasonable ? I don't see anything special in the
>>> READMEr about new prerequisites for SpannerIO.
>>>
>>> Does anyone else notice this tests failure ?
>>>
>>> Thanks,
>>> Regards
>>> JB
>>>
>>
>> --
>> Jean-Baptiste Onofré
>> jbonofre@apache.org
>> http://blog.nanthrax.net
>> Talend - http://www.talend.com
>>
> 

-- 
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com

Re: [INFO] Build fails on GCP IO (Spanner)

Posted by Dan Halperin <dh...@google.com.INVALID>.
This looks like somewhere the unit tests are inferring a project from the
environment when they should not be doing so.

On Mon, May 29, 2017 at 8:38 AM, Jean-Baptiste Onofré <jb...@nanthrax.net>
wrote:

> Gonna try to purge my local m2 repo.
>
> Regards
> JB
>
>
> On 05/29/2017 08:05 AM, Jean-Baptiste Onofré wrote:
>
>> Hi team,
>>
>> Since last week, the build is broken due to tests failure on the
>> GCP/Spanner IO:
>>
>> java.lang.IllegalArgumentException: A project ID is required for this
>> service but could not be determined from the builder or the environment.
>> Please set a project ID using the builder.
>>
>> However, Jenkins seems OK on this. I checked and I don't see anything
>> special in the system variables or JVM arguments.
>>
>> I started a change on the SpannerIO to get the project ID in the code in
>> order to have the tests OK (fixing SpannerIO write). Depending of the
>> answers on this e-mail, I will create a pull request.
>>
>> Do you think it's reasonable ? I don't see anything special in the
>> READMEr about new prerequisites for SpannerIO.
>>
>> Does anyone else notice this tests failure ?
>>
>> Thanks,
>> Regards
>> JB
>>
>
> --
> Jean-Baptiste Onofré
> jbonofre@apache.org
> http://blog.nanthrax.net
> Talend - http://www.talend.com
>

Re: [INFO] Build fails on GCP IO (Spanner)

Posted by Jean-Baptiste Onofré <jb...@nanthrax.net>.
Gonna try to purge my local m2 repo.

Regards
JB

On 05/29/2017 08:05 AM, Jean-Baptiste Onofré wrote:
> Hi team,
> 
> Since last week, the build is broken due to tests failure on the GCP/Spanner IO:
> 
> java.lang.IllegalArgumentException: A project ID is required for this service 
> but could not be determined from the builder or the environment.  Please set a 
> project ID using the builder.
> 
> However, Jenkins seems OK on this. I checked and I don't see anything special in 
> the system variables or JVM arguments.
> 
> I started a change on the SpannerIO to get the project ID in the code in order 
> to have the tests OK (fixing SpannerIO write). Depending of the answers on this 
> e-mail, I will create a pull request.
> 
> Do you think it's reasonable ? I don't see anything special in the READMEr about 
> new prerequisites for SpannerIO.
> 
> Does anyone else notice this tests failure ?
> 
> Thanks,
> Regards
> JB

-- 
Jean-Baptiste Onofré
jbonofre@apache.org
http://blog.nanthrax.net
Talend - http://www.talend.com