You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by Reuven Lax <re...@google.com> on 2021/01/08 01:41:51 UTC

pulllicenses fails while building

I recently upgraded to Python 3 on my build machine. Now all attempts to
build Beam fail with the following. Anyone know how to ix this?

urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED]
certificate verify failed: unable to get local issuer certificate
(_ssl.c:1123)>

ERROR:root:Invalid url for paranamer-2.7:
https://raw.githubusercontent.com/paul-hammant/paranamer/master/LICENSE.txt.

Re: pulllicenses fails while building

Posted by Kyle Weaver <kc...@google.com>.
FYI Emily fixed the bug with unintended license pulling. So bugs like the
one Reuven originally reported should be bypassed by default.

On Fri, Jan 8, 2021 at 5:01 PM Kyle Weaver <kc...@google.com> wrote:

> > $0.02 can we make it a separate target rather than an existing target
> with flags?
>
> Something like :sdks:java:container:java8:dockerWithLicenses? I think that
> would make sense, but it's orthogonal to this bug. Can you file a feature
> request Kenn?
>
> On Fri, Jan 8, 2021 at 4:50 PM Kenneth Knowles <ke...@apache.org> wrote:
>
>> $0.02 can we make it a separate target rather than an existing target
>> with flags?
>>
>> On Fri, Jan 8, 2021 at 11:06 AM Kyle Weaver <kc...@google.com> wrote:
>>
>>> ./gradlew :sdks:java:container:build runs the pullLicenses task.
>>> https://issues.apache.org/jira/browse/BEAM-11586
>>>
>>> On Fri, Jan 8, 2021 at 10:59 AM Kyle Weaver <kc...@google.com> wrote:
>>>
>>>> Which Gradle command are you running Reuven? And which Gradle task is
>>>> failing?
>>>>
>>>> > Also, I am not sure why licenses are pulled for regular development
>>>> case. I thought it was not meant to run by default.
>>>>
>>>> +1 this seems like a bug. IIRC you are supposed to pass
>>>> "-Pdocker-pull-licenses" to Gradle to enable pulling licenses, but it
>>>> shouldn't be set by default.
>>>>
>>>> On Thu, Jan 7, 2021 at 7:48 PM Reuven Lax <re...@google.com> wrote:
>>>>
>>>>> Unfortunately, setting that env variable didn't change anything.
>>>>>
>>>>> On Thu, Jan 7, 2021 at 7:09 PM Ahmet Altay <al...@google.com> wrote:
>>>>>
>>>>>> Googled this a bit. Setting this env variable might fix the problem
>>>>>> by bypassing the check:
>>>>>> export PYTHONHTTPSVERIFY=0
>>>>>>
>>>>>> Could you try that? If it works we can make that part of the script.
>>>>>>
>>>>>> Also, I am not sure why licenses are pulled for regular development
>>>>>> case. I thought it was not meant to run by default.
>>>>>>
>>>>>> /cc +Tyson Hamilton <ty...@google.com> +Emily Ye
>>>>>> <em...@google.com>
>>>>>>
>>>>>> On Thu, Jan 7, 2021 at 5:42 PM Reuven Lax <re...@google.com> wrote:
>>>>>>
>>>>>>> I recently upgraded to Python 3 on my build machine. Now all
>>>>>>> attempts to build Beam fail with the following. Anyone know how to ix this?
>>>>>>>
>>>>>>> urllib.error.URLError: <urlopen error [SSL:
>>>>>>> CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local
>>>>>>> issuer certificate (_ssl.c:1123)>
>>>>>>>
>>>>>>> ERROR:root:Invalid url for paranamer-2.7:
>>>>>>> https://raw.githubusercontent.com/paul-hammant/paranamer/master/LICENSE.txt
>>>>>>> .
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>

Re: pulllicenses fails while building

Posted by Kyle Weaver <kc...@google.com>.
> $0.02 can we make it a separate target rather than an existing target
with flags?

Something like :sdks:java:container:java8:dockerWithLicenses? I think that
would make sense, but it's orthogonal to this bug. Can you file a feature
request Kenn?

On Fri, Jan 8, 2021 at 4:50 PM Kenneth Knowles <ke...@apache.org> wrote:

> $0.02 can we make it a separate target rather than an existing target with
> flags?
>
> On Fri, Jan 8, 2021 at 11:06 AM Kyle Weaver <kc...@google.com> wrote:
>
>> ./gradlew :sdks:java:container:build runs the pullLicenses task.
>> https://issues.apache.org/jira/browse/BEAM-11586
>>
>> On Fri, Jan 8, 2021 at 10:59 AM Kyle Weaver <kc...@google.com> wrote:
>>
>>> Which Gradle command are you running Reuven? And which Gradle task is
>>> failing?
>>>
>>> > Also, I am not sure why licenses are pulled for regular development
>>> case. I thought it was not meant to run by default.
>>>
>>> +1 this seems like a bug. IIRC you are supposed to pass
>>> "-Pdocker-pull-licenses" to Gradle to enable pulling licenses, but it
>>> shouldn't be set by default.
>>>
>>> On Thu, Jan 7, 2021 at 7:48 PM Reuven Lax <re...@google.com> wrote:
>>>
>>>> Unfortunately, setting that env variable didn't change anything.
>>>>
>>>> On Thu, Jan 7, 2021 at 7:09 PM Ahmet Altay <al...@google.com> wrote:
>>>>
>>>>> Googled this a bit. Setting this env variable might fix the problem by
>>>>> bypassing the check:
>>>>> export PYTHONHTTPSVERIFY=0
>>>>>
>>>>> Could you try that? If it works we can make that part of the script.
>>>>>
>>>>> Also, I am not sure why licenses are pulled for regular development
>>>>> case. I thought it was not meant to run by default.
>>>>>
>>>>> /cc +Tyson Hamilton <ty...@google.com> +Emily Ye
>>>>> <em...@google.com>
>>>>>
>>>>> On Thu, Jan 7, 2021 at 5:42 PM Reuven Lax <re...@google.com> wrote:
>>>>>
>>>>>> I recently upgraded to Python 3 on my build machine. Now all
>>>>>> attempts to build Beam fail with the following. Anyone know how to ix this?
>>>>>>
>>>>>> urllib.error.URLError: <urlopen error [SSL:
>>>>>> CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local
>>>>>> issuer certificate (_ssl.c:1123)>
>>>>>>
>>>>>> ERROR:root:Invalid url for paranamer-2.7:
>>>>>> https://raw.githubusercontent.com/paul-hammant/paranamer/master/LICENSE.txt
>>>>>> .
>>>>>>
>>>>>>
>>>>>>
>>>>>>

Re: pulllicenses fails while building

Posted by Kenneth Knowles <ke...@apache.org>.
$0.02 can we make it a separate target rather than an existing target with
flags?

On Fri, Jan 8, 2021 at 11:06 AM Kyle Weaver <kc...@google.com> wrote:

> ./gradlew :sdks:java:container:build runs the pullLicenses task.
> https://issues.apache.org/jira/browse/BEAM-11586
>
> On Fri, Jan 8, 2021 at 10:59 AM Kyle Weaver <kc...@google.com> wrote:
>
>> Which Gradle command are you running Reuven? And which Gradle task is
>> failing?
>>
>> > Also, I am not sure why licenses are pulled for regular development
>> case. I thought it was not meant to run by default.
>>
>> +1 this seems like a bug. IIRC you are supposed to pass
>> "-Pdocker-pull-licenses" to Gradle to enable pulling licenses, but it
>> shouldn't be set by default.
>>
>> On Thu, Jan 7, 2021 at 7:48 PM Reuven Lax <re...@google.com> wrote:
>>
>>> Unfortunately, setting that env variable didn't change anything.
>>>
>>> On Thu, Jan 7, 2021 at 7:09 PM Ahmet Altay <al...@google.com> wrote:
>>>
>>>> Googled this a bit. Setting this env variable might fix the problem by
>>>> bypassing the check:
>>>> export PYTHONHTTPSVERIFY=0
>>>>
>>>> Could you try that? If it works we can make that part of the script.
>>>>
>>>> Also, I am not sure why licenses are pulled for regular development
>>>> case. I thought it was not meant to run by default.
>>>>
>>>> /cc +Tyson Hamilton <ty...@google.com> +Emily Ye <em...@google.com>
>>>>
>>>>
>>>> On Thu, Jan 7, 2021 at 5:42 PM Reuven Lax <re...@google.com> wrote:
>>>>
>>>>> I recently upgraded to Python 3 on my build machine. Now all
>>>>> attempts to build Beam fail with the following. Anyone know how to ix this?
>>>>>
>>>>> urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED]
>>>>> certificate verify failed: unable to get local issuer certificate
>>>>> (_ssl.c:1123)>
>>>>>
>>>>> ERROR:root:Invalid url for paranamer-2.7:
>>>>> https://raw.githubusercontent.com/paul-hammant/paranamer/master/LICENSE.txt
>>>>> .
>>>>>
>>>>>
>>>>>
>>>>>

Re: pulllicenses fails while building

Posted by Kyle Weaver <kc...@google.com>.
./gradlew :sdks:java:container:build runs the pullLicenses task.
https://issues.apache.org/jira/browse/BEAM-11586

On Fri, Jan 8, 2021 at 10:59 AM Kyle Weaver <kc...@google.com> wrote:

> Which Gradle command are you running Reuven? And which Gradle task is
> failing?
>
> > Also, I am not sure why licenses are pulled for regular development
> case. I thought it was not meant to run by default.
>
> +1 this seems like a bug. IIRC you are supposed to pass
> "-Pdocker-pull-licenses" to Gradle to enable pulling licenses, but it
> shouldn't be set by default.
>
> On Thu, Jan 7, 2021 at 7:48 PM Reuven Lax <re...@google.com> wrote:
>
>> Unfortunately, setting that env variable didn't change anything.
>>
>> On Thu, Jan 7, 2021 at 7:09 PM Ahmet Altay <al...@google.com> wrote:
>>
>>> Googled this a bit. Setting this env variable might fix the problem by
>>> bypassing the check:
>>> export PYTHONHTTPSVERIFY=0
>>>
>>> Could you try that? If it works we can make that part of the script.
>>>
>>> Also, I am not sure why licenses are pulled for regular development
>>> case. I thought it was not meant to run by default.
>>>
>>> /cc +Tyson Hamilton <ty...@google.com> +Emily Ye <em...@google.com>
>>>
>>> On Thu, Jan 7, 2021 at 5:42 PM Reuven Lax <re...@google.com> wrote:
>>>
>>>> I recently upgraded to Python 3 on my build machine. Now all
>>>> attempts to build Beam fail with the following. Anyone know how to ix this?
>>>>
>>>> urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED]
>>>> certificate verify failed: unable to get local issuer certificate
>>>> (_ssl.c:1123)>
>>>>
>>>> ERROR:root:Invalid url for paranamer-2.7:
>>>> https://raw.githubusercontent.com/paul-hammant/paranamer/master/LICENSE.txt
>>>> .
>>>>
>>>>
>>>>
>>>>

Re: pulllicenses fails while building

Posted by Kyle Weaver <kc...@google.com>.
Which Gradle command are you running Reuven? And which Gradle task is
failing?

> Also, I am not sure why licenses are pulled for regular development case.
I thought it was not meant to run by default.

+1 this seems like a bug. IIRC you are supposed to pass
"-Pdocker-pull-licenses" to Gradle to enable pulling licenses, but it
shouldn't be set by default.

On Thu, Jan 7, 2021 at 7:48 PM Reuven Lax <re...@google.com> wrote:

> Unfortunately, setting that env variable didn't change anything.
>
> On Thu, Jan 7, 2021 at 7:09 PM Ahmet Altay <al...@google.com> wrote:
>
>> Googled this a bit. Setting this env variable might fix the problem by
>> bypassing the check:
>> export PYTHONHTTPSVERIFY=0
>>
>> Could you try that? If it works we can make that part of the script.
>>
>> Also, I am not sure why licenses are pulled for regular development case.
>> I thought it was not meant to run by default.
>>
>> /cc +Tyson Hamilton <ty...@google.com> +Emily Ye <em...@google.com>
>>
>> On Thu, Jan 7, 2021 at 5:42 PM Reuven Lax <re...@google.com> wrote:
>>
>>> I recently upgraded to Python 3 on my build machine. Now all attempts to
>>> build Beam fail with the following. Anyone know how to ix this?
>>>
>>> urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED]
>>> certificate verify failed: unable to get local issuer certificate
>>> (_ssl.c:1123)>
>>>
>>> ERROR:root:Invalid url for paranamer-2.7:
>>> https://raw.githubusercontent.com/paul-hammant/paranamer/master/LICENSE.txt
>>> .
>>>
>>>
>>>
>>>

Re: pulllicenses fails while building

Posted by Reuven Lax <re...@google.com>.
Unfortunately, setting that env variable didn't change anything.

On Thu, Jan 7, 2021 at 7:09 PM Ahmet Altay <al...@google.com> wrote:

> Googled this a bit. Setting this env variable might fix the problem by
> bypassing the check:
> export PYTHONHTTPSVERIFY=0
>
> Could you try that? If it works we can make that part of the script.
>
> Also, I am not sure why licenses are pulled for regular development case.
> I thought it was not meant to run by default.
>
> /cc +Tyson Hamilton <ty...@google.com> +Emily Ye <em...@google.com>
>
> On Thu, Jan 7, 2021 at 5:42 PM Reuven Lax <re...@google.com> wrote:
>
>> I recently upgraded to Python 3 on my build machine. Now all attempts to
>> build Beam fail with the following. Anyone know how to ix this?
>>
>> urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED]
>> certificate verify failed: unable to get local issuer certificate
>> (_ssl.c:1123)>
>>
>> ERROR:root:Invalid url for paranamer-2.7:
>> https://raw.githubusercontent.com/paul-hammant/paranamer/master/LICENSE.txt
>> .
>>
>>
>>
>>

Re: pulllicenses fails while building

Posted by Ahmet Altay <al...@google.com>.
Googled this a bit. Setting this env variable might fix the problem by
bypassing the check:
export PYTHONHTTPSVERIFY=0

Could you try that? If it works we can make that part of the script.

Also, I am not sure why licenses are pulled for regular development case. I
thought it was not meant to run by default.

/cc +Tyson Hamilton <ty...@google.com> +Emily Ye <em...@google.com>

On Thu, Jan 7, 2021 at 5:42 PM Reuven Lax <re...@google.com> wrote:

> I recently upgraded to Python 3 on my build machine. Now all attempts to
> build Beam fail with the following. Anyone know how to ix this?
>
> urllib.error.URLError: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED]
> certificate verify failed: unable to get local issuer certificate
> (_ssl.c:1123)>
>
> ERROR:root:Invalid url for paranamer-2.7:
> https://raw.githubusercontent.com/paul-hammant/paranamer/master/LICENSE.txt
> .
>
>
>
>