You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by Brian Bowman <Br...@sas.com> on 2019/07/15 15:54:11 UTC
Workaround for Thrift download ERRORs
Is there a workaround for the following error?
requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
Here’s the log info from cmake:
-- Checking for module 'thrift'
-- No package 'thrift' found
-- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
Building Apache Thrift from source
Downloading Apache Thrift from Traceback (most recent call last):
File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
suggested_mirror = get_url('https://www.apache.org/dyn/'
File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
return requests.get(url).content
File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
return request('get', url, **kwargs)
File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
response = session.request(method=method, url=url, **kwargs)
File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
resp = self.send(prep, **send_kwargs)
File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
r = adapter.send(request, **kwargs)
File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
raise SSLError(e, request=request)
requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
Thanks,
Brian
Re: Workaround for Thrift download ERRORs
Posted by Brian Bowman <Br...@sas.com>.
This turns out to be a problem with cert validation when cmake sets up to download thrift, due to back-level RHEL 6 and Python 2.6.6 on the internal SAS build node where this fails.
We need to update to a newer supported version of Python on these machines.
https://issues.apache.org/jira/ seems to be down right now. I'll add a comment about this when it comes back.
-Brian
On 7/15/19, 3:45 PM, "Brian Bowman" <Br...@sas.com> wrote:
EXTERNAL
Wes,
I can reproduce this issue with a post-0.14.0 git-cloned repos on the same linux system where I see with the 0.14.0 release download. The successful cmake/make occurs on a Liunx VM where I personally staged all of the built tools, built gcc, cmake 3.2+ etc. This looks like a problem with my build environments here at SAS and NOT with the apache arrow/parquet code base.
Just updated https://issues.apache.org/jira/browse/ARROW-5953 with this info. I'll keep this JIRA open for now in case there is something new to report that can help others novice (like me) in building arrow/parquet.
Forgive the noise.
-Brian
On 7/15/19, 2:54 PM, "Wes McKinney" <we...@gmail.com> wrote:
EXTERNAL
Sorry, that's not right. That commit was included in 0.14.0. So I'm
not sure what code change could cause what you're seeing
On Mon, Jul 15, 2019 at 1:53 PM Wes McKinney <we...@gmail.com> wrote:
>
> It might have gotten fixed in
>
> https://github.com/apache/arrow/commit/3a37bf29c512b4c72c8da5b2a8657b21548cc47a#diff-d7849d7fb46f0cd405cfe5fd03828fcd
>
> On Mon, Jul 15, 2019 at 1:50 PM Brian Bowman <Br...@sas.com> wrote:
> >
> > See: https://issues.apache.org/jira/browse/ARROW-5953
> >
> > I'll keep digging.
> >
> > -Brian
> >
> > On 7/15/19, 2:45 PM, "Wes McKinney" <we...@gmail.com> wrote:
> >
> > EXTERNAL
> >
> > Brian -- I am concerned the issue is non-deterministic and relates to
> > the get_apache_mirror.py script. There may be something we can do to
> > make that script more robust, e.g. adding retry logic or some fallback
> > to a known mirror. Of course, if you can consistently reproduce the
> > issue that is good to know too
> >
> > - Wes
> >
> > On Mon, Jul 15, 2019 at 1:31 PM Brian Bowman <Br...@sas.com> wrote:
> > >
> > > Wes,
> > >
> > > Here are the cmake thrift log lines from a build of apache-arrow git clone on 06Jul2019 where cmake successfully downloads thrift.
> > >
> > > -- Checking for module 'thrift'
> > > -- No package 'thrift' found
> > > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB)
> > > Building Apache Thrift from source
> > > Downloading Apache Thrift from http://mirror.metrocast.net/apache//thrift/0.12.0/thrift-0.12.0.tar.gz
> > >
> > > Do you still want a JIRA issue entered, given that this git clone works and is a bit newer than the arrow-0.14.0 release .tar?
> > >
> > > - Brian
> > >
> > >
> > > On 7/15/19, 12:39 PM, "Wes McKinney" <we...@gmail.com> wrote:
> > >
> > > EXTERNAL
> > >
> > > hi Brian,
> > >
> > > Can you please open a JIRA issue?
> > >
> > > Does running the "get_apache_mirror.py" script work for you by itself?
> > >
> > > $ python cpp/build-support/get_apache_mirror.py
> > > https://www-eu.apache.org/dist/
> > >
> > > - Wes
> > >
> > > On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
> > > >
> > > > Is there a workaround for the following error?
> > > >
> > > > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> > > >
> > > > I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
> > > >
> > > > Here’s the log info from cmake:
> > > >
> > > > -- Checking for module 'thrift'
> > > > -- No package 'thrift' found
> > > > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> > > > Building Apache Thrift from source
> > > > Downloading Apache Thrift from Traceback (most recent call last):
> > > > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> > > > suggested_mirror = get_url('https://www.apache.org/dyn/'
> > > > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> > > > return requests.get(url).content
> > > > File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> > > > return request('get', url, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> > > > response = session.request(method=method, url=url, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> > > > resp = self.send(prep, **send_kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> > > > r = adapter.send(request, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> > > > raise SSLError(e, request=request)
> > > > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> > > >
> > > >
> > > > Thanks,
> > > >
> > > >
> > > > Brian
> > > >
> > >
> > >
> >
> >
Re: Workaround for Thrift download ERRORs
Posted by Brian Bowman <Br...@sas.com>.
Wes,
I can reproduce this issue with a post-0.14.0 git-cloned repos on the same linux system where I see with the 0.14.0 release download. The successful cmake/make occurs on a Liunx VM where I personally staged all of the built tools, built gcc, cmake 3.2+ etc. This looks like a problem with my build environments here at SAS and NOT with the apache arrow/parquet code base.
Just updated https://issues.apache.org/jira/browse/ARROW-5953 with this info. I'll keep this JIRA open for now in case there is something new to report that can help others novice (like me) in building arrow/parquet.
Forgive the noise.
-Brian
On 7/15/19, 2:54 PM, "Wes McKinney" <we...@gmail.com> wrote:
EXTERNAL
Sorry, that's not right. That commit was included in 0.14.0. So I'm
not sure what code change could cause what you're seeing
On Mon, Jul 15, 2019 at 1:53 PM Wes McKinney <we...@gmail.com> wrote:
>
> It might have gotten fixed in
>
> https://github.com/apache/arrow/commit/3a37bf29c512b4c72c8da5b2a8657b21548cc47a#diff-d7849d7fb46f0cd405cfe5fd03828fcd
>
> On Mon, Jul 15, 2019 at 1:50 PM Brian Bowman <Br...@sas.com> wrote:
> >
> > See: https://issues.apache.org/jira/browse/ARROW-5953
> >
> > I'll keep digging.
> >
> > -Brian
> >
> > On 7/15/19, 2:45 PM, "Wes McKinney" <we...@gmail.com> wrote:
> >
> > EXTERNAL
> >
> > Brian -- I am concerned the issue is non-deterministic and relates to
> > the get_apache_mirror.py script. There may be something we can do to
> > make that script more robust, e.g. adding retry logic or some fallback
> > to a known mirror. Of course, if you can consistently reproduce the
> > issue that is good to know too
> >
> > - Wes
> >
> > On Mon, Jul 15, 2019 at 1:31 PM Brian Bowman <Br...@sas.com> wrote:
> > >
> > > Wes,
> > >
> > > Here are the cmake thrift log lines from a build of apache-arrow git clone on 06Jul2019 where cmake successfully downloads thrift.
> > >
> > > -- Checking for module 'thrift'
> > > -- No package 'thrift' found
> > > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB)
> > > Building Apache Thrift from source
> > > Downloading Apache Thrift from http://mirror.metrocast.net/apache//thrift/0.12.0/thrift-0.12.0.tar.gz
> > >
> > > Do you still want a JIRA issue entered, given that this git clone works and is a bit newer than the arrow-0.14.0 release .tar?
> > >
> > > - Brian
> > >
> > >
> > > On 7/15/19, 12:39 PM, "Wes McKinney" <we...@gmail.com> wrote:
> > >
> > > EXTERNAL
> > >
> > > hi Brian,
> > >
> > > Can you please open a JIRA issue?
> > >
> > > Does running the "get_apache_mirror.py" script work for you by itself?
> > >
> > > $ python cpp/build-support/get_apache_mirror.py
> > > https://www-eu.apache.org/dist/
> > >
> > > - Wes
> > >
> > > On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
> > > >
> > > > Is there a workaround for the following error?
> > > >
> > > > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> > > >
> > > > I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
> > > >
> > > > Here’s the log info from cmake:
> > > >
> > > > -- Checking for module 'thrift'
> > > > -- No package 'thrift' found
> > > > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> > > > Building Apache Thrift from source
> > > > Downloading Apache Thrift from Traceback (most recent call last):
> > > > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> > > > suggested_mirror = get_url('https://www.apache.org/dyn/'
> > > > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> > > > return requests.get(url).content
> > > > File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> > > > return request('get', url, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> > > > response = session.request(method=method, url=url, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> > > > resp = self.send(prep, **send_kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> > > > r = adapter.send(request, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> > > > raise SSLError(e, request=request)
> > > > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> > > >
> > > >
> > > > Thanks,
> > > >
> > > >
> > > > Brian
> > > >
> > >
> > >
> >
> >
Re: Workaround for Thrift download ERRORs
Posted by Wes McKinney <we...@gmail.com>.
Sorry, that's not right. That commit was included in 0.14.0. So I'm
not sure what code change could cause what you're seeing
On Mon, Jul 15, 2019 at 1:53 PM Wes McKinney <we...@gmail.com> wrote:
>
> It might have gotten fixed in
>
> https://github.com/apache/arrow/commit/3a37bf29c512b4c72c8da5b2a8657b21548cc47a#diff-d7849d7fb46f0cd405cfe5fd03828fcd
>
> On Mon, Jul 15, 2019 at 1:50 PM Brian Bowman <Br...@sas.com> wrote:
> >
> > See: https://issues.apache.org/jira/browse/ARROW-5953
> >
> > I'll keep digging.
> >
> > -Brian
> >
> > On 7/15/19, 2:45 PM, "Wes McKinney" <we...@gmail.com> wrote:
> >
> > EXTERNAL
> >
> > Brian -- I am concerned the issue is non-deterministic and relates to
> > the get_apache_mirror.py script. There may be something we can do to
> > make that script more robust, e.g. adding retry logic or some fallback
> > to a known mirror. Of course, if you can consistently reproduce the
> > issue that is good to know too
> >
> > - Wes
> >
> > On Mon, Jul 15, 2019 at 1:31 PM Brian Bowman <Br...@sas.com> wrote:
> > >
> > > Wes,
> > >
> > > Here are the cmake thrift log lines from a build of apache-arrow git clone on 06Jul2019 where cmake successfully downloads thrift.
> > >
> > > -- Checking for module 'thrift'
> > > -- No package 'thrift' found
> > > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB)
> > > Building Apache Thrift from source
> > > Downloading Apache Thrift from http://mirror.metrocast.net/apache//thrift/0.12.0/thrift-0.12.0.tar.gz
> > >
> > > Do you still want a JIRA issue entered, given that this git clone works and is a bit newer than the arrow-0.14.0 release .tar?
> > >
> > > - Brian
> > >
> > >
> > > On 7/15/19, 12:39 PM, "Wes McKinney" <we...@gmail.com> wrote:
> > >
> > > EXTERNAL
> > >
> > > hi Brian,
> > >
> > > Can you please open a JIRA issue?
> > >
> > > Does running the "get_apache_mirror.py" script work for you by itself?
> > >
> > > $ python cpp/build-support/get_apache_mirror.py
> > > https://www-eu.apache.org/dist/
> > >
> > > - Wes
> > >
> > > On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
> > > >
> > > > Is there a workaround for the following error?
> > > >
> > > > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> > > >
> > > > I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
> > > >
> > > > Here’s the log info from cmake:
> > > >
> > > > -- Checking for module 'thrift'
> > > > -- No package 'thrift' found
> > > > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> > > > Building Apache Thrift from source
> > > > Downloading Apache Thrift from Traceback (most recent call last):
> > > > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> > > > suggested_mirror = get_url('https://www.apache.org/dyn/'
> > > > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> > > > return requests.get(url).content
> > > > File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> > > > return request('get', url, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> > > > response = session.request(method=method, url=url, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> > > > resp = self.send(prep, **send_kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> > > > r = adapter.send(request, **kwargs)
> > > > File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> > > > raise SSLError(e, request=request)
> > > > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> > > >
> > > >
> > > > Thanks,
> > > >
> > > >
> > > > Brian
> > > >
> > >
> > >
> >
> >
Re: Workaround for Thrift download ERRORs
Posted by Wes McKinney <we...@gmail.com>.
It might have gotten fixed in
https://github.com/apache/arrow/commit/3a37bf29c512b4c72c8da5b2a8657b21548cc47a#diff-d7849d7fb46f0cd405cfe5fd03828fcd
On Mon, Jul 15, 2019 at 1:50 PM Brian Bowman <Br...@sas.com> wrote:
>
> See: https://issues.apache.org/jira/browse/ARROW-5953
>
> I'll keep digging.
>
> -Brian
>
> On 7/15/19, 2:45 PM, "Wes McKinney" <we...@gmail.com> wrote:
>
> EXTERNAL
>
> Brian -- I am concerned the issue is non-deterministic and relates to
> the get_apache_mirror.py script. There may be something we can do to
> make that script more robust, e.g. adding retry logic or some fallback
> to a known mirror. Of course, if you can consistently reproduce the
> issue that is good to know too
>
> - Wes
>
> On Mon, Jul 15, 2019 at 1:31 PM Brian Bowman <Br...@sas.com> wrote:
> >
> > Wes,
> >
> > Here are the cmake thrift log lines from a build of apache-arrow git clone on 06Jul2019 where cmake successfully downloads thrift.
> >
> > -- Checking for module 'thrift'
> > -- No package 'thrift' found
> > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB)
> > Building Apache Thrift from source
> > Downloading Apache Thrift from http://mirror.metrocast.net/apache//thrift/0.12.0/thrift-0.12.0.tar.gz
> >
> > Do you still want a JIRA issue entered, given that this git clone works and is a bit newer than the arrow-0.14.0 release .tar?
> >
> > - Brian
> >
> >
> > On 7/15/19, 12:39 PM, "Wes McKinney" <we...@gmail.com> wrote:
> >
> > EXTERNAL
> >
> > hi Brian,
> >
> > Can you please open a JIRA issue?
> >
> > Does running the "get_apache_mirror.py" script work for you by itself?
> >
> > $ python cpp/build-support/get_apache_mirror.py
> > https://www-eu.apache.org/dist/
> >
> > - Wes
> >
> > On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
> > >
> > > Is there a workaround for the following error?
> > >
> > > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> > >
> > > I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
> > >
> > > Here’s the log info from cmake:
> > >
> > > -- Checking for module 'thrift'
> > > -- No package 'thrift' found
> > > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> > > Building Apache Thrift from source
> > > Downloading Apache Thrift from Traceback (most recent call last):
> > > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> > > suggested_mirror = get_url('https://www.apache.org/dyn/'
> > > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> > > return requests.get(url).content
> > > File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> > > return request('get', url, **kwargs)
> > > File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> > > response = session.request(method=method, url=url, **kwargs)
> > > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> > > resp = self.send(prep, **send_kwargs)
> > > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> > > r = adapter.send(request, **kwargs)
> > > File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> > > raise SSLError(e, request=request)
> > > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> > >
> > >
> > > Thanks,
> > >
> > >
> > > Brian
> > >
> >
> >
>
>
Re: Workaround for Thrift download ERRORs
Posted by Brian Bowman <Br...@sas.com>.
See: https://issues.apache.org/jira/browse/ARROW-5953
I'll keep digging.
-Brian
On 7/15/19, 2:45 PM, "Wes McKinney" <we...@gmail.com> wrote:
EXTERNAL
Brian -- I am concerned the issue is non-deterministic and relates to
the get_apache_mirror.py script. There may be something we can do to
make that script more robust, e.g. adding retry logic or some fallback
to a known mirror. Of course, if you can consistently reproduce the
issue that is good to know too
- Wes
On Mon, Jul 15, 2019 at 1:31 PM Brian Bowman <Br...@sas.com> wrote:
>
> Wes,
>
> Here are the cmake thrift log lines from a build of apache-arrow git clone on 06Jul2019 where cmake successfully downloads thrift.
>
> -- Checking for module 'thrift'
> -- No package 'thrift' found
> -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB)
> Building Apache Thrift from source
> Downloading Apache Thrift from http://mirror.metrocast.net/apache//thrift/0.12.0/thrift-0.12.0.tar.gz
>
> Do you still want a JIRA issue entered, given that this git clone works and is a bit newer than the arrow-0.14.0 release .tar?
>
> - Brian
>
>
> On 7/15/19, 12:39 PM, "Wes McKinney" <we...@gmail.com> wrote:
>
> EXTERNAL
>
> hi Brian,
>
> Can you please open a JIRA issue?
>
> Does running the "get_apache_mirror.py" script work for you by itself?
>
> $ python cpp/build-support/get_apache_mirror.py
> https://www-eu.apache.org/dist/
>
> - Wes
>
> On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
> >
> > Is there a workaround for the following error?
> >
> > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> >
> > I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
> >
> > Here’s the log info from cmake:
> >
> > -- Checking for module 'thrift'
> > -- No package 'thrift' found
> > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> > Building Apache Thrift from source
> > Downloading Apache Thrift from Traceback (most recent call last):
> > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> > suggested_mirror = get_url('https://www.apache.org/dyn/'
> > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> > return requests.get(url).content
> > File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> > return request('get', url, **kwargs)
> > File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> > response = session.request(method=method, url=url, **kwargs)
> > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> > resp = self.send(prep, **send_kwargs)
> > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> > r = adapter.send(request, **kwargs)
> > File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> > raise SSLError(e, request=request)
> > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> >
> >
> > Thanks,
> >
> >
> > Brian
> >
>
>
Re: Workaround for Thrift download ERRORs
Posted by Wes McKinney <we...@gmail.com>.
Brian -- I am concerned the issue is non-deterministic and relates to
the get_apache_mirror.py script. There may be something we can do to
make that script more robust, e.g. adding retry logic or some fallback
to a known mirror. Of course, if you can consistently reproduce the
issue that is good to know too
- Wes
On Mon, Jul 15, 2019 at 1:31 PM Brian Bowman <Br...@sas.com> wrote:
>
> Wes,
>
> Here are the cmake thrift log lines from a build of apache-arrow git clone on 06Jul2019 where cmake successfully downloads thrift.
>
> -- Checking for module 'thrift'
> -- No package 'thrift' found
> -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB)
> Building Apache Thrift from source
> Downloading Apache Thrift from http://mirror.metrocast.net/apache//thrift/0.12.0/thrift-0.12.0.tar.gz
>
> Do you still want a JIRA issue entered, given that this git clone works and is a bit newer than the arrow-0.14.0 release .tar?
>
> - Brian
>
>
> On 7/15/19, 12:39 PM, "Wes McKinney" <we...@gmail.com> wrote:
>
> EXTERNAL
>
> hi Brian,
>
> Can you please open a JIRA issue?
>
> Does running the "get_apache_mirror.py" script work for you by itself?
>
> $ python cpp/build-support/get_apache_mirror.py
> https://www-eu.apache.org/dist/
>
> - Wes
>
> On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
> >
> > Is there a workaround for the following error?
> >
> > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> >
> > I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
> >
> > Here’s the log info from cmake:
> >
> > -- Checking for module 'thrift'
> > -- No package 'thrift' found
> > -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> > Building Apache Thrift from source
> > Downloading Apache Thrift from Traceback (most recent call last):
> > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> > suggested_mirror = get_url('https://www.apache.org/dyn/'
> > File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> > return requests.get(url).content
> > File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> > return request('get', url, **kwargs)
> > File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> > response = session.request(method=method, url=url, **kwargs)
> > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> > resp = self.send(prep, **send_kwargs)
> > File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> > r = adapter.send(request, **kwargs)
> > File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> > raise SSLError(e, request=request)
> > requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
> >
> >
> > Thanks,
> >
> >
> > Brian
> >
>
>
Re: Workaround for Thrift download ERRORs
Posted by Brian Bowman <Br...@sas.com>.
Wes,
Here are the cmake thrift log lines from a build of apache-arrow git clone on 06Jul2019 where cmake successfully downloads thrift.
-- Checking for module 'thrift'
-- No package 'thrift' found
-- Could NOT find Thrift (missing: THRIFT_STATIC_LIB)
Building Apache Thrift from source
Downloading Apache Thrift from http://mirror.metrocast.net/apache//thrift/0.12.0/thrift-0.12.0.tar.gz
Do you still want a JIRA issue entered, given that this git clone works and is a bit newer than the arrow-0.14.0 release .tar?
- Brian
On 7/15/19, 12:39 PM, "Wes McKinney" <we...@gmail.com> wrote:
EXTERNAL
hi Brian,
Can you please open a JIRA issue?
Does running the "get_apache_mirror.py" script work for you by itself?
$ python cpp/build-support/get_apache_mirror.py
https://www-eu.apache.org/dist/
- Wes
On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
>
> Is there a workaround for the following error?
>
> requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
>
> I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
>
> Here’s the log info from cmake:
>
> -- Checking for module 'thrift'
> -- No package 'thrift' found
> -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> Building Apache Thrift from source
> Downloading Apache Thrift from Traceback (most recent call last):
> File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> suggested_mirror = get_url('https://www.apache.org/dyn/'
> File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> return requests.get(url).content
> File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> return request('get', url, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> response = session.request(method=method, url=url, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> resp = self.send(prep, **send_kwargs)
> File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> r = adapter.send(request, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> raise SSLError(e, request=request)
> requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
>
>
> Thanks,
>
>
> Brian
>
Re: Workaround for Thrift download ERRORs
Posted by Brian Bowman <Br...@sas.com>.
Wes,
Here are the cmake thrift log lines from a build of apache-arrow git clone on 06Jul2019 where cmake successfully downloads thrift.
-- Checking for module 'thrift'
-- No package 'thrift' found
-- Could NOT find Thrift (missing: THRIFT_STATIC_LIB)
Building Apache Thrift from source
Downloading Apache Thrift from http://mirror.metrocast.net/apache//thrift/0.12.0/thrift-0.12.0.tar.gz
Do you still want a JIRA issue entered, given that this git clone works and is a bit newer than the arrow-0.14.0 release .tar?
- Brian
On 7/15/19, 12:39 PM, "Wes McKinney" <we...@gmail.com> wrote:
EXTERNAL
hi Brian,
Can you please open a JIRA issue?
Does running the "get_apache_mirror.py" script work for you by itself?
$ python cpp/build-support/get_apache_mirror.py
https://www-eu.apache.org/dist/
- Wes
On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
>
> Is there a workaround for the following error?
>
> requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
>
> I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
>
> Here’s the log info from cmake:
>
> -- Checking for module 'thrift'
> -- No package 'thrift' found
> -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> Building Apache Thrift from source
> Downloading Apache Thrift from Traceback (most recent call last):
> File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> suggested_mirror = get_url('https://www.apache.org/dyn/'
> File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> return requests.get(url).content
> File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> return request('get', url, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> response = session.request(method=method, url=url, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> resp = self.send(prep, **send_kwargs)
> File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> r = adapter.send(request, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> raise SSLError(e, request=request)
> requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
>
>
> Thanks,
>
>
> Brian
>
Re: Workaround for Thrift download ERRORs
Posted by Wes McKinney <we...@gmail.com>.
hi Brian,
Can you please open a JIRA issue?
Does running the "get_apache_mirror.py" script work for you by itself?
$ python cpp/build-support/get_apache_mirror.py
https://www-eu.apache.org/dist/
- Wes
On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
>
> Is there a workaround for the following error?
>
> requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
>
> I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
>
> Here’s the log info from cmake:
>
> -- Checking for module 'thrift'
> -- No package 'thrift' found
> -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> Building Apache Thrift from source
> Downloading Apache Thrift from Traceback (most recent call last):
> File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> suggested_mirror = get_url('https://www.apache.org/dyn/'
> File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> return requests.get(url).content
> File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> return request('get', url, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> response = session.request(method=method, url=url, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> resp = self.send(prep, **send_kwargs)
> File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> r = adapter.send(request, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> raise SSLError(e, request=request)
> requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
>
>
> Thanks,
>
>
> Brian
>
Re: Workaround for Thrift download ERRORs
Posted by Wes McKinney <we...@gmail.com>.
hi Brian,
Can you please open a JIRA issue?
Does running the "get_apache_mirror.py" script work for you by itself?
$ python cpp/build-support/get_apache_mirror.py
https://www-eu.apache.org/dist/
- Wes
On Mon, Jul 15, 2019 at 10:54 AM Brian Bowman <Br...@sas.com> wrote:
>
> Is there a workaround for the following error?
>
> requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
>
> I’ve inflated apache-arrow-0.14.0.tar and the thrift-0.12.0.tar.gz is not being found curing cmake. This results in downstream compile errors during make.
>
> Here’s the log info from cmake:
>
> -- Checking for module 'thrift'
> -- No package 'thrift' found
> -- Could NOT find Thrift (missing: THRIFT_STATIC_LIB THRIFT_INCLUDE_DIR THRIFT_COMPILER)
> Building Apache Thrift from source
> Downloading Apache Thrift from Traceback (most recent call last):
> File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 38, in <module>
> suggested_mirror = get_url('https://www.apache.org/dyn/'
> File "…/apache-arrow-0.14.0/cpp/build-support/get_apache_mirror.py", line 27, in get_url
> return requests.get(url).content
> File "/usr/lib/python2.6/site-packages/requests/api.py", line 68, in get
> return request('get', url, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/api.py", line 50, in request
> response = session.request(method=method, url=url, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 464, in request
> resp = self.send(prep, **send_kwargs)
> File "/usr/lib/python2.6/site-packages/requests/sessions.py", line 576, in send
> r = adapter.send(request, **kwargs)
> File "/usr/lib/python2.6/site-packages/requests/adapters.py", line 431, in send
> raise SSLError(e, request=request)
> requests.exceptions.SSLError: hostname 'www.apache.org' doesn't match either of '*.openoffice.org', 'openoffice.org'/thrift/0.12.0/thrift-0.12.0.tar.gz
>
>
> Thanks,
>
>
> Brian
>