You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@beam.apache.org by "Morand, Sebastien" <se...@veolia.com> on 2017/09/15 08:26:25 UTC
Problem while upgrading lib
Hi,
Hi got a problem when I install the oauth2client>=4.0.0 version:
>>> import apache_beam.io.gcp.gcsio
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File
"/home/ubuntu/workspace/tmp/beam_oauth/env/local/lib/python2.7/site-packages/apache_beam/io/gcp/gcsio.py",
line 53, in <module>
'Google Cloud Storage I/O not supported for this execution environment '
ImportError: Google Cloud Storage I/O not supported for this execution
environment (could not import storage API client).
>>>
Steps to reproduce:
virtualenv env && source env/bin/activate && pip install
'apache_beam==2.1.0' 'oauth2client>=4.0.0' && echo "import
apache_beam.io.gcp.gcsio"|python2
What is going on? How can I make apache_beam working with oauth2client >= 4.
Thanks by advance,
Regards,
*Sébastien MORAND*
Team Lead Solution Architect
Technology & Operations / Digital Factory
Veolia - Group Information Systems & Technology (IS&T)
Cell.: +33 7 52 66 20 81 / Direct: +33 1 85 57 71 08
Bureau 0144C (Ouest)
30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
*www.veolia.com <http://www.veolia.com>*
<http://www.veolia.com>
<https://www.facebook.com/veoliaenvironment/>
<https://www.youtube.com/user/veoliaenvironnement>
<https://www.linkedin.com/company/veolia-environnement>
<https://twitter.com/veolia>
--
--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain
information that is proprietary, privileged and/or confidential to Veolia
Environnement and/or its affiliates and is intended exclusively for the
person(s) to whom it is addressed. If you are not the intended recipient,
please notify the sender by return e-mail and delete all copies of this
e-mail, including all attachments. Unless expressly authorized, any use,
disclosure, publication, retransmission or dissemination of this e-mail
and/or of its attachments is strictly prohibited.
Ce message electronique et ses fichiers attaches sont strictement
confidentiels et peuvent contenir des elements dont Veolia Environnement
et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc
destines a l'usage de leurs seuls destinataires. Si vous avez recu ce
message par erreur, merci de le retourner a son emetteur et de le detruire
ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la
publication, la distribution, ou la reproduction non expressement
autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------
Re: Problem while upgrading lib
Posted by Charles Chen <cc...@google.com.INVALID>.
Please also use the requirement "pip install apache_beam[gcp]" to pull in
appropriate Google Cloud dependencies, if needed.
On Tue, Oct 3, 2017 at 11:47 AM Ahmet Altay <al...@google.com.invalid>
wrote:
> google-apitools dependency (which is required for GCS) does not work
> with oauth2client >= 4.0.0 [1]. Because of this Beam Python SDK also does
> not work with oauth2client >= 4.0.0 versions, and this is captured
> correctly in the setup.py [2].
>
> Ahmet
>
> [1]
>
> https://github.com/google/apitools/blob/7aff8d88960b669c9e946c938de5841c5f296f4f/setup.py#L32
> [2]
>
> https://github.com/apache/beam/blob/f9bc76364636b92239510f9e6bd242ea0ea62ac6/sdks/python/setup.py#L104
>
> On Tue, Sep 19, 2017 at 8:40 AM, Morand, Sebastien <
> sebastien.morand@veolia.com> wrote:
>
> > Hi,
> >
> > No help on this?
> >
> > Regards,
> >
> > *Sébastien MORAND*
> > Team Lead Solution Architect
> > Technology & Operations / Digital Factory
> > Veolia - Group Information Systems & Technology (IS&T)
> > Cell.: +33 7 52 66 20 81 <+33%207%2052%2066%2020%2081> / Direct: +33 1
> 85 57 71 08 <+33%201%2085%2057%2071%2008>
> > Bureau 0144C (Ouest)
> > 30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
> > *www.veolia.com <http://www.veolia.com>*
> > <http://www.veolia.com>
> > <https://www.facebook.com/veoliaenvironment/>
> > <https://www.youtube.com/user/veoliaenvironnement>
> > <https://www.linkedin.com/company/veolia-environnement>
> > <https://twitter.com/veolia>
> >
> > On 15 September 2017 at 10:26, Morand, Sebastien <
> > sebastien.morand@veolia.com> wrote:
> >
> > > Hi,
> > >
> > > Hi got a problem when I install the oauth2client>=4.0.0 version:
> > >
> > > >>> import apache_beam.io.gcp.gcsio
> > > Traceback (most recent call last):
> > > File "<stdin>", line 1, in <module>
> > > File "/home/ubuntu/workspace/tmp/beam_oauth/env/local/lib/
> > > python2.7/site-packages/apache_beam/io/gcp/gcsio.py", line 53, in
> > <module>
> > > 'Google Cloud Storage I/O not supported for this execution
> > environment
> > > '
> > > ImportError: Google Cloud Storage I/O not supported for this execution
> > > environment (could not import storage API client).
> > > >>>
> > >
> > > Steps to reproduce:
> > > virtualenv env && source env/bin/activate && pip install
> > > 'apache_beam==2.1.0' 'oauth2client>=4.0.0' && echo "import
> > > apache_beam.io.gcp.gcsio"|python2
> > >
> > > What is going on? How can I make apache_beam working with oauth2client
> >=
> > > 4.
> > >
> > > Thanks by advance,
> > > Regards,
> > >
> > > *Sébastien MORAND*
> > > Team Lead Solution Architect
> > > Technology & Operations / Digital Factory
> > > Veolia - Group Information Systems & Technology (IS&T)
> > > Cell.: +33 7 52 66 20 81 <+33%207%2052%2066%2020%2081> / Direct: +33
> 1 85 57 71 08 <+33%201%2085%2057%2071%2008>
> > > <+33%201%2085%2057%2071%2008>
> > > Bureau 0144C (Ouest)
> > > 30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
> > > *www.veolia.com <http://www.veolia.com>*
> > > <http://www.veolia.com>
> > > <https://www.facebook.com/veoliaenvironment/>
> > > <https://www.youtube.com/user/veoliaenvironnement>
> > > <https://www.linkedin.com/company/veolia-environnement>
> > > <https://twitter.com/veolia>
> > >
> >
> > --
> >
> > ------------------------------------------------------------
> > --------------------------------
> > This e-mail transmission (message and any attached files) may contain
> > information that is proprietary, privileged and/or confidential to Veolia
> > Environnement and/or its affiliates and is intended exclusively for the
> > person(s) to whom it is addressed. If you are not the intended recipient,
> > please notify the sender by return e-mail and delete all copies of this
> > e-mail, including all attachments. Unless expressly authorized, any use,
> > disclosure, publication, retransmission or dissemination of this e-mail
> > and/or of its attachments is strictly prohibited.
> >
> > Ce message electronique et ses fichiers attaches sont strictement
> > confidentiels et peuvent contenir des elements dont Veolia Environnement
> > et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc
> > destines a l'usage de leurs seuls destinataires. Si vous avez recu ce
> > message par erreur, merci de le retourner a son emetteur et de le
> detruire
> > ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la
> > publication, la distribution, ou la reproduction non expressement
> > autorisees de ce message et de ses pieces attachees sont interdites.
> > ------------------------------------------------------------
> > --------------------------------
> >
>
Re: Problem while upgrading lib
Posted by Ahmet Altay <al...@google.com.INVALID>.
google-apitools dependency (which is required for GCS) does not work
with oauth2client >= 4.0.0 [1]. Because of this Beam Python SDK also does
not work with oauth2client >= 4.0.0 versions, and this is captured
correctly in the setup.py [2].
Ahmet
[1]
https://github.com/google/apitools/blob/7aff8d88960b669c9e946c938de5841c5f296f4f/setup.py#L32
[2]
https://github.com/apache/beam/blob/f9bc76364636b92239510f9e6bd242ea0ea62ac6/sdks/python/setup.py#L104
On Tue, Sep 19, 2017 at 8:40 AM, Morand, Sebastien <
sebastien.morand@veolia.com> wrote:
> Hi,
>
> No help on this?
>
> Regards,
>
> *Sébastien MORAND*
> Team Lead Solution Architect
> Technology & Operations / Digital Factory
> Veolia - Group Information Systems & Technology (IS&T)
> Cell.: +33 7 52 66 20 81 / Direct: +33 1 85 57 71 08
> Bureau 0144C (Ouest)
> 30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
> *www.veolia.com <http://www.veolia.com>*
> <http://www.veolia.com>
> <https://www.facebook.com/veoliaenvironment/>
> <https://www.youtube.com/user/veoliaenvironnement>
> <https://www.linkedin.com/company/veolia-environnement>
> <https://twitter.com/veolia>
>
> On 15 September 2017 at 10:26, Morand, Sebastien <
> sebastien.morand@veolia.com> wrote:
>
> > Hi,
> >
> > Hi got a problem when I install the oauth2client>=4.0.0 version:
> >
> > >>> import apache_beam.io.gcp.gcsio
> > Traceback (most recent call last):
> > File "<stdin>", line 1, in <module>
> > File "/home/ubuntu/workspace/tmp/beam_oauth/env/local/lib/
> > python2.7/site-packages/apache_beam/io/gcp/gcsio.py", line 53, in
> <module>
> > 'Google Cloud Storage I/O not supported for this execution
> environment
> > '
> > ImportError: Google Cloud Storage I/O not supported for this execution
> > environment (could not import storage API client).
> > >>>
> >
> > Steps to reproduce:
> > virtualenv env && source env/bin/activate && pip install
> > 'apache_beam==2.1.0' 'oauth2client>=4.0.0' && echo "import
> > apache_beam.io.gcp.gcsio"|python2
> >
> > What is going on? How can I make apache_beam working with oauth2client >=
> > 4.
> >
> > Thanks by advance,
> > Regards,
> >
> > *Sébastien MORAND*
> > Team Lead Solution Architect
> > Technology & Operations / Digital Factory
> > Veolia - Group Information Systems & Technology (IS&T)
> > Cell.: +33 7 52 66 20 81 / Direct: +33 1 85 57 71 08
> > <+33%201%2085%2057%2071%2008>
> > Bureau 0144C (Ouest)
> > 30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
> > *www.veolia.com <http://www.veolia.com>*
> > <http://www.veolia.com>
> > <https://www.facebook.com/veoliaenvironment/>
> > <https://www.youtube.com/user/veoliaenvironnement>
> > <https://www.linkedin.com/company/veolia-environnement>
> > <https://twitter.com/veolia>
> >
>
> --
>
> ------------------------------------------------------------
> --------------------------------
> This e-mail transmission (message and any attached files) may contain
> information that is proprietary, privileged and/or confidential to Veolia
> Environnement and/or its affiliates and is intended exclusively for the
> person(s) to whom it is addressed. If you are not the intended recipient,
> please notify the sender by return e-mail and delete all copies of this
> e-mail, including all attachments. Unless expressly authorized, any use,
> disclosure, publication, retransmission or dissemination of this e-mail
> and/or of its attachments is strictly prohibited.
>
> Ce message electronique et ses fichiers attaches sont strictement
> confidentiels et peuvent contenir des elements dont Veolia Environnement
> et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc
> destines a l'usage de leurs seuls destinataires. Si vous avez recu ce
> message par erreur, merci de le retourner a son emetteur et de le detruire
> ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la
> publication, la distribution, ou la reproduction non expressement
> autorisees de ce message et de ses pieces attachees sont interdites.
> ------------------------------------------------------------
> --------------------------------
>
Re: Problem while upgrading lib
Posted by "Morand, Sebastien" <se...@veolia.com>.
Hi,
No help on this?
Regards,
*Sébastien MORAND*
Team Lead Solution Architect
Technology & Operations / Digital Factory
Veolia - Group Information Systems & Technology (IS&T)
Cell.: +33 7 52 66 20 81 / Direct: +33 1 85 57 71 08
Bureau 0144C (Ouest)
30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
*www.veolia.com <http://www.veolia.com>*
<http://www.veolia.com>
<https://www.facebook.com/veoliaenvironment/>
<https://www.youtube.com/user/veoliaenvironnement>
<https://www.linkedin.com/company/veolia-environnement>
<https://twitter.com/veolia>
On 15 September 2017 at 10:26, Morand, Sebastien <
sebastien.morand@veolia.com> wrote:
> Hi,
>
> Hi got a problem when I install the oauth2client>=4.0.0 version:
>
> >>> import apache_beam.io.gcp.gcsio
> Traceback (most recent call last):
> File "<stdin>", line 1, in <module>
> File "/home/ubuntu/workspace/tmp/beam_oauth/env/local/lib/
> python2.7/site-packages/apache_beam/io/gcp/gcsio.py", line 53, in <module>
> 'Google Cloud Storage I/O not supported for this execution environment
> '
> ImportError: Google Cloud Storage I/O not supported for this execution
> environment (could not import storage API client).
> >>>
>
> Steps to reproduce:
> virtualenv env && source env/bin/activate && pip install
> 'apache_beam==2.1.0' 'oauth2client>=4.0.0' && echo "import
> apache_beam.io.gcp.gcsio"|python2
>
> What is going on? How can I make apache_beam working with oauth2client >=
> 4.
>
> Thanks by advance,
> Regards,
>
> *Sébastien MORAND*
> Team Lead Solution Architect
> Technology & Operations / Digital Factory
> Veolia - Group Information Systems & Technology (IS&T)
> Cell.: +33 7 52 66 20 81 / Direct: +33 1 85 57 71 08
> <+33%201%2085%2057%2071%2008>
> Bureau 0144C (Ouest)
> 30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
> *www.veolia.com <http://www.veolia.com>*
> <http://www.veolia.com>
> <https://www.facebook.com/veoliaenvironment/>
> <https://www.youtube.com/user/veoliaenvironnement>
> <https://www.linkedin.com/company/veolia-environnement>
> <https://twitter.com/veolia>
>
--
--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain
information that is proprietary, privileged and/or confidential to Veolia
Environnement and/or its affiliates and is intended exclusively for the
person(s) to whom it is addressed. If you are not the intended recipient,
please notify the sender by return e-mail and delete all copies of this
e-mail, including all attachments. Unless expressly authorized, any use,
disclosure, publication, retransmission or dissemination of this e-mail
and/or of its attachments is strictly prohibited.
Ce message electronique et ses fichiers attaches sont strictement
confidentiels et peuvent contenir des elements dont Veolia Environnement
et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc
destines a l'usage de leurs seuls destinataires. Si vous avez recu ce
message par erreur, merci de le retourner a son emetteur et de le detruire
ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la
publication, la distribution, ou la reproduction non expressement
autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------
Re: Problem while upgrading lib
Posted by "Morand, Sebastien" <se...@veolia.com>.
Hi,
No help on this?
Regards,
*Sébastien MORAND*
Team Lead Solution Architect
Technology & Operations / Digital Factory
Veolia - Group Information Systems & Technology (IS&T)
Cell.: +33 7 52 66 20 81 / Direct: +33 1 85 57 71 08
Bureau 0144C (Ouest)
30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
*www.veolia.com <http://www.veolia.com>*
<http://www.veolia.com>
<https://www.facebook.com/veoliaenvironment/>
<https://www.youtube.com/user/veoliaenvironnement>
<https://www.linkedin.com/company/veolia-environnement>
<https://twitter.com/veolia>
On 15 September 2017 at 10:26, Morand, Sebastien <
sebastien.morand@veolia.com> wrote:
> Hi,
>
> Hi got a problem when I install the oauth2client>=4.0.0 version:
>
> >>> import apache_beam.io.gcp.gcsio
> Traceback (most recent call last):
> File "<stdin>", line 1, in <module>
> File "/home/ubuntu/workspace/tmp/beam_oauth/env/local/lib/
> python2.7/site-packages/apache_beam/io/gcp/gcsio.py", line 53, in <module>
> 'Google Cloud Storage I/O not supported for this execution environment
> '
> ImportError: Google Cloud Storage I/O not supported for this execution
> environment (could not import storage API client).
> >>>
>
> Steps to reproduce:
> virtualenv env && source env/bin/activate && pip install
> 'apache_beam==2.1.0' 'oauth2client>=4.0.0' && echo "import
> apache_beam.io.gcp.gcsio"|python2
>
> What is going on? How can I make apache_beam working with oauth2client >=
> 4.
>
> Thanks by advance,
> Regards,
>
> *Sébastien MORAND*
> Team Lead Solution Architect
> Technology & Operations / Digital Factory
> Veolia - Group Information Systems & Technology (IS&T)
> Cell.: +33 7 52 66 20 81 / Direct: +33 1 85 57 71 08
> <+33%201%2085%2057%2071%2008>
> Bureau 0144C (Ouest)
> 30, rue Madeleine-Vionnet - 93300 Aubervilliers, France
> *www.veolia.com <http://www.veolia.com>*
> <http://www.veolia.com>
> <https://www.facebook.com/veoliaenvironment/>
> <https://www.youtube.com/user/veoliaenvironnement>
> <https://www.linkedin.com/company/veolia-environnement>
> <https://twitter.com/veolia>
>
--
--------------------------------------------------------------------------------------------
This e-mail transmission (message and any attached files) may contain
information that is proprietary, privileged and/or confidential to Veolia
Environnement and/or its affiliates and is intended exclusively for the
person(s) to whom it is addressed. If you are not the intended recipient,
please notify the sender by return e-mail and delete all copies of this
e-mail, including all attachments. Unless expressly authorized, any use,
disclosure, publication, retransmission or dissemination of this e-mail
and/or of its attachments is strictly prohibited.
Ce message electronique et ses fichiers attaches sont strictement
confidentiels et peuvent contenir des elements dont Veolia Environnement
et/ou l'une de ses entites affiliees sont proprietaires. Ils sont donc
destines a l'usage de leurs seuls destinataires. Si vous avez recu ce
message par erreur, merci de le retourner a son emetteur et de le detruire
ainsi que toutes les pieces attachees. L'utilisation, la divulgation, la
publication, la distribution, ou la reproduction non expressement
autorisees de ce message et de ses pieces attachees sont interdites.
--------------------------------------------------------------------------------------------