You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Valentyn Tymofieiev (Jira)" <ji...@apache.org> on 2021/10/14 00:03:00 UTC
[jira] [Commented] (BEAM-10244) Populate requirements cache fails
on poetry-based packages
[ https://issues.apache.org/jira/browse/BEAM-10244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17428544#comment-17428544 ]
Valentyn Tymofieiev commented on BEAM-10244:
--------------------------------------------
I believe this has been fixed in Poetry, but packages using poetry may need to follow https://github.com/python-poetry/poetry/issues/1975#issuecomment-684773959 to pick up the fix..
Note that packages that switched to PEP-517 with either with Poetry or Setuptools may be much slower to stage as of now. For details, see:
https://github.com/pypa/setuptools/discussions/2814
https://lists.apache.org/thread.html/rf6236c964bd0158cae8a2fe2feb1a0c180003584673d4adc2923ed08%40%3Cdev.beam.apache.org%3E .
> Populate requirements cache fails on poetry-based packages
> ----------------------------------------------------------
>
> Key: BEAM-10244
> URL: https://issues.apache.org/jira/browse/BEAM-10244
> Project: Beam
> Issue Type: Bug
> Components: sdk-py-core
> Reporter: Udi Meiri
> Priority: P1
> Time Spent: 10m
> Remaining Estimate: 0h
>
> Sample command to recreate:
> {code}
> pip download rsa==4.1 --no-binary :all:
> {code}
> {code}
> Collecting rsa==4.1
> File was already downloaded /usr/local/google/home/ehudm/so_srcs/b158725078/rsa-4.1.tar.gz
> Installing build dependencies ... error
> ERROR: Command errored out with exit status 1:
> command: /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7 /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-l4iugm_b/overlay --no-warn-script-location --no-binary :all: --only-binary :none: -i https://pypi.org/simple -- 'poetry>=0.12'
> cwd: None
> Complete output (50 lines):
> Collecting poetry>=0.12
> Using cached https://files.pythonhosted.org/packages/65/76/3ce57248bc821634955ffd43eb58e7ea17ed5cf6c15f94059885cb1b6155/poetry-1.0.9.tar.gz
> Installing build dependencies: started
> Installing build dependencies: finished with status 'done'
> Getting requirements to build wheel: started
> Getting requirements to build wheel: finished with status 'error'
> ERROR: Command errored out with exit status 1:
> command: /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7 /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py get_requires_for_build_wheel /tmp/tmpqizpa3_5
> cwd: /tmp/pip-install-idj3pvty/poetry
> Complete output (36 lines):
> Traceback (most recent call last):
> File "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py", line 207, in <module>
> main()
> File "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py", line 197, in main
> json_out['return_val'] = hook(**hook_input['kwargs'])
> File "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py", line 54, in get_requires_for_build_wheel
> return hook(config_settings)
> File "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py", line 53, in get_requires_for_build_wheel
> return self._backend.get_requires_for_build_sdist(config_settings)
> File "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py", line 38, in _backend
> obj = self._module_from_dir(modname)
> File "/tmp/pip-build-env-igoypwpj/overlay/lib/python3.7/site-packages/intreehooks.py", line 25, in _module_from_dir
> mod = importlib.import_module(modname)
> File "/usr/local/google/home/ehudm/.pyenv/versions/3.7.5/lib/python3.7/importlib/__init__.py", line 127, in import_module
> return _bootstrap._gcd_import(name[level:], package, level)
> File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
> File "<frozen importlib._bootstrap>", line 983, in _find_and_load
> File "<frozen importlib._bootstrap>", line 953, in _find_and_load_unlocked
> File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
> File "<frozen importlib._bootstrap>", line 1006, in _gcd_import
> File "<frozen importlib._bootstrap>", line 983, in _find_and_load
> File "<frozen importlib._bootstrap>", line 967, in _find_and_load_unlocked
> File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
> File "<frozen importlib._bootstrap_external>", line 728, in exec_module
> File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
> File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/__init__.py", line 10, in <module>
> from .builder import Builder
> File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builder.py", line 1, in <module>
> from .builders.complete import CompleteBuilder
> File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builders/__init__.py", line 1, in <module>
> from .complete import CompleteBuilder
> File "/tmp/pip-install-idj3pvty/poetry/poetry/masonry/builders/complete.py", line 6, in <module>
> from poetry.factory import Factory
> File "/tmp/pip-install-idj3pvty/poetry/poetry/factory.py", line 10, in <module>
> from clikit.api.io.io import IO
> ModuleNotFoundError: No module named 'clikit'
> ----------------------------------------
> ERROR: Command errored out with exit status 1: /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7 /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip/_vendor/pep517/_in_process.py get_requires_for_build_wheel /tmp/tmpqizpa3_5 Check the logs for full command output.
> WARNING: You are using pip version 19.2.3, however version 20.1.1 is available.
> You should consider upgrading via the 'pip install --upgrade pip' command.
> ----------------------------------------
> ERROR: Command errored out with exit status 1: /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/bin/python3.7 /usr/local/google/home/ehudm/.pyenv/versions/3.7.5/envs/b158725078/lib/python3.7/site-packages/pip install --ignore-installed --no-user --prefix /tmp/pip-build-env-l4iugm_b/overlay --no-warn-script-location --no-binary :all: --only-binary :none: -i https://pypi.org/simple -- 'poetry>=0.12' Check the logs for full command output.
> WARNING: You are using pip version 19.2.3, however version 20.1.1 is available.
> You should consider upgrading via the 'pip install --upgrade pip' command.
> {code}
> Trying to download poetry directly also gives the same error.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)