You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by GitBox <gi...@apache.org> on 2022/10/01 10:03:30 UTC
[GitHub] [iceberg] djouallah opened a new issue, #5901: pip install pyiceberg on windows require C++ to be installed
djouallah opened a new issue, #5901:
URL: https://github.com/apache/iceberg/issues/5901
### Apache Iceberg version
main (development)
### Query engine
_No response_
### Please describe the bug 🐞
when I tired to install pip install pyiceberg on windows 10, it did complaining about missing C++ files, I was expect a binary distribution not compiling the source myself ? is this by design
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] djouallah commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
djouallah commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1265014486
PS C:\Users\mimoune.djouallah\Desktop\TPC-H-SF10> pip3 install wheel
Requirement already satisfied: wheel in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (0.37.1)
PS C:\Users\mimoune.djouallah\Desktop\TPC-H-SF10> pip3 install pyiceberg[pyarrow]
Collecting pyiceberg[pyarrow]
Using cached pyiceberg-0.1.0-py3-none-any.whl (276 kB)
Collecting mmh3<4.0.0,>=3.0.0
Using cached mmh3-3.0.0.tar.gz (10 kB)
Preparing metadata (setup.py) ... done
Collecting pyyaml<7.0.0,>=6.0.0
Using cached PyYAML-6.0-cp310-cp310-win_amd64.whl (151 kB)
Requirement already satisfied: click<9.0.0,>=8.1.3 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (8.1.3)
Collecting zstandard<0.19.0,>=0.18.0
Using cached zstandard-0.18.0-cp310-cp310-win_amd64.whl (611 kB)
Requirement already satisfied: pydantic<2.0.0,>=1.10.2 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (1.10.2)
Requirement already satisfied: rich<13.0.0,>=12.5.1 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (12.5.1)
Requirement already satisfied: requests<3.0.0,>=2.28.1 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (2.28.1)
Collecting fsspec==2022.8.2
Using cached fsspec-2022.8.2-py3-none-any.whl (140 kB)
Requirement already satisfied: pyarrow<10.0.0,>=9.0.0 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (9.0.0)
Requirement already satisfied: colorama in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from click<9.0.0,>=8.1.3->pyiceberg[pyarrow]) (0.4.5)Requirement already satisfied: numpy>=1.16.6 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyarrow<10.0.0,>=9.0.0->pyiceberg[pyarrow]) (1.23.1)
Requirement already satisfied: typing-extensions>=4.1.0 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pydantic<2.0.0,>=1.10.2->pyiceberg[pyarrow]) (4.3.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from requests<3.0.0,>=2.28.1->pyiceberg[pyarrow]) (1.26.11)
Requirement already satisfied: idna<4,>=2.5 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from requests<3.0.0,>=2.28.1->pyiceberg[pyarrow]) (3.3)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from requests<3.0.0,>=2.28.1->pyiceberg[pyarrow]) (2022.6.15)
Requirement already satisfied: charset-normalizer<3,>=2 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from requests<3.0.0,>=2.28.1->pyiceberg[pyarrow]) (2.1.1)
Requirement already satisfied: pygments<3.0.0,>=2.6.0 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from rich<13.0.0,>=12.5.1->pyiceberg[pyarrow]) (2.13.0)
Requirement already satisfied: commonmark<0.10.0,>=0.9.0 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from rich<13.0.0,>=12.5.1->pyiceberg[pyarrow]) (0.9.1)
Building wheels for collected packages: mmh3
Building wheel for mmh3 (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [5 lines of output]
running bdist_wheel
running build
running build_ext
building 'mmh3' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for mmh3
Running setup.py clean for mmh3
Failed to build mmh3
Installing collected packages: mmh3, zstandard, pyyaml, fsspec, pyiceberg
Running setup.py install for mmh3 ... error
error: subprocess-exited-with-error
× Running setup.py install for mmh3 did not run successfully.
│ exit code: 1
╰─> [7 lines of output]
running install
C:\Users\mimoune.djouallah\AppData\Local\Programs\Python\Python310\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running build
running build_ext
building 'mmh3' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> mmh3
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] Fokko commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
Fokko commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1265011029
Thanks @djouallah for sharing. Could you try to install `wheel` (`pip3 install wheel`), and then install PyIceberg?
I noticed this from the log:
> Using legacy 'setup.py install' for mmh3, since package 'wheel' is not installed.
This means that it will fall back on installing it from the source, which will mean that it will try to compile the native extension.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] djouallah commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
djouallah commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1343674152
thanks, it works now with 0.2 release
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] djouallah closed issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
djouallah closed issue #5901: pip install pyiceberg on windows require C++ to be installed
URL: https://github.com/apache/iceberg/issues/5901
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] samredai commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
samredai commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1264528588
I believe this is because of the pyarrow dependency. In the pyarrow [docs](https://arrow.apache.org/docs/python/install.html#using-pip) they include tips for getting around installation issues on windows.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] djouallah commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
djouallah commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1287830326
it is seems mmh3 is not supported, is there an alternative solution please ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] djouallah commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
djouallah commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1264558185
I have pyarrow installed already?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] djouallah commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
djouallah commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1264858480
PS C:\Users\mimoune.djouallah\Desktop\TPC-H-SF10> pip3 install pyiceberg[pyarrow]
Collecting pyiceberg[pyarrow]
Using cached pyiceberg-0.1.0-py3-none-any.whl (276 kB)
Requirement already satisfied: rich<13.0.0,>=12.5.1 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (12.5.1)
Requirement already satisfied: click<9.0.0,>=8.1.3 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (8.1.3)
Collecting zstandard<0.19.0,>=0.18.0
Using cached zstandard-0.18.0-cp310-cp310-win_amd64.whl (611 kB)
Collecting fsspec==2022.8.2
Using cached fsspec-2022.8.2-py3-none-any.whl (140 kB)
Collecting mmh3<4.0.0,>=3.0.0
Using cached mmh3-3.0.0.tar.gz (10 kB)
Preparing metadata (setup.py) ... done
Collecting pyyaml<7.0.0,>=6.0.0
Using cached PyYAML-6.0-cp310-cp310-win_amd64.whl (151 kB)
Requirement already satisfied: pydantic<2.0.0,>=1.10.2 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (1.10.2)Requirement already satisfied: requests<3.0.0,>=2.28.1 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (2.28.1)Requirement already satisfied: pyarrow<10.0.0,>=9.0.0 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyiceberg[pyarrow]) (9.0.0)
Requirement already satisfied: colorama in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from click<9.0.0,>=8.1.3->pyiceberg[pyarrow]) (0.4.5)
Requirement already satisfied: numpy>=1.16.6 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pyarrow<10.0.0,>=9.0.0->pyiceberg[pyarrow]) (1.23.1)
Requirement already satisfied: typing-extensions>=4.1.0 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from pydantic<2.0.0,>=1.10.2->pyiceberg[pyarrow]) (4.3.0)
Requirement already satisfied: charset-normalizer<3,>=2 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from requests<3.0.0,>=2.28.1->pyiceberg[pyarrow]) (2.1.1)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from requests<3.0.0,>=2.28.1->pyiceberg[pyarrow]) (1.26.11)
Requirement already satisfied: certifi>=2017.4.17 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from requests<3.0.0,>=2.28.1->pyiceberg[pyarrow]) (2022.6.15)
Requirement already satisfied: idna<4,>=2.5 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from requests<3.0.0,>=2.28.1->pyiceberg[pyarrow]) (3.3)
Requirement already satisfied: commonmark<0.10.0,>=0.9.0 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from rich<13.0.0,>=12.5.1->pyiceberg[pyarrow]) (0.9.1)
Requirement already satisfied: pygments<3.0.0,>=2.6.0 in c:\users\mimoune.djouallah\appdata\local\programs\python\python310\lib\site-packages (from rich<13.0.0,>=12.5.1->pyiceberg[pyarrow]) (2.13.0)
Using legacy 'setup.py install' for mmh3, since package 'wheel' is not installed.
Installing collected packages: mmh3, zstandard, pyyaml, fsspec, pyiceberg
Running setup.py install for mmh3 ... error
error: subprocess-exited-with-error
× Running setup.py install for mmh3 did not run successfully.
│ exit code: 1
╰─> [7 lines of output]
running install
C:\Users\mimoune.djouallah\AppData\Local\Programs\Python\Python310\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running build
running build_ext
building 'mmh3' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> mmh3
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] Fokko commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
Fokko commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1264711410
@djouallah Thanks for reaching out and creating the issue.
Could you share the command that you use to install PyIceberg? For example, `pip3 install pyiceberg[pyarrow]` would install it with PyArrow support, or `pip3 install pyiceberg[s3fs]` would install it with the s3fs backend. Knowing this would help us to reproduce it.
Could you also share the error that you're seeing? Just the output of the console would be helpful 👍🏻
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] djouallah commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
djouallah commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1265015708
I think the issue is with mmh3
PS C:\Users\mimoune.djouallah\Desktop\TPC-H-SF10> pip3 install mmh3
Collecting mmh3
Using cached mmh3-3.0.0.tar.gz (10 kB)
Preparing metadata (setup.py) ... done
Building wheels for collected packages: mmh3
Building wheel for mmh3 (setup.py) ... error
error: subprocess-exited-with-error
× python setup.py bdist_wheel did not run successfully.
│ exit code: 1
╰─> [5 lines of output]
running bdist_wheel
running build
running build_ext
building 'mmh3' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed building wheel for mmh3
Running setup.py clean for mmh3
Failed to build mmh3
Installing collected packages: mmh3
Running setup.py install for mmh3 ... error
error: subprocess-exited-with-error
× Running setup.py install for mmh3 did not run successfully.
│ exit code: 1
╰─> [7 lines of output]
running install
C:\Users\mimoune.djouallah\AppData\Local\Programs\Python\Python310\lib\site-packages\setuptools\command\install.py:34: SetuptoolsDeprecationWarning: setup.py install is deprecated. Use build and pip and other standards-based tools.
warnings.warn(
running build
running build_ext
building 'mmh3' extension
error: Microsoft Visual C++ 14.0 or greater is required. Get it with "Microsoft C++ Build Tools": https://visualstudio.microsoft.com/visual-cpp-build-tools/
[end of output]
note: This error originates from a subprocess, and is likely not a problem with pip.
error: legacy-install-failure
× Encountered error while trying to install package.
╰─> mmh3
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
PS C:\Users\mimoune.djouallah\Desktop\TPC-H-SF10>
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org
[GitHub] [iceberg] Fokko commented on issue #5901: pip install pyiceberg on windows require C++ to be installed
Posted by GitBox <gi...@apache.org>.
Fokko commented on issue #5901:
URL: https://github.com/apache/iceberg/issues/5901#issuecomment-1344862830
Awesome, thanks for letting us know! @djouallah
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org