You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@arrow.apache.org by "Kirby, Adam" <ak...@gmail.com> on 2022/07/28 19:25:21 UTC
[Python] install specific tag of pyarrow+cpp
Hi,
Is there a way to install a specific tag of pyarrow that bundles the cpp
library (without needing to interactively execute the build process and
install from there)?
I would make do with the nightly, but need to test a release version rather
than debug version, and ideally be able to specify the tag.
It’s straightforward to build/install the python portion only from github
tags via pip, but this of course doesn’t build/bundle the cpp library.
pip install git+https://github.com/apache/arrow.git@apache-arrow-9.0.0#egg=pyarrow\&subdirectory=python
Thank you!
Re: [Python] install specific tag of pyarrow+cpp
Posted by "Kirby, Adam" <ak...@gmail.com>.
Hi Raul, Thank you very much -- both helpful tips! -Adam
On Fri, Jul 29, 2022 at 5:12 AM Raul Cumplido Dominguez <
raul@voltrondata.com> wrote:
> Hi,
>
> I re-read your message and I understand now that what you meant for
> release is that you wanted to test the 9.0.0 release.
>
> Wheels are uploaded to Apache artifactory when the release candidate is
> created [1].
>
> Maybe from there?
> $ pip install
> https://apache.jfrog.io/artifactory/arrow/python-rc/9.0.0-rc1/pyarrow-9.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
> Collecting pyarrow==9.0.0
> Downloading
> https://apache.jfrog.io/artifactory/arrow/python-rc/9.0.0-rc1/pyarrow-9.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
> (35.3 MB)
> ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35.3/35.3 MB 4.1 MB/s eta
> 0:00:00
> Requirement already satisfied: numpy>=1.16.6 in
> ./test-arrow-9.0.0/lib/python3.10/site-packages (from pyarrow==9.0.0)
> (1.23.1)
> Installing collected packages: pyarrow
> Attempting uninstall: pyarrow
> ...
> Successfully installed pyarrow-9.0.0
>
> [1] https://apache.jfrog.io/ui/native/arrow/python-rc/
>
Re: [Python] install specific tag of pyarrow+cpp
Posted by Raul Cumplido Dominguez <ra...@voltrondata.com>.
Hi,
I re-read your message and I understand now that what you meant for release
is that you wanted to test the 9.0.0 release.
Wheels are uploaded to Apache artifactory when the release candidate is
created [1].
Maybe from there?
$ pip install
https://apache.jfrog.io/artifactory/arrow/python-rc/9.0.0-rc1/pyarrow-9.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Collecting pyarrow==9.0.0
Downloading
https://apache.jfrog.io/artifactory/arrow/python-rc/9.0.0-rc1/pyarrow-9.0.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(35.3 MB)
━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 35.3/35.3 MB 4.1 MB/s eta
0:00:00
Requirement already satisfied: numpy>=1.16.6 in
./test-arrow-9.0.0/lib/python3.10/site-packages (from pyarrow==9.0.0)
(1.23.1)
Installing collected packages: pyarrow
Attempting uninstall: pyarrow
...
Successfully installed pyarrow-9.0.0
[1] https://apache.jfrog.io/ui/native/arrow/python-rc/
Re: [Python] install specific tag of pyarrow+cpp
Posted by Raul Cumplido Dominguez <ra...@voltrondata.com>.
Hi Adam,
I don't think we can do it from a tag currently but from what I understand
the nightly built wheels are built on Release mode not on Debug. See the
following log from one of our nightly builds [1]:
+ echo '=== (3.8) Building wheel ==='
+ export PYARROW_BUILD_TYPE=release
+ PYARROW_BUILD_TYPE=release
Could in that case work?
The nightly built wheels [2]:
pip install --extra-index-url https://pypi.fury.io/arrow-nightlies/
--prefer-binary --pre pyarrow
Raúl
[1]
https://github.com/ursacomputing/crossbow/runs/7556272107?check_suite_focus=true#step:6:2157
[2] https://pypi.fury.io/arrow-nightlies/pyarrow
On Thu, Jul 28, 2022 at 9:26 PM Kirby, Adam <ak...@gmail.com> wrote:
> Hi,
>
> Is there a way to install a specific tag of pyarrow that bundles the cpp
> library (without needing to interactively execute the build process and
> install from there)?
>
> I would make do with the nightly, but need to test a release version
> rather than debug version, and ideally be able to specify the tag.
>
> It’s straightforward to build/install the python portion only from github
> tags via pip, but this of course doesn’t build/bundle the cpp library.
>
> pip install git+https://github.com/apache/arrow.git@apache-arrow-9.0.0#egg=pyarrow\&subdirectory=python
>
> Thank you!
>