You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Eric Scott (JIRA)" <ji...@apache.org> on 2018/08/24 14:11:00 UTC

[jira] [Commented] (ARROW-2783) Importing conda-forge pyarrow fails

    [ https://issues.apache.org/jira/browse/ARROW-2783?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16591715#comment-16591715 ] 

Eric Scott commented on ARROW-2783:
-----------------------------------

This problem isn't completely fixed.  There's still a conflict between pyarrow and libhdfs3 (which pyarrow uses), converging at boost-cpp.
{code:java}
$ conda install 'boost-cpp>=1.67'
Solving environment: failed

UnsatisfiableError: The following specifications were found to be in conflict:
- boost-cpp[version='>=1.67']
- libhdfs3=2.3-0 -> boost-cpp==1.66.0
Use "conda info <package>" to see the dependencies for each package.
{code}
Background:

My specific need was on feather (which pulls in pyarrow and causes the conflict) and hdfs3.  Not to hijack this thread, but if there's another way around that specific problem, then I'm not stalled out any more.

> Importing conda-forge pyarrow fails
> -----------------------------------
>
>                 Key: ARROW-2783
>                 URL: https://issues.apache.org/jira/browse/ARROW-2783
>             Project: Apache Arrow
>          Issue Type: Task
>          Components: Python
>    Affects Versions: 0.9.0
>            Reporter: Phillip Cloud
>            Assignee: Uwe L. Korn
>            Priority: Major
>             Fix For: 0.9.0
>
>
> Possibly related to: https://issues.apache.org/jira/projects/ARROW/issues/ARROW-2770
> Steps to reproduce:
> {code}
> $ conda create -n test python=3 pyarrow -c conda-forge -y
> $ conda activate test
> $ python -c 'import pyarrow'
> {code}
> This gives:
> {code}
> Traceback (most recent call last):
>   File "<string>", line 1, in <module>
>   File "/home/phillip/miniconda3/envs/py36/lib/python3.6/site-packages/pyarrow/__init__.py", line 47
> , in <module>
>     from pyarrow.lib import cpu_count, set_cpu_count
> ImportError: libboost_system.so.1.65.1: cannot open shared object file: No such file or directory
> {code}
> Downgrading boost to {{1.65.1}} gives a symbol lookup error:
> {code}
> $ conda install boost-cpp=1.65.1 -y -c conda-forge
> $ python -c 'import pyarrow'
> Traceback (most recent call last):
>   File "<string>", line 1, in <module>
>   File "/home/phillip/miniconda3/envs/py36/lib/python3.6/site-packages/pyarrow/__init__.py", line 47
> , in <module>
>     from pyarrow.lib import cpu_count, set_cpu_count
> ImportError: /home/phillip/miniconda3/envs/py36/lib/python3.6/site-packages/pyarrow/../../../libarrow.so.0: undefined symbol: _ZN5boost13match_resultsIN9__gnu_cxx17__normal_iteratorIPKcNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEEEESaINS_9sub_matchISB_EEEE12maybe_assignERKSF_
> {code}
> Installing {{pyarrow}} from {{defaults}} and importing it works fine.
> cc [~kszucs] [~xhochy]



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)