You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2017/08/02 14:38:01 UTC
[jira] [Commented] (ARROW-1314) libhdfs installation didn't work -
mac
[ https://issues.apache.org/jira/browse/ARROW-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16111021#comment-16111021 ]
Wes McKinney commented on ARROW-1314:
-------------------------------------
Where did you obtain the Hadoop distribution for Mac?
> libhdfs installation didn't work - mac
> --------------------------------------
>
> Key: ARROW-1314
> URL: https://issues.apache.org/jira/browse/ARROW-1314
> Project: Apache Arrow
> Issue Type: Improvement
> Environment: mac 10.12.6
> Reporter: Martin Durant
>
> Having set
> HADOOP_HOME /Users/mdurant/Downloads/hadoop-2.8.1 (straight download, does contain libhdfs.so in native)
> java openjdk version "1.8.0_121" in anaconda install directory
> and CLASSPATH as in the docs (too long to show)
> ```
> In [3]: pa.hdfs
> ---------------------------------------------------------------------------
> AttributeError Traceback (most recent call last)
> <ipython-input-3-4ceca32a5f9f> in <module>()
> ----> 1 pa.hdfs
> AttributeError: module 'pyarrow' has no attribute 'hdfs'
> In [4]: pa.have_libhdfs()
> Out[4]: False
> In [5]: pa.have_libhdfs3()
> Out[5]: False
> ```
> (I also have libhdfs3.so - not .dylib - but it is not found even if included in DYLD_FALLBACK_LIBRARY_PATH)
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)