You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Rok Mihevc (Jira)" <ji...@apache.org> on 2023/01/11 07:14:04 UTC
[jira] [Commented] (ARROW-1314) [C++] Provide installation guidance for macOS users who wish to use JNI-based HDFS interface
[ https://issues.apache.org/jira/browse/ARROW-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17658347#comment-17658347 ]
Rok Mihevc commented on ARROW-1314:
-----------------------------------
This issue has been migrated to [issue #17333|https://github.com/apache/arrow/issues/17333] on GitHub. Please see the [migration documentation|https://github.com/apache/arrow/issues/14542] for further details.
> [C++] Provide installation guidance for macOS users who wish to use JNI-based HDFS interface
> --------------------------------------------------------------------------------------------
>
> Key: ARROW-1314
> URL: https://issues.apache.org/jira/browse/ARROW-1314
> Project: Apache Arrow
> Issue Type: Improvement
> Components: Documentation
> Environment: mac 10.12.6
> Reporter: Martin Durant
> Priority: Major
>
> Having set
> HADOOP_HOME /Users/mdurant/Downloads/hadoop-2.8.1 (straight download, does contain libhdfs.so in native)
> java openjdk version "1.8.0_121" in anaconda install directory
> and CLASSPATH as in the docs (too long to show)
> ```
> In [3]: pa.hdfs
> ---------------------------------------------------------------------------
> AttributeError Traceback (most recent call last)
> <ipython-input-3-4ceca32a5f9f> in <module>()
> ----> 1 pa.hdfs
> AttributeError: module 'pyarrow' has no attribute 'hdfs'
> In [4]: pa.have_libhdfs()
> Out[4]: False
> In [5]: pa.have_libhdfs3()
> Out[5]: False
> ```
> (I also have libhdfs3.so - not .dylib - but it is not found even if included in DYLD_FALLBACK_LIBRARY_PATH)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)