You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by xu...@apache.org on 2023/11/10 10:23:53 UTC
(incubator-opendal) branch main updated: docs: Add macos specific doc updates for hdfs (#3559)
This is an automated email from the ASF dual-hosted git repository.
xuanwo pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-opendal.git
The following commit(s) were added to refs/heads/main by this push:
new 4dc4e6cf3 docs: Add macos specific doc updates for hdfs (#3559)
4dc4e6cf3 is described below
commit 4dc4e6cf388d1a499fde1108faf07d35a6cd629c
Author: Shubham Raizada <sh...@gmail.com>
AuthorDate: Fri Nov 10 15:53:49 2023 +0530
docs: Add macos specific doc updates for hdfs (#3559)
add macos specific doc updates for hdfs
---
core/src/services/hdfs/docs.md | 19 +++++++++++++++++++
1 file changed, 19 insertions(+)
diff --git a/core/src/services/hdfs/docs.md b/core/src/services/hdfs/docs.md
index 99eeaeac2..f3a11771f 100644
--- a/core/src/services/hdfs/docs.md
+++ b/core/src/services/hdfs/docs.md
@@ -85,6 +85,25 @@ export CLASSPATH=$HADOOP_CONF_DIR:$HADOOP_CLASSPATH:$CLASSPATH
```rust
builder.name_node("hdfs://cluster_name");
```
+
+### macOS Specific Note
+
+If you encounter an issue during the build process on macOS with an error message similar to:
+
+```shell
+ld: unknown file type in $HADOOP_HOME/lib/native/libhdfs.so.0.0.0
+clang: error: linker command failed with exit code 1 (use -v to see invocation)
+```
+This error is likely due to the fact that the official Hadoop build includes the libhdfs.so file for the x86-64 architecture, which is not compatible with aarch64 architecture required for MacOS.
+
+To resolve this issue, you can add hdrs as a dependency in your Rust application's Cargo.toml file, and enable the vendored feature:
+
+```toml
+[dependencies]
+hdrs = { version = "<version_number>", features = ["vendored"] }
+```
+Enabling the vendored feature ensures that hdrs includes the necessary libhdfs.so library built for the correct architecture.
+
## Example
### Via Builder