You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@opendal.apache.org by "amunra (via GitHub)" <gi...@apache.org> on 2023/11/08 09:48:31 UTC
[PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
amunra opened a new pull request, #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527
Allow building the Java bindings on Linux ARM64.
Additionally allows the script to run with older Python versions that require strings in `subprocess` calls.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527#issuecomment-1801507706
> The last time I try it, cargo build returns error. So at least some code doesn't support cross compile to aarch64 on x86_64.
Got it, let's track this in a new issue instead.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "amunra (via GitHub)" <gi...@apache.org>.
amunra commented on PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527#issuecomment-1801499300
> > Our CI (for our own code which build opendal as part of it) ran this so I have some degree of confidence it's correct, though I haven't run the opendal tests: I've just used the lib as a dependency.
>
> That's impressive! I wasn't aware that opendal-java had a user. Is your project open source, perhaps questdb? May I include you as a listed user in the README.md file?
How we use OpenDAL:
* We have a closed-source edition of QuestDB called "Enterprise".
* This release has replication support which works by storing WALs in an object store.
* Our original implementation supported S3 only, last week we swapped out our implementation from S3 to opendal in our Rust code (our replication feature is written in Rust because we want to avoid garbage collection) in the interest of supporting Azure Blob.
* I now have an incomplete PR that swaps out our Java tests from using the AWS Java SDK to using `opendal-java`. This is where the set of bugfixes are coming from.
* Our DB builds on a number of platforms, including Linux/ARM64 which is where this patch comes in.
* It would be awesome to get Linux/ARM64 binaries for `opendal-java`.
* We intend to support additional object stores over time (webhdfs is probably next up), but this will be on a by-need basis dependent on what our customers are after.
Thanks for building this lib! It's coming together nicely!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "tisonkun (via GitHub)" <gi...@apache.org>.
tisonkun commented on PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527#issuecomment-1801506223
> maybe we can do it for linux aarch64 too.
The last time I try it, cargo build returns error. So at least some code doesn't support cross compile to aarch64 on x86_64.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527#issuecomment-1801462831
Unfortunately, we lack the CI resources to accommodate this change, but it's likely to function.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527#issuecomment-1801481446
> Our CI (for our own code which build opendal as part of it) ran this so I have some degree of confidence it's correct, though I haven't run the opendal tests: I've just used the lib as a dependency.
That's impressive! I wasn't aware that opendal-java had a user. Is your project open source, perhaps questdb? May I include you as a listed user in the README.md file?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527#issuecomment-1801473618
> This obviously brings in the whole question of actually cutting the binaries for this platform. For now, I've been adding `incubator-opendal` as a git submodule and pulling it by adding it as a module in `pom.xml`.
https://github.com/apache/incubator-opendal/blob/9546db7d9736b4fcfd42713731942c443fb54dc4/.github/workflows/release_java.yml#L67-L75
We are performing cross compile for macos aarch64 support, maybe we can do it for linux aarch64 too.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo merged PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "Xuanwo (via GitHub)" <gi...@apache.org>.
Xuanwo commented on PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527#issuecomment-1801501870
Bravo!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] build(bindings/java): Allow building on `linux-aarch_64` [incubator-opendal]
Posted by "amunra (via GitHub)" <gi...@apache.org>.
amunra commented on PR #3527:
URL: https://github.com/apache/incubator-opendal/pull/3527#issuecomment-1801463911
This obviously brings in the whole question of actually cutting the binaries for this platform.
For now, I've been adding `incubator-opendal` as a git submodule and pulling it by adding it as a module in `pom.xml`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org