You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@impala.apache.org by "ji chen (Code Review)" <ge...@cloudera.org> on 2025/12/07 16:44:56 UTC
[native-toolchain-CR] IMPALA-14609: Add ARROW VERSION.0.0 to support aarch64
ji chen has uploaded this change for review. ( http://gerrit.cloudera.org:8080/23754
Change subject: IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
......................................................................
IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
The patch fix the jni loading issue for aarch64 environment.
impalad fails to start after building in aarch64 environments with error:
```
E IllegalStateException: error loading native libraries:
java.io.FileNotFoundException: aarch_64/libarrow_cdata_jni.so
```
this is because in arrow 13.0.0,arrow jni so is not available
in maven central repo. It is available in arrow 14.0.0 or later.
so we propose to add ARROW_VERSION=15.0.0 to fix this
jni loading issue.
Testing:
Built new toolchain and pass paimon test in aarch64 environment.
Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
---
M buildall.sh
M source/arrow/build.sh
2 files changed, 3 insertions(+), 2 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/native-toolchain refs/changes/54/23754/1
--
To view, visit http://gerrit.cloudera.org:8080/23754
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: native-toolchain
Gerrit-Branch: master
Gerrit-MessageType: newchange
Gerrit-Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
Gerrit-Change-Number: 23754
Gerrit-PatchSet: 1
Gerrit-Owner: ji chen <ji...@163.com>
[native-toolchain-CR] IMPALA-14609: Add ARROW VERSION.0.0 to support aarch64
Posted by "Quanlong Huang (Code Review)" <ge...@cloudera.org>.
Quanlong Huang has posted comments on this change. ( http://gerrit.cloudera.org:8080/23754 )
Change subject: IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
......................................................................
Patch Set 2: Code-Review+2
--
To view, visit http://gerrit.cloudera.org:8080/23754
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: native-toolchain
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
Gerrit-Change-Number: 23754
Gerrit-PatchSet: 2
Gerrit-Owner: ji chen <ji...@163.com>
Gerrit-Reviewer: Quanlong Huang <hu...@gmail.com>
Gerrit-Comment-Date: Mon, 08 Dec 2025 03:09:25 +0000
Gerrit-HasComments: No
[native-toolchain-CR] IMPALA-14609: Add ARROW VERSION.0.0 to support aarch64
Posted by "Zoltan Borok-Nagy (Code Review)" <ge...@cloudera.org>.
Zoltan Borok-Nagy has submitted this change and it was merged. ( http://gerrit.cloudera.org:8080/23754 )
Change subject: IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
......................................................................
IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
The patch fix the jni loading issue for aarch64 environment.
impalad fails to start after building in aarch64 environments
with error:
```
E IllegalStateException: error loading native libraries:
java.io.FileNotFoundException: aarch_64/libarrow_cdata_jni.so
```
this is because in arrow 13.0.0,arrow jni so is not available
in maven central repo. It is available in arrow 14.0.0 or later.
so we propose to add ARROW_VERSION=15.0.0 to fix this
jni loading issue.
Testing:
Built new toolchain and pass paimon test in aarch64 environment.
Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
Reviewed-on: http://gerrit.cloudera.org:8080/23754
Reviewed-by: Quanlong Huang <hu...@gmail.com>
Reviewed-by: Zoltan Borok-Nagy <bo...@cloudera.com>
Tested-by: Zoltan Borok-Nagy <bo...@cloudera.com>
---
M buildall.sh
1 file changed, 1 insertion(+), 0 deletions(-)
Approvals:
Quanlong Huang: Looks good to me, approved
Zoltan Borok-Nagy: Looks good to me, approved; Verified
--
To view, visit http://gerrit.cloudera.org:8080/23754
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: native-toolchain
Gerrit-Branch: master
Gerrit-MessageType: merged
Gerrit-Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
Gerrit-Change-Number: 23754
Gerrit-PatchSet: 3
Gerrit-Owner: ji chen <ji...@163.com>
Gerrit-Reviewer: Quanlong Huang <hu...@gmail.com>
Gerrit-Reviewer: Zoltan Borok-Nagy <bo...@cloudera.com>
[native-toolchain-CR] IMPALA-14609: Add ARROW VERSION.0.0 to support aarch64
Posted by "Quanlong Huang (Code Review)" <ge...@cloudera.org>.
Quanlong Huang has posted comments on this change. ( http://gerrit.cloudera.org:8080/23754 )
Change subject: IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
......................................................................
Patch Set 1:
(2 comments)
http://gerrit.cloudera.org:8080/#/c/23754/1//COMMIT_MSG
Commit Message:
http://gerrit.cloudera.org:8080/#/c/23754/1//COMMIT_MSG@9
PS1, Line 9:
nit: remove spaces here and in following lines
http://gerrit.cloudera.org:8080/#/c/23754/1/source/arrow/build.sh
File source/arrow/build.sh:
http://gerrit.cloudera.org:8080/#/c/23754/1/source/arrow/build.sh@26
PS1, Line 26: https://archive.apache.org/dist/arrow/arrow-${PACKAGE_VERSION}/apache-arrow-${PACKAGE_VERSION}.tar.gz
I have uploaded the source tarball to our s3 bucket. Probably we don't need this now.
https://native-toolchain.s3.amazonaws.com/source/arrow/arrow-15.0.0.tar.gz
--
To view, visit http://gerrit.cloudera.org:8080/23754
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: native-toolchain
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
Gerrit-Change-Number: 23754
Gerrit-PatchSet: 1
Gerrit-Owner: ji chen <ji...@163.com>
Gerrit-Reviewer: Quanlong Huang <hu...@gmail.com>
Gerrit-Comment-Date: Mon, 08 Dec 2025 02:47:19 +0000
Gerrit-HasComments: Yes
[native-toolchain-CR] IMPALA-14609: Add ARROW VERSION.0.0 to support aarch64
Posted by "ji chen (Code Review)" <ge...@cloudera.org>.
ji chen has uploaded a new patch set (#2). ( http://gerrit.cloudera.org:8080/23754 )
Change subject: IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
......................................................................
IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
The patch fix the jni loading issue for aarch64 environment.
impalad fails to start after building in aarch64 environments
with error:
```
E IllegalStateException: error loading native libraries:
java.io.FileNotFoundException: aarch_64/libarrow_cdata_jni.so
```
this is because in arrow 13.0.0,arrow jni so is not available
in maven central repo. It is available in arrow 14.0.0 or later.
so we propose to add ARROW_VERSION=15.0.0 to fix this
jni loading issue.
Testing:
Built new toolchain and pass paimon test in aarch64 environment.
Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
---
M buildall.sh
1 file changed, 1 insertion(+), 0 deletions(-)
git pull ssh://gerrit.cloudera.org:29418/native-toolchain refs/changes/54/23754/2
--
To view, visit http://gerrit.cloudera.org:8080/23754
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: native-toolchain
Gerrit-Branch: master
Gerrit-MessageType: newpatchset
Gerrit-Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
Gerrit-Change-Number: 23754
Gerrit-PatchSet: 2
Gerrit-Owner: ji chen <ji...@163.com>
Gerrit-Reviewer: Quanlong Huang <hu...@gmail.com>
[native-toolchain-CR] IMPALA-14609: Add ARROW VERSION.0.0 to support aarch64
Posted by "Zoltan Borok-Nagy (Code Review)" <ge...@cloudera.org>.
Zoltan Borok-Nagy has posted comments on this change. ( http://gerrit.cloudera.org:8080/23754 )
Change subject: IMPALA-14609: Add ARROW_VERSION=15.0.0 to support aarch64
......................................................................
Patch Set 2: Verified+1 Code-Review+2
--
To view, visit http://gerrit.cloudera.org:8080/23754
To unsubscribe, visit http://gerrit.cloudera.org:8080/settings
Gerrit-Project: native-toolchain
Gerrit-Branch: master
Gerrit-MessageType: comment
Gerrit-Change-Id: Ie040c0ef171d281b1cc1ad929e61cc817a9e4210
Gerrit-Change-Number: 23754
Gerrit-PatchSet: 2
Gerrit-Owner: ji chen <ji...@163.com>
Gerrit-Reviewer: Quanlong Huang <hu...@gmail.com>
Gerrit-Reviewer: Zoltan Borok-Nagy <bo...@cloudera.com>
Gerrit-Comment-Date: Mon, 08 Dec 2025 10:09:32 +0000
Gerrit-HasComments: No