You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amoro.apache.org by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/10/20 01:53:21 UTC
[PR] [AMORO-4451][Build] Discontinue Hadoop 2 support [amoro]
j1wonpark opened a new pull request, #4452:
URL: https://github.com/apache/amoro/pull/4452
## Why are the changes needed?
Close #4451.
## Brief change log
- Remove Hadoop 2 build, CI and distribution support.
- Replace the Flink optimizer image's Hadoop 2 libraries with Maven-selected Hadoop 3 client JARs.
- Update documentation and add a manual image regression test.
## How was this patch tested?
- Default package build and Spark 3.3/3.4 test compilation passed.
- Trino: 19 tests passed; Flink executor: 9 tests passed.
- Image regression: RED on Hadoop 2, GREEN on Flink 1.14/1.20 Java 11 images.
- Incremental JAR copy, formatting and shell checks passed.
Image tests cover Hadoop/Parquet class loading; complete optimizer jobs and external storage were not tested.
## Documentation
Updated build, installation and release instructions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [AMORO-4451][Build] Discontinue Hadoop 2 support [amoro]
Posted by "xxubai (via GitHub)" <gi...@apache.org>.
xxubai commented on code in PR #4452:
URL: https://github.com/apache/amoro/pull/4452#discussion_r4332532110
##########
README.md:
##########
@@ -123,7 +120,7 @@ Amoro is built using Maven with JDK 11 and 17(required for `amoro-format-mixed/a
* Build and skip dashboard: `./mvnw clean package -Pskip-dashboard-build`
* Build and disable disk storage, RocksDB will NOT be introduced to avoid memory overflow: `./mvnw clean package -DskipTests -Pno-extented-disk-storage`
* Build and enable aliyun-oss-sdk: `./mvnw clean package -DskipTests -Paliyun-oss-sdk`
-* Build with hadoop 2.x(the default is 3.x) dependencies: `./mvnw clean package -DskipTests -Phadoop2`
+* Hadoop 3 is required. Hadoop 2 support, including the `hadoop2` Maven profile and distribution packages, has been removed for the next release.
Review Comment:
nit: I think this can simply be removed from the latest documentation.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [AMORO-4451][Build] Discontinue Hadoop 2 support [amoro]
Posted by "xxubai (via GitHub)" <gi...@apache.org>.
xxubai commented on code in PR #4452:
URL: https://github.com/apache/amoro/pull/4452#discussion_r4332532110
##########
README.md:
##########
@@ -123,7 +120,7 @@ Amoro is built using Maven with JDK 11 and 17(required for `amoro-format-mixed/a
* Build and skip dashboard: `./mvnw clean package -Pskip-dashboard-build`
* Build and disable disk storage, RocksDB will NOT be introduced to avoid memory overflow: `./mvnw clean package -DskipTests -Pno-extented-disk-storage`
* Build and enable aliyun-oss-sdk: `./mvnw clean package -DskipTests -Paliyun-oss-sdk`
-* Build with hadoop 2.x(the default is 3.x) dependencies: `./mvnw clean package -DskipTests -Phadoop2`
+* Hadoop 3 is required. Hadoop 2 support, including the `hadoop2` Maven profile and distribution packages, has been removed for the next release.
Review Comment:
nit: I think it is simple to remove it for latest doc
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [PR] [AMORO-4451][Build] Discontinue Hadoop 2 support [amoro]
Posted by "xxubai (via GitHub)" <gi...@apache.org>.
xxubai merged PR #4452:
URL: https://github.com/apache/amoro/pull/4452
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org