You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "pan3793 (via GitHub)" <gi...@apache.org> on 2025/08/26 05:14:33 UTC
[PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
pan3793 opened a new pull request, #7898:
URL: https://github.com/apache/hadoop/pull/7898
<!--
Thanks for sending a pull request!
1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute
2. Make sure your PR title starts with JIRA issue id, e.g., 'HADOOP-17799. Your PR title ...'.
-->
### Description of PR
Debian 10 EOL, and the apt repo is unavailable, this PR upgrades it to Debian 11
```
docker run --rm -it debian:10 bash
root@bc2a4c509cb3:/# apt update
Ign:1 http://deb.debian.org/debian buster InRelease
Ign:2 http://deb.debian.org/debian-security buster/updates InRelease
Ign:3 http://deb.debian.org/debian buster-updates InRelease
Err:4 http://deb.debian.org/debian buster Release
404 Not Found [IP: 151.101.90.132 80]
Err:5 http://deb.debian.org/debian-security buster/updates Release
404 Not Found [IP: 151.101.90.132 80]
Err:6 http://deb.debian.org/debian buster-updates Release
404 Not Found [IP: 151.101.90.132 80]
Reading package lists... Done
E: The repository 'http://deb.debian.org/debian buster Release' does not have a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
E: The repository 'http://deb.debian.org/debian-security buster/updates Release' does not have a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
E: The repository 'http://deb.debian.org/debian buster-updates Release' does not have a Release file.
N: Updating from such a repository can't be done securely, and is therefore disabled by default.
N: See apt-secure(8) manpage for repository creation and user configuration details.
root@bc2a4c509cb3:/#
```
[Debian 11 will be EOL after 31 Aug 2026](https://endoflife.date/debian). I didn't switch it to Debian 12 or 13 because the new version does not have `openjdk-11-jdk` in the apt repo.
### How was this patch tested?
```
$ ./start-build-env.sh debian_11
...
_ _ _ ______
| | | | | | | _ \
| |_| | __ _ __| | ___ ___ _ __ | | | |_____ __
| _ |/ _` |/ _` |/ _ \ / _ \| '_ \ | | | / _ \ \ / /
| | | | (_| | (_| | (_) | (_) | |_) | | |/ / __/\ V /
\_| |_/\__,_|\__,_|\___/ \___/| .__/ |___/ \___| \_(_)
| |
|_|
This is the standard Hadoop Developer build environment.
This has all the right tools installed required to build
Hadoop from source.
chengpan@c85a4426ba52:~/hadoop$
```
```
$ mvn clean install -DskipTests -Pnative -Pyarn-ui -DskipShade
...
[INFO] Reactor Summary for Apache Hadoop Main 3.5.0-SNAPSHOT:
[INFO]
[INFO] Apache Hadoop Main ................................. SUCCESS [ 0.662 s]
[INFO] Apache Hadoop Build Tools .......................... SUCCESS [ 1.010 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 0.592 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [ 0.618 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 0.069 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [ 0.109 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [ 1.754 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [ 0.416 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [ 2.437 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [ 0.581 s]
[INFO] Apache Hadoop Common ............................... SUCCESS [ 22.868 s]
[INFO] Apache Hadoop NFS .................................. SUCCESS [ 1.273 s]
[INFO] Apache Hadoop KMS .................................. SUCCESS [ 1.393 s]
[INFO] Apache Hadoop Registry ............................. SUCCESS [ 1.533 s]
[INFO] Apache Hadoop Common Project ....................... SUCCESS [ 0.040 s]
[INFO] Apache Hadoop HDFS Client .......................... SUCCESS [ 11.693 s]
[INFO] Apache Hadoop HDFS ................................. SUCCESS [ 22.103 s]
[INFO] Apache Hadoop HDFS Native Client ................... SUCCESS [02:13 min]
[INFO] Apache Hadoop HttpFS ............................... SUCCESS [ 2.320 s]
[INFO] Apache Hadoop HDFS-NFS ............................. SUCCESS [ 1.312 s]
[INFO] Apache Hadoop YARN ................................. SUCCESS [ 0.042 s]
[INFO] Apache Hadoop YARN API ............................. SUCCESS [ 7.877 s]
[INFO] Apache Hadoop YARN Common .......................... SUCCESS [ 6.436 s]
[INFO] Apache Hadoop YARN Server .......................... SUCCESS [ 0.038 s]
[INFO] Apache Hadoop YARN Server Common ................... SUCCESS [ 5.022 s]
[INFO] Apache Hadoop YARN ApplicationHistoryService ....... SUCCESS [ 2.078 s]
[INFO] Apache Hadoop YARN Timeline Service ................ SUCCESS [ 1.541 s]
[INFO] Apache Hadoop YARN Web Proxy ....................... SUCCESS [ 1.331 s]
[INFO] Apache Hadoop YARN ResourceManager ................. SUCCESS [ 13.285 s]
[INFO] Apache Hadoop YARN NodeManager ..................... SUCCESS [ 24.058 s]
[INFO] Apache Hadoop YARN Server Tests .................... SUCCESS [ 1.467 s]
[INFO] Apache Hadoop YARN Client .......................... SUCCESS [ 2.682 s]
[INFO] Apache Hadoop MapReduce Client ..................... SUCCESS [ 0.682 s]
[INFO] Apache Hadoop MapReduce Core ....................... SUCCESS [ 5.570 s]
[INFO] Apache Hadoop MapReduce Common ..................... SUCCESS [ 2.672 s]
[INFO] Apache Hadoop MapReduce Shuffle .................... SUCCESS [ 1.767 s]
[INFO] Apache Hadoop MapReduce App ........................ SUCCESS [ 3.697 s]
[INFO] Apache Hadoop MapReduce HistoryServer .............. SUCCESS [ 2.380 s]
[INFO] Apache Hadoop MapReduce JobClient .................. SUCCESS [ 4.119 s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [ 2.581 s]
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [ 1.206 s]
[INFO] Apache Hadoop Federation Balance ................... SUCCESS [ 1.630 s]
[INFO] Apache Hadoop HDFS-RBF ............................. SUCCESS [ 15.224 s]
[INFO] Apache Hadoop HDFS Project ......................... SUCCESS [ 0.035 s]
[INFO] Apache Hadoop YARN SharedCacheManager .............. SUCCESS [ 1.195 s]
[INFO] Apache Hadoop YARN Timeline Plugin Storage ......... SUCCESS [ 1.104 s]
[INFO] Apache Hadoop YARN TimelineService HBase Backend ... SUCCESS [ 0.034 s]
[INFO] Apache Hadoop YARN TimelineService HBase Common .... SUCCESS [ 1.532 s]
[INFO] Apache Hadoop YARN TimelineService HBase Client .... SUCCESS [ 4.403 s]
[INFO] Apache Hadoop YARN TimelineService HBase Servers ... SUCCESS [ 0.039 s]
[INFO] Apache Hadoop YARN TimelineService HBase Server 2.5 SUCCESS [ 1.835 s]
[INFO] Apache Hadoop YARN TimelineService HBase tests ..... SUCCESS [ 1.916 s]
[INFO] Apache Hadoop YARN Router .......................... SUCCESS [ 2.665 s]
[INFO] Apache Hadoop YARN TimelineService DocumentStore ... SUCCESS [ 1.284 s]
[INFO] Apache Hadoop YARN GlobalPolicyGenerator ........... SUCCESS [ 1.474 s]
[INFO] Apache Hadoop YARN Applications .................... SUCCESS [ 0.033 s]
[INFO] Apache Hadoop YARN DistributedShell ................ SUCCESS [ 1.413 s]
[INFO] Apache Hadoop YARN Unmanaged Am Launcher ........... SUCCESS [ 0.925 s]
[INFO] Apache Hadoop YARN Services ........................ SUCCESS [ 0.033 s]
[INFO] Apache Hadoop YARN Services Core ................... SUCCESS [ 3.138 s]
[INFO] Apache Hadoop YARN Services API .................... SUCCESS [ 1.914 s]
[INFO] Apache Hadoop YARN Application Catalog ............. SUCCESS [ 0.038 s]
[INFO] Apache Hadoop YARN Application Catalog Webapp ...... SUCCESS [ 11.624 s]
[INFO] Apache Hadoop YARN Application Catalog Docker Image SUCCESS [ 0.048 s]
[INFO] Apache Hadoop YARN Application MaWo ................ SUCCESS [ 0.035 s]
[INFO] Apache Hadoop YARN Application MaWo Core ........... SUCCESS [ 0.991 s]
[INFO] Apache Hadoop YARN Site ............................ SUCCESS [ 0.075 s]
[INFO] Apache Hadoop YARN Registry ........................ SUCCESS [ 0.458 s]
[INFO] Apache Hadoop YARN UI .............................. SUCCESS [02:07 min]
[INFO] Apache Hadoop YARN CSI ............................. SUCCESS [ 3.403 s]
[INFO] Apache Hadoop YARN Project ......................... SUCCESS [ 1.283 s]
[INFO] Apache Hadoop MapReduce HistoryServer Plugins ...... SUCCESS [ 1.046 s]
[INFO] Apache Hadoop MapReduce NativeTask ................. SUCCESS [ 18.413 s]
[INFO] Apache Hadoop MapReduce Uploader ................... SUCCESS [ 1.040 s]
[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [ 1.912 s]
[INFO] Apache Hadoop MapReduce ............................ SUCCESS [ 1.140 s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [ 2.034 s]
[INFO] Apache Hadoop Client Aggregator .................... SUCCESS [ 0.728 s]
[INFO] Apache Hadoop Dynamometer Workload Simulator ....... SUCCESS [ 1.363 s]
[INFO] Apache Hadoop Dynamometer Cluster Simulator ........ SUCCESS [ 1.878 s]
[INFO] Apache Hadoop Dynamometer Block Listing Generator .. SUCCESS [ 1.241 s]
[INFO] Apache Hadoop Dynamometer Dist ..................... SUCCESS [ 1.161 s]
[INFO] Apache Hadoop Dynamometer .......................... SUCCESS [ 0.034 s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [ 1.310 s]
[INFO] Apache Hadoop Archive Logs ......................... SUCCESS [ 1.536 s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [ 1.914 s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [ 1.920 s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [ 1.347 s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [ 1.377 s]
[INFO] Apache Hadoop Pipes ................................ SUCCESS [ 2.679 s]
[INFO] Apache Hadoop Amazon Web Services support .......... SUCCESS [ 7.690 s]
[INFO] Apache Hadoop Kafka Library support ................ SUCCESS [ 0.901 s]
[INFO] Apache Hadoop Azure support ........................ SUCCESS [ 5.553 s]
[INFO] Apache Hadoop Aliyun OSS support ................... SUCCESS [ 1.183 s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [ 1.679 s]
[INFO] Apache Hadoop Resource Estimator Service ........... SUCCESS [ 1.213 s]
[INFO] Apache Hadoop Azure Data Lake support .............. SUCCESS [ 1.156 s]
[INFO] Apache Hadoop Image Generation Tool ................ SUCCESS [ 1.256 s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [ 0.704 s]
[INFO] Apache Hadoop OpenStack support .................... SUCCESS [ 0.047 s]
[INFO] Apache Hadoop Common Benchmark ..................... SUCCESS [ 9.812 s]
[INFO] Apache Hadoop Compatibility Benchmark .............. SUCCESS [ 0.853 s]
[INFO] Apache Hadoop Tools ................................ SUCCESS [ 0.032 s]
[INFO] Apache Hadoop Client API ........................... SUCCESS [ 0.911 s]
[INFO] Apache Hadoop Client Runtime ....................... SUCCESS [ 0.763 s]
[INFO] Apache Hadoop Client Packaging Invariants .......... SUCCESS [ 0.367 s]
[INFO] Apache Hadoop Client Test Minicluster .............. SUCCESS [ 0.756 s]
[INFO] Apache Hadoop Client Packaging Invariants for Test . SUCCESS [ 0.174 s]
[INFO] Apache Hadoop Client Packaging Integration Tests ... SUCCESS [ 0.778 s]
[INFO] Apache Hadoop Distribution ......................... SUCCESS [ 0.493 s]
[INFO] Apache Hadoop Client Modules ....................... SUCCESS [ 0.034 s]
[INFO] Apache Hadoop Tencent COS Support .................. SUCCESS [ 56.113 s]
[INFO] Apache Hadoop OBS support .......................... SUCCESS [ 1.335 s]
[INFO] Apache Hadoop Volcano Engine Services support ...... SUCCESS [ 2.005 s]
[INFO] Apache Hadoop Cloud Storage ........................ SUCCESS [ 0.444 s]
[INFO] Apache Hadoop Cloud Storage Project ................ SUCCESS [ 0.032 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 10:25 min
[INFO] Finished at: 2025-08-26T05:03:57Z
[INFO] ------------------------------------------------------------------------
```
### For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
- [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "slfan1989 (via GitHub)" <gi...@apache.org>.
slfan1989 commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3241445604
> @slfan1989, unnecessary changes are reverted, should be good to go
@pan3793 Thank you for your contribution, LGTM. I will merge this PR soon.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "slfan1989 (via GitHub)" <gi...@apache.org>.
slfan1989 commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3242753656
@pan3793 Thanks for the contribution! Merged into trunk.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3226834289
(!) A patch to the testing environment has been detected.
Re-executing against the patched versions to perform further tests.
The console is at https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/3/console in case of problems.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3226674242
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 0m 0s | | Docker mode activated. |
| -1 :x: | docker | 0m 19s | | Dockerfile '/home/jenkins/jenkins-home/workspace/hadoop-multibranch_PR-7898/rockylinux-8/src/dev-support/docker/Dockerfile_rockylinux_8' not found. |
| Subsystem | Report/Notes |
|----------:|:-------------|
| GITHUB PR | https://github.com/apache/hadoop/pull/7898 |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/2/console |
| versions | git=2.34.1 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3223228361
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 22m 6s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | shellcheck | 0m 0s | | Shellcheck was not available. |
| +0 :ok: | shelldocs | 0m 0s | | Shelldocs was not available. |
| +0 :ok: | hadolint | 0m 0s | | hadolint was not available. |
| +0 :ok: | jsonlint | 0m 0s | | jsonlint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
|||| _ trunk Compile Tests _ |
| +1 :green_heart: | mvninstall | 40m 22s | | trunk passed |
| -1 :x: | mvnsite | 17m 26s | [/branch-mvnsite-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/1/artifact/out/branch-mvnsite-root.txt) | root in trunk failed. |
| +1 :green_heart: | shadedclient | 94m 11s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +1 :green_heart: | mvninstall | 32m 16s | | the patch passed |
| +1 :green_heart: | blanks | 0m 1s | | The patch has no blanks issues. |
| -1 :x: | mvnsite | 11m 20s | [/patch-mvnsite-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/1/artifact/out/patch-mvnsite-root.txt) | root in the patch failed. |
| +1 :green_heart: | shadedclient | 47m 38s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 14m 13s | | root in the patch passed. |
| +1 :green_heart: | asflicense | 1m 57s | | The patch does not generate ASF License warnings. |
| | | 214m 23s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/1/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/7898 |
| Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs hadolint mvnsite unit jsonlint |
| uname | Linux 71b5c8e33180 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / f40defe72ea1f0f9d9778a4da76097fa2e1fa02b |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/1/testReport/ |
| Max. process+thread count | 707 (vs. ulimit of 5500) |
| modules | C: . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/1/console |
| versions | git=2.27.0 maven=3.6.3 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "slfan1989 (via GitHub)" <gi...@apache.org>.
slfan1989 commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3223070232
LGTM.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "slfan1989 (via GitHub)" <gi...@apache.org>.
slfan1989 commented on code in PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#discussion_r2311396990
##########
hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/cli/TestCLI.java:
##########
@@ -43,7 +43,6 @@ public void tearDown() throws Exception {
@Override
protected CommandExecutor.Result execute(CLICommand cmd) throws Exception {
return cmd.getExecutor("", conf).executeCommand(cmd.getCmd());
-
Review Comment:
The changes in Debian are as expected, and we can roll back the modifications to this unit as they are unrelated to our main changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on code in PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#discussion_r2299802155
##########
start-build-env.sh:
##########
@@ -93,7 +93,7 @@ RUN userdel -r \$(getent passwd ${USER_ID} | cut -d: -f1) 2>/dev/null || :
RUN groupadd --non-unique -g ${GROUP_ID} ${USER_NAME}
RUN useradd -g ${GROUP_ID} -u ${USER_ID} -k /root -m ${USER_NAME} -d "${DOCKER_HOME_DIR}"
RUN echo "${USER_NAME} ALL=NOPASSWD: ALL" > "/etc/sudoers.d/hadoop-build-${USER_ID}"
-ENV HOME "${DOCKER_HOME_DIR}"
+ENV HOME="${DOCKER_HOME_DIR}"
Review Comment:
update because
```
1 warning found (use docker --debug to expand):
- LegacyKeyValueFormat: "ENV key=value" should be used instead of legacy "ENV key value" format (line 7)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3241344735
@slfan1989, unnecessary changes are reverted, should be good to go
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3242127699
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 0m 51s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 1s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 1s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 1s | | detect-secrets was not available. |
| +0 :ok: | shellcheck | 0m 1s | | Shellcheck was not available. |
| +0 :ok: | shelldocs | 0m 1s | | Shelldocs was not available. |
| +0 :ok: | hadolint | 0m 1s | | hadolint was not available. |
| +0 :ok: | jsonlint | 0m 1s | | jsonlint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
|||| _ trunk Compile Tests _ |
| +1 :green_heart: | mvninstall | 45m 10s | | trunk passed |
| +1 :green_heart: | mvnsite | 25m 17s | | trunk passed |
| +1 :green_heart: | shadedclient | 111m 52s | | branch has no errors when building and testing our client artifacts. |
| -0 :warning: | patch | 112m 30s | | Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary. |
|||| _ Patch Compile Tests _ |
| +1 :green_heart: | mvninstall | 39m 13s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | mvnsite | 21m 1s | | the patch passed |
| +1 :green_heart: | shadedclient | 62m 8s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 15m 40s | | root in the patch passed. |
| +1 :green_heart: | asflicense | 1m 56s | | The patch does not generate ASF License warnings. |
| | | 234m 15s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/6/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/7898 |
| Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs hadolint mvnsite unit jsonlint |
| uname | Linux f4938eb59c7e 5.15.0-144-generic #157-Ubuntu SMP Mon Jun 16 07:33:10 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 131b7dbbd530ccac5ad0d41775484cb7bc2306e2 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/6/testReport/ |
| Max. process+thread count | 524 (vs. ulimit of 5500) |
| modules | C: . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/6/console |
| versions | git=2.43.7 maven=3.6.3 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "stoty (via GitHub)" <gi...@apache.org>.
stoty commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3228059389
I think it would be useful to run at least the native (C code) tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3238250392
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 36m 32s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 1s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 1s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 1s | | detect-secrets was not available. |
| +0 :ok: | shellcheck | 0m 1s | | Shellcheck was not available. |
| +0 :ok: | shelldocs | 0m 1s | | Shelldocs was not available. |
| +0 :ok: | hadolint | 0m 1s | | hadolint was not available. |
| +0 :ok: | jsonlint | 0m 1s | | jsonlint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 1 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 9m 34s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 39m 49s | | trunk passed |
| +1 :green_heart: | compile | 17m 55s | | trunk passed |
| +1 :green_heart: | checkstyle | 5m 58s | | trunk passed |
| +1 :green_heart: | mvnsite | 24m 46s | | trunk passed |
| +1 :green_heart: | javadoc | 8m 39s | | trunk passed |
| +1 :green_heart: | spotbugs | 39m 38s | | trunk passed |
| +1 :green_heart: | shadedclient | 83m 13s | | branch has no errors when building and testing our client artifacts. |
| -0 :warning: | patch | 83m 51s | | Used diff version of patch file. Binary files and potentially other changes not applied. Please rebase and squash commits if necessary. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 43s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 39m 7s | | the patch passed |
| +1 :green_heart: | compile | 16m 47s | | the patch passed |
| +1 :green_heart: | javac | 16m 47s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | checkstyle | 6m 13s | | the patch passed |
| +1 :green_heart: | mvnsite | 24m 36s | | the patch passed |
| +1 :green_heart: | javadoc | 10m 7s | | the patch passed |
| +1 :green_heart: | spotbugs | 42m 23s | | the patch passed |
| +1 :green_heart: | shadedclient | 83m 31s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| -1 :x: | unit | 438m 25s | [/patch-unit-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/5/artifact/out/patch-unit-root.txt) | root in the patch failed. |
| +1 :green_heart: | asflicense | 2m 27s | | The patch does not generate ASF License warnings. |
| | | 861m 21s | | |
| Reason | Tests |
|-------:|:------|
| Failed junit tests | hadoop.fs.compat.common.TestHdfsCompatShellCommand |
| | hadoop.fs.compat.common.TestHdfsCompatDefaultSuites |
| | hadoop.hdfs.tools.TestDFSAdmin |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/5/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/7898 |
| Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs hadolint mvnsite unit jsonlint compile javac javadoc mvninstall shadedclient spotbugs checkstyle |
| uname | Linux b15de39f0892 5.15.0-144-generic #157-Ubuntu SMP Mon Jun 16 07:33:10 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / d7d9893cf80efe73d802c253eb12508143e8a636 |
| Default Java | Red Hat, Inc.-1.8.0_462-b08 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/5/testReport/ |
| Max. process+thread count | 2833 (vs. ulimit of 5500) |
| modules | C: hadoop-common-project/hadoop-common . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/5/console |
| versions | git=2.43.7 maven=3.6.3 spotbugs=4.2.2 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "pan3793 (via GitHub)" <gi...@apache.org>.
pan3793 commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3223320943
> We need to solve the compilation error issue.
The building error occurs on CentOS 8 stage, looks like I need to fix it first
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7898:
URL: https://github.com/apache/hadoop/pull/7898#issuecomment-3227579915
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 20m 58s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | shelldocs | 0m 1s | | Shelldocs was not available. |
| +0 :ok: | jsonlint | 0m 1s | | jsonlint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
|||| _ HADOOP-19661 Compile Tests _ |
| +1 :green_heart: | mvninstall | 45m 24s | | HADOOP-19661 passed |
| +1 :green_heart: | mvnsite | 22m 56s | | HADOOP-19661 passed |
| +1 :green_heart: | shadedclient | 40m 21s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +1 :green_heart: | mvninstall | 36m 26s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | hadolint | 0m 2s | | No new issues. |
| +1 :green_heart: | mvnsite | 20m 1s | | the patch passed |
| +1 :green_heart: | shellcheck | 0m 0s | | No new issues. |
| +1 :green_heart: | shadedclient | 40m 8s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 16m 4s | | root in the patch passed. |
| +1 :green_heart: | asflicense | 1m 5s | | The patch does not generate ASF License warnings. |
| | | 246m 11s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/3/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/7898 |
| Optional Tests | dupname asflicense codespell detsecrets hadolint shellcheck shelldocs mvnsite unit jsonlint |
| uname | Linux 1b828c1875fb 5.15.0-144-generic #157-Ubuntu SMP Mon Jun 16 07:33:10 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | HADOOP-19661 / 7f02ba4fa4464804763bb80838673e37361a7f6b |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/3/testReport/ |
| Max. process+thread count | 588 (vs. ulimit of 5500) |
| modules | C: . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7898/3/console |
| versions | git=2.25.1 maven=3.6.3 hadolint=1.11.1-0-g0e692dd shellcheck=0.7.0 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19659. Upgrade Debian 10 to 11 in build env Dockerfile [hadoop]
Posted by "slfan1989 (via GitHub)" <gi...@apache.org>.
slfan1989 merged PR #7898:
URL: https://github.com/apache/hadoop/pull/7898
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org