You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "steveloughran (via GitHub)" <gi...@apache.org> on 2025/09/17 13:51:38 UTC
[PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
steveloughran opened a new pull request, #7980:
URL: https://github.com/apache/hadoop/pull/7980
* new assembly for hadoop cloud storage
* hadoop-cloud-storage does the assembly on -Pdist
* layout stitching to move into share/hadoop/common/lib
* remove connectors from hadoop-tools-dist
* cut old jackson version from huawaei cloud dependency -even though it was being upgraded by our own artifacts, it was a complication.
### How was this patch tested?
Manual build, review, storediag, hadoop fs commands
### For code changes:
- [=] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
- [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3327784078
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 15m 12s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | shelldocs | 0m 0s | | Shelldocs was not available. |
| +0 :ok: | xmllint | 0m 0s | | xmllint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 10m 27s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 38m 56s | | trunk passed |
| +1 :green_heart: | compile | 16m 7s | | trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | compile | 13m 50s | | trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | mvnsite | 20m 36s | | trunk passed |
| +1 :green_heart: | javadoc | 9m 11s | | trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 7m 39s | | trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| -1 :x: | shadedclient | 18m 3s | | branch has errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 35s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 38m 59s | | the patch passed |
| +1 :green_heart: | compile | 15m 25s | | the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javac | 15m 25s | | the patch passed |
| +1 :green_heart: | compile | 13m 56s | | the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | javac | 13m 56s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | mvnsite | 18m 55s | | the patch passed |
| +1 :green_heart: | shellcheck | 0m 0s | | No new issues. |
| -1 :x: | javadoc | 9m 9s | [/results-javadoc-javadoc-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/artifact/out/results-javadoc-javadoc-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt) | root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 generated 10 new + 5526 unchanged - 10 fixed = 5536 total (was 5536) |
| -1 :x: | javadoc | 7m 34s | [/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/artifact/out/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt) | root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 generated 10 new + 1418 unchanged - 10 fixed = 1428 total (was 1428) |
| -1 :x: | shadedclient | 19m 38s | | patch has errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| -1 :x: | unit | 800m 7s | [/patch-unit-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/artifact/out/patch-unit-root.txt) | root in the patch passed. |
| +1 :green_heart: | asflicense | 1m 46s | | The patch does not generate ASF License warnings. |
| | | 1046m 13s | | |
| Reason | Tests |
|-------:|:------|
| Failed junit tests | hadoop.yarn.server.router.subcluster.capacity.TestYarnFederationWithCapacityScheduler |
| | hadoop.mapreduce.v2.TestUberAM |
| | hadoop.yarn.sls.appmaster.TestAMSimulator |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
| Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xmllint |
| uname | Linux 271d5e8aaf6a 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 0aaa6ce66e8a8fc7fc04fa4e2650badf956d531a |
| Default Java | Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/testReport/ |
| Max. process+thread count | 4938 (vs. ulimit of 5500) |
| modules | C: hadoop-assemblies hadoop-tools/hadoop-tools-dist hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-cloud-storage . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/console |
| versions | git=2.25.1 maven=3.9.11 shellcheck=0.7.0 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303936232
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 0m 33s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | shelldocs | 0m 0s | | Shelldocs was not available. |
| +0 :ok: | xmllint | 0m 1s | | xmllint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 13m 4s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 43m 58s | | trunk passed |
| +1 :green_heart: | compile | 16m 16s | | trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | compile | 13m 34s | | trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | mvnsite | 2m 57s | | trunk passed |
| +1 :green_heart: | javadoc | 2m 53s | | trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 2m 43s | | trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | shadedclient | 40m 19s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 35s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 1m 10s | | the patch passed |
| +1 :green_heart: | compile | 14m 58s | | the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javac | 14m 58s | | the patch passed |
| +1 :green_heart: | compile | 13m 51s | | the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | javac | 13m 51s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | mvnsite | 2m 55s | | the patch passed |
| +1 :green_heart: | shellcheck | 0m 0s | | No new issues. |
| +1 :green_heart: | javadoc | 2m 47s | | the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 2m 41s | | the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | shadedclient | 42m 52s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 0m 39s | | hadoop-assemblies in the patch passed. |
| +1 :green_heart: | unit | 0m 41s | | hadoop-tools-dist in the patch passed. |
| +1 :green_heart: | unit | 0m 44s | | hadoop-huaweicloud in the patch passed. |
| +1 :green_heart: | unit | 0m 41s | | hadoop-cloud-storage in the patch passed. |
| +1 :green_heart: | asflicense | 1m 6s | | The patch does not generate ASF License warnings. |
| | | 214m 20s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/1/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
| Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xmllint |
| uname | Linux 604f3bcd050e 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / c59e35149ea17b7cea37be9203a265dcbff118fe |
| Default Java | Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/1/testReport/ |
| Max. process+thread count | 548 (vs. ulimit of 5500) |
| modules | C: hadoop-assemblies hadoop-tools/hadoop-tools-dist hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-cloud-storage U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/1/console |
| versions | git=2.25.1 maven=3.6.3 shellcheck=0.7.0 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran merged PR #7980:
URL: https://github.com/apache/hadoop/pull/7980
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3402138222
shaded test failures
* some in yarn which are presumably unrelated...let's see
* lots of more skipped tests in hadoop-azure, hadoop-azuredatalake, such as `TestAbfsInputStreamStatistics` which is skipping .... Looks like maven is back to running these tests and skipping where they don't have the credentials
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303435683
Having audited the files coming off the cloud connectors, we have about a dozen whose licenses aren't in the binary
```
analyticsaccelerator-s3-1.3.0.jar
cos_api-bundle-5.6.19.jar
dom4j-2.1.4.jar
esdk-obs-java-3.20.4.2.jar
java-trace-api-0.2.11-beta.jar
java-xmlbuilder-1.2.jar
opentracing-api-0.33.0.jar
opentracing-noop-0.33.0.jar
opentracing-util-0.33.0.jar
reactive-streams-1.0.3.jar
ve-tos-java-sdk-hadoop-2.8.9.jar
```
the analyticsaccelerator is @ahmarsuhail 's work to add to the license, not sure about the others.
Proposed: identify which connector the unacknowledged artifacts are coming from, create homework for each team.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303133677
for contrast, here's 3.4.2
```
../hadoop-3.4.2/:
total 272
drwxr-xr-x@ 13 stevel staff 416 Aug 7 12:58 bin
-rw-r--r--@ 1 stevel staff 824 Aug 27 16:58 binding.xml
drwxr-xr-x@ 3 stevel staff 96 Aug 25 17:09 downloads
drwxr-xr-x@ 3 stevel staff 96 Aug 7 12:16 etc
drwxr-xr-x@ 7 stevel staff 224 Aug 7 12:58 include
drwxr-xr-x@ 3 stevel staff 96 Aug 7 12:58 lib
drwxr-xr-x@ 14 stevel staff 448 Aug 7 12:58 libexec
-rw-r--r--@ 1 stevel staff 23682 Aug 7 10:40 LICENSE-binary
-rw-r--r--@ 1 stevel staff 15791 Aug 7 10:39 LICENSE.txt
drwxr-xr-x@ 45 stevel staff 1440 Aug 7 12:58 licenses-binary
-rw-r--r--@ 1 stevel staff 45514 Aug 27 17:12 log.txt
-rw-r--r--@ 1 stevel staff 27373 Aug 7 10:39 NOTICE-binary
-rw-r--r--@ 1 stevel staff 1541 Aug 7 10:39 NOTICE.txt
-rw-r--r--@ 1 stevel staff 175 Aug 7 10:39 README.txt
drwxr-xr-x@ 29 stevel staff 928 Aug 7 12:16 sbin
-rw-r--r--@ 1 stevel staff 438 Aug 25 16:59 secrets.bin
drwxr-xr-x@ 4 stevel staff 128 Aug 7 13:23 share
-rw-r--r--@ 1 stevel staff 275 Aug 27 17:12 system.properties
share/hadoop/common/lib:
total 1401704
-rw-r--r--@ 1 stevel staff 106151 Sep 17 12:57 aliyun-java-core-0.2.11-beta.jar
-rw-r--r--@ 1 stevel staff 194215 Sep 17 12:57 aliyun-java-sdk-core-4.5.10.jar
-rw-r--r--@ 1 stevel staff 163698 Sep 17 12:57 aliyun-java-sdk-kms-2.11.0.jar
-rw-r--r--@ 1 stevel staff 220800 Sep 17 12:57 aliyun-java-sdk-ram-3.1.0.jar
-rw-r--r--@ 1 stevel staff 928456 Sep 17 12:57 aliyun-sdk-oss-3.18.1.jar
-rw-r--r--@ 1 stevel staff 2470776 Sep 17 12:57 analyticsaccelerator-s3-1.3.0.jar
-rw-r--r--@ 1 stevel staff 27006 Sep 17 13:11 aopalliance-repackaged-2.6.1.jar
-rw-r--r--@ 1 stevel staff 20891 Sep 17 13:11 audience-annotations-0.12.0.jar
-rw-r--r--@ 1 stevel staff 651391 Sep 17 13:11 avro-1.11.4.jar
-rw-r--r--@ 1 stevel staff 113966 Sep 17 12:57 azure-data-lake-store-sdk-2.3.9.jar
-rw-r--r--@ 1 stevel staff 10288 Sep 17 12:57 azure-keyvault-core-1.0.0.jar
-rw-r--r--@ 1 stevel staff 815331 Sep 17 12:57 azure-storage-7.0.1.jar
-rw-r--r--@ 1 stevel staff 8324412 Sep 17 13:11 bcprov-jdk18on-1.78.1.jar
-rw-r--r--@ 1 stevel staff 641534749 Sep 17 12:57 bundle-2.29.52.jar
-rw-r--r--@ 1 stevel staff 223979 Sep 17 13:11 checker-qual-3.33.0.jar
-rw-r--r--@ 1 stevel staff 75479 Sep 17 13:11 commons-cli-1.9.0.jar
-rw-r--r--@ 1 stevel staff 353793 Sep 17 13:11 commons-codec-1.15.jar
-rw-r--r--@ 1 stevel staff 751914 Sep 17 13:11 commons-collections4-4.4.jar
-rw-r--r--@ 1 stevel staff 1079377 Sep 17 13:11 commons-compress-1.26.1.jar
-rw-r--r--@ 1 stevel staff 657516 Sep 17 13:11 commons-configuration2-2.10.1.jar
-rw-r--r--@ 1 stevel staff 24239 Sep 17 13:11 commons-daemon-1.0.13.jar
-rw-r--r--@ 1 stevel staff 508826 Sep 17 13:11 commons-io-2.16.1.jar
-rw-r--r--@ 1 stevel staff 673587 Sep 17 13:11 commons-lang3-3.17.0.jar
-rw-r--r--@ 1 stevel staff 70816 Sep 17 13:11 commons-logging-1.3.0.jar
-rw-r--r--@ 1 stevel staff 2213560 Sep 17 13:11 commons-math3-3.6.1.jar
-rw-r--r--@ 1 stevel staff 316431 Sep 17 13:11 commons-net-3.9.0.jar
-rw-r--r--@ 1 stevel staff 238400 Sep 17 13:11 commons-text-1.10.0.jar
-rw-r--r--@ 1 stevel staff 8661164 Sep 17 12:57 cos_api-bundle-5.6.19.jar
-rw-r--r--@ 1 stevel staff 2983237 Sep 17 13:11 curator-client-5.2.0.jar
-rw-r--r--@ 1 stevel staff 336384 Sep 17 13:11 curator-framework-5.2.0.jar
-rw-r--r--@ 1 stevel staff 315569 Sep 17 13:11 curator-recipes-5.2.0.jar
-rw-r--r--@ 1 stevel staff 583996 Sep 17 13:11 dnsjava-3.6.1.jar
-rw-r--r--@ 1 stevel staff 324655 Sep 17 12:57 dom4j-2.1.4.jar
-rw-r--r--@ 1 stevel staff 670059 Sep 17 12:57 esdk-obs-java-3.20.4.2.jar
-rw-r--r--@ 1 stevel staff 4617 Sep 17 13:11 failureaccess-1.0.1.jar
-rw-r--r--@ 1 stevel staff 249277 Sep 17 13:11 gson-2.9.0.jar
-rw-r--r--@ 1 stevel staff 3037368 Sep 17 13:11 guava-32.0.1-jre.jar
-rw-r--r--@ 1 stevel staff 94013 Sep 17 12:57 hadoop-aliyun-3.5.0-20250916.124028-685.jar
-rw-r--r--@ 1 stevel staff 14456 Sep 17 13:11 hadoop-annotations-3.5.0-SNAPSHOT.jar
-rw-r--r--@ 1 stevel staff 114335 Sep 17 13:11 hadoop-auth-3.5.0-SNAPSHOT.jar
-rw-r--r--@ 1 stevel staff 930516 Sep 17 12:57 hadoop-aws-3.5.0-20250916.124028-686.jar
-rw-r--r--@ 1 stevel staff 827349 Sep 17 12:57 hadoop-azure-3.5.0-20250916.124028-685.jar
-rw-r--r--@ 1 stevel staff 33363 Sep 17 12:57 hadoop-azure-datalake-3.5.0-20250916.124028-685.jar
-rw-r--r--@ 1 stevel staff 70007 Sep 17 12:57 hadoop-cos-3.5.0-20250916.124028-683.jar
-rw-r--r--@ 1 stevel staff 138447 Sep 17 12:57 hadoop-gcp-3.5.0-SNAPSHOT.jar
-rw-r--r--@ 1 stevel staff 142274 Sep 17 12:57 hadoop-huaweicloud-3.5.0-SNAPSHOT.jar
-rw-r--r--@ 1 stevel staff 3519516 Sep 17 13:11 hadoop-shaded-guava-1.4.0.jar
-rw-r--r--@ 1 stevel staff 1952967 Sep 17 13:11 hadoop-shaded-protobuf_3_25-1.4.0.jar
-rw-r--r--@ 1 stevel staff 4019589 Sep 17 12:57 hadoop-tos-3.5.0-20250916.124028-202.jar
-rw-r--r--@ 1 stevel staff 200223 Sep 17 13:11 hk2-api-2.6.1.jar
-rw-r--r--@ 1 stevel staff 203358 Sep 17 13:11 hk2-locator-2.6.1.jar
-rw-r--r--@ 1 stevel staff 131590 Sep 17 13:11 hk2-utils-2.6.1.jar
-rw-r--r--@ 1 stevel staff 780321 Sep 17 13:11 httpclient-4.5.13.jar
-rw-r--r--@ 1 stevel staff 328593 Sep 17 13:11 httpcore-4.4.13.jar
-rw-r--r--@ 1 stevel staff 102220 Sep 17 12:57 ini4j-0.5.4.jar
-rw-r--r--@ 1 stevel staff 29807 Sep 17 13:11 istack-commons-runtime-3.0.12.jar
-rw-r--r--@ 1 stevel staff 9301 Sep 17 13:11 j2objc-annotations-2.8.jar
-rw-r--r--@ 1 stevel staff 76636 Sep 17 13:11 jackson-annotations-2.14.3.jar
-rw-r--r--@ 1 stevel staff 473081 Sep 17 13:11 jackson-core-2.14.3.jar
-rw-r--r--@ 1 stevel staff 1617187 Sep 17 13:11 jackson-databind-2.14.3.jar
-rw-r--r--@ 1 stevel staff 68453 Sep 17 13:11 jakarta.activation-1.2.2.jar
-rw-r--r--@ 1 stevel staff 44399 Sep 17 13:11 jakarta.activation-api-1.2.1.jar
-rw-r--r--@ 1 stevel staff 25058 Sep 17 13:11 jakarta.annotation-api-1.3.5.jar
-rw-r--r--@ 1 stevel staff 18140 Sep 17 13:11 jakarta.inject-2.6.1.jar
-rw-r--r--@ 1 stevel staff 82973 Sep 17 13:11 jakarta.servlet-api-4.0.4.jar
-rw-r--r--@ 1 stevel staff 53683 Sep 17 13:11 jakarta.servlet.jsp-api-2.3.6.jar
-rw-r--r--@ 1 stevel staff 91930 Sep 17 13:11 jakarta.validation-api-2.0.2.jar
-rw-r--r--@ 1 stevel staff 140376 Sep 17 13:11 jakarta.ws.rs-api-2.1.6.jar
-rw-r--r--@ 1 stevel staff 115638 Sep 17 13:11 jakarta.xml.bind-api-2.3.3.jar
-rw-r--r--@ 1 stevel staff 7771 Sep 17 12:57 java-trace-api-0.2.11-beta.jar
-rw-r--r--@ 1 stevel staff 18432 Sep 17 12:57 java-xmlbuilder-1.2.jar
-rw-r--r--@ 1 stevel staff 794714 Sep 17 13:11 javassist-3.30.2-GA.jar
-rw-r--r--@ 1 stevel staff 95806 Sep 17 13:11 javax.servlet-api-3.1.0.jar
-rw-r--r--@ 1 stevel staff 1019097 Sep 17 13:11 jaxb-runtime-2.3.9.jar
-rw-r--r--@ 1 stevel staff 4722 Sep 17 13:11 jcip-annotations-1.0-1.jar
-rw-r--r--@ 1 stevel staff 327806 Sep 17 12:57 jdom2-2.0.6.1.jar
-rw-r--r--@ 1 stevel staff 311826 Sep 17 13:11 jersey-client-2.46.jar
-rw-r--r--@ 1 stevel staff 1267957 Sep 17 13:11 jersey-common-2.46.jar
-rw-r--r--@ 1 stevel staff 32929 Sep 17 13:11 jersey-container-servlet-2.46.jar
-rw-r--r--@ 1 stevel staff 75742 Sep 17 13:11 jersey-container-servlet-core-2.46.jar
-rw-r--r--@ 1 stevel staff 80272 Sep 17 13:11 jersey-hk2-2.46.jar
-rw-r--r--@ 1 stevel staff 964550 Sep 17 13:11 jersey-server-2.46.jar
-rw-r--r--@ 1 stevel staff 90184 Sep 17 12:57 jettison-1.5.4.jar
-rw-r--r--@ 1 stevel staff 249911 Sep 17 13:11 jetty-http-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 183011 Sep 17 13:11 jetty-io-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 118496 Sep 17 13:11 jetty-security-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 739348 Sep 17 13:11 jetty-server-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 146064 Sep 17 13:11 jetty-servlet-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 588962 Sep 17 13:11 jetty-util-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 66643 Sep 17 13:11 jetty-util-ajax-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 140308 Sep 17 13:11 jetty-webapp-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 68894 Sep 17 13:11 jetty-xml-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 282591 Sep 17 13:11 jsch-0.1.55.jar
-rw-r--r--@ 1 stevel staff 19936 Sep 17 13:11 jsr305-3.0.2.jar
-rw-r--r--@ 1 stevel staff 4519 Sep 17 13:11 jul-to-slf4j-1.7.36.jar
-rw-r--r--@ 1 stevel staff 223129 Sep 17 13:11 kerb-core-2.0.3.jar
-rw-r--r--@ 1 stevel staff 115065 Sep 17 13:11 kerb-crypto-2.0.3.jar
-rw-r--r--@ 1 stevel staff 36361 Sep 17 13:11 kerb-util-2.0.3.jar
-rw-r--r--@ 1 stevel staff 100095 Sep 17 13:11 kerby-asn1-2.0.3.jar
-rw-r--r--@ 1 stevel staff 30190 Sep 17 13:11 kerby-config-2.0.3.jar
-rw-r--r--@ 1 stevel staff 200581 Sep 17 13:11 kerby-pkix-2.0.3.jar
-rw-r--r--@ 1 stevel staff 40787 Sep 17 13:11 kerby-util-2.0.3.jar
-rw-r--r--@ 1 stevel staff 2199 Sep 17 13:11 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
-rw-r--r--@ 1 stevel staff 136314 Sep 17 13:11 metrics-core-3.2.4.jar
-rw-r--r--@ 1 stevel staff 4554 Sep 17 13:11 netty-all-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 339045 Sep 17 13:11 netty-buffer-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 355199 Sep 17 13:11 netty-codec-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 67192 Sep 17 13:11 netty-codec-dns-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 37789 Sep 17 13:11 netty-codec-haproxy-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 674362 Sep 17 13:11 netty-codec-http-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 490985 Sep 17 13:11 netty-codec-http2-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 44736 Sep 17 13:11 netty-codec-memcache-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 113699 Sep 17 13:11 netty-codec-mqtt-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 46015 Sep 17 13:11 netty-codec-redis-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 21344 Sep 17 13:11 netty-codec-smtp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 121032 Sep 17 13:11 netty-codec-socks-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 34636 Sep 17 13:11 netty-codec-stomp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 19823 Sep 17 13:11 netty-codec-xml-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 719225 Sep 17 13:11 netty-common-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 580162 Sep 17 13:11 netty-handler-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 25650 Sep 17 13:11 netty-handler-proxy-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 26833 Sep 17 13:11 netty-handler-ssl-ocsp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 37842 Sep 17 13:11 netty-resolver-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 188360 Sep 17 13:11 netty-resolver-dns-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 9145 Sep 17 13:11 netty-resolver-dns-classes-macos-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 19825 Sep 17 13:11 netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar
-rw-r--r--@ 1 stevel staff 19629 Sep 17 13:11 netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar
-rw-r--r--@ 1 stevel staff 521428 Sep 17 13:11 netty-transport-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 147621 Sep 17 13:11 netty-transport-classes-epoll-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 108558 Sep 17 13:11 netty-transport-classes-kqueue-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 42321 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar
-rw-r--r--@ 1 stevel staff 36594 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar
-rw-r--r--@ 1 stevel staff 40644 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar
-rw-r--r--@ 1 stevel staff 6193 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 25741 Sep 17 13:11 netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar
-rw-r--r--@ 1 stevel staff 25170 Sep 17 13:11 netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar
-rw-r--r--@ 1 stevel staff 44157 Sep 17 13:11 netty-transport-native-unix-common-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 18241 Sep 17 13:11 netty-transport-rxtx-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 50814 Sep 17 13:11 netty-transport-sctp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 32189 Sep 17 13:11 netty-transport-udt-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 779369 Sep 17 13:11 nimbus-jose-jwt-9.37.2.jar
-rw-r--r--@ 1 stevel staff 425763 Sep 17 12:57 okhttp-3.14.2.jar
-rw-r--r--@ 1 stevel staff 91980 Sep 17 12:57 okio-1.17.2.jar
-rw-r--r--@ 1 stevel staff 141734 Sep 17 12:57 opentelemetry-api-1.38.0.jar
-rw-r--r--@ 1 stevel staff 47252 Sep 17 12:57 opentelemetry-context-1.38.0.jar
-rw-r--r--@ 1 stevel staff 18189 Sep 17 12:57 opentracing-api-0.33.0.jar
-rw-r--r--@ 1 stevel staff 10542 Sep 17 12:57 opentracing-noop-0.33.0.jar
-rw-r--r--@ 1 stevel staff 7504 Sep 17 12:57 opentracing-util-0.33.0.jar
-rw-r--r--@ 1 stevel staff 281989 Sep 17 12:57 org.jacoco.agent-0.8.5-runtime.jar
-rw-r--r--@ 1 stevel staff 19479 Sep 17 13:11 osgi-resource-locator-1.0.3.jar
-rw-r--r--@ 1 stevel staff 128414 Sep 17 13:11 re2j-1.1.jar
-rw-r--r--@ 1 stevel staff 11369 Sep 17 12:57 reactive-streams-1.0.3.jar
-rw-r--r--@ 1 stevel staff 332398 Sep 17 13:11 reload4j-1.2.22.jar
-rw-r--r--@ 1 stevel staff 41125 Sep 17 13:11 slf4j-api-1.7.36.jar
-rw-r--r--@ 1 stevel staff 9824 Sep 17 13:11 slf4j-reload4j-1.7.36.jar
-rw-r--r--@ 1 stevel staff 2112099 Sep 17 13:11 snappy-java-1.1.10.4.jar
-rw-r--r--@ 1 stevel staff 195909 Sep 17 13:11 stax2-api-4.2.1.jar
-rw-r--r--@ 1 stevel staff 72007 Sep 17 13:11 txw2-2.3.9.jar
-rw-r--r--@ 1 stevel staff 443788 Sep 17 12:57 wildfly-openssl-2.1.4.Final.jar
-rw-r--r--@ 1 stevel staff 522679 Sep 17 13:11 woodstox-core-5.4.0.jar
-rw-r--r--@ 1 stevel staff 1323991 Sep 17 13:11 zookeeper-3.8.4.jar
-rw-r--r--@ 1 stevel staff 254932 Sep 17 13:11 zookeeper-jute-3.8.4.jar
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3405523026
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 21m 30s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | shelldocs | 0m 0s | | Shelldocs was not available. |
| +0 :ok: | xmllint | 0m 0s | | xmllint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 1 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 9m 15s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 35m 25s | | trunk passed |
| +1 :green_heart: | compile | 17m 37s | | trunk passed |
| +1 :green_heart: | checkstyle | 3m 40s | | trunk passed |
| -1 :x: | mvnsite | 11m 2s | [/branch-mvnsite-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-mvnsite-root.txt) | root in trunk failed. |
| +1 :green_heart: | javadoc | 9m 44s | | trunk passed |
| +0 :ok: | spotbugs | 0m 27s | | branch/hadoop-project no spotbugs output file (spotbugsXml.xml) |
| +0 :ok: | spotbugs | 0m 22s | | branch/hadoop-assemblies no spotbugs output file (spotbugsXml.xml) |
| -1 :x: | spotbugs | 1m 19s | [/branch-spotbugs-hadoop-common-project_hadoop-common.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-common-project_hadoop-common.txt) | hadoop-common in trunk failed. |
| -1 :x: | spotbugs | 0m 32s | [/branch-spotbugs-hadoop-tools_hadoop-gcp.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-tools_hadoop-gcp.txt) | hadoop-gcp in trunk failed. |
| +0 :ok: | spotbugs | 0m 23s | | branch/hadoop-tools/hadoop-tools-dist no spotbugs output file (spotbugsXml.xml) |
| -1 :x: | spotbugs | 0m 32s | [/branch-spotbugs-hadoop-cloud-storage-project_hadoop-huaweicloud.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-cloud-storage-project_hadoop-huaweicloud.txt) | hadoop-huaweicloud in trunk failed. |
| -1 :x: | spotbugs | 0m 37s | [/branch-spotbugs-hadoop-cloud-storage-project_hadoop-tos.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-cloud-storage-project_hadoop-tos.txt) | hadoop-tos in trunk failed. |
| +0 :ok: | spotbugs | 0m 23s | | branch/hadoop-cloud-storage-project/hadoop-cloud-storage no spotbugs output file (spotbugsXml.xml) |
| -1 :x: | spotbugs | 0m 31s | [/branch-spotbugs-hadoop-cloud-storage-project.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-cloud-storage-project.txt) | hadoop-cloud-storage-project in trunk failed. |
| -1 :x: | spotbugs | 0m 30s | [/branch-spotbugs-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-root.txt) | root in trunk failed. |
| +1 :green_heart: | shadedclient | 30m 50s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 34s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 43m 52s | | the patch passed |
| +1 :green_heart: | compile | 17m 5s | | the patch passed |
| +1 :green_heart: | javac | 17m 5s | | the patch passed |
| +1 :green_heart: | blanks | 0m 1s | | The patch has no blanks issues. |
| +1 :green_heart: | checkstyle | 3m 39s | | the patch passed |
| -1 :x: | mvnsite | 7m 36s | [/patch-mvnsite-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-mvnsite-root.txt) | root in the patch failed. |
| +1 :green_heart: | shellcheck | 0m 0s | | No new issues. |
| -1 :x: | javadoc | 9m 41s | [/results-javadoc-javadoc-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/results-javadoc-javadoc-root.txt) | root generated 30 new + 42985 unchanged - 30 fixed = 43015 total (was 43015) |
| +0 :ok: | spotbugs | 0m 22s | | hadoop-project has no data from spotbugs |
| +0 :ok: | spotbugs | 0m 22s | | hadoop-assemblies has no data from spotbugs |
| -1 :x: | spotbugs | 1m 19s | [/patch-spotbugs-hadoop-common-project_hadoop-common.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-common-project_hadoop-common.txt) | hadoop-common in the patch failed. |
| +0 :ok: | spotbugs | 0m 24s | | hadoop-tools/hadoop-tools-dist has no data from spotbugs |
| -1 :x: | spotbugs | 0m 33s | [/patch-spotbugs-hadoop-tools_hadoop-gcp.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-tools_hadoop-gcp.txt) | hadoop-gcp in the patch failed. |
| -1 :x: | spotbugs | 0m 32s | [/patch-spotbugs-hadoop-cloud-storage-project_hadoop-huaweicloud.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-cloud-storage-project_hadoop-huaweicloud.txt) | hadoop-huaweicloud in the patch failed. |
| -1 :x: | spotbugs | 0m 36s | [/patch-spotbugs-hadoop-cloud-storage-project_hadoop-tos.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-cloud-storage-project_hadoop-tos.txt) | hadoop-tos in the patch failed. |
| +0 :ok: | spotbugs | 0m 22s | | hadoop-cloud-storage-project/hadoop-cloud-storage has no data from spotbugs |
| +0 :ok: | spotbugs | 0m 23s | | hadoop-cloud-storage-project/hadoop-cloud-storage-dist has no data from spotbugs |
| -1 :x: | spotbugs | 0m 31s | [/patch-spotbugs-hadoop-cloud-storage-project.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-cloud-storage-project.txt) | hadoop-cloud-storage-project in the patch failed. |
| -1 :x: | spotbugs | 0m 30s | [/patch-spotbugs-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-root.txt) | root in the patch failed. |
| +1 :green_heart: | shadedclient | 31m 14s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| -1 :x: | unit | 801m 10s | [/patch-unit-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-unit-root.txt) | root in the patch passed. |
| -1 :x: | asflicense | 1m 45s | [/results-asflicense.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/results-asflicense.txt) | The patch generated 1 ASF License warnings. |
| | | 1072m 30s | | |
| Reason | Tests |
|-------:|:------|
| Failed junit tests | hadoop.yarn.sls.appmaster.TestAMSimulator |
| | hadoop.hdfs.tools.TestDFSAdmin |
| | hadoop.yarn.service.TestYarnNativeServices |
| | hadoop.yarn.server.router.subcluster.capacity.TestYarnFederationWithCapacityScheduler |
| | hadoop.yarn.server.router.webapp.TestRouterWebServicesREST |
| | hadoop.yarn.server.router.webapp.TestFederationWebApp |
| | hadoop.fs.tosfs.object.TestObjectOutputStream |
| | hadoop.fs.tosfs.commit.TestMagicOutputStream |
| | hadoop.fs.tosfs.object.tos.auth.TestEnvironmentCredentialsProvider |
| | hadoop.fs.tosfs.object.tos.auth.TestDefaultCredentialsProviderChain |
| | hadoop.fs.tosfs.object.TestObjectRangeInputStream |
| | hadoop.fs.tosfs.object.TestObjectMultiRangeInputStream |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
| Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xmllint spotbugs checkstyle |
| uname | Linux 209e4e5576fc 5.15.0-144-generic #157-Ubuntu SMP Mon Jun 16 07:33:10 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 0254bb430e1623793f30744d7b32a37202f2d586 |
| Default Java | Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/testReport/ |
| Max. process+thread count | 3665 (vs. ulimit of 5500) |
| modules | C: hadoop-project hadoop-assemblies hadoop-common-project/hadoop-common hadoop-tools/hadoop-tools-dist hadoop-tools/hadoop-gcp hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-tos hadoop-cloud-storage-project/hadoop-cloud-storage hadoop-cloud-storage-project/hadoop-cloud-storage-dist hadoop-cloud-storage-project . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/console |
| versions | git=2.25.1 maven=3.9.11 shellcheck=0.7.0 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303127263
* This puts the hadoop-azure, hadoop-aws &c binaries into common/lib and so on the classpath everywhere
* some problem with gcs instantiation during enum (will file later, as while it surfaces here, I think it's unrelated)
* my local builds end up (today) with some versioned jars as well as the -SNAPSHOT. I think this is from me tainting my maven repo, would like to see what others see
```
total 1401704
-rw-r--r--@ 1 stevel staff 106151 Sep 17 12:57 aliyun-java-core-0.2.11-beta.jar
-rw-r--r--@ 1 stevel staff 194215 Sep 17 12:57 aliyun-java-sdk-core-4.5.10.jar
-rw-r--r--@ 1 stevel staff 163698 Sep 17 12:57 aliyun-java-sdk-kms-2.11.0.jar
-rw-r--r--@ 1 stevel staff 220800 Sep 17 12:57 aliyun-java-sdk-ram-3.1.0.jar
-rw-r--r--@ 1 stevel staff 928456 Sep 17 12:57 aliyun-sdk-oss-3.18.1.jar
-rw-r--r--@ 1 stevel staff 2470776 Sep 17 12:57 analyticsaccelerator-s3-1.3.0.jar
-rw-r--r--@ 1 stevel staff 27006 Sep 17 13:11 aopalliance-repackaged-2.6.1.jar
-rw-r--r--@ 1 stevel staff 20891 Sep 17 13:11 audience-annotations-0.12.0.jar
-rw-r--r--@ 1 stevel staff 651391 Sep 17 13:11 avro-1.11.4.jar
-rw-r--r--@ 1 stevel staff 113966 Sep 17 12:57 azure-data-lake-store-sdk-2.3.9.jar
-rw-r--r--@ 1 stevel staff 10288 Sep 17 12:57 azure-keyvault-core-1.0.0.jar
-rw-r--r--@ 1 stevel staff 815331 Sep 17 12:57 azure-storage-7.0.1.jar
-rw-r--r--@ 1 stevel staff 8324412 Sep 17 13:11 bcprov-jdk18on-1.78.1.jar
-rw-r--r--@ 1 stevel staff 641534749 Sep 17 12:57 bundle-2.29.52.jar
-rw-r--r--@ 1 stevel staff 223979 Sep 17 13:11 checker-qual-3.33.0.jar
-rw-r--r--@ 1 stevel staff 75479 Sep 17 13:11 commons-cli-1.9.0.jar
-rw-r--r--@ 1 stevel staff 353793 Sep 17 13:11 commons-codec-1.15.jar
-rw-r--r--@ 1 stevel staff 751914 Sep 17 13:11 commons-collections4-4.4.jar
-rw-r--r--@ 1 stevel staff 1079377 Sep 17 13:11 commons-compress-1.26.1.jar
-rw-r--r--@ 1 stevel staff 657516 Sep 17 13:11 commons-configuration2-2.10.1.jar
-rw-r--r--@ 1 stevel staff 24239 Sep 17 13:11 commons-daemon-1.0.13.jar
-rw-r--r--@ 1 stevel staff 508826 Sep 17 13:11 commons-io-2.16.1.jar
-rw-r--r--@ 1 stevel staff 673587 Sep 17 13:11 commons-lang3-3.17.0.jar
-rw-r--r--@ 1 stevel staff 70816 Sep 17 13:11 commons-logging-1.3.0.jar
-rw-r--r--@ 1 stevel staff 2213560 Sep 17 13:11 commons-math3-3.6.1.jar
-rw-r--r--@ 1 stevel staff 316431 Sep 17 13:11 commons-net-3.9.0.jar
-rw-r--r--@ 1 stevel staff 238400 Sep 17 13:11 commons-text-1.10.0.jar
-rw-r--r--@ 1 stevel staff 8661164 Sep 17 12:57 cos_api-bundle-5.6.19.jar
-rw-r--r--@ 1 stevel staff 2983237 Sep 17 13:11 curator-client-5.2.0.jar
-rw-r--r--@ 1 stevel staff 336384 Sep 17 13:11 curator-framework-5.2.0.jar
-rw-r--r--@ 1 stevel staff 315569 Sep 17 13:11 curator-recipes-5.2.0.jar
-rw-r--r--@ 1 stevel staff 583996 Sep 17 13:11 dnsjava-3.6.1.jar
-rw-r--r--@ 1 stevel staff 324655 Sep 17 12:57 dom4j-2.1.4.jar
-rw-r--r--@ 1 stevel staff 670059 Sep 17 12:57 esdk-obs-java-3.20.4.2.jar
-rw-r--r--@ 1 stevel staff 4617 Sep 17 13:11 failureaccess-1.0.1.jar
-rw-r--r--@ 1 stevel staff 249277 Sep 17 13:11 gson-2.9.0.jar
-rw-r--r--@ 1 stevel staff 3037368 Sep 17 13:11 guava-32.0.1-jre.jar
-rw-r--r--@ 1 stevel staff 94013 Sep 17 12:57 hadoop-aliyun-3.5.0-20250916.124028-685.jar
-rw-r--r--@ 1 stevel staff 14456 Sep 17 13:11 hadoop-annotations-3.5.0-SNAPSHOT.jar
-rw-r--r--@ 1 stevel staff 114335 Sep 17 13:11 hadoop-auth-3.5.0-SNAPSHOT.jar
-rw-r--r--@ 1 stevel staff 930516 Sep 17 12:57 hadoop-aws-3.5.0-20250916.124028-686.jar
-rw-r--r--@ 1 stevel staff 827349 Sep 17 12:57 hadoop-azure-3.5.0-20250916.124028-685.jar
-rw-r--r--@ 1 stevel staff 33363 Sep 17 12:57 hadoop-azure-datalake-3.5.0-20250916.124028-685.jar
-rw-r--r--@ 1 stevel staff 70007 Sep 17 12:57 hadoop-cos-3.5.0-20250916.124028-683.jar
-rw-r--r--@ 1 stevel staff 138447 Sep 17 12:57 hadoop-gcp-3.5.0-SNAPSHOT.jar
-rw-r--r--@ 1 stevel staff 142274 Sep 17 12:57 hadoop-huaweicloud-3.5.0-SNAPSHOT.jar
-rw-r--r--@ 1 stevel staff 3519516 Sep 17 13:11 hadoop-shaded-guava-1.4.0.jar
-rw-r--r--@ 1 stevel staff 1952967 Sep 17 13:11 hadoop-shaded-protobuf_3_25-1.4.0.jar
-rw-r--r--@ 1 stevel staff 4019589 Sep 17 12:57 hadoop-tos-3.5.0-20250916.124028-202.jar
-rw-r--r--@ 1 stevel staff 200223 Sep 17 13:11 hk2-api-2.6.1.jar
-rw-r--r--@ 1 stevel staff 203358 Sep 17 13:11 hk2-locator-2.6.1.jar
-rw-r--r--@ 1 stevel staff 131590 Sep 17 13:11 hk2-utils-2.6.1.jar
-rw-r--r--@ 1 stevel staff 780321 Sep 17 13:11 httpclient-4.5.13.jar
-rw-r--r--@ 1 stevel staff 328593 Sep 17 13:11 httpcore-4.4.13.jar
-rw-r--r--@ 1 stevel staff 102220 Sep 17 12:57 ini4j-0.5.4.jar
-rw-r--r--@ 1 stevel staff 29807 Sep 17 13:11 istack-commons-runtime-3.0.12.jar
-rw-r--r--@ 1 stevel staff 9301 Sep 17 13:11 j2objc-annotations-2.8.jar
-rw-r--r--@ 1 stevel staff 76636 Sep 17 13:11 jackson-annotations-2.14.3.jar
-rw-r--r--@ 1 stevel staff 473081 Sep 17 13:11 jackson-core-2.14.3.jar
-rw-r--r--@ 1 stevel staff 1617187 Sep 17 13:11 jackson-databind-2.14.3.jar
-rw-r--r--@ 1 stevel staff 68453 Sep 17 13:11 jakarta.activation-1.2.2.jar
-rw-r--r--@ 1 stevel staff 44399 Sep 17 13:11 jakarta.activation-api-1.2.1.jar
-rw-r--r--@ 1 stevel staff 25058 Sep 17 13:11 jakarta.annotation-api-1.3.5.jar
-rw-r--r--@ 1 stevel staff 18140 Sep 17 13:11 jakarta.inject-2.6.1.jar
-rw-r--r--@ 1 stevel staff 82973 Sep 17 13:11 jakarta.servlet-api-4.0.4.jar
-rw-r--r--@ 1 stevel staff 53683 Sep 17 13:11 jakarta.servlet.jsp-api-2.3.6.jar
-rw-r--r--@ 1 stevel staff 91930 Sep 17 13:11 jakarta.validation-api-2.0.2.jar
-rw-r--r--@ 1 stevel staff 140376 Sep 17 13:11 jakarta.ws.rs-api-2.1.6.jar
-rw-r--r--@ 1 stevel staff 115638 Sep 17 13:11 jakarta.xml.bind-api-2.3.3.jar
-rw-r--r--@ 1 stevel staff 7771 Sep 17 12:57 java-trace-api-0.2.11-beta.jar
-rw-r--r--@ 1 stevel staff 18432 Sep 17 12:57 java-xmlbuilder-1.2.jar
-rw-r--r--@ 1 stevel staff 794714 Sep 17 13:11 javassist-3.30.2-GA.jar
-rw-r--r--@ 1 stevel staff 95806 Sep 17 13:11 javax.servlet-api-3.1.0.jar
-rw-r--r--@ 1 stevel staff 1019097 Sep 17 13:11 jaxb-runtime-2.3.9.jar
-rw-r--r--@ 1 stevel staff 4722 Sep 17 13:11 jcip-annotations-1.0-1.jar
-rw-r--r--@ 1 stevel staff 327806 Sep 17 12:57 jdom2-2.0.6.1.jar
-rw-r--r--@ 1 stevel staff 311826 Sep 17 13:11 jersey-client-2.46.jar
-rw-r--r--@ 1 stevel staff 1267957 Sep 17 13:11 jersey-common-2.46.jar
-rw-r--r--@ 1 stevel staff 32929 Sep 17 13:11 jersey-container-servlet-2.46.jar
-rw-r--r--@ 1 stevel staff 75742 Sep 17 13:11 jersey-container-servlet-core-2.46.jar
-rw-r--r--@ 1 stevel staff 80272 Sep 17 13:11 jersey-hk2-2.46.jar
-rw-r--r--@ 1 stevel staff 964550 Sep 17 13:11 jersey-server-2.46.jar
-rw-r--r--@ 1 stevel staff 90184 Sep 17 12:57 jettison-1.5.4.jar
-rw-r--r--@ 1 stevel staff 249911 Sep 17 13:11 jetty-http-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 183011 Sep 17 13:11 jetty-io-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 118496 Sep 17 13:11 jetty-security-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 739348 Sep 17 13:11 jetty-server-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 146064 Sep 17 13:11 jetty-servlet-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 588962 Sep 17 13:11 jetty-util-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 66643 Sep 17 13:11 jetty-util-ajax-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 140308 Sep 17 13:11 jetty-webapp-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 68894 Sep 17 13:11 jetty-xml-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 282591 Sep 17 13:11 jsch-0.1.55.jar
-rw-r--r--@ 1 stevel staff 19936 Sep 17 13:11 jsr305-3.0.2.jar
-rw-r--r--@ 1 stevel staff 4519 Sep 17 13:11 jul-to-slf4j-1.7.36.jar
-rw-r--r--@ 1 stevel staff 223129 Sep 17 13:11 kerb-core-2.0.3.jar
-rw-r--r--@ 1 stevel staff 115065 Sep 17 13:11 kerb-crypto-2.0.3.jar
-rw-r--r--@ 1 stevel staff 36361 Sep 17 13:11 kerb-util-2.0.3.jar
-rw-r--r--@ 1 stevel staff 100095 Sep 17 13:11 kerby-asn1-2.0.3.jar
-rw-r--r--@ 1 stevel staff 30190 Sep 17 13:11 kerby-config-2.0.3.jar
-rw-r--r--@ 1 stevel staff 200581 Sep 17 13:11 kerby-pkix-2.0.3.jar
-rw-r--r--@ 1 stevel staff 40787 Sep 17 13:11 kerby-util-2.0.3.jar
-rw-r--r--@ 1 stevel staff 2199 Sep 17 13:11 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
-rw-r--r--@ 1 stevel staff 136314 Sep 17 13:11 metrics-core-3.2.4.jar
-rw-r--r--@ 1 stevel staff 4554 Sep 17 13:11 netty-all-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 339045 Sep 17 13:11 netty-buffer-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 355199 Sep 17 13:11 netty-codec-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 67192 Sep 17 13:11 netty-codec-dns-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 37789 Sep 17 13:11 netty-codec-haproxy-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 674362 Sep 17 13:11 netty-codec-http-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 490985 Sep 17 13:11 netty-codec-http2-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 44736 Sep 17 13:11 netty-codec-memcache-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 113699 Sep 17 13:11 netty-codec-mqtt-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 46015 Sep 17 13:11 netty-codec-redis-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 21344 Sep 17 13:11 netty-codec-smtp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 121032 Sep 17 13:11 netty-codec-socks-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 34636 Sep 17 13:11 netty-codec-stomp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 19823 Sep 17 13:11 netty-codec-xml-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 719225 Sep 17 13:11 netty-common-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 580162 Sep 17 13:11 netty-handler-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 25650 Sep 17 13:11 netty-handler-proxy-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 26833 Sep 17 13:11 netty-handler-ssl-ocsp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 37842 Sep 17 13:11 netty-resolver-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 188360 Sep 17 13:11 netty-resolver-dns-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 9145 Sep 17 13:11 netty-resolver-dns-classes-macos-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 19825 Sep 17 13:11 netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar
-rw-r--r--@ 1 stevel staff 19629 Sep 17 13:11 netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar
-rw-r--r--@ 1 stevel staff 521428 Sep 17 13:11 netty-transport-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 147621 Sep 17 13:11 netty-transport-classes-epoll-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 108558 Sep 17 13:11 netty-transport-classes-kqueue-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 42321 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar
-rw-r--r--@ 1 stevel staff 36594 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar
-rw-r--r--@ 1 stevel staff 40644 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar
-rw-r--r--@ 1 stevel staff 6193 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 25741 Sep 17 13:11 netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar
-rw-r--r--@ 1 stevel staff 25170 Sep 17 13:11 netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar
-rw-r--r--@ 1 stevel staff 44157 Sep 17 13:11 netty-transport-native-unix-common-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 18241 Sep 17 13:11 netty-transport-rxtx-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 50814 Sep 17 13:11 netty-transport-sctp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 32189 Sep 17 13:11 netty-transport-udt-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 779369 Sep 17 13:11 nimbus-jose-jwt-9.37.2.jar
-rw-r--r--@ 1 stevel staff 425763 Sep 17 12:57 okhttp-3.14.2.jar
-rw-r--r--@ 1 stevel staff 91980 Sep 17 12:57 okio-1.17.2.jar
-rw-r--r--@ 1 stevel staff 141734 Sep 17 12:57 opentelemetry-api-1.38.0.jar
-rw-r--r--@ 1 stevel staff 47252 Sep 17 12:57 opentelemetry-context-1.38.0.jar
-rw-r--r--@ 1 stevel staff 18189 Sep 17 12:57 opentracing-api-0.33.0.jar
-rw-r--r--@ 1 stevel staff 10542 Sep 17 12:57 opentracing-noop-0.33.0.jar
-rw-r--r--@ 1 stevel staff 7504 Sep 17 12:57 opentracing-util-0.33.0.jar
-rw-r--r--@ 1 stevel staff 281989 Sep 17 12:57 org.jacoco.agent-0.8.5-runtime.jar
-rw-r--r--@ 1 stevel staff 19479 Sep 17 13:11 osgi-resource-locator-1.0.3.jar
-rw-r--r--@ 1 stevel staff 128414 Sep 17 13:11 re2j-1.1.jar
-rw-r--r--@ 1 stevel staff 11369 Sep 17 12:57 reactive-streams-1.0.3.jar
-rw-r--r--@ 1 stevel staff 332398 Sep 17 13:11 reload4j-1.2.22.jar
-rw-r--r--@ 1 stevel staff 41125 Sep 17 13:11 slf4j-api-1.7.36.jar
-rw-r--r--@ 1 stevel staff 9824 Sep 17 13:11 slf4j-reload4j-1.7.36.jar
-rw-r--r--@ 1 stevel staff 2112099 Sep 17 13:11 snappy-java-1.1.10.4.jar
-rw-r--r--@ 1 stevel staff 195909 Sep 17 13:11 stax2-api-4.2.1.jar
-rw-r--r--@ 1 stevel staff 72007 Sep 17 13:11 txw2-2.3.9.jar
-rw-r--r--@ 1 stevel staff 443788 Sep 17 12:57 wildfly-openssl-2.1.4.Final.jar
-rw-r--r--@ 1 stevel staff 522679 Sep 17 13:11 woodstox-core-5.4.0.jar
-rw-r--r--@ 1 stevel staff 1323991 Sep 17 13:11 zookeeper-3.8.4.jar
-rw-r--r--@ 1 stevel staff 254932 Sep 17 13:11 zookeeper-jute-3.8.4.jar
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3312222391
did you do a `mvn clean package`?
`hadoop-cloud-storage-project/hadoop-cloud-storage/target/hadoop-cloud-storage-3.5.0-SNAPSHOT/share/hadoop/common/lib` -new, contains all cloud stuff we want in; should cut stuff already going to be there just to reduce copying
`hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/share/hadoop/tools/lib`
should remove hadoop-azure, hadoop-aws, hadoop-gcs, bundle.jar...
the big distro created under `hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/` is what is shipped.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3387174385
Latest build generates stack traces from gcs and obs filesystem incomplete CP in service loader. Both need to move to core-default.xml *only* which is faster anyway.
```
2025-10-09 20:06:44,452 [main] WARN fs.FileSystem (FileSystem.java:loadFileSystems(3539)) - Cannot load filesystem
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.gs.GoogleHadoopFileSystem could not be instantiated
at java.util.ServiceLoader.fail(ServiceLoader.java:232)
at java.util.ServiceLoader.access$100(ServiceLoader.java:185)
at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:3525)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3562)
at org.apache.hadoop.fs.store.diag.StoreDiag.probeForFileSystemClass(StoreDiag.java:671)
at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:223)
at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:170)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:97)
at org.apache.hadoop.fs.store.diag.StoreDiag.exec(StoreDiag.java:1255)
at org.apache.hadoop.fs.store.diag.StoreDiag.main(StoreDiag.java:1264)
at storediag.main(storediag.java:25)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:333)
at org.apache.hadoop.util.RunJar.main(RunJar.java:254)
Caused by: java.lang.NoClassDefFoundError: com/google/auth/Credentials
at java.lang.Class.getDeclaredConstructors0(Native Method)
at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)
at java.lang.Class.getConstructor0(Class.java:3075)
at java.lang.Class.newInstance(Class.java:412)
at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:380)
... 18 more
Caused by: java.lang.ClassNotFoundException: com.google.auth.Credentials
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
... 23 more
2025-10-09 20:06:44,456 [main] WARN fs.FileSystem (FileSystem.java:loadFileSystems(3539)) - Cannot load filesystem
java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.obs.OBSFileSystem could not be instantiated
at java.util.ServiceLoader.fail(ServiceLoader.java:232)
at java.util.ServiceLoader.access$100(ServiceLoader.java:185)
at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:3525)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3562)
at org.apache.hadoop.fs.store.diag.StoreDiag.probeForFileSystemClass(StoreDiag.java:671)
at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:223)
at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:170)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:97)
at org.apache.hadoop.fs.store.diag.StoreDiag.exec(StoreDiag.java:1255)
at org.apache.hadoop.fs.store.diag.StoreDiag.main(StoreDiag.java:1264)
at storediag.main(storediag.java:25)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:333)
at org.apache.hadoop.util.RunJar.main(RunJar.java:254)
Caused by: java.lang.NoClassDefFoundError: com/obs/services/exception/ObsException
at java.lang.Class.getDeclaredConstructors0(Native Method)
at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)
at java.lang.Class.getConstructor0(Class.java:3075)
at java.lang.Class.newInstance(Class.java:412)
at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:380)
... 18 more
Caused by: java.lang.ClassNotFoundException: com.obs.services.exception.ObsException
at java.net.URLClassLoader.findClass(URLClassLoader.java:387)
at java.lang.ClassLoader.loadClass(ClassLoader.java:419)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)
at java.lang.ClassLoader.loadClass(ClassLoader.java:352)
... 23 more
FileSystem for s3a:// is: org.apache.hadoop.fs.s3a.S3AFileSystem
Loaded from: file:/Users/stevel/Projects/Releases/hadoop-3.5.0-SNAPSHOT/share/hadoop/common/lib/hadoop-aws-3.5.0-SNAPSHOT.jar via sun.misc.Launcher$AppClassLoader@41906a77
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3387715974
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 1m 9s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | shelldocs | 0m 0s | | Shelldocs was not available. |
| +0 :ok: | xmllint | 0m 1s | | xmllint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| -1 :x: | test4tests | 0m 0s | | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 9m 3s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 38m 50s | | trunk passed |
| +1 :green_heart: | compile | 16m 3s | | trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | compile | 14m 6s | | trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | mvnsite | 21m 2s | | trunk passed |
| +1 :green_heart: | javadoc | 9m 0s | | trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javadoc | 7m 29s | | trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | shadedclient | 49m 55s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 40s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 41m 14s | | the patch passed |
| +1 :green_heart: | compile | 15m 33s | | the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 |
| +1 :green_heart: | javac | 15m 33s | | the patch passed |
| +1 :green_heart: | compile | 13m 29s | | the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| +1 :green_heart: | javac | 13m 29s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | mvnsite | 18m 48s | | the patch passed |
| +1 :green_heart: | shellcheck | 0m 0s | | No new issues. |
| -1 :x: | javadoc | 9m 58s | [/results-javadoc-javadoc-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/artifact/out/results-javadoc-javadoc-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt) | root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 generated 10 new + 5526 unchanged - 10 fixed = 5536 total (was 5536) |
| -1 :x: | javadoc | 8m 2s | [/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/artifact/out/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt) | root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 generated 10 new + 1418 unchanged - 10 fixed = 1428 total (was 1428) |
| +1 :green_heart: | shadedclient | 63m 31s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| -1 :x: | unit | 2m 22s | [/patch-unit-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/artifact/out/patch-unit-root.txt) | root in the patch failed. |
| +0 :ok: | asflicense | 0m 32s | | ASF License check generated no output? |
| | | 309m 40s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
| Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xmllint |
| uname | Linux 01b725e22dc7 5.15.0-156-generic #166-Ubuntu SMP Sat Aug 9 00:02:46 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 76b4eae78d738ee73cf68118a87c9204d120d752 |
| Default Java | Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/testReport/ |
| Max. process+thread count | 699 (vs. ulimit of 5500) |
| modules | C: hadoop-project hadoop-assemblies hadoop-tools/hadoop-tools-dist hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-tos hadoop-cloud-storage-project/hadoop-cloud-storage hadoop-cloud-storage-project/hadoop-cloud-storage-dist hadoop-cloud-storage-project . U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/console |
| versions | git=2.25.1 maven=3.9.11 shellcheck=0.7.0 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303139199
by contrast: 3.4.2
```
total 98048
-rw-r--r--@ 1 stevel staff 3448 Aug 7 12:16 animal-sniffer-annotations-1.17.jar
-rw-r--r--@ 1 stevel staff 20891 Aug 7 12:16 audience-annotations-0.12.0.jar
-rw-r--r--@ 1 stevel staff 651391 Aug 7 12:16 avro-1.11.4.jar
-rw-r--r--@ 1 stevel staff 8324412 Aug 7 12:15 bcprov-jdk18on-1.78.1.jar
-rw-r--r--@ 1 stevel staff 193322 Aug 7 12:16 checker-qual-2.5.2.jar
-rw-r--r--@ 1 stevel staff 75479 Aug 7 12:16 commons-cli-1.9.0.jar
-rw-r--r--@ 1 stevel staff 353793 Aug 7 12:16 commons-codec-1.15.jar
-rw-r--r--@ 1 stevel staff 751914 Aug 7 12:16 commons-collections4-4.4.jar
-rw-r--r--@ 1 stevel staff 1079377 Aug 7 12:16 commons-compress-1.26.1.jar
-rw-r--r--@ 1 stevel staff 657516 Aug 7 12:16 commons-configuration2-2.10.1.jar
-rw-r--r--@ 1 stevel staff 24239 Aug 7 12:16 commons-daemon-1.0.13.jar
-rw-r--r--@ 1 stevel staff 508826 Aug 7 12:16 commons-io-2.16.1.jar
-rw-r--r--@ 1 stevel staff 673587 Aug 7 12:16 commons-lang3-3.17.0.jar
-rw-r--r--@ 1 stevel staff 70816 Aug 7 12:16 commons-logging-1.3.0.jar
-rw-r--r--@ 1 stevel staff 2213560 Aug 7 12:16 commons-math3-3.6.1.jar
-rw-r--r--@ 1 stevel staff 316431 Aug 7 12:16 commons-net-3.9.0.jar
-rw-r--r--@ 1 stevel staff 238400 Aug 7 12:16 commons-text-1.10.0.jar
-rw-r--r--@ 1 stevel staff 2983237 Aug 7 12:16 curator-client-5.2.0.jar
-rw-r--r--@ 1 stevel staff 336384 Aug 7 12:16 curator-framework-5.2.0.jar
-rw-r--r--@ 1 stevel staff 315569 Aug 7 12:16 curator-recipes-5.2.0.jar
-rw-r--r--@ 1 stevel staff 583996 Aug 7 12:16 dnsjava-3.6.1.jar
-rw-r--r--@ 1 stevel staff 3727 Aug 7 12:16 failureaccess-1.0.jar
-rw-r--r--@ 1 stevel staff 249277 Aug 7 12:16 gson-2.9.0.jar
-rw-r--r--@ 1 stevel staff 2747878 Aug 7 12:16 guava-27.0-jre.jar
-rw-r--r--@ 1 stevel staff 25517 Aug 7 12:16 hadoop-annotations-3.4.2.jar
-rw-r--r--@ 1 stevel staff 110106 Aug 7 12:16 hadoop-auth-3.4.2.jar
-rw-r--r--@ 1 stevel staff 810477 Aug 7 12:39 hadoop-azure-3.4.2.jar
-rw-r--r--@ 1 stevel staff 3519516 Aug 7 12:16 hadoop-shaded-guava-1.4.0.jar
-rw-r--r--@ 1 stevel staff 1952967 Aug 7 12:16 hadoop-shaded-protobuf_3_25-1.4.0.jar
-rw-r--r--@ 1 stevel staff 780321 Aug 7 12:16 httpclient-4.5.13.jar
-rw-r--r--@ 1 stevel staff 328593 Aug 7 12:16 httpcore-4.4.13.jar
-rw-r--r--@ 1 stevel staff 8782 Aug 7 12:16 j2objc-annotations-1.1.jar
-rw-r--r--@ 1 stevel staff 75705 Aug 7 12:16 jackson-annotations-2.12.7.jar
-rw-r--r--@ 1 stevel staff 365538 Aug 7 12:16 jackson-core-2.12.7.jar
-rw-r--r--@ 1 stevel staff 1512418 Aug 7 12:16 jackson-databind-2.12.7.1.jar
-rw-r--r--@ 1 stevel staff 44399 Aug 7 12:16 jakarta.activation-api-1.2.1.jar
-rw-r--r--@ 1 stevel staff 95806 Aug 7 12:16 javax.servlet-api-3.1.0.jar
-rw-r--r--@ 1 stevel staff 102244 Aug 7 12:16 jaxb-api-2.2.11.jar
-rw-r--r--@ 1 stevel staff 890168 Aug 7 12:16 jaxb-impl-2.2.3-1.jar
-rw-r--r--@ 1 stevel staff 4722 Aug 7 12:16 jcip-annotations-1.0-1.jar
-rw-r--r--@ 1 stevel staff 436731 Aug 7 12:16 jersey-core-1.19.4.jar
-rw-r--r--@ 1 stevel staff 158890 Aug 7 12:16 jersey-json-1.22.0.jar
-rw-r--r--@ 1 stevel staff 705276 Aug 7 12:16 jersey-server-1.19.4.jar
-rw-r--r--@ 1 stevel staff 128990 Aug 7 12:16 jersey-servlet-1.19.4.jar
-rw-r--r--@ 1 stevel staff 90184 Aug 7 12:16 jettison-1.5.4.jar
-rw-r--r--@ 1 stevel staff 249911 Aug 7 12:16 jetty-http-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 183011 Aug 7 12:16 jetty-io-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 118496 Aug 7 12:16 jetty-security-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 739348 Aug 7 12:16 jetty-server-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 146064 Aug 7 12:16 jetty-servlet-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 588962 Aug 7 12:16 jetty-util-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 66643 Aug 7 12:16 jetty-util-ajax-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 140308 Aug 7 12:16 jetty-webapp-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 68894 Aug 7 12:16 jetty-xml-9.4.57.v20241219.jar
-rw-r--r--@ 1 stevel staff 282591 Aug 7 12:16 jsch-0.1.55.jar
-rw-r--r--@ 1 stevel staff 100636 Aug 7 12:15 jsp-api-2.1.jar
-rw-r--r--@ 1 stevel staff 19936 Aug 7 12:16 jsr305-3.0.2.jar
-rw-r--r--@ 1 stevel staff 46367 Aug 7 12:16 jsr311-api-1.1.1.jar
-rw-r--r--@ 1 stevel staff 4519 Aug 7 12:16 jul-to-slf4j-1.7.36.jar
-rw-r--r--@ 1 stevel staff 223129 Aug 7 12:16 kerb-core-2.0.3.jar
-rw-r--r--@ 1 stevel staff 115065 Aug 7 12:16 kerb-crypto-2.0.3.jar
-rw-r--r--@ 1 stevel staff 36361 Aug 7 12:16 kerb-util-2.0.3.jar
-rw-r--r--@ 1 stevel staff 100095 Aug 7 12:16 kerby-asn1-2.0.3.jar
-rw-r--r--@ 1 stevel staff 30190 Aug 7 12:16 kerby-config-2.0.3.jar
-rw-r--r--@ 1 stevel staff 200581 Aug 7 12:16 kerby-pkix-2.0.3.jar
-rw-r--r--@ 1 stevel staff 40787 Aug 7 12:16 kerby-util-2.0.3.jar
-rw-r--r--@ 1 stevel staff 2199 Aug 7 12:16 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
-rw-r--r--@ 1 stevel staff 136314 Aug 7 12:16 metrics-core-3.2.4.jar
-rw-r--r--@ 1 stevel staff 4554 Aug 7 12:15 netty-all-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 339045 Aug 7 12:16 netty-buffer-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 355199 Aug 7 12:16 netty-codec-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 67192 Aug 7 12:15 netty-codec-dns-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 37789 Aug 7 12:15 netty-codec-haproxy-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 674362 Aug 7 12:15 netty-codec-http-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 490985 Aug 7 12:15 netty-codec-http2-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 44736 Aug 7 12:15 netty-codec-memcache-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 113699 Aug 7 12:15 netty-codec-mqtt-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 46015 Aug 7 12:15 netty-codec-redis-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 21344 Aug 7 12:15 netty-codec-smtp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 121032 Aug 7 12:15 netty-codec-socks-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 34636 Aug 7 12:15 netty-codec-stomp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 19823 Aug 7 12:15 netty-codec-xml-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 719225 Aug 7 12:16 netty-common-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 580162 Aug 7 12:16 netty-handler-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 25650 Aug 7 12:15 netty-handler-proxy-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 26833 Aug 7 12:15 netty-handler-ssl-ocsp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 37842 Aug 7 12:16 netty-resolver-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 188360 Aug 7 12:15 netty-resolver-dns-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 9145 Aug 7 12:15 netty-resolver-dns-classes-macos-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 19825 Aug 7 12:15 netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar
-rw-r--r--@ 1 stevel staff 19629 Aug 7 12:15 netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar
-rw-r--r--@ 1 stevel staff 521428 Aug 7 12:16 netty-transport-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 147621 Aug 7 12:16 netty-transport-classes-epoll-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 108558 Aug 7 12:15 netty-transport-classes-kqueue-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 42321 Aug 7 12:15 netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar
-rw-r--r--@ 1 stevel staff 36594 Aug 7 12:15 netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar
-rw-r--r--@ 1 stevel staff 40644 Aug 7 12:15 netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar
-rw-r--r--@ 1 stevel staff 6193 Aug 7 12:16 netty-transport-native-epoll-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 25741 Aug 7 12:15 netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar
-rw-r--r--@ 1 stevel staff 25170 Aug 7 12:15 netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar
-rw-r--r--@ 1 stevel staff 44157 Aug 7 12:16 netty-transport-native-unix-common-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 18241 Aug 7 12:15 netty-transport-rxtx-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 50814 Aug 7 12:15 netty-transport-sctp-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 32189 Aug 7 12:15 netty-transport-udt-4.1.118.Final.jar
-rw-r--r--@ 1 stevel staff 779369 Aug 7 12:16 nimbus-jose-jwt-9.37.2.jar
-rw-r--r--@ 1 stevel staff 128414 Aug 7 12:16 re2j-1.1.jar
-rw-r--r--@ 1 stevel staff 332398 Aug 7 12:16 reload4j-1.2.22.jar
-rw-r--r--@ 1 stevel staff 41125 Aug 7 12:15 slf4j-api-1.7.36.jar
-rw-r--r--@ 1 stevel staff 9824 Aug 7 12:15 slf4j-reload4j-1.7.36.jar
-rw-r--r--@ 1 stevel staff 2112099 Aug 7 12:16 snappy-java-1.1.10.4.jar
-rw-r--r--@ 1 stevel staff 195909 Aug 7 12:16 stax2-api-4.2.1.jar
-rw-r--r--@ 1 stevel staff 522679 Aug 7 12:16 woodstox-core-5.4.0.jar
-rw-r--r--@ 1 stevel staff 1323991 Aug 7 12:16 zookeeper-3.8.4.jar
-rw-r--r--@ 1 stevel staff 254932 Aug 7 12:16 zookeeper-jute-3.8.4.jar
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "cnauroth (via GitHub)" <gi...@apache.org>.
cnauroth commented on code in PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#discussion_r2446383325
##########
hadoop-cloud-storage-project/pom.xml:
##########
@@ -34,6 +34,7 @@
<module>hadoop-cos</module>
<module>hadoop-huaweicloud</module>
<module>hadoop-tos</module>
+ <module>hadoop-cloud-storage-dist</module>
Review Comment:
It seems like we would never need to enter execution of `hadoop-cloud-storage-dist` unless we are building a distro (activating `-Pdist`). Should we also wrap inclusion of the sub-module here behind activation of the `dist` profile?
##########
BUILDING.txt:
##########
@@ -388,6 +388,58 @@ Create a local staging version of the website (in /tmp/hadoop-site)
Note that the site needs to be built in a second pass after other artifacts.
+----------------------------------------------------------------------------------
+Including Cloud Connector Dependencies in Distributions:
+
+Hadoop distributions include the hadoop modules need to work with data and services
Review Comment:
Nitpick: "modules needed".
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3425948823
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 0m 0s | | Docker mode activated. |
| -1 :x: | patch | 0m 16s | | https://github.com/apache/hadoop/pull/7980 does not apply to trunk. Rebase required? Wrong Branch? See https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute for help. |
| Subsystem | Report/Notes |
|----------:|:-------------|
| GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/10/console |
| versions | git=2.34.1 |
| Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "cnauroth (via GitHub)" <gi...@apache.org>.
cnauroth commented on code in PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#discussion_r2449857037
##########
BUILDING.txt:
##########
@@ -388,6 +388,57 @@ Create a local staging version of the website (in /tmp/hadoop-site)
Note that the site needs to be built in a second pass after other artifacts.
+----------------------------------------------------------------------------------
+Including Cloud Connector Dependencies in Distributions:
+
+Hadoop distributions include the hadoop modules needed to work with data and services
+on cloud infrastructure
+
+However, dependencies are omitted for all cloud connectors except hadoop-azure
+(abfs:// and wasb://) and possibly hadoop-gcp (gs://) and hadoop-tos (tos://).
+For the latter two modules, it depends on shading options.
+
+For hadoop-aws the AWS SDK bundle.jar is omitted, but everything else is included.
+
+Excluding the extra binaries:
+* Keeps release artifact size below the limit of the ASF distribution network.
+* Reduces download and size overhead in docker usage.
+* Reduces the CVE attack surface and audit-related complaints about those same ScVES.
Review Comment:
Nitpick: "CVEs."
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3516563186
@cnauroth do you see anything else which needs to go in here? I think I'm done at least as a merge to trunk goes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on code in PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#discussion_r2447670994
##########
hadoop-cloud-storage-project/pom.xml:
##########
@@ -34,6 +34,7 @@
<module>hadoop-cos</module>
<module>hadoop-huaweicloud</module>
<module>hadoop-tos</module>
+ <module>hadoop-cloud-storage-dist</module>
Review Comment:
valid point. Will do, as it'll save on disk space as well as time.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]
Posted by "ahmarsuhail (via GitHub)" <gi...@apache.org>.
ahmarsuhail commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3311933628
not very familiar with how the packaging stuff works, so finding this a bit difficult to review.
How are testing the packaging, I just ran `mvn package -Pdist -DskipTests -Dmaven.javadoc.skip=true -DskipShade`, but the outputs in :
`hadoop-cloud-storage-project/hadoop-cloud-storage/target/hadoop-cloud-storage-3.5.0-SNAPSHOT/share/hadoop/common/lib`,
`hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/share/hadoop/tools/lib`
`hadoop/hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/share/hadoop/common/lib`
are all the same before and after your changes, so I must be doing something wrong.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org