You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "steveloughran (via GitHub)" <gi...@apache.org> on 2025/09/17 13:51:38 UTC

[PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

steveloughran opened a new pull request, #7980:
URL: https://github.com/apache/hadoop/pull/7980

   
   
   * new assembly for hadoop cloud storage
   * hadoop-cloud-storage does the assembly on -Pdist
   * layout stitching to move into share/hadoop/common/lib
   * remove connectors from hadoop-tools-dist
   * cut old jackson version from huawaei cloud dependency -even though it was being upgraded by our own artifacts, it was a complication.
   
   
   ### How was this patch tested?
   
   Manual build, review, storediag, hadoop fs commands
   
   
   ### For code changes:
   
   - [=] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
   - [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation?
   - [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)?
   - [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3327784078

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |:----:|----------:|--------:|:--------:|:-------:|
   | +0 :ok: |  reexec  |  15m 12s |  |  Docker mode activated.  |
   |||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  |  No case conflicting files found.  |
   | +0 :ok: |  codespell  |   0m  0s |  |  codespell was not available.  |
   | +0 :ok: |  detsecrets  |   0m  0s |  |  detect-secrets was not available.  |
   | +0 :ok: |  shelldocs  |   0m  0s |  |  Shelldocs was not available.  |
   | +0 :ok: |  xmllint  |   0m  0s |  |  xmllint was not available.  |
   | +1 :green_heart: |  @author  |   0m  0s |  |  The patch does not contain any @author tags.  |
   | -1 :x: |  test4tests  |   0m  0s |  |  The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.  |
   |||| _ trunk Compile Tests _ |
   | +0 :ok: |  mvndep  |  10m 27s |  |  Maven dependency ordering for branch  |
   | +1 :green_heart: |  mvninstall  |  38m 56s |  |  trunk passed  |
   | +1 :green_heart: |  compile  |  16m  7s |  |  trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  compile  |  13m 50s |  |  trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  mvnsite  |  20m 36s |  |  trunk passed  |
   | +1 :green_heart: |  javadoc  |   9m 11s |  |  trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  javadoc  |   7m 39s |  |  trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | -1 :x: |  shadedclient  |  18m  3s |  |  branch has errors when building and testing our client artifacts.  |
   |||| _ Patch Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 35s |  |  Maven dependency ordering for patch  |
   | +1 :green_heart: |  mvninstall  |  38m 59s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  15m 25s |  |  the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  javac  |  15m 25s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  13m 56s |  |  the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  javac  |  13m 56s |  |  the patch passed  |
   | +1 :green_heart: |  blanks  |   0m  0s |  |  The patch has no blanks issues.  |
   | +1 :green_heart: |  mvnsite  |  18m 55s |  |  the patch passed  |
   | +1 :green_heart: |  shellcheck  |   0m  0s |  |  No new issues.  |
   | -1 :x: |  javadoc  |   9m  9s | [/results-javadoc-javadoc-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/artifact/out/results-javadoc-javadoc-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt) |  root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 generated 10 new + 5526 unchanged - 10 fixed = 5536 total (was 5536)  |
   | -1 :x: |  javadoc  |   7m 34s | [/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/artifact/out/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt) |  root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 generated 10 new + 1418 unchanged - 10 fixed = 1428 total (was 1428)  |
   | -1 :x: |  shadedclient  |  19m 38s |  |  patch has errors when building and testing our client artifacts.  |
   |||| _ Other Tests _ |
   | -1 :x: |  unit  | 800m  7s | [/patch-unit-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/artifact/out/patch-unit-root.txt) |  root in the patch passed.  |
   | +1 :green_heart: |  asflicense  |   1m 46s |  |  The patch does not generate ASF License warnings.  |
   |  |   | 1046m 13s |  |  |
   
   
   | Reason | Tests |
   |-------:|:------|
   | Failed junit tests | hadoop.yarn.server.router.subcluster.capacity.TestYarnFederationWithCapacityScheduler |
   |   | hadoop.mapreduce.v2.TestUberAM |
   |   | hadoop.yarn.sls.appmaster.TestAMSimulator |
   
   
   | Subsystem | Report/Notes |
   |----------:|:-------------|
   | Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/artifact/out/Dockerfile |
   | GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
   | Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xmllint |
   | uname | Linux 271d5e8aaf6a 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/bin/hadoop.sh |
   | git revision | trunk / 0aaa6ce66e8a8fc7fc04fa4e2650badf956d531a |
   | Default Java | Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
   | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
   |  Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/testReport/ |
   | Max. process+thread count | 4938 (vs. ulimit of 5500) |
   | modules | C: hadoop-assemblies hadoop-tools/hadoop-tools-dist hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-cloud-storage . U: . |
   | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/2/console |
   | versions | git=2.25.1 maven=3.9.11 shellcheck=0.7.0 |
   | Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303936232

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |:----:|----------:|--------:|:--------:|:-------:|
   | +0 :ok: |  reexec  |   0m 33s |  |  Docker mode activated.  |
   |||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  |  No case conflicting files found.  |
   | +0 :ok: |  codespell  |   0m  0s |  |  codespell was not available.  |
   | +0 :ok: |  detsecrets  |   0m  0s |  |  detect-secrets was not available.  |
   | +0 :ok: |  shelldocs  |   0m  0s |  |  Shelldocs was not available.  |
   | +0 :ok: |  xmllint  |   0m  1s |  |  xmllint was not available.  |
   | +1 :green_heart: |  @author  |   0m  0s |  |  The patch does not contain any @author tags.  |
   | -1 :x: |  test4tests  |   0m  0s |  |  The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.  |
   |||| _ trunk Compile Tests _ |
   | +0 :ok: |  mvndep  |  13m  4s |  |  Maven dependency ordering for branch  |
   | +1 :green_heart: |  mvninstall  |  43m 58s |  |  trunk passed  |
   | +1 :green_heart: |  compile  |  16m 16s |  |  trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  compile  |  13m 34s |  |  trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  mvnsite  |   2m 57s |  |  trunk passed  |
   | +1 :green_heart: |  javadoc  |   2m 53s |  |  trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  javadoc  |   2m 43s |  |  trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  shadedclient  |  40m 19s |  |  branch has no errors when building and testing our client artifacts.  |
   |||| _ Patch Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 35s |  |  Maven dependency ordering for patch  |
   | +1 :green_heart: |  mvninstall  |   1m 10s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  14m 58s |  |  the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  javac  |  14m 58s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  13m 51s |  |  the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  javac  |  13m 51s |  |  the patch passed  |
   | +1 :green_heart: |  blanks  |   0m  0s |  |  The patch has no blanks issues.  |
   | +1 :green_heart: |  mvnsite  |   2m 55s |  |  the patch passed  |
   | +1 :green_heart: |  shellcheck  |   0m  0s |  |  No new issues.  |
   | +1 :green_heart: |  javadoc  |   2m 47s |  |  the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  javadoc  |   2m 41s |  |  the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  shadedclient  |  42m 52s |  |  patch has no errors when building and testing our client artifacts.  |
   |||| _ Other Tests _ |
   | +1 :green_heart: |  unit  |   0m 39s |  |  hadoop-assemblies in the patch passed.  |
   | +1 :green_heart: |  unit  |   0m 41s |  |  hadoop-tools-dist in the patch passed.  |
   | +1 :green_heart: |  unit  |   0m 44s |  |  hadoop-huaweicloud in the patch passed.  |
   | +1 :green_heart: |  unit  |   0m 41s |  |  hadoop-cloud-storage in the patch passed.  |
   | +1 :green_heart: |  asflicense  |   1m  6s |  |  The patch does not generate ASF License warnings.  |
   |  |   | 214m 20s |  |  |
   
   
   | Subsystem | Report/Notes |
   |----------:|:-------------|
   | Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/1/artifact/out/Dockerfile |
   | GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
   | Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xmllint |
   | uname | Linux 604f3bcd050e 5.15.0-143-generic #153-Ubuntu SMP Fri Jun 13 19:10:45 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/bin/hadoop.sh |
   | git revision | trunk / c59e35149ea17b7cea37be9203a265dcbff118fe |
   | Default Java | Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
   | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
   |  Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/1/testReport/ |
   | Max. process+thread count | 548 (vs. ulimit of 5500) |
   | modules | C: hadoop-assemblies hadoop-tools/hadoop-tools-dist hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-cloud-storage U: . |
   | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/1/console |
   | versions | git=2.25.1 maven=3.6.3 shellcheck=0.7.0 |
   | Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran merged PR #7980:
URL: https://github.com/apache/hadoop/pull/7980


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3402138222

   shaded test failures
   * some in yarn which are presumably unrelated...let's see
   * lots of more skipped tests in hadoop-azure, hadoop-azuredatalake, such as `TestAbfsInputStreamStatistics` which is skipping  .... Looks like maven is back to running these tests and skipping where they don't have the credentials


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303435683

   Having audited the files coming off the cloud connectors, we have about a dozen whose licenses aren't in the binary
   
   ```
   analyticsaccelerator-s3-1.3.0.jar
   cos_api-bundle-5.6.19.jar
   dom4j-2.1.4.jar
   esdk-obs-java-3.20.4.2.jar
   java-trace-api-0.2.11-beta.jar
   java-xmlbuilder-1.2.jar
   opentracing-api-0.33.0.jar
   opentracing-noop-0.33.0.jar
   opentracing-util-0.33.0.jar
   reactive-streams-1.0.3.jar
   ve-tos-java-sdk-hadoop-2.8.9.jar
   ```
   
   the analyticsaccelerator is @ahmarsuhail 's work to add to the license, not sure about the others. 
   
   Proposed: identify which connector the unacknowledged artifacts are coming from, create homework for each team. 
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303133677

   for contrast, here's 3.4.2
   ```
   ../hadoop-3.4.2/:
   total 272
   drwxr-xr-x@ 13 stevel  staff    416 Aug  7 12:58 bin
   -rw-r--r--@  1 stevel  staff    824 Aug 27 16:58 binding.xml
   drwxr-xr-x@  3 stevel  staff     96 Aug 25 17:09 downloads
   drwxr-xr-x@  3 stevel  staff     96 Aug  7 12:16 etc
   drwxr-xr-x@  7 stevel  staff    224 Aug  7 12:58 include
   drwxr-xr-x@  3 stevel  staff     96 Aug  7 12:58 lib
   drwxr-xr-x@ 14 stevel  staff    448 Aug  7 12:58 libexec
   -rw-r--r--@  1 stevel  staff  23682 Aug  7 10:40 LICENSE-binary
   -rw-r--r--@  1 stevel  staff  15791 Aug  7 10:39 LICENSE.txt
   drwxr-xr-x@ 45 stevel  staff   1440 Aug  7 12:58 licenses-binary
   -rw-r--r--@  1 stevel  staff  45514 Aug 27 17:12 log.txt
   -rw-r--r--@  1 stevel  staff  27373 Aug  7 10:39 NOTICE-binary
   -rw-r--r--@  1 stevel  staff   1541 Aug  7 10:39 NOTICE.txt
   -rw-r--r--@  1 stevel  staff    175 Aug  7 10:39 README.txt
   drwxr-xr-x@ 29 stevel  staff    928 Aug  7 12:16 sbin
   -rw-r--r--@  1 stevel  staff    438 Aug 25 16:59 secrets.bin
   drwxr-xr-x@  4 stevel  staff    128 Aug  7 13:23 share
   -rw-r--r--@  1 stevel  staff    275 Aug 27 17:12 system.properties
   
   share/hadoop/common/lib:
   total 1401704
   -rw-r--r--@ 1 stevel  staff     106151 Sep 17 12:57 aliyun-java-core-0.2.11-beta.jar
   -rw-r--r--@ 1 stevel  staff     194215 Sep 17 12:57 aliyun-java-sdk-core-4.5.10.jar
   -rw-r--r--@ 1 stevel  staff     163698 Sep 17 12:57 aliyun-java-sdk-kms-2.11.0.jar
   -rw-r--r--@ 1 stevel  staff     220800 Sep 17 12:57 aliyun-java-sdk-ram-3.1.0.jar
   -rw-r--r--@ 1 stevel  staff     928456 Sep 17 12:57 aliyun-sdk-oss-3.18.1.jar
   -rw-r--r--@ 1 stevel  staff    2470776 Sep 17 12:57 analyticsaccelerator-s3-1.3.0.jar
   -rw-r--r--@ 1 stevel  staff      27006 Sep 17 13:11 aopalliance-repackaged-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff      20891 Sep 17 13:11 audience-annotations-0.12.0.jar
   -rw-r--r--@ 1 stevel  staff     651391 Sep 17 13:11 avro-1.11.4.jar
   -rw-r--r--@ 1 stevel  staff     113966 Sep 17 12:57 azure-data-lake-store-sdk-2.3.9.jar
   -rw-r--r--@ 1 stevel  staff      10288 Sep 17 12:57 azure-keyvault-core-1.0.0.jar
   -rw-r--r--@ 1 stevel  staff     815331 Sep 17 12:57 azure-storage-7.0.1.jar
   -rw-r--r--@ 1 stevel  staff    8324412 Sep 17 13:11 bcprov-jdk18on-1.78.1.jar
   -rw-r--r--@ 1 stevel  staff  641534749 Sep 17 12:57 bundle-2.29.52.jar
   -rw-r--r--@ 1 stevel  staff     223979 Sep 17 13:11 checker-qual-3.33.0.jar
   -rw-r--r--@ 1 stevel  staff      75479 Sep 17 13:11 commons-cli-1.9.0.jar
   -rw-r--r--@ 1 stevel  staff     353793 Sep 17 13:11 commons-codec-1.15.jar
   -rw-r--r--@ 1 stevel  staff     751914 Sep 17 13:11 commons-collections4-4.4.jar
   -rw-r--r--@ 1 stevel  staff    1079377 Sep 17 13:11 commons-compress-1.26.1.jar
   -rw-r--r--@ 1 stevel  staff     657516 Sep 17 13:11 commons-configuration2-2.10.1.jar
   -rw-r--r--@ 1 stevel  staff      24239 Sep 17 13:11 commons-daemon-1.0.13.jar
   -rw-r--r--@ 1 stevel  staff     508826 Sep 17 13:11 commons-io-2.16.1.jar
   -rw-r--r--@ 1 stevel  staff     673587 Sep 17 13:11 commons-lang3-3.17.0.jar
   -rw-r--r--@ 1 stevel  staff      70816 Sep 17 13:11 commons-logging-1.3.0.jar
   -rw-r--r--@ 1 stevel  staff    2213560 Sep 17 13:11 commons-math3-3.6.1.jar
   -rw-r--r--@ 1 stevel  staff     316431 Sep 17 13:11 commons-net-3.9.0.jar
   -rw-r--r--@ 1 stevel  staff     238400 Sep 17 13:11 commons-text-1.10.0.jar
   -rw-r--r--@ 1 stevel  staff    8661164 Sep 17 12:57 cos_api-bundle-5.6.19.jar
   -rw-r--r--@ 1 stevel  staff    2983237 Sep 17 13:11 curator-client-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff     336384 Sep 17 13:11 curator-framework-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff     315569 Sep 17 13:11 curator-recipes-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff     583996 Sep 17 13:11 dnsjava-3.6.1.jar
   -rw-r--r--@ 1 stevel  staff     324655 Sep 17 12:57 dom4j-2.1.4.jar
   -rw-r--r--@ 1 stevel  staff     670059 Sep 17 12:57 esdk-obs-java-3.20.4.2.jar
   -rw-r--r--@ 1 stevel  staff       4617 Sep 17 13:11 failureaccess-1.0.1.jar
   -rw-r--r--@ 1 stevel  staff     249277 Sep 17 13:11 gson-2.9.0.jar
   -rw-r--r--@ 1 stevel  staff    3037368 Sep 17 13:11 guava-32.0.1-jre.jar
   -rw-r--r--@ 1 stevel  staff      94013 Sep 17 12:57 hadoop-aliyun-3.5.0-20250916.124028-685.jar
   -rw-r--r--@ 1 stevel  staff      14456 Sep 17 13:11 hadoop-annotations-3.5.0-SNAPSHOT.jar
   -rw-r--r--@ 1 stevel  staff     114335 Sep 17 13:11 hadoop-auth-3.5.0-SNAPSHOT.jar
   -rw-r--r--@ 1 stevel  staff     930516 Sep 17 12:57 hadoop-aws-3.5.0-20250916.124028-686.jar
   -rw-r--r--@ 1 stevel  staff     827349 Sep 17 12:57 hadoop-azure-3.5.0-20250916.124028-685.jar
   -rw-r--r--@ 1 stevel  staff      33363 Sep 17 12:57 hadoop-azure-datalake-3.5.0-20250916.124028-685.jar
   -rw-r--r--@ 1 stevel  staff      70007 Sep 17 12:57 hadoop-cos-3.5.0-20250916.124028-683.jar
   -rw-r--r--@ 1 stevel  staff     138447 Sep 17 12:57 hadoop-gcp-3.5.0-SNAPSHOT.jar
   -rw-r--r--@ 1 stevel  staff     142274 Sep 17 12:57 hadoop-huaweicloud-3.5.0-SNAPSHOT.jar
   -rw-r--r--@ 1 stevel  staff    3519516 Sep 17 13:11 hadoop-shaded-guava-1.4.0.jar
   -rw-r--r--@ 1 stevel  staff    1952967 Sep 17 13:11 hadoop-shaded-protobuf_3_25-1.4.0.jar
   -rw-r--r--@ 1 stevel  staff    4019589 Sep 17 12:57 hadoop-tos-3.5.0-20250916.124028-202.jar
   -rw-r--r--@ 1 stevel  staff     200223 Sep 17 13:11 hk2-api-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff     203358 Sep 17 13:11 hk2-locator-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff     131590 Sep 17 13:11 hk2-utils-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff     780321 Sep 17 13:11 httpclient-4.5.13.jar
   -rw-r--r--@ 1 stevel  staff     328593 Sep 17 13:11 httpcore-4.4.13.jar
   -rw-r--r--@ 1 stevel  staff     102220 Sep 17 12:57 ini4j-0.5.4.jar
   -rw-r--r--@ 1 stevel  staff      29807 Sep 17 13:11 istack-commons-runtime-3.0.12.jar
   -rw-r--r--@ 1 stevel  staff       9301 Sep 17 13:11 j2objc-annotations-2.8.jar
   -rw-r--r--@ 1 stevel  staff      76636 Sep 17 13:11 jackson-annotations-2.14.3.jar
   -rw-r--r--@ 1 stevel  staff     473081 Sep 17 13:11 jackson-core-2.14.3.jar
   -rw-r--r--@ 1 stevel  staff    1617187 Sep 17 13:11 jackson-databind-2.14.3.jar
   -rw-r--r--@ 1 stevel  staff      68453 Sep 17 13:11 jakarta.activation-1.2.2.jar
   -rw-r--r--@ 1 stevel  staff      44399 Sep 17 13:11 jakarta.activation-api-1.2.1.jar
   -rw-r--r--@ 1 stevel  staff      25058 Sep 17 13:11 jakarta.annotation-api-1.3.5.jar
   -rw-r--r--@ 1 stevel  staff      18140 Sep 17 13:11 jakarta.inject-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff      82973 Sep 17 13:11 jakarta.servlet-api-4.0.4.jar
   -rw-r--r--@ 1 stevel  staff      53683 Sep 17 13:11 jakarta.servlet.jsp-api-2.3.6.jar
   -rw-r--r--@ 1 stevel  staff      91930 Sep 17 13:11 jakarta.validation-api-2.0.2.jar
   -rw-r--r--@ 1 stevel  staff     140376 Sep 17 13:11 jakarta.ws.rs-api-2.1.6.jar
   -rw-r--r--@ 1 stevel  staff     115638 Sep 17 13:11 jakarta.xml.bind-api-2.3.3.jar
   -rw-r--r--@ 1 stevel  staff       7771 Sep 17 12:57 java-trace-api-0.2.11-beta.jar
   -rw-r--r--@ 1 stevel  staff      18432 Sep 17 12:57 java-xmlbuilder-1.2.jar
   -rw-r--r--@ 1 stevel  staff     794714 Sep 17 13:11 javassist-3.30.2-GA.jar
   -rw-r--r--@ 1 stevel  staff      95806 Sep 17 13:11 javax.servlet-api-3.1.0.jar
   -rw-r--r--@ 1 stevel  staff    1019097 Sep 17 13:11 jaxb-runtime-2.3.9.jar
   -rw-r--r--@ 1 stevel  staff       4722 Sep 17 13:11 jcip-annotations-1.0-1.jar
   -rw-r--r--@ 1 stevel  staff     327806 Sep 17 12:57 jdom2-2.0.6.1.jar
   -rw-r--r--@ 1 stevel  staff     311826 Sep 17 13:11 jersey-client-2.46.jar
   -rw-r--r--@ 1 stevel  staff    1267957 Sep 17 13:11 jersey-common-2.46.jar
   -rw-r--r--@ 1 stevel  staff      32929 Sep 17 13:11 jersey-container-servlet-2.46.jar
   -rw-r--r--@ 1 stevel  staff      75742 Sep 17 13:11 jersey-container-servlet-core-2.46.jar
   -rw-r--r--@ 1 stevel  staff      80272 Sep 17 13:11 jersey-hk2-2.46.jar
   -rw-r--r--@ 1 stevel  staff     964550 Sep 17 13:11 jersey-server-2.46.jar
   -rw-r--r--@ 1 stevel  staff      90184 Sep 17 12:57 jettison-1.5.4.jar
   -rw-r--r--@ 1 stevel  staff     249911 Sep 17 13:11 jetty-http-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     183011 Sep 17 13:11 jetty-io-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     118496 Sep 17 13:11 jetty-security-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     739348 Sep 17 13:11 jetty-server-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     146064 Sep 17 13:11 jetty-servlet-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     588962 Sep 17 13:11 jetty-util-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff      66643 Sep 17 13:11 jetty-util-ajax-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     140308 Sep 17 13:11 jetty-webapp-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff      68894 Sep 17 13:11 jetty-xml-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     282591 Sep 17 13:11 jsch-0.1.55.jar
   -rw-r--r--@ 1 stevel  staff      19936 Sep 17 13:11 jsr305-3.0.2.jar
   -rw-r--r--@ 1 stevel  staff       4519 Sep 17 13:11 jul-to-slf4j-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff     223129 Sep 17 13:11 kerb-core-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff     115065 Sep 17 13:11 kerb-crypto-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff      36361 Sep 17 13:11 kerb-util-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff     100095 Sep 17 13:11 kerby-asn1-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff      30190 Sep 17 13:11 kerby-config-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff     200581 Sep 17 13:11 kerby-pkix-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff      40787 Sep 17 13:11 kerby-util-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff       2199 Sep 17 13:11 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
   -rw-r--r--@ 1 stevel  staff     136314 Sep 17 13:11 metrics-core-3.2.4.jar
   -rw-r--r--@ 1 stevel  staff       4554 Sep 17 13:11 netty-all-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     339045 Sep 17 13:11 netty-buffer-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     355199 Sep 17 13:11 netty-codec-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      67192 Sep 17 13:11 netty-codec-dns-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      37789 Sep 17 13:11 netty-codec-haproxy-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     674362 Sep 17 13:11 netty-codec-http-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     490985 Sep 17 13:11 netty-codec-http2-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      44736 Sep 17 13:11 netty-codec-memcache-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     113699 Sep 17 13:11 netty-codec-mqtt-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      46015 Sep 17 13:11 netty-codec-redis-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      21344 Sep 17 13:11 netty-codec-smtp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     121032 Sep 17 13:11 netty-codec-socks-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      34636 Sep 17 13:11 netty-codec-stomp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      19823 Sep 17 13:11 netty-codec-xml-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     719225 Sep 17 13:11 netty-common-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     580162 Sep 17 13:11 netty-handler-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      25650 Sep 17 13:11 netty-handler-proxy-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      26833 Sep 17 13:11 netty-handler-ssl-ocsp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      37842 Sep 17 13:11 netty-resolver-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     188360 Sep 17 13:11 netty-resolver-dns-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff       9145 Sep 17 13:11 netty-resolver-dns-classes-macos-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      19825 Sep 17 13:11 netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff      19629 Sep 17 13:11 netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar
   -rw-r--r--@ 1 stevel  staff     521428 Sep 17 13:11 netty-transport-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     147621 Sep 17 13:11 netty-transport-classes-epoll-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     108558 Sep 17 13:11 netty-transport-classes-kqueue-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      42321 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff      36594 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar
   -rw-r--r--@ 1 stevel  staff      40644 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar
   -rw-r--r--@ 1 stevel  staff       6193 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      25741 Sep 17 13:11 netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff      25170 Sep 17 13:11 netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar
   -rw-r--r--@ 1 stevel  staff      44157 Sep 17 13:11 netty-transport-native-unix-common-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      18241 Sep 17 13:11 netty-transport-rxtx-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      50814 Sep 17 13:11 netty-transport-sctp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      32189 Sep 17 13:11 netty-transport-udt-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     779369 Sep 17 13:11 nimbus-jose-jwt-9.37.2.jar
   -rw-r--r--@ 1 stevel  staff     425763 Sep 17 12:57 okhttp-3.14.2.jar
   -rw-r--r--@ 1 stevel  staff      91980 Sep 17 12:57 okio-1.17.2.jar
   -rw-r--r--@ 1 stevel  staff     141734 Sep 17 12:57 opentelemetry-api-1.38.0.jar
   -rw-r--r--@ 1 stevel  staff      47252 Sep 17 12:57 opentelemetry-context-1.38.0.jar
   -rw-r--r--@ 1 stevel  staff      18189 Sep 17 12:57 opentracing-api-0.33.0.jar
   -rw-r--r--@ 1 stevel  staff      10542 Sep 17 12:57 opentracing-noop-0.33.0.jar
   -rw-r--r--@ 1 stevel  staff       7504 Sep 17 12:57 opentracing-util-0.33.0.jar
   -rw-r--r--@ 1 stevel  staff     281989 Sep 17 12:57 org.jacoco.agent-0.8.5-runtime.jar
   -rw-r--r--@ 1 stevel  staff      19479 Sep 17 13:11 osgi-resource-locator-1.0.3.jar
   -rw-r--r--@ 1 stevel  staff     128414 Sep 17 13:11 re2j-1.1.jar
   -rw-r--r--@ 1 stevel  staff      11369 Sep 17 12:57 reactive-streams-1.0.3.jar
   -rw-r--r--@ 1 stevel  staff     332398 Sep 17 13:11 reload4j-1.2.22.jar
   -rw-r--r--@ 1 stevel  staff      41125 Sep 17 13:11 slf4j-api-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff       9824 Sep 17 13:11 slf4j-reload4j-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff    2112099 Sep 17 13:11 snappy-java-1.1.10.4.jar
   -rw-r--r--@ 1 stevel  staff     195909 Sep 17 13:11 stax2-api-4.2.1.jar
   -rw-r--r--@ 1 stevel  staff      72007 Sep 17 13:11 txw2-2.3.9.jar
   -rw-r--r--@ 1 stevel  staff     443788 Sep 17 12:57 wildfly-openssl-2.1.4.Final.jar
   -rw-r--r--@ 1 stevel  staff     522679 Sep 17 13:11 woodstox-core-5.4.0.jar
   -rw-r--r--@ 1 stevel  staff    1323991 Sep 17 13:11 zookeeper-3.8.4.jar
   -rw-r--r--@ 1 stevel  staff     254932 Sep 17 13:11 zookeeper-jute-3.8.4.jar
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3405523026

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |:----:|----------:|--------:|:--------:|:-------:|
   | +0 :ok: |  reexec  |  21m 30s |  |  Docker mode activated.  |
   |||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  |  No case conflicting files found.  |
   | +0 :ok: |  codespell  |   0m  0s |  |  codespell was not available.  |
   | +0 :ok: |  detsecrets  |   0m  0s |  |  detect-secrets was not available.  |
   | +0 :ok: |  shelldocs  |   0m  0s |  |  Shelldocs was not available.  |
   | +0 :ok: |  xmllint  |   0m  0s |  |  xmllint was not available.  |
   | +1 :green_heart: |  @author  |   0m  0s |  |  The patch does not contain any @author tags.  |
   | +1 :green_heart: |  test4tests  |   0m  0s |  |  The patch appears to include 1 new or modified test files.  |
   |||| _ trunk Compile Tests _ |
   | +0 :ok: |  mvndep  |   9m 15s |  |  Maven dependency ordering for branch  |
   | +1 :green_heart: |  mvninstall  |  35m 25s |  |  trunk passed  |
   | +1 :green_heart: |  compile  |  17m 37s |  |  trunk passed  |
   | +1 :green_heart: |  checkstyle  |   3m 40s |  |  trunk passed  |
   | -1 :x: |  mvnsite  |  11m  2s | [/branch-mvnsite-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-mvnsite-root.txt) |  root in trunk failed.  |
   | +1 :green_heart: |  javadoc  |   9m 44s |  |  trunk passed  |
   | +0 :ok: |  spotbugs  |   0m 27s |  |  branch/hadoop-project no spotbugs output file (spotbugsXml.xml)  |
   | +0 :ok: |  spotbugs  |   0m 22s |  |  branch/hadoop-assemblies no spotbugs output file (spotbugsXml.xml)  |
   | -1 :x: |  spotbugs  |   1m 19s | [/branch-spotbugs-hadoop-common-project_hadoop-common.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-common-project_hadoop-common.txt) |  hadoop-common in trunk failed.  |
   | -1 :x: |  spotbugs  |   0m 32s | [/branch-spotbugs-hadoop-tools_hadoop-gcp.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-tools_hadoop-gcp.txt) |  hadoop-gcp in trunk failed.  |
   | +0 :ok: |  spotbugs  |   0m 23s |  |  branch/hadoop-tools/hadoop-tools-dist no spotbugs output file (spotbugsXml.xml)  |
   | -1 :x: |  spotbugs  |   0m 32s | [/branch-spotbugs-hadoop-cloud-storage-project_hadoop-huaweicloud.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-cloud-storage-project_hadoop-huaweicloud.txt) |  hadoop-huaweicloud in trunk failed.  |
   | -1 :x: |  spotbugs  |   0m 37s | [/branch-spotbugs-hadoop-cloud-storage-project_hadoop-tos.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-cloud-storage-project_hadoop-tos.txt) |  hadoop-tos in trunk failed.  |
   | +0 :ok: |  spotbugs  |   0m 23s |  |  branch/hadoop-cloud-storage-project/hadoop-cloud-storage no spotbugs output file (spotbugsXml.xml)  |
   | -1 :x: |  spotbugs  |   0m 31s | [/branch-spotbugs-hadoop-cloud-storage-project.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-hadoop-cloud-storage-project.txt) |  hadoop-cloud-storage-project in trunk failed.  |
   | -1 :x: |  spotbugs  |   0m 30s | [/branch-spotbugs-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/branch-spotbugs-root.txt) |  root in trunk failed.  |
   | +1 :green_heart: |  shadedclient  |  30m 50s |  |  branch has no errors when building and testing our client artifacts.  |
   |||| _ Patch Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 34s |  |  Maven dependency ordering for patch  |
   | +1 :green_heart: |  mvninstall  |  43m 52s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  17m  5s |  |  the patch passed  |
   | +1 :green_heart: |  javac  |  17m  5s |  |  the patch passed  |
   | +1 :green_heart: |  blanks  |   0m  1s |  |  The patch has no blanks issues.  |
   | +1 :green_heart: |  checkstyle  |   3m 39s |  |  the patch passed  |
   | -1 :x: |  mvnsite  |   7m 36s | [/patch-mvnsite-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-mvnsite-root.txt) |  root in the patch failed.  |
   | +1 :green_heart: |  shellcheck  |   0m  0s |  |  No new issues.  |
   | -1 :x: |  javadoc  |   9m 41s | [/results-javadoc-javadoc-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/results-javadoc-javadoc-root.txt) |  root generated 30 new + 42985 unchanged - 30 fixed = 43015 total (was 43015)  |
   | +0 :ok: |  spotbugs  |   0m 22s |  |  hadoop-project has no data from spotbugs  |
   | +0 :ok: |  spotbugs  |   0m 22s |  |  hadoop-assemblies has no data from spotbugs  |
   | -1 :x: |  spotbugs  |   1m 19s | [/patch-spotbugs-hadoop-common-project_hadoop-common.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-common-project_hadoop-common.txt) |  hadoop-common in the patch failed.  |
   | +0 :ok: |  spotbugs  |   0m 24s |  |  hadoop-tools/hadoop-tools-dist has no data from spotbugs  |
   | -1 :x: |  spotbugs  |   0m 33s | [/patch-spotbugs-hadoop-tools_hadoop-gcp.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-tools_hadoop-gcp.txt) |  hadoop-gcp in the patch failed.  |
   | -1 :x: |  spotbugs  |   0m 32s | [/patch-spotbugs-hadoop-cloud-storage-project_hadoop-huaweicloud.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-cloud-storage-project_hadoop-huaweicloud.txt) |  hadoop-huaweicloud in the patch failed.  |
   | -1 :x: |  spotbugs  |   0m 36s | [/patch-spotbugs-hadoop-cloud-storage-project_hadoop-tos.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-cloud-storage-project_hadoop-tos.txt) |  hadoop-tos in the patch failed.  |
   | +0 :ok: |  spotbugs  |   0m 22s |  |  hadoop-cloud-storage-project/hadoop-cloud-storage has no data from spotbugs  |
   | +0 :ok: |  spotbugs  |   0m 23s |  |  hadoop-cloud-storage-project/hadoop-cloud-storage-dist has no data from spotbugs  |
   | -1 :x: |  spotbugs  |   0m 31s | [/patch-spotbugs-hadoop-cloud-storage-project.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-hadoop-cloud-storage-project.txt) |  hadoop-cloud-storage-project in the patch failed.  |
   | -1 :x: |  spotbugs  |   0m 30s | [/patch-spotbugs-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-spotbugs-root.txt) |  root in the patch failed.  |
   | +1 :green_heart: |  shadedclient  |  31m 14s |  |  patch has no errors when building and testing our client artifacts.  |
   |||| _ Other Tests _ |
   | -1 :x: |  unit  | 801m 10s | [/patch-unit-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/patch-unit-root.txt) |  root in the patch passed.  |
   | -1 :x: |  asflicense  |   1m 45s | [/results-asflicense.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/results-asflicense.txt) |  The patch generated 1 ASF License warnings.  |
   |  |   | 1072m 30s |  |  |
   
   
   | Reason | Tests |
   |-------:|:------|
   | Failed junit tests | hadoop.yarn.sls.appmaster.TestAMSimulator |
   |   | hadoop.hdfs.tools.TestDFSAdmin |
   |   | hadoop.yarn.service.TestYarnNativeServices |
   |   | hadoop.yarn.server.router.subcluster.capacity.TestYarnFederationWithCapacityScheduler |
   |   | hadoop.yarn.server.router.webapp.TestRouterWebServicesREST |
   |   | hadoop.yarn.server.router.webapp.TestFederationWebApp |
   |   | hadoop.fs.tosfs.object.TestObjectOutputStream |
   |   | hadoop.fs.tosfs.commit.TestMagicOutputStream |
   |   | hadoop.fs.tosfs.object.tos.auth.TestEnvironmentCredentialsProvider |
   |   | hadoop.fs.tosfs.object.tos.auth.TestDefaultCredentialsProviderChain |
   |   | hadoop.fs.tosfs.object.TestObjectRangeInputStream |
   |   | hadoop.fs.tosfs.object.TestObjectMultiRangeInputStream |
   
   
   | Subsystem | Report/Notes |
   |----------:|:-------------|
   | Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/artifact/out/Dockerfile |
   | GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
   | Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xmllint spotbugs checkstyle |
   | uname | Linux 209e4e5576fc 5.15.0-144-generic #157-Ubuntu SMP Mon Jun 16 07:33:10 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/bin/hadoop.sh |
   | git revision | trunk / 0254bb430e1623793f30744d7b32a37202f2d586 |
   | Default Java | Ubuntu-17.0.15+6-Ubuntu-0ubuntu120.04 |
   |  Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/testReport/ |
   | Max. process+thread count | 3665 (vs. ulimit of 5500) |
   | modules | C: hadoop-project hadoop-assemblies hadoop-common-project/hadoop-common hadoop-tools/hadoop-tools-dist hadoop-tools/hadoop-gcp hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-tos hadoop-cloud-storage-project/hadoop-cloud-storage hadoop-cloud-storage-project/hadoop-cloud-storage-dist hadoop-cloud-storage-project . U: . |
   | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/7/console |
   | versions | git=2.25.1 maven=3.9.11 shellcheck=0.7.0 |
   | Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303127263

   
   * This puts the hadoop-azure, hadoop-aws &c binaries into common/lib and so on the classpath everywhere
   * some problem with gcs instantiation during enum (will file later, as while it surfaces here, I think it's unrelated)
   * my local builds end up (today) with some versioned jars as well as the -SNAPSHOT. I think this is from me tainting my maven repo, would like to see what others see
   
   ```
   total 1401704
   -rw-r--r--@ 1 stevel  staff     106151 Sep 17 12:57 aliyun-java-core-0.2.11-beta.jar
   -rw-r--r--@ 1 stevel  staff     194215 Sep 17 12:57 aliyun-java-sdk-core-4.5.10.jar
   -rw-r--r--@ 1 stevel  staff     163698 Sep 17 12:57 aliyun-java-sdk-kms-2.11.0.jar
   -rw-r--r--@ 1 stevel  staff     220800 Sep 17 12:57 aliyun-java-sdk-ram-3.1.0.jar
   -rw-r--r--@ 1 stevel  staff     928456 Sep 17 12:57 aliyun-sdk-oss-3.18.1.jar
   -rw-r--r--@ 1 stevel  staff    2470776 Sep 17 12:57 analyticsaccelerator-s3-1.3.0.jar
   -rw-r--r--@ 1 stevel  staff      27006 Sep 17 13:11 aopalliance-repackaged-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff      20891 Sep 17 13:11 audience-annotations-0.12.0.jar
   -rw-r--r--@ 1 stevel  staff     651391 Sep 17 13:11 avro-1.11.4.jar
   -rw-r--r--@ 1 stevel  staff     113966 Sep 17 12:57 azure-data-lake-store-sdk-2.3.9.jar
   -rw-r--r--@ 1 stevel  staff      10288 Sep 17 12:57 azure-keyvault-core-1.0.0.jar
   -rw-r--r--@ 1 stevel  staff     815331 Sep 17 12:57 azure-storage-7.0.1.jar
   -rw-r--r--@ 1 stevel  staff    8324412 Sep 17 13:11 bcprov-jdk18on-1.78.1.jar
   -rw-r--r--@ 1 stevel  staff  641534749 Sep 17 12:57 bundle-2.29.52.jar
   -rw-r--r--@ 1 stevel  staff     223979 Sep 17 13:11 checker-qual-3.33.0.jar
   -rw-r--r--@ 1 stevel  staff      75479 Sep 17 13:11 commons-cli-1.9.0.jar
   -rw-r--r--@ 1 stevel  staff     353793 Sep 17 13:11 commons-codec-1.15.jar
   -rw-r--r--@ 1 stevel  staff     751914 Sep 17 13:11 commons-collections4-4.4.jar
   -rw-r--r--@ 1 stevel  staff    1079377 Sep 17 13:11 commons-compress-1.26.1.jar
   -rw-r--r--@ 1 stevel  staff     657516 Sep 17 13:11 commons-configuration2-2.10.1.jar
   -rw-r--r--@ 1 stevel  staff      24239 Sep 17 13:11 commons-daemon-1.0.13.jar
   -rw-r--r--@ 1 stevel  staff     508826 Sep 17 13:11 commons-io-2.16.1.jar
   -rw-r--r--@ 1 stevel  staff     673587 Sep 17 13:11 commons-lang3-3.17.0.jar
   -rw-r--r--@ 1 stevel  staff      70816 Sep 17 13:11 commons-logging-1.3.0.jar
   -rw-r--r--@ 1 stevel  staff    2213560 Sep 17 13:11 commons-math3-3.6.1.jar
   -rw-r--r--@ 1 stevel  staff     316431 Sep 17 13:11 commons-net-3.9.0.jar
   -rw-r--r--@ 1 stevel  staff     238400 Sep 17 13:11 commons-text-1.10.0.jar
   -rw-r--r--@ 1 stevel  staff    8661164 Sep 17 12:57 cos_api-bundle-5.6.19.jar
   -rw-r--r--@ 1 stevel  staff    2983237 Sep 17 13:11 curator-client-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff     336384 Sep 17 13:11 curator-framework-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff     315569 Sep 17 13:11 curator-recipes-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff     583996 Sep 17 13:11 dnsjava-3.6.1.jar
   -rw-r--r--@ 1 stevel  staff     324655 Sep 17 12:57 dom4j-2.1.4.jar
   -rw-r--r--@ 1 stevel  staff     670059 Sep 17 12:57 esdk-obs-java-3.20.4.2.jar
   -rw-r--r--@ 1 stevel  staff       4617 Sep 17 13:11 failureaccess-1.0.1.jar
   -rw-r--r--@ 1 stevel  staff     249277 Sep 17 13:11 gson-2.9.0.jar
   -rw-r--r--@ 1 stevel  staff    3037368 Sep 17 13:11 guava-32.0.1-jre.jar
   -rw-r--r--@ 1 stevel  staff      94013 Sep 17 12:57 hadoop-aliyun-3.5.0-20250916.124028-685.jar
   -rw-r--r--@ 1 stevel  staff      14456 Sep 17 13:11 hadoop-annotations-3.5.0-SNAPSHOT.jar
   -rw-r--r--@ 1 stevel  staff     114335 Sep 17 13:11 hadoop-auth-3.5.0-SNAPSHOT.jar
   -rw-r--r--@ 1 stevel  staff     930516 Sep 17 12:57 hadoop-aws-3.5.0-20250916.124028-686.jar
   -rw-r--r--@ 1 stevel  staff     827349 Sep 17 12:57 hadoop-azure-3.5.0-20250916.124028-685.jar
   -rw-r--r--@ 1 stevel  staff      33363 Sep 17 12:57 hadoop-azure-datalake-3.5.0-20250916.124028-685.jar
   -rw-r--r--@ 1 stevel  staff      70007 Sep 17 12:57 hadoop-cos-3.5.0-20250916.124028-683.jar
   -rw-r--r--@ 1 stevel  staff     138447 Sep 17 12:57 hadoop-gcp-3.5.0-SNAPSHOT.jar
   -rw-r--r--@ 1 stevel  staff     142274 Sep 17 12:57 hadoop-huaweicloud-3.5.0-SNAPSHOT.jar
   -rw-r--r--@ 1 stevel  staff    3519516 Sep 17 13:11 hadoop-shaded-guava-1.4.0.jar
   -rw-r--r--@ 1 stevel  staff    1952967 Sep 17 13:11 hadoop-shaded-protobuf_3_25-1.4.0.jar
   -rw-r--r--@ 1 stevel  staff    4019589 Sep 17 12:57 hadoop-tos-3.5.0-20250916.124028-202.jar
   -rw-r--r--@ 1 stevel  staff     200223 Sep 17 13:11 hk2-api-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff     203358 Sep 17 13:11 hk2-locator-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff     131590 Sep 17 13:11 hk2-utils-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff     780321 Sep 17 13:11 httpclient-4.5.13.jar
   -rw-r--r--@ 1 stevel  staff     328593 Sep 17 13:11 httpcore-4.4.13.jar
   -rw-r--r--@ 1 stevel  staff     102220 Sep 17 12:57 ini4j-0.5.4.jar
   -rw-r--r--@ 1 stevel  staff      29807 Sep 17 13:11 istack-commons-runtime-3.0.12.jar
   -rw-r--r--@ 1 stevel  staff       9301 Sep 17 13:11 j2objc-annotations-2.8.jar
   -rw-r--r--@ 1 stevel  staff      76636 Sep 17 13:11 jackson-annotations-2.14.3.jar
   -rw-r--r--@ 1 stevel  staff     473081 Sep 17 13:11 jackson-core-2.14.3.jar
   -rw-r--r--@ 1 stevel  staff    1617187 Sep 17 13:11 jackson-databind-2.14.3.jar
   -rw-r--r--@ 1 stevel  staff      68453 Sep 17 13:11 jakarta.activation-1.2.2.jar
   -rw-r--r--@ 1 stevel  staff      44399 Sep 17 13:11 jakarta.activation-api-1.2.1.jar
   -rw-r--r--@ 1 stevel  staff      25058 Sep 17 13:11 jakarta.annotation-api-1.3.5.jar
   -rw-r--r--@ 1 stevel  staff      18140 Sep 17 13:11 jakarta.inject-2.6.1.jar
   -rw-r--r--@ 1 stevel  staff      82973 Sep 17 13:11 jakarta.servlet-api-4.0.4.jar
   -rw-r--r--@ 1 stevel  staff      53683 Sep 17 13:11 jakarta.servlet.jsp-api-2.3.6.jar
   -rw-r--r--@ 1 stevel  staff      91930 Sep 17 13:11 jakarta.validation-api-2.0.2.jar
   -rw-r--r--@ 1 stevel  staff     140376 Sep 17 13:11 jakarta.ws.rs-api-2.1.6.jar
   -rw-r--r--@ 1 stevel  staff     115638 Sep 17 13:11 jakarta.xml.bind-api-2.3.3.jar
   -rw-r--r--@ 1 stevel  staff       7771 Sep 17 12:57 java-trace-api-0.2.11-beta.jar
   -rw-r--r--@ 1 stevel  staff      18432 Sep 17 12:57 java-xmlbuilder-1.2.jar
   -rw-r--r--@ 1 stevel  staff     794714 Sep 17 13:11 javassist-3.30.2-GA.jar
   -rw-r--r--@ 1 stevel  staff      95806 Sep 17 13:11 javax.servlet-api-3.1.0.jar
   -rw-r--r--@ 1 stevel  staff    1019097 Sep 17 13:11 jaxb-runtime-2.3.9.jar
   -rw-r--r--@ 1 stevel  staff       4722 Sep 17 13:11 jcip-annotations-1.0-1.jar
   -rw-r--r--@ 1 stevel  staff     327806 Sep 17 12:57 jdom2-2.0.6.1.jar
   -rw-r--r--@ 1 stevel  staff     311826 Sep 17 13:11 jersey-client-2.46.jar
   -rw-r--r--@ 1 stevel  staff    1267957 Sep 17 13:11 jersey-common-2.46.jar
   -rw-r--r--@ 1 stevel  staff      32929 Sep 17 13:11 jersey-container-servlet-2.46.jar
   -rw-r--r--@ 1 stevel  staff      75742 Sep 17 13:11 jersey-container-servlet-core-2.46.jar
   -rw-r--r--@ 1 stevel  staff      80272 Sep 17 13:11 jersey-hk2-2.46.jar
   -rw-r--r--@ 1 stevel  staff     964550 Sep 17 13:11 jersey-server-2.46.jar
   -rw-r--r--@ 1 stevel  staff      90184 Sep 17 12:57 jettison-1.5.4.jar
   -rw-r--r--@ 1 stevel  staff     249911 Sep 17 13:11 jetty-http-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     183011 Sep 17 13:11 jetty-io-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     118496 Sep 17 13:11 jetty-security-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     739348 Sep 17 13:11 jetty-server-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     146064 Sep 17 13:11 jetty-servlet-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     588962 Sep 17 13:11 jetty-util-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff      66643 Sep 17 13:11 jetty-util-ajax-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     140308 Sep 17 13:11 jetty-webapp-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff      68894 Sep 17 13:11 jetty-xml-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff     282591 Sep 17 13:11 jsch-0.1.55.jar
   -rw-r--r--@ 1 stevel  staff      19936 Sep 17 13:11 jsr305-3.0.2.jar
   -rw-r--r--@ 1 stevel  staff       4519 Sep 17 13:11 jul-to-slf4j-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff     223129 Sep 17 13:11 kerb-core-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff     115065 Sep 17 13:11 kerb-crypto-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff      36361 Sep 17 13:11 kerb-util-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff     100095 Sep 17 13:11 kerby-asn1-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff      30190 Sep 17 13:11 kerby-config-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff     200581 Sep 17 13:11 kerby-pkix-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff      40787 Sep 17 13:11 kerby-util-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff       2199 Sep 17 13:11 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
   -rw-r--r--@ 1 stevel  staff     136314 Sep 17 13:11 metrics-core-3.2.4.jar
   -rw-r--r--@ 1 stevel  staff       4554 Sep 17 13:11 netty-all-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     339045 Sep 17 13:11 netty-buffer-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     355199 Sep 17 13:11 netty-codec-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      67192 Sep 17 13:11 netty-codec-dns-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      37789 Sep 17 13:11 netty-codec-haproxy-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     674362 Sep 17 13:11 netty-codec-http-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     490985 Sep 17 13:11 netty-codec-http2-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      44736 Sep 17 13:11 netty-codec-memcache-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     113699 Sep 17 13:11 netty-codec-mqtt-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      46015 Sep 17 13:11 netty-codec-redis-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      21344 Sep 17 13:11 netty-codec-smtp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     121032 Sep 17 13:11 netty-codec-socks-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      34636 Sep 17 13:11 netty-codec-stomp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      19823 Sep 17 13:11 netty-codec-xml-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     719225 Sep 17 13:11 netty-common-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     580162 Sep 17 13:11 netty-handler-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      25650 Sep 17 13:11 netty-handler-proxy-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      26833 Sep 17 13:11 netty-handler-ssl-ocsp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      37842 Sep 17 13:11 netty-resolver-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     188360 Sep 17 13:11 netty-resolver-dns-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff       9145 Sep 17 13:11 netty-resolver-dns-classes-macos-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      19825 Sep 17 13:11 netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff      19629 Sep 17 13:11 netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar
   -rw-r--r--@ 1 stevel  staff     521428 Sep 17 13:11 netty-transport-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     147621 Sep 17 13:11 netty-transport-classes-epoll-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     108558 Sep 17 13:11 netty-transport-classes-kqueue-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      42321 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff      36594 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar
   -rw-r--r--@ 1 stevel  staff      40644 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar
   -rw-r--r--@ 1 stevel  staff       6193 Sep 17 13:11 netty-transport-native-epoll-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      25741 Sep 17 13:11 netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff      25170 Sep 17 13:11 netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar
   -rw-r--r--@ 1 stevel  staff      44157 Sep 17 13:11 netty-transport-native-unix-common-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      18241 Sep 17 13:11 netty-transport-rxtx-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      50814 Sep 17 13:11 netty-transport-sctp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff      32189 Sep 17 13:11 netty-transport-udt-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     779369 Sep 17 13:11 nimbus-jose-jwt-9.37.2.jar
   -rw-r--r--@ 1 stevel  staff     425763 Sep 17 12:57 okhttp-3.14.2.jar
   -rw-r--r--@ 1 stevel  staff      91980 Sep 17 12:57 okio-1.17.2.jar
   -rw-r--r--@ 1 stevel  staff     141734 Sep 17 12:57 opentelemetry-api-1.38.0.jar
   -rw-r--r--@ 1 stevel  staff      47252 Sep 17 12:57 opentelemetry-context-1.38.0.jar
   -rw-r--r--@ 1 stevel  staff      18189 Sep 17 12:57 opentracing-api-0.33.0.jar
   -rw-r--r--@ 1 stevel  staff      10542 Sep 17 12:57 opentracing-noop-0.33.0.jar
   -rw-r--r--@ 1 stevel  staff       7504 Sep 17 12:57 opentracing-util-0.33.0.jar
   -rw-r--r--@ 1 stevel  staff     281989 Sep 17 12:57 org.jacoco.agent-0.8.5-runtime.jar
   -rw-r--r--@ 1 stevel  staff      19479 Sep 17 13:11 osgi-resource-locator-1.0.3.jar
   -rw-r--r--@ 1 stevel  staff     128414 Sep 17 13:11 re2j-1.1.jar
   -rw-r--r--@ 1 stevel  staff      11369 Sep 17 12:57 reactive-streams-1.0.3.jar
   -rw-r--r--@ 1 stevel  staff     332398 Sep 17 13:11 reload4j-1.2.22.jar
   -rw-r--r--@ 1 stevel  staff      41125 Sep 17 13:11 slf4j-api-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff       9824 Sep 17 13:11 slf4j-reload4j-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff    2112099 Sep 17 13:11 snappy-java-1.1.10.4.jar
   -rw-r--r--@ 1 stevel  staff     195909 Sep 17 13:11 stax2-api-4.2.1.jar
   -rw-r--r--@ 1 stevel  staff      72007 Sep 17 13:11 txw2-2.3.9.jar
   -rw-r--r--@ 1 stevel  staff     443788 Sep 17 12:57 wildfly-openssl-2.1.4.Final.jar
   -rw-r--r--@ 1 stevel  staff     522679 Sep 17 13:11 woodstox-core-5.4.0.jar
   -rw-r--r--@ 1 stevel  staff    1323991 Sep 17 13:11 zookeeper-3.8.4.jar
   -rw-r--r--@ 1 stevel  staff     254932 Sep 17 13:11 zookeeper-jute-3.8.4.jar
   
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3312222391

   did you do a `mvn clean package`?
   
   `hadoop-cloud-storage-project/hadoop-cloud-storage/target/hadoop-cloud-storage-3.5.0-SNAPSHOT/share/hadoop/common/lib`  -new, contains all cloud stuff we want in; should cut stuff already going to be there just to reduce copying
   
   `hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/share/hadoop/tools/lib`
   should remove hadoop-azure, hadoop-aws, hadoop-gcs, bundle.jar...
   
   the big distro created under `hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/` is what is shipped.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3387174385

   Latest build generates stack traces from gcs and obs filesystem incomplete CP in service loader. Both need to move to core-default.xml *only* which is faster anyway.
   
   ```
   
   2025-10-09 20:06:44,452 [main] WARN  fs.FileSystem (FileSystem.java:loadFileSystems(3539)) - Cannot load filesystem
   java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.gs.GoogleHadoopFileSystem could not be instantiated    
           at java.util.ServiceLoader.fail(ServiceLoader.java:232)                                                                                            
           at java.util.ServiceLoader.access$100(ServiceLoader.java:185)                                                                                      
           at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384)                                                                        
           at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)                                                                               
           at java.util.ServiceLoader$1.next(ServiceLoader.java:480)                                                                                          
           at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:3525)                                                                           
           at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3562)                                                                        
           at org.apache.hadoop.fs.store.diag.StoreDiag.probeForFileSystemClass(StoreDiag.java:671)                                                           
           at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:223)                                                                               
           at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:170)                                                                               
           at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82)                                                                                       
           at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:97)                                                                                       
           at org.apache.hadoop.fs.store.diag.StoreDiag.exec(StoreDiag.java:1255)                                                                             
           at org.apache.hadoop.fs.store.diag.StoreDiag.main(StoreDiag.java:1264)                                                                             
           at storediag.main(storediag.java:25)                                                                                                               
           at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                     
           at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)                                                                   
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                           
           at java.lang.reflect.Method.invoke(Method.java:498)                                                                                                
           at org.apache.hadoop.util.RunJar.run(RunJar.java:333)                                                                                              
           at org.apache.hadoop.util.RunJar.main(RunJar.java:254)                                                                                             
   Caused by: java.lang.NoClassDefFoundError: com/google/auth/Credentials                                                                                     
           at java.lang.Class.getDeclaredConstructors0(Native Method)                                                                                         
           at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)                                                                                 
           at java.lang.Class.getConstructor0(Class.java:3075)                                                                                                
           at java.lang.Class.newInstance(Class.java:412)                                                                                                     
           at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:380)                                                                        
           ... 18 more                                                                                                                                        
   Caused by: java.lang.ClassNotFoundException: com.google.auth.Credentials                                                                                   
           at java.net.URLClassLoader.findClass(URLClassLoader.java:387)                                                                                      
           at java.lang.ClassLoader.loadClass(ClassLoader.java:419)                                                                                           
           at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)                                                                                   
           at java.lang.ClassLoader.loadClass(ClassLoader.java:352)                                                                                           
           ... 23 more                                                                                                                                        
   2025-10-09 20:06:44,456 [main] WARN  fs.FileSystem (FileSystem.java:loadFileSystems(3539)) - Cannot load filesystem                                        
   java.util.ServiceConfigurationError: org.apache.hadoop.fs.FileSystem: Provider org.apache.hadoop.fs.obs.OBSFileSystem could not be instantiated            
           at java.util.ServiceLoader.fail(ServiceLoader.java:232)                                                                                            
           at java.util.ServiceLoader.access$100(ServiceLoader.java:185)                                                                                      
           at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:384)                                                                        
           at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)                                                                               
           at java.util.ServiceLoader$1.next(ServiceLoader.java:480)                                                                                          
           at org.apache.hadoop.fs.FileSystem.loadFileSystems(FileSystem.java:3525)                                                                           
           at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3562)                                                                        
           at org.apache.hadoop.fs.store.diag.StoreDiag.probeForFileSystemClass(StoreDiag.java:671)                                                           
           at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:223)                                                                               
           at org.apache.hadoop.fs.store.diag.StoreDiag.run(StoreDiag.java:170)                                                                               
           at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82)                                                                                       
           at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:97)                                                                                       
           at org.apache.hadoop.fs.store.diag.StoreDiag.exec(StoreDiag.java:1255)                                                                             
           at org.apache.hadoop.fs.store.diag.StoreDiag.main(StoreDiag.java:1264)                                                                             
           at storediag.main(storediag.java:25)                                                                                                               
           at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)                                                                                     
           at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)                                                                   
           at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)                                                           
           at java.lang.reflect.Method.invoke(Method.java:498)                                                                                                
           at org.apache.hadoop.util.RunJar.run(RunJar.java:333)                                                                                              
           at org.apache.hadoop.util.RunJar.main(RunJar.java:254)                                                                                             
   Caused by: java.lang.NoClassDefFoundError: com/obs/services/exception/ObsException                                                                         
           at java.lang.Class.getDeclaredConstructors0(Native Method)                                                                                         
           at java.lang.Class.privateGetDeclaredConstructors(Class.java:2671)                                                                                 
           at java.lang.Class.getConstructor0(Class.java:3075)                                                                                                
           at java.lang.Class.newInstance(Class.java:412)                                                                                                     
           at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:380)                                                                        
           ... 18 more                                                                                                                                        
   Caused by: java.lang.ClassNotFoundException: com.obs.services.exception.ObsException                                                                       
           at java.net.URLClassLoader.findClass(URLClassLoader.java:387)                                                                                      
           at java.lang.ClassLoader.loadClass(ClassLoader.java:419)                                                                                           
           at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352)                                                                                   
           at java.lang.ClassLoader.loadClass(ClassLoader.java:352)                                                                                           
           ... 23 more                                                                                                                                        
   FileSystem for s3a:// is: org.apache.hadoop.fs.s3a.S3AFileSystem                                                                                           
   Loaded from: file:/Users/stevel/Projects/Releases/hadoop-3.5.0-SNAPSHOT/share/hadoop/common/lib/hadoop-aws-3.5.0-SNAPSHOT.jar via sun.misc.Launcher$AppClassLoader@41906a77                                                                                                                                           
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3387715974

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |:----:|----------:|--------:|:--------:|:-------:|
   | +0 :ok: |  reexec  |   1m  9s |  |  Docker mode activated.  |
   |||| _ Prechecks _ |
   | +1 :green_heart: |  dupname  |   0m  0s |  |  No case conflicting files found.  |
   | +0 :ok: |  codespell  |   0m  0s |  |  codespell was not available.  |
   | +0 :ok: |  detsecrets  |   0m  0s |  |  detect-secrets was not available.  |
   | +0 :ok: |  shelldocs  |   0m  0s |  |  Shelldocs was not available.  |
   | +0 :ok: |  xmllint  |   0m  1s |  |  xmllint was not available.  |
   | +1 :green_heart: |  @author  |   0m  0s |  |  The patch does not contain any @author tags.  |
   | -1 :x: |  test4tests  |   0m  0s |  |  The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch.  |
   |||| _ trunk Compile Tests _ |
   | +0 :ok: |  mvndep  |   9m  3s |  |  Maven dependency ordering for branch  |
   | +1 :green_heart: |  mvninstall  |  38m 50s |  |  trunk passed  |
   | +1 :green_heart: |  compile  |  16m  3s |  |  trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  compile  |  14m  6s |  |  trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  mvnsite  |  21m  2s |  |  trunk passed  |
   | +1 :green_heart: |  javadoc  |   9m  0s |  |  trunk passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  javadoc  |   7m 29s |  |  trunk passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  shadedclient  |  49m 55s |  |  branch has no errors when building and testing our client artifacts.  |
   |||| _ Patch Compile Tests _ |
   | +0 :ok: |  mvndep  |   0m 40s |  |  Maven dependency ordering for patch  |
   | +1 :green_heart: |  mvninstall  |  41m 14s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  15m 33s |  |  the patch passed with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04  |
   | +1 :green_heart: |  javac  |  15m 33s |  |  the patch passed  |
   | +1 :green_heart: |  compile  |  13m 29s |  |  the patch passed with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09  |
   | +1 :green_heart: |  javac  |  13m 29s |  |  the patch passed  |
   | +1 :green_heart: |  blanks  |   0m  0s |  |  The patch has no blanks issues.  |
   | +1 :green_heart: |  mvnsite  |  18m 48s |  |  the patch passed  |
   | +1 :green_heart: |  shellcheck  |   0m  0s |  |  No new issues.  |
   | -1 :x: |  javadoc  |   9m 58s | [/results-javadoc-javadoc-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/artifact/out/results-javadoc-javadoc-root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04.txt) |  root-jdkUbuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 with JDK Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 generated 10 new + 5526 unchanged - 10 fixed = 5536 total (was 5536)  |
   | -1 :x: |  javadoc  |   8m  2s | [/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/artifact/out/results-javadoc-javadoc-root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09.txt) |  root-jdkPrivateBuild-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 with JDK Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 generated 10 new + 1418 unchanged - 10 fixed = 1428 total (was 1428)  |
   | +1 :green_heart: |  shadedclient  |  63m 31s |  |  patch has no errors when building and testing our client artifacts.  |
   |||| _ Other Tests _ |
   | -1 :x: |  unit  |   2m 22s | [/patch-unit-root.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/artifact/out/patch-unit-root.txt) |  root in the patch failed.  |
   | +0 :ok: |  asflicense  |   0m 32s |  |  ASF License check generated no output?  |
   |  |   | 309m 40s |  |  |
   
   
   | Subsystem | Report/Notes |
   |----------:|:-------------|
   | Docker | ClientAPI=1.51 ServerAPI=1.51 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/artifact/out/Dockerfile |
   | GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
   | Optional Tests | dupname asflicense codespell detsecrets shellcheck shelldocs compile javac javadoc mvninstall mvnsite unit shadedclient xmllint |
   | uname | Linux 01b725e22dc7 5.15.0-156-generic #166-Ubuntu SMP Sat Aug 9 00:02:46 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux |
   | Build tool | maven |
   | Personality | dev-support/bin/hadoop.sh |
   | git revision | trunk / 76b4eae78d738ee73cf68118a87c9204d120d752 |
   | Default Java | Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
   | Multi-JDK versions | /usr/lib/jvm/java-11-openjdk-amd64:Ubuntu-11.0.27+6-post-Ubuntu-0ubuntu120.04 /usr/lib/jvm/java-8-openjdk-amd64:Private Build-1.8.0_452-8u452-ga~us1-0ubuntu1~20.04-b09 |
   |  Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/testReport/ |
   | Max. process+thread count | 699 (vs. ulimit of 5500) |
   | modules | C: hadoop-project hadoop-assemblies hadoop-tools/hadoop-tools-dist hadoop-cloud-storage-project/hadoop-huaweicloud hadoop-cloud-storage-project/hadoop-tos hadoop-cloud-storage-project/hadoop-cloud-storage hadoop-cloud-storage-project/hadoop-cloud-storage-dist hadoop-cloud-storage-project . U: . |
   | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/4/console |
   | versions | git=2.25.1 maven=3.9.11 shellcheck=0.7.0 |
   | Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3303139199

   by contrast: 3.4.2
   ```
   total 98048
   -rw-r--r--@ 1 stevel  staff     3448 Aug  7 12:16 animal-sniffer-annotations-1.17.jar
   -rw-r--r--@ 1 stevel  staff    20891 Aug  7 12:16 audience-annotations-0.12.0.jar
   -rw-r--r--@ 1 stevel  staff   651391 Aug  7 12:16 avro-1.11.4.jar
   -rw-r--r--@ 1 stevel  staff  8324412 Aug  7 12:15 bcprov-jdk18on-1.78.1.jar
   -rw-r--r--@ 1 stevel  staff   193322 Aug  7 12:16 checker-qual-2.5.2.jar
   -rw-r--r--@ 1 stevel  staff    75479 Aug  7 12:16 commons-cli-1.9.0.jar
   -rw-r--r--@ 1 stevel  staff   353793 Aug  7 12:16 commons-codec-1.15.jar
   -rw-r--r--@ 1 stevel  staff   751914 Aug  7 12:16 commons-collections4-4.4.jar
   -rw-r--r--@ 1 stevel  staff  1079377 Aug  7 12:16 commons-compress-1.26.1.jar
   -rw-r--r--@ 1 stevel  staff   657516 Aug  7 12:16 commons-configuration2-2.10.1.jar
   -rw-r--r--@ 1 stevel  staff    24239 Aug  7 12:16 commons-daemon-1.0.13.jar
   -rw-r--r--@ 1 stevel  staff   508826 Aug  7 12:16 commons-io-2.16.1.jar
   -rw-r--r--@ 1 stevel  staff   673587 Aug  7 12:16 commons-lang3-3.17.0.jar
   -rw-r--r--@ 1 stevel  staff    70816 Aug  7 12:16 commons-logging-1.3.0.jar
   -rw-r--r--@ 1 stevel  staff  2213560 Aug  7 12:16 commons-math3-3.6.1.jar
   -rw-r--r--@ 1 stevel  staff   316431 Aug  7 12:16 commons-net-3.9.0.jar
   -rw-r--r--@ 1 stevel  staff   238400 Aug  7 12:16 commons-text-1.10.0.jar
   -rw-r--r--@ 1 stevel  staff  2983237 Aug  7 12:16 curator-client-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff   336384 Aug  7 12:16 curator-framework-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff   315569 Aug  7 12:16 curator-recipes-5.2.0.jar
   -rw-r--r--@ 1 stevel  staff   583996 Aug  7 12:16 dnsjava-3.6.1.jar
   -rw-r--r--@ 1 stevel  staff     3727 Aug  7 12:16 failureaccess-1.0.jar
   -rw-r--r--@ 1 stevel  staff   249277 Aug  7 12:16 gson-2.9.0.jar
   -rw-r--r--@ 1 stevel  staff  2747878 Aug  7 12:16 guava-27.0-jre.jar
   -rw-r--r--@ 1 stevel  staff    25517 Aug  7 12:16 hadoop-annotations-3.4.2.jar
   -rw-r--r--@ 1 stevel  staff   110106 Aug  7 12:16 hadoop-auth-3.4.2.jar
   -rw-r--r--@ 1 stevel  staff   810477 Aug  7 12:39 hadoop-azure-3.4.2.jar
   -rw-r--r--@ 1 stevel  staff  3519516 Aug  7 12:16 hadoop-shaded-guava-1.4.0.jar
   -rw-r--r--@ 1 stevel  staff  1952967 Aug  7 12:16 hadoop-shaded-protobuf_3_25-1.4.0.jar
   -rw-r--r--@ 1 stevel  staff   780321 Aug  7 12:16 httpclient-4.5.13.jar
   -rw-r--r--@ 1 stevel  staff   328593 Aug  7 12:16 httpcore-4.4.13.jar
   -rw-r--r--@ 1 stevel  staff     8782 Aug  7 12:16 j2objc-annotations-1.1.jar
   -rw-r--r--@ 1 stevel  staff    75705 Aug  7 12:16 jackson-annotations-2.12.7.jar
   -rw-r--r--@ 1 stevel  staff   365538 Aug  7 12:16 jackson-core-2.12.7.jar
   -rw-r--r--@ 1 stevel  staff  1512418 Aug  7 12:16 jackson-databind-2.12.7.1.jar
   -rw-r--r--@ 1 stevel  staff    44399 Aug  7 12:16 jakarta.activation-api-1.2.1.jar
   -rw-r--r--@ 1 stevel  staff    95806 Aug  7 12:16 javax.servlet-api-3.1.0.jar
   -rw-r--r--@ 1 stevel  staff   102244 Aug  7 12:16 jaxb-api-2.2.11.jar
   -rw-r--r--@ 1 stevel  staff   890168 Aug  7 12:16 jaxb-impl-2.2.3-1.jar
   -rw-r--r--@ 1 stevel  staff     4722 Aug  7 12:16 jcip-annotations-1.0-1.jar
   -rw-r--r--@ 1 stevel  staff   436731 Aug  7 12:16 jersey-core-1.19.4.jar
   -rw-r--r--@ 1 stevel  staff   158890 Aug  7 12:16 jersey-json-1.22.0.jar
   -rw-r--r--@ 1 stevel  staff   705276 Aug  7 12:16 jersey-server-1.19.4.jar
   -rw-r--r--@ 1 stevel  staff   128990 Aug  7 12:16 jersey-servlet-1.19.4.jar
   -rw-r--r--@ 1 stevel  staff    90184 Aug  7 12:16 jettison-1.5.4.jar
   -rw-r--r--@ 1 stevel  staff   249911 Aug  7 12:16 jetty-http-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff   183011 Aug  7 12:16 jetty-io-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff   118496 Aug  7 12:16 jetty-security-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff   739348 Aug  7 12:16 jetty-server-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff   146064 Aug  7 12:16 jetty-servlet-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff   588962 Aug  7 12:16 jetty-util-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff    66643 Aug  7 12:16 jetty-util-ajax-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff   140308 Aug  7 12:16 jetty-webapp-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff    68894 Aug  7 12:16 jetty-xml-9.4.57.v20241219.jar
   -rw-r--r--@ 1 stevel  staff   282591 Aug  7 12:16 jsch-0.1.55.jar
   -rw-r--r--@ 1 stevel  staff   100636 Aug  7 12:15 jsp-api-2.1.jar
   -rw-r--r--@ 1 stevel  staff    19936 Aug  7 12:16 jsr305-3.0.2.jar
   -rw-r--r--@ 1 stevel  staff    46367 Aug  7 12:16 jsr311-api-1.1.1.jar
   -rw-r--r--@ 1 stevel  staff     4519 Aug  7 12:16 jul-to-slf4j-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff   223129 Aug  7 12:16 kerb-core-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff   115065 Aug  7 12:16 kerb-crypto-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff    36361 Aug  7 12:16 kerb-util-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff   100095 Aug  7 12:16 kerby-asn1-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff    30190 Aug  7 12:16 kerby-config-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff   200581 Aug  7 12:16 kerby-pkix-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff    40787 Aug  7 12:16 kerby-util-2.0.3.jar
   -rw-r--r--@ 1 stevel  staff     2199 Aug  7 12:16 listenablefuture-9999.0-empty-to-avoid-conflict-with-guava.jar
   -rw-r--r--@ 1 stevel  staff   136314 Aug  7 12:16 metrics-core-3.2.4.jar
   -rw-r--r--@ 1 stevel  staff     4554 Aug  7 12:15 netty-all-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   339045 Aug  7 12:16 netty-buffer-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   355199 Aug  7 12:16 netty-codec-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    67192 Aug  7 12:15 netty-codec-dns-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    37789 Aug  7 12:15 netty-codec-haproxy-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   674362 Aug  7 12:15 netty-codec-http-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   490985 Aug  7 12:15 netty-codec-http2-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    44736 Aug  7 12:15 netty-codec-memcache-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   113699 Aug  7 12:15 netty-codec-mqtt-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    46015 Aug  7 12:15 netty-codec-redis-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    21344 Aug  7 12:15 netty-codec-smtp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   121032 Aug  7 12:15 netty-codec-socks-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    34636 Aug  7 12:15 netty-codec-stomp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    19823 Aug  7 12:15 netty-codec-xml-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   719225 Aug  7 12:16 netty-common-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   580162 Aug  7 12:16 netty-handler-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    25650 Aug  7 12:15 netty-handler-proxy-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    26833 Aug  7 12:15 netty-handler-ssl-ocsp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    37842 Aug  7 12:16 netty-resolver-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   188360 Aug  7 12:15 netty-resolver-dns-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff     9145 Aug  7 12:15 netty-resolver-dns-classes-macos-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    19825 Aug  7 12:15 netty-resolver-dns-native-macos-4.1.118.Final-osx-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff    19629 Aug  7 12:15 netty-resolver-dns-native-macos-4.1.118.Final-osx-x86_64.jar
   -rw-r--r--@ 1 stevel  staff   521428 Aug  7 12:16 netty-transport-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   147621 Aug  7 12:16 netty-transport-classes-epoll-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   108558 Aug  7 12:15 netty-transport-classes-kqueue-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    42321 Aug  7 12:15 netty-transport-native-epoll-4.1.118.Final-linux-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff    36594 Aug  7 12:15 netty-transport-native-epoll-4.1.118.Final-linux-riscv64.jar
   -rw-r--r--@ 1 stevel  staff    40644 Aug  7 12:15 netty-transport-native-epoll-4.1.118.Final-linux-x86_64.jar
   -rw-r--r--@ 1 stevel  staff     6193 Aug  7 12:16 netty-transport-native-epoll-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    25741 Aug  7 12:15 netty-transport-native-kqueue-4.1.118.Final-osx-aarch_64.jar
   -rw-r--r--@ 1 stevel  staff    25170 Aug  7 12:15 netty-transport-native-kqueue-4.1.118.Final-osx-x86_64.jar
   -rw-r--r--@ 1 stevel  staff    44157 Aug  7 12:16 netty-transport-native-unix-common-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    18241 Aug  7 12:15 netty-transport-rxtx-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    50814 Aug  7 12:15 netty-transport-sctp-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff    32189 Aug  7 12:15 netty-transport-udt-4.1.118.Final.jar
   -rw-r--r--@ 1 stevel  staff   779369 Aug  7 12:16 nimbus-jose-jwt-9.37.2.jar
   -rw-r--r--@ 1 stevel  staff   128414 Aug  7 12:16 re2j-1.1.jar
   -rw-r--r--@ 1 stevel  staff   332398 Aug  7 12:16 reload4j-1.2.22.jar
   -rw-r--r--@ 1 stevel  staff    41125 Aug  7 12:15 slf4j-api-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff     9824 Aug  7 12:15 slf4j-reload4j-1.7.36.jar
   -rw-r--r--@ 1 stevel  staff  2112099 Aug  7 12:16 snappy-java-1.1.10.4.jar
   -rw-r--r--@ 1 stevel  staff   195909 Aug  7 12:16 stax2-api-4.2.1.jar
   -rw-r--r--@ 1 stevel  staff   522679 Aug  7 12:16 woodstox-core-5.4.0.jar
   -rw-r--r--@ 1 stevel  staff  1323991 Aug  7 12:16 zookeeper-3.8.4.jar
   -rw-r--r--@ 1 stevel  staff   254932 Aug  7 12:16 zookeeper-jute-3.8.4.jar
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "cnauroth (via GitHub)" <gi...@apache.org>.
cnauroth commented on code in PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#discussion_r2446383325


##########
hadoop-cloud-storage-project/pom.xml:
##########
@@ -34,6 +34,7 @@
     <module>hadoop-cos</module>
     <module>hadoop-huaweicloud</module>
     <module>hadoop-tos</module>
+    <module>hadoop-cloud-storage-dist</module>

Review Comment:
   It seems like we would never need to enter execution of `hadoop-cloud-storage-dist` unless we are building a distro (activating `-Pdist`). Should we also wrap inclusion of the sub-module here behind activation of the `dist` profile?



##########
BUILDING.txt:
##########
@@ -388,6 +388,58 @@ Create a local staging version of the website (in /tmp/hadoop-site)
 
 Note that the site needs to be built in a second pass after other artifacts.
 
+----------------------------------------------------------------------------------
+Including Cloud Connector Dependencies in Distributions:
+
+Hadoop distributions include the hadoop modules need to work with data and services

Review Comment:
   Nitpick: "modules needed".



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3425948823

   :broken_heart: **-1 overall**
   
   
   
   
   
   
   | Vote | Subsystem | Runtime |  Logfile | Comment |
   |:----:|----------:|--------:|:--------:|:-------:|
   | +0 :ok: |  reexec  |   0m  0s |  |  Docker mode activated.  |
   | -1 :x: |  patch  |   0m 16s |  |  https://github.com/apache/hadoop/pull/7980 does not apply to trunk. Rebase required? Wrong Branch? See https://cwiki.apache.org/confluence/display/HADOOP/How+To+Contribute for help.  |
   
   
   | Subsystem | Report/Notes |
   |----------:|:-------------|
   | GITHUB PR | https://github.com/apache/hadoop/pull/7980 |
   | Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-7980/10/console |
   | versions | git=2.34.1 |
   | Powered by | Apache Yetus 0.14.0 https://yetus.apache.org |
   
   
   This message was automatically generated.
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "cnauroth (via GitHub)" <gi...@apache.org>.
cnauroth commented on code in PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#discussion_r2449857037


##########
BUILDING.txt:
##########
@@ -388,6 +388,57 @@ Create a local staging version of the website (in /tmp/hadoop-site)
 
 Note that the site needs to be built in a second pass after other artifacts.
 
+----------------------------------------------------------------------------------
+Including Cloud Connector Dependencies in Distributions:
+
+Hadoop distributions include the hadoop modules needed to work with data and services
+on cloud infrastructure
+
+However, dependencies are omitted for all cloud connectors except hadoop-azure
+(abfs:// and wasb://) and possibly hadoop-gcp (gs://) and hadoop-tos (tos://).
+For the latter two modules, it depends on shading options.
+
+For hadoop-aws the AWS SDK bundle.jar is omitted, but everything else is included.
+
+Excluding the extra binaries:
+* Keeps release artifact size below the limit of the ASF distribution network.
+* Reduces download and size overhead in docker usage.
+* Reduces the CVE attack surface and audit-related complaints about those same ScVES.

Review Comment:
   Nitpick: "CVEs."



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3516563186

   @cnauroth do you see anything else which needs to go in here? I think I'm done at least as a merge to trunk goes.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "steveloughran (via GitHub)" <gi...@apache.org>.
steveloughran commented on code in PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#discussion_r2447670994


##########
hadoop-cloud-storage-project/pom.xml:
##########
@@ -34,6 +34,7 @@
     <module>hadoop-cos</module>
     <module>hadoop-huaweicloud</module>
     <module>hadoop-tos</module>
+    <module>hadoop-cloud-storage-dist</module>

Review Comment:
   valid point. Will do, as it'll save on disk space as well as time.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org


Re: [PR] HADOOP-19696. hadoop binary distribution to move cloud connectors to hadoop common/lib [hadoop]

Posted by "ahmarsuhail (via GitHub)" <gi...@apache.org>.
ahmarsuhail commented on PR #7980:
URL: https://github.com/apache/hadoop/pull/7980#issuecomment-3311933628

   not very familiar with how the packaging stuff works, so finding this a bit difficult to review. 
   
   How are testing the packaging, I just ran `mvn package -Pdist -DskipTests -Dmaven.javadoc.skip=true  -DskipShade`, but the outputs in :
   
   `hadoop-cloud-storage-project/hadoop-cloud-storage/target/hadoop-cloud-storage-3.5.0-SNAPSHOT/share/hadoop/common/lib`, 
   
   `hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/share/hadoop/tools/lib`
   
   `hadoop/hadoop-dist/target/hadoop-3.5.0-SNAPSHOT/share/hadoop/common/lib` 
   
   
   are all the same before and after your changes, so I must be doing something wrong.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org