You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "joseluisll (via GitHub)" <gi...@apache.org> on 2026/07/28 12:00:19 UTC
[PR] HDFS-11039. Document 42 configuration properties missing from hdfs-default.xml. [hadoop]
joseluisll opened a new pull request, #8637:
URL: https://github.com/apache/hadoop/pull/8637
### Description of PR
Documents **42 configuration properties** in `hdfs-default.xml` that are read
by production code but were previously discoverable only by reading the
source. Every property listed below is live and non-deprecated: each read
site was verified, none appears in any `DeprecationDelta` table, and none
carries a deprecated constant. This answers the question asked on HDFS-11039
in 2018 — *which* properties should be added.
**No production code is changed.** The diff touches exactly two files:
`hdfs-default.xml` (+42 `<property>` entries, 1 rename of a deprecated
property name to its current one) and `TestHdfsConfigFields.java` (skip-list
bookkeeping only, explained below).
#### The 42 properties
| Property | Default | Rationale |
| --- | --- | --- |
| `dfs.datanode.synconclose` | `false` | Controls fsync of block files on close; read by `BlockReceiver`. Was skip-listed under `// Fully deprecated properties?` — disproved. |
| `dfs.datanode.non.local.lazy.persist` | `false` | Permits LAZY_PERSIST writes from non-local clients; read by `DNConf`. Was skip-listed under the same stale comment — disproved. |
| `dfs.namenode.tolerate.heartbeat.multiplier` | `4` | Heartbeat-staleness tolerance when deleting excess replicas; read by `BlockPlacementPolicyDefault`. Same stale skip entry — disproved. |
| `dfs.namenode.replqueue.threshold-pct` | *(empty; falls back to `dfs.namenode.safemode.threshold-pct`)* | Threshold for initializing replication queues; read by `BlockManagerSafeMode`. Same stale skip entry — disproved. |
| `dfs.ha.log-roll.rpc.timeout` | `20000` | RPC timeout for the Standby's edit-log-roll requests; read by `EditLogTailer`. Was skip-listed as `// Removed by HDFS-6440` — the property is still read; the claim is incorrect. |
| `dfs.ha.tail-edits.max-txns-per-lock` | `9223372036854775807` | Bounds transactions applied per namesystem write-lock hold on the Standby; declared in `EditLogTailer`, outside any `*ConfigKeys` class. |
| `dfs.client.read.shortcircuit.metrics.sampling.percentage` | `0` | Sampling percentage for short-circuit read latency metrics; 0 disables. Declared in `HdfsClientConfigKeys.Read.ShortCircuit`, which the comparison test does not reflect over. |
| `dfs.webhdfs.oauth2.credential` | *(empty)* | OAuth2 credential for `CredentialBasedAccessTokenProvider`. Siblings were documented; this constant lives outside `HdfsClientConfigKeys`. |
| `dfs.webhdfs.oauth2.refresh.token` | *(empty)* | OAuth2 refresh token for `ConfRefreshTokenBasedAccessTokenProvider`. Same situation. |
| `dfs.webhdfs.oauth2.refresh.token.expires.ms.since.epoch` | *(empty)* | Expiry of the OAuth2 refresh token. Same situation. |
| `nfs.http.port` | `50079` | Fallback HTTP port for the NFS gateway web UI; effective port comes from `nfs.http.address`. |
| `nfs.http.address` | `0.0.0.0:50079` | HTTP bind address of the NFS gateway web UI. |
| `nfs.https.port` | `50579` | Fallback HTTPS port; effective port comes from `nfs.https.address`. |
| `nfs.https.address` | `0.0.0.0:50579` | HTTPS bind address of the NFS gateway web UI. |
| `nfs.file.dump` | `true` | Enables dumping out-of-order NFS writes to the local dump directory. |
| `nfs.dtmax` | `65536` | Maximum readdir transfer size of the gateway. |
| `nfs.export.point` | `/` | The HDFS path exported by the gateway. |
| `nfs.max.open.files` | `256` | Maximum concurrently open file streams in the gateway. |
| `nfs.stream.timeout` | `600000` | Inactivity timeout for NFS write streams (ms). |
| `nfs.large.file.upload` | `true` | Enables the gateway's large-file upload handling. |
| `nfs.aix.compatibility.mode.enabled` | `false` | Enables workarounds for AIX NFS clients. |
| `nfs.metrics.percentiles.intervals` | *(empty)* | Rollover intervals for gateway latency percentile metrics. |
| `nfs.superuser` | *(empty)* | NFS client user granted HDFS superuser access through the gateway. |
| `nfs.registration.port` | `40` | Privileged port used when registering with the portmapper. |
| `nfs.udp.client.portmap.timeout.millis` | `500` | Timeout for portmap RPC connections. |
| `nfs.port.monitoring.disabled` | `true` | Whether clients may connect from unprivileged ports. Renamed from the deprecated `nfs.allow.insecure.ports` per `NfsConfiguration`'s `DeprecationDelta`. |
| `dfs.datatransfer.server.fixedBlackList.file` | `/etc/hadoop/fixedBlackList` | Fixed server-side deny list for `BlackListBasedTrustedChannelResolver`. |
| `dfs.datatransfer.server.variableBlackList.enable` | `false` | Enables the reloadable server-side deny list. |
| `dfs.datatransfer.server.variableBlackList.file` | `/etc/hadoop/blackList` | Reloadable server-side deny-list file. |
| `dfs.datatransfer.server.variableBlackList.cache.secs` | `3600` | Reload interval of the server-side deny list. |
| `dfs.datatransfer.client.fixedBlackList.file` | *(empty; falls back to the server value)* | Fixed client-side deny list. |
| `dfs.datatransfer.client.variableBlackList.enable` | `false` | Enables the reloadable client-side deny list. |
| `dfs.datatransfer.client.variableBlackList.file` | *(empty; falls back to the server value)* | Reloadable client-side deny-list file. |
| `dfs.datatransfer.client.variableBlackList.cache.secs` | `3600` | Reload interval of the client-side deny list. |
| `dfs.datatransfer.server.fixedwhitelist.file` | `/etc/hadoop/fixedwhitelist` | Fixed server-side allow list for `WhitelistBasedTrustedChannelResolver`. |
| `dfs.datatransfer.server.variablewhitelist.enable` | `false` | Enables the reloadable server-side allow list. |
| `dfs.datatransfer.server.variablewhitelist.file` | `/etc/hadoop/whitelist` | Reloadable server-side allow-list file. |
| `dfs.datatransfer.server.variablewhitelist.cache.secs` | `3600` | Reload interval of the server-side allow list. |
| `dfs.datatransfer.client.fixedwhitelist.file` | *(empty; falls back to the server value)* | Fixed client-side allow list. |
| `dfs.datatransfer.client.variablewhitelist.enable` | `false` | Enables the reloadable client-side allow list. |
| `dfs.datatransfer.client.variablewhitelist.file` | *(empty; falls back to the server value)* | Reloadable client-side allow-list file. |
| `dfs.datatransfer.client.variablewhitelist.cache.secs` | `3600` | Reload interval of the client-side allow list. |
#### Why TestHdfsConfigFields is in the diff
`TestHdfsConfigFields` enforces, in both directions, that `hdfs-default.xml`
and the reflected `*ConfigKeys` classes agree, modulo its skip lists.
Documenting these properties therefore requires skip-list bookkeeping — the
same idiom as the existing `nfs` prefix entry, routinely updated by past
patches (HDFS-15870, HDFS-15514, HDFS-15559):
* **Removed** the five stale skip entries (`dfs.datanode.synconclose`,
`dfs.datanode.non.local.lazy.persist`,
`dfs.namenode.tolerate.heartbeat.multiplier`,
`dfs.namenode.replqueue.threshold-pct`, `dfs.ha.log-roll.rpc.timeout`), so
those constants are again enforced against the xml and the gap cannot
silently reopen for them.
* **Added** skip entries for `dfs.datatransfer.{server,client}.*`,
`dfs.ha.tail-edits.max-txns-per-lock`, `dfs.webhdfs.oauth2.*` and
`dfs.client.read.shortcircuit.metrics.sampling.percentage`, whose constants
live in classes the test does not reflect over. The `nfs.*` entries are
covered by the existing `nfs` prefix entry; `NfsConfigKeys` itself cannot be
reflected, as `hadoop-hdfs-nfs` depends on `hadoop-hdfs` and can never be on
this test's classpath.
* **Corrected** the comments on the two entries that legitimately remain
skip-listed (`dfs.corruptfilesreturned.max`, `dfs.metrics.session-id`).
A follow-up can strengthen enforcement by promoting the declaring classes
into `configurationClasses` where module dependencies allow.
<details>
<summary><b>Method</b> — how the list was produced and verified</summary>
The list was produced by static analysis of the entire `hadoop-hdfs-project`
source tree, cross-validated by two independently implemented scanners (one
Java, one Python), and verified against Hadoop's own machinery:
1. **Forward extraction** — every `String` config-key constant in every class
(not just `*ConfigKeys` registries), resolving multi-line declarations and
`PREFIX + "suffix"` concatenation, including cross-class references.
2. **Inverse sweep** — every `Configuration` accessor call site
(`get*`, `getTimeDuration`, `getPropsWithPrefix`, …) resolved back to a
key, catching literal-only keys that have no constant at all.
3. **Deprecation cross-check** — `DeprecationDelta` tables
(`HdfsConfiguration`, `NfsConfiguration`), `HdfsClientConfigKeys.DeprecatedKeys`,
and `@Deprecated` annotations. A `@Deprecated` *constant* was not treated
as a deprecated *property* (most such constants merely moved classes).
4. **Skip-list audit** — every `Test*ConfigFields` skip entry re-checked
against the code. Reasons stating intent ("not intended for users",
"purposely hidden") were respected; reasons stating checkable facts
("deprecated", "removed") were verified.
5. **Oracle validation** — before trusting any finding, the extraction was
required to reproduce the green `TestHdfsConfigFields`/`TestRBFConfigFields`
results with a zero diff; any discrepancy was treated as a scanner bug.
6. **Live verification** — `HdfsConfiguration` was instantiated and its merged
property set diffed against the xml through the real
`Configuration.loadResource` pipeline, including `${...}` resolution.
**Descriptions policy.** Descriptions are derived from the declaring
constant's Javadoc, surrounding code comments, or direct inspection of the
read site — never invented. Secrets and unset-by-default properties use an
empty `<value>`, matching file convention.
</details>
<details>
<summary><b>Properties deliberately not documented</b> — exclusions and their justification</summary>
The audit identified further undocumented keys that are deliberately excluded
from this patch. Each exclusion is justified by explicit source-level intent,
by deprecation status, or by demonstrated absence of effect:
| Excluded | Justification |
| --- | --- |
| `dfs.namenode.snapshot.deletion.ordered`, `dfs.namenode.snapshot.deletion.ordered.gc.period.ms`, `dfs.namenode.snapshot.trashroot.enabled` | The declaring sources (`SnapshotManager`, `FSNamesystem`) designate these keys as private configuration. Documenting them would contradict recorded upstream intent. |
| `dfs.ha.tail-edits.qjm.rpc.max-txns` | Annotated in `QuorumJournalManager` as not publicly exposed. |
| `dfs.datanode.xceiver.stop.timeout.millis` | Annotated in `DFSConfigKeys` as hidden and intentionally undocumented. |
| `dfs.datanode.startup`, `dfs.namenode.startup` | Recorded in the skip list as not intended for users; they carry the startup option internally and are not operator-settable configuration. |
| `ignore.secure.ports.for.testing`, `dfs.datanode.enable.fileio.fault.injection`, `dfs.datanode.duplicate.replica.deletion` | Test-only instrumentation hooks with no operational function. |
| `dfs.datanode.min.supported.namenode.version`, `dfs.namenode.min.supported.datanode.version` | Internal version-compatibility floors; not operator-tunable in any supported scenario. |
| `dfs.corruptfilesreturned.max` | The value is read but never consulted by any code path. Documenting an ineffective key would misinform operators. The skip-list comment has been corrected to record this. |
| `dfs.metrics.session-id` | Deprecated alias, registered in `HdfsClientConfigKeys.DeprecatedKeys`. The skip-list comment has been corrected to record this. |
| `dfs.namenode.audit.log.async` | Obsolete. The sole read site exists to warn that the key is no longer in use. |
| `dfs.federation.router.*` (4 keys) | Owned by `hdfs-rbf-default.xml`; a separate JIRA will be filed. |
</details>
Contains content generated by Anthropic Claude Code.
### How was this patch tested?
* `mvn test -Dtest=TestHdfsConfigFields` on the rebased branch against
current trunk (JDK 17): 4/4 pass, BUILD SUCCESS.
* XML well-formedness and duplicate-name check: clean. (Three pre-existing
duplicate `dfs.journalnode.kerberos.*` entries were noticed upstream;
untouched here as out of scope.)
* Live round-trip: instantiated `HdfsConfiguration` and diffed its merged
property set against the xml through the real resource-loading pipeline;
every non-empty documented value matches the code default, including
`${...}` resolution.
### For code changes:
- [x] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP-17799. Your PR title ...')?
- [ ] Object storage: have the integration tests been executed and the endpoint declared according to the connector-specific documentation? *(N/A — no object-storage changes)*
- [ ] If adding new dependencies to the code, are these dependencies licensed in a way that is compatible for inclusion under [ASF 2.0](http://www.apache.org/legal/resolved.html#category-a)? *(N/A — no new dependencies)*
- [ ] If applicable, have you updated the `LICENSE`, `LICENSE-binary`, `NOTICE-binary` files? *(N/A)*
### AI Tooling
This contribution was prepared with the assistance of Anthropic Claude Code:
property discovery, classification and description drafting were performed
with its assistance and were reviewed, verified against the source, and
approved by the contributor.
- [x] The PR includes the phrase "Contains content generated by <tool>"
where <tool> is the name of the AI tool used.
- [x] My use of AI contributions follows the ASF legal policy
https://www.apache.org/legal/generative-tooling.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HDFS-11039. Document 42 configuration properties missing from hdfs-default.xml. [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #8637:
URL: https://github.com/apache/hadoop/pull/8637#issuecomment-5107904280
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 12m 29s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | xmllint | 0m 0s | | xmllint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 1 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +1 :green_heart: | mvninstall | 42m 12s | | trunk passed |
| +1 :green_heart: | compile | 1m 48s | | trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | compile | 1m 48s | | trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | checkstyle | 1m 51s | | trunk passed |
| +1 :green_heart: | mvnsite | 1m 56s | | trunk passed |
| +1 :green_heart: | javadoc | 1m 29s | | trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javadoc | 1m 29s | | trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | spotbugs | 4m 13s | | trunk passed |
| +1 :green_heart: | shadedclient | 32m 24s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +1 :green_heart: | mvninstall | 1m 23s | | the patch passed |
| +1 :green_heart: | compile | 1m 16s | | the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javac | 1m 16s | | the patch passed |
| +1 :green_heart: | compile | 1m 20s | | the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javac | 1m 20s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | checkstyle | 1m 15s | | the patch passed |
| +1 :green_heart: | mvnsite | 1m 27s | | the patch passed |
| +1 :green_heart: | javadoc | 1m 1s | | the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javadoc | 1m 1s | | the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | spotbugs | 3m 52s | | the patch passed |
| +1 :green_heart: | shadedclient | 30m 43s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 220m 19s | | hadoop-hdfs in the patch passed. |
| +1 :green_heart: | asflicense | 0m 43s | | The patch does not generate ASF License warnings. |
| | | 364m 4s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/1/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/8637 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle |
| uname | Linux 6b097aa7eca5 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / c82f036ebe356840e6dcf15157eb0ad36e04457e |
| Default Java | Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| Multi-JDK versions | /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/1/testReport/ |
| Max. process+thread count | 3824 (vs. ulimit of 10000) |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/1/console |
| versions | git=2.43.0 maven=3.9.15 spotbugs=4.9.7 |
| Powered by | Apache Yetus 0.14.1 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HDFS-11039. Document 41 configuration properties missing from hdfs-default.xml and update documentation for deprecated properties [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #8637:
URL: https://github.com/apache/hadoop/pull/8637#issuecomment-5232059481
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 0m 35s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | markdownlint | 0m 0s | | markdownlint was not available. |
| +0 :ok: | xmllint | 0m 0s | | xmllint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 1 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 2m 5s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 41m 48s | | trunk passed |
| +1 :green_heart: | compile | 16m 25s | | trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | compile | 16m 30s | | trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | checkstyle | 5m 28s | | trunk passed |
| +1 :green_heart: | mvnsite | 4m 1s | | trunk passed |
| +1 :green_heart: | javadoc | 3m 2s | | trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javadoc | 2m 59s | | trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | spotbugs | 7m 21s | | trunk passed |
| +1 :green_heart: | shadedclient | 32m 24s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 28s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 2m 35s | | the patch passed |
| +1 :green_heart: | compile | 15m 30s | | the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javac | 15m 30s | | the patch passed |
| +1 :green_heart: | compile | 16m 32s | | the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javac | 16m 32s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | checkstyle | 5m 32s | | the patch passed |
| +1 :green_heart: | mvnsite | 3m 58s | | the patch passed |
| +1 :green_heart: | javadoc | 3m 1s | | the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javadoc | 3m 0s | | the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | spotbugs | 7m 43s | | the patch passed |
| +1 :green_heart: | shadedclient | 32m 49s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 23m 29s | | hadoop-common in the patch passed. |
| +1 :green_heart: | unit | 219m 39s | | hadoop-hdfs in the patch passed. |
| +1 :green_heart: | asflicense | 1m 23s | | The patch does not generate ASF License warnings. |
| | | 470m 39s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/4/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/8637 |
| Optional Tests | dupname asflicense mvnsite codespell detsecrets markdownlint compile javac javadoc mvninstall unit shadedclient xmllint spotbugs checkstyle |
| uname | Linux 332dc3952354 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / fa07f9a765dd9e713e645ba4d24d09e95cc5c29f |
| Default Java | Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| Multi-JDK versions | /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/4/testReport/ |
| Max. process+thread count | 3101 (vs. ulimit of 10000) |
| modules | C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/4/console |
| versions | git=2.43.0 maven=3.9.15 spotbugs=4.9.7 |
| Powered by | Apache Yetus 0.14.1 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HDFS-11039. Document 42 configuration properties missing from hdfs-default.xml. [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #8637:
URL: https://github.com/apache/hadoop/pull/8637#issuecomment-5110078289
:broken_heart: **-1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 0m 37s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 1s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 1s | | detect-secrets was not available. |
| +0 :ok: | xmllint | 0m 1s | | xmllint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 1 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +1 :green_heart: | mvninstall | 49m 23s | | trunk passed |
| +1 :green_heart: | compile | 2m 0s | | trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | compile | 2m 10s | | trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | checkstyle | 1m 46s | | trunk passed |
| +1 :green_heart: | mvnsite | 2m 3s | | trunk passed |
| +1 :green_heart: | javadoc | 1m 35s | | trunk passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javadoc | 1m 26s | | trunk passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | spotbugs | 4m 16s | | trunk passed |
| +1 :green_heart: | shadedclient | 36m 1s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +1 :green_heart: | mvninstall | 1m 28s | | the patch passed |
| +1 :green_heart: | compile | 1m 20s | | the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javac | 1m 20s | | the patch passed |
| +1 :green_heart: | compile | 1m 30s | | the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javac | 1m 30s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | checkstyle | 1m 21s | | the patch passed |
| +1 :green_heart: | mvnsite | 1m 37s | | the patch passed |
| +1 :green_heart: | javadoc | 1m 2s | | the patch passed with JDK Ubuntu-21.0.11+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | javadoc | 1m 5s | | the patch passed with JDK Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| +1 :green_heart: | spotbugs | 4m 12s | | the patch passed |
| +1 :green_heart: | shadedclient | 35m 40s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| -1 :x: | unit | 223m 0s | [/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt](https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/2/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt) | hadoop-hdfs in the patch passed. |
| +1 :green_heart: | asflicense | 0m 46s | | The patch does not generate ASF License warnings. |
| | | 372m 12s | | |
| Reason | Tests |
|-------:|:------|
| Failed junit tests | hadoop.hdfs.server.datanode.fsdataset.impl.TestFsVolumeList |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.55 ServerAPI=1.55 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/2/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/8637 |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall mvnsite unit shadedclient codespell detsecrets xmllint spotbugs checkstyle |
| uname | Linux 19b86e7852d8 5.15.0-181-generic #191-Ubuntu SMP Fri May 22 19:09:02 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 7337373f825815964385899deb5610f97b216732 |
| Default Java | Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| Multi-JDK versions | /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.11+10-1-24.04.2-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.19+10-1-24.04.2-Ubuntu |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/2/testReport/ |
| Max. process+thread count | 3329 (vs. ulimit of 10000) |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U: hadoop-hdfs-project/hadoop-hdfs |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/2/console |
| versions | git=2.43.0 maven=3.9.15 spotbugs=4.9.7 |
| Powered by | Apache Yetus 0.14.1 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org
Re: [PR] HDFS-11039. Document 41 configuration properties missing from hdfs-default.xml and update documentation for deprecated properties [hadoop]
Posted by "hadoop-yetus (via GitHub)" <gi...@apache.org>.
hadoop-yetus commented on PR #8637:
URL: https://github.com/apache/hadoop/pull/8637#issuecomment-6268740899
:confetti_ball: **+1 overall**
| Vote | Subsystem | Runtime | Logfile | Comment |
|:----:|----------:|--------:|:--------:|:-------:|
| +0 :ok: | reexec | 13m 16s | | Docker mode activated. |
|||| _ Prechecks _ |
| +1 :green_heart: | dupname | 0m 0s | | No case conflicting files found. |
| +0 :ok: | codespell | 0m 0s | | codespell was not available. |
| +0 :ok: | detsecrets | 0m 0s | | detect-secrets was not available. |
| +0 :ok: | markdownlint | 0m 0s | | markdownlint was not available. |
| +0 :ok: | xmllint | 0m 0s | | xmllint was not available. |
| +1 :green_heart: | @author | 0m 0s | | The patch does not contain any @author tags. |
| +1 :green_heart: | test4tests | 0m 0s | | The patch appears to include 1 new or modified test files. |
|||| _ trunk Compile Tests _ |
| +0 :ok: | mvndep | 1m 52s | | Maven dependency ordering for branch |
| +1 :green_heart: | mvninstall | 43m 7s | | trunk passed |
| +1 :green_heart: | compile | 16m 34s | | trunk passed with JDK Ubuntu-21.0.12.1+1-1-24.04.4-Ubuntu |
| +1 :green_heart: | compile | 16m 52s | | trunk passed with JDK Ubuntu-17.0.20.1+1-1-24.04-Ubuntu |
| +1 :green_heart: | checkstyle | 5m 39s | | trunk passed |
| +1 :green_heart: | mvnsite | 4m 4s | | trunk passed |
| +1 :green_heart: | javadoc | 3m 5s | | trunk passed with JDK Ubuntu-21.0.12.1+1-1-24.04.4-Ubuntu |
| +1 :green_heart: | javadoc | 3m 4s | | trunk passed with JDK Ubuntu-17.0.20.1+1-1-24.04-Ubuntu |
| +1 :green_heart: | spotbugs | 7m 26s | | trunk passed |
| +1 :green_heart: | shadedclient | 32m 26s | | branch has no errors when building and testing our client artifacts. |
|||| _ Patch Compile Tests _ |
| +0 :ok: | mvndep | 0m 27s | | Maven dependency ordering for patch |
| +1 :green_heart: | mvninstall | 2m 37s | | the patch passed |
| +1 :green_heart: | compile | 15m 39s | | the patch passed with JDK Ubuntu-21.0.12.1+1-1-24.04.4-Ubuntu |
| +1 :green_heart: | javac | 15m 39s | | the patch passed |
| +1 :green_heart: | compile | 16m 41s | | the patch passed with JDK Ubuntu-17.0.20.1+1-1-24.04-Ubuntu |
| +1 :green_heart: | javac | 16m 41s | | the patch passed |
| +1 :green_heart: | blanks | 0m 0s | | The patch has no blanks issues. |
| +1 :green_heart: | checkstyle | 5m 34s | | the patch passed |
| +1 :green_heart: | mvnsite | 4m 3s | | the patch passed |
| +1 :green_heart: | javadoc | 3m 3s | | the patch passed with JDK Ubuntu-21.0.12.1+1-1-24.04.4-Ubuntu |
| +1 :green_heart: | javadoc | 3m 6s | | the patch passed with JDK Ubuntu-17.0.20.1+1-1-24.04-Ubuntu |
| +1 :green_heart: | spotbugs | 7m 48s | | the patch passed |
| +1 :green_heart: | shadedclient | 32m 45s | | patch has no errors when building and testing our client artifacts. |
|||| _ Other Tests _ |
| +1 :green_heart: | unit | 24m 2s | | hadoop-common in the patch passed. |
| +1 :green_heart: | unit | 223m 22s | | hadoop-hdfs in the patch passed. |
| +1 :green_heart: | asflicense | 1m 28s | | The patch does not generate ASF License warnings. |
| | | 490m 44s | | |
| Subsystem | Report/Notes |
|----------:|:-------------|
| Docker | ClientAPI=1.56 ServerAPI=1.56 base: https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/5/artifact/out/Dockerfile |
| GITHUB PR | https://github.com/apache/hadoop/pull/8637 |
| Optional Tests | dupname asflicense mvnsite codespell detsecrets markdownlint compile javac javadoc mvninstall unit shadedclient xmllint spotbugs checkstyle |
| uname | Linux f8e6f29bf88f 5.15.0-190-generic #200-Ubuntu SMP Fri Aug 7 15:06:04 UTC 2026 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | dev-support/bin/hadoop.sh |
| git revision | trunk / 4200836649b015e38a266d53f67a8a0a23e0d52d |
| Default Java | Ubuntu-17.0.20.1+1-1-24.04-Ubuntu |
| Multi-JDK versions | /usr/lib/jvm/java-21-openjdk-amd64:Ubuntu-21.0.12.1+1-1-24.04.4-Ubuntu /usr/lib/jvm/java-17-openjdk-amd64:Ubuntu-17.0.20.1+1-1-24.04-Ubuntu |
| Test Results | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/5/testReport/ |
| Max. process+thread count | 3383 (vs. ulimit of 10000) |
| modules | C: hadoop-common-project/hadoop-common hadoop-hdfs-project/hadoop-hdfs U: . |
| Console output | https://ci-hadoop.apache.org/job/hadoop-multibranch/job/PR-8637/5/console |
| versions | git=2.43.0 maven=3.9.15 spotbugs=4.9.7 |
| Powered by | Apache Yetus 0.14.1 https://yetus.apache.org |
This message was automatically generated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org