You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ozone.apache.org by "Andrey Yarovoy (Jira)" <ji...@apache.org> on 2026/10/12 17:57:00 UTC

[jira] [Assigned] (HDDS-16946) Remove the per-call InfoBucket from rooted-ofs isFileClosed and recoverLease

     [ https://issues.apache.org/jira/browse/HDDS-16946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrey Yarovoy reassigned HDDS-16946:
-------------------------------------

    Assignee: Andrey Yarovoy

> Remove the per-call InfoBucket from rooted-ofs isFileClosed and recoverLease
> ----------------------------------------------------------------------------
>
>                 Key: HDDS-16946
>                 URL: https://issues.apache.org/jira/browse/HDDS-16946
>             Project: Apache Ozone
>          Issue Type: Improvement
>          Components: OM
>            Reporter: Andrey Yarovoy
>            Assignee: Andrey Yarovoy
>            Priority: Major
>
> `BasicRootedOzoneClientAdapterImpl.isFileClosed` and `recoverFilePrepare` call `getBucket()` before their real RPC. That is an `InfoBucket` (plus `InfoVolume` + `InfoBucket` per link hop). The fetch does one job:
> `OzoneFSUtils.validateBucketLayout`, which throws `IllegalArgumentException` for OBJECT_STORE. Neither
> site reads anything else from the returned `OzoneBucket`, apart from volume and bucket names it already
> has. These are the hsync paths: HBase calls `isFileClosed` while it waits for lease recovery, and `recoverLease` on region server failover.
> * **isFileClosed** issues `GetFileStatus` (`OzoneBucket.getFileStatus` → `ClientProtocol.getOzoneFileStatus`,
> headOp=false). `OmMetadataReader.getFileStatus` has rejected OBJECT_STORE with `NOT_SUPPORTED_OPERATION`
> unconditionally since HDDS-15925 (`OzoneManagerVersion.GET_FILE_STATUS_REJECTS_OBS`, 14). There, the
> layout comes from `ResolvedBucket`, so links are resolved.
> * **recoverLease** issues `RecoverLease`. `OzoneManagerRatisUtils.createClientRequest` looks up the
> link-resolved layout and rejects every non-FSO bucket (LEGACY too) before Ratis, with
> "Bucket ... is not FSO layout. It does not support lease recovery". This check dates from HDDS-7769
> (2023). `RpcClient.recoverLease` refuses to send the RPC at all unless the OM is at least
> `HBASE_SUPPORT` (7), which was added in 2024. So every OM that can receive this RPC already has the check.
> ### Proposed change
> *isFileClosed.* When `proxy.getOmVersion() >= GET_FILE_STATUS_REJECTS_OBS`, call
> `proxy.getOzoneFileStatus(volume, bucket, key, false)` directly, the same way HDDS-15925 changed
> `getFileStatus`. Map `NOT_SUPPORTED_OPERATION` to `IllegalArgumentException`. Against an older OM keep the
> current `getBucket()` path.
> Keep the `isSnapshotPath()` check before the RPC. Today it runs after `getBucket()`, so a snapshot path in
> a missing bucket reports `FileNotFoundException`, and after the change it reports "file is in a
> snapshot". Either keep that order (cheap: the snapshot path check is local) or call the difference out
> in the PR.
> *recoverLease.* Drop the `getBucket()` and pass `ofsPath.getVolumeName()` / `getBucketName()`. Those are
> the names `bucket.getVolumeName()` / `getName()` return today, because the link handle carries the
> link's own names.
> The one behaviour change is the exception type for an OBJECT_STORE bucket. Today the client throws
> `IllegalArgumentException` before any RPC. Without the fetch, OM's plain `IOException` reaches the
> client as `OMException(INTERNAL_ERROR)`. To keep the exception type unchanged, follow the HDDS-16760
> pattern:
> * OM throws `OMException(NOT_SUPPORTED_OPERATION)` instead of `IOException`, with the same message.
> * Add a new `OzoneManagerVersion` constant, placed after `LIST_STATUS_REJECTS_OBS(101)`. The number is
> assigned at merge; coordinate it with sibling Jiras.
> * At or above that version the client skips `getBucket()` and maps `NOT_SUPPORTED_OPERATION` to
> `IllegalArgumentException`. Below it the client keeps `getBucket()`.
> LEGACY buckets behave as before: the client never rejected them, and OM rejects them under either code.
> ### Compatibility
> | | isFileClosed | recoverLease |
> |---|---|---|
> | New client, OM ≥ new constant | 1 RPC, OBS → `IllegalArgumentException` | 1 RPC, OBS → `IllegalArgumentException` |
> | New client, older OM | 1 RPC for OM ≥ 14; `getBucket()` path below | `getBucket()` path, unchanged |
> | Old client, new OM | unchanged | unchanged, except LEGACY now gets `NOT_SUPPORTED_OPERATION` instead of `INTERNAL_ERROR` |
> There is no protobuf change and no new configuration.
> Point for review: dropping the fetch drops the BUCKET/READ ACL check that `getBucketDetails` performed.
> `GetFileStatus` and `RecoverLease` keep their own key-level ACL checks, and OM checks READ on each link
> bucket it follows, which is the same trade-off accepted in HDDS-15925 and HDDS-16760.
> ## Testing
> * Adapter (Mockito partial mock, like `TestBasicRootedOzoneClientAdapterHeadOp`):
> * Both operations issue exactly one OM call and no `getBucket()`.
> *`NOT_SUPPORTED_OPERATION` → `IllegalArgumentException`.
> *`FILE_NOT_FOUND` / `KEY_NOT_FOUND` / `BUCKET_NOT_FOUND` keep today's `FileNotFoundException` mapping.
> * An older OM falls back to `getBucket()`, including an OM that reports `ZDU` for recoverLease.
> * OM: `TestOMRecoverLeaseRequest` (or the `createClientRequest` test) asserts `NOT_SUPPORTED_OPERATION`
> for OBJECT_STORE and LEGACY, and success for FSO.
> * `AbstractRootedOzoneFileSystemTest`: `isFileClosed` / `recoverLease` on an OBJECT_STORE bucket still fail
> with `IllegalArgumentException`. Assert the RPC-count property in the adapter test, not by OMMetrics
> deltas. OMMetrics is cluster-global and the trash emptier moves it (HDDS-16513).
> * Benchmark: the cost of these calls is too low and they are too rare to be worth a dedicated
> benchmark. The RPC count goes from 2 to 1 per call, and the adapter test asserts it exactly.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ozone.apache.org
For additional commands, e-mail: issues-help@ozone.apache.org