You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@fluss.apache.org by "luoyuxia (via GitHub)" <gi...@apache.org> on 2026/09/17 07:05:22 UTC
[I] [Paimon] Use unique commit users for lake tiering commits [fluss]
luoyuxia opened a new issue, #4396:
URL: https://github.com/apache/fluss/issues/4396
### Search before asking
- [x] I searched in the [issues](https://github.com/apache/fluss/issues) and found nothing similar.
### Description
The Paimon lake tiering committer currently uses the fixed commit user `__fluss_lake_tiering` for every commit:
```java
fileStoreTable.newCommit(FLUSS_LAKE_TIERING_COMMIT_USER);
```
Paimon expects each committer instance to use a unique commit user. Reusing the same user across committer instances can interfere with Paimon's commit identification and recovery semantics.
Update the Paimon integration so that each committer uses a unique user derived from the Fluss prefix, for example:
```text
__fluss_lake_tiering__<UUID>
```
Paimon provides `CoreOptions.COMMIT_USER_PREFIX` (`commit.user-prefix`) for this purpose and appends a UUID to the configured prefix. The Fluss Paimon table copy should set this option and use the generated commit user when creating or aborting a commit.
The recovery path must also be updated. `getMissingLakeSnapshot` currently finds Fluss snapshots by checking whether `snapshot.commitUser()` exactly equals `__fluss_lake_tiering`. After commit users become unique, it should recognize commit users by the Fluss prefix while preserving compatibility with snapshots written using the old fixed user.
Add tests covering:
- different Paimon committer instances use different commit users;
- generated commit users carry the Fluss lake-tiering prefix;
- missing-snapshot recovery recognizes the new prefixed users;
- snapshots written with the legacy fixed user remain discoverable.
### Willingness to contribute
- [ ] I'm willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Paimon] Use unique commit users for lake tiering commits [fluss]
Posted by "luoyuxia (via GitHub)" <gi...@apache.org>.
luoyuxia commented on issue #4396:
URL: https://github.com/apache/fluss/issues/4396#issuecomment-5710436898
cc @fhan688
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Paimon] Use unique commit users for lake tiering commits [fluss]
Posted by "luoyuxia (via GitHub)" <gi...@apache.org>.
luoyuxia closed issue #4396: [Paimon] Use unique commit users for lake tiering commits
URL: https://github.com/apache/fluss/issues/4396
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Paimon] Use unique commit users for lake tiering commits [fluss]
Posted by "fhan688 (via GitHub)" <gi...@apache.org>.
fhan688 commented on issue #4396:
URL: https://github.com/apache/fluss/issues/4396#issuecomment-5724374366
> cc [@fhan688](https://github.com/fhan688)
Thanks! Please assign to me
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@fluss.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org