You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "JunRuiLee (via GitHub)" <gi...@apache.org> on 2026/05/20 10:04:27 UTC

[PR] [python] Implement partition expiration for pypaimon [paimon]

JunRuiLee opened a new pull request, #7918:
URL: https://github.com/apache/paimon/pull/7918

   ## Purpose
   
     Add pypaimon support for expiring partitions based on table options and CLI overrides, matching the Java partition expiration behavior for `values-time` and `update-time` strategies.
   
     This includes:
     - Partition expiration orchestration for `FileStoreTable`.
     - Partition entry discovery from manifest metadata.
     - Time extraction from partition values.
     - Java `DateTimeFormatter`-style timestamp formatter support.
     - `table expire-partitions` CLI command.
     - Partition expiration options in Python `CoreOptions`.
     - Null partition handling via `partition.default-name`.
     - Default `partition.expiration-max-num=100`.
   
     ## Tests
   
     Added `paimon-python/pypaimon/tests/partition_expire_test.py` covering:
     - Extracting partition time from simple date and timestamp values.
     - Extracting time with timestamp patterns across multiple partition fields.
     - Java formatter conversion cases like `yyyyMMdd`.
     - Selecting expired partitions with `values-time`.
     - Selecting expired partitions with `update-time`.
     - Skipping unparseable partition values.
     - Respecting expiration check interval.
     - Respecting max expire count.
     - Empty partition lists.
     - Unconfigured expiration.
     - Non-partitioned tables.
     - Duration parsing for days, hours, minutes, seconds, milliseconds, and combined durations.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [python] Implement partition expiration for pypaimon [paimon]

Posted by "JunRuiLee (via GitHub)" <gi...@apache.org>.
JunRuiLee closed pull request #7918: [python] Implement partition expiration for pypaimon
URL: https://github.com/apache/paimon/pull/7918


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [python] Implement partition expiration for pypaimon [paimon]

Posted by "JunRuiLee (via GitHub)" <gi...@apache.org>.
JunRuiLee commented on PR #7918:
URL: https://github.com/apache/paimon/pull/7918#issuecomment-4526112216

   Thanks @JingsongLi for the review, I've addressed all comments. PTAL~


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org