You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "JingsongLi (via GitHub)" <gi...@apache.org> on 2023/07/18 08:07:36 UTC

[GitHub] [incubator-paimon] JingsongLi opened a new pull request, #1588: [core] Automatic Creation for tags

JingsongLi opened a new pull request, #1588:
URL: https://github.com/apache/incubator-paimon/pull/1588

   <!-- Please specify the module before the PR name: [core] ... or [flink] ... -->
   
   ### Purpose
   
   <!-- Linking this pull request to the issue -->
   Paimon supports automatic creation of tags in writing job.
   
   **Option 1: Choose Creation Mode**
   
   You can set `'tag.automatic-creation'` to `process-time` or `watermark`:
   - `process-time`: Create TAG based on the time of the machine.
   - `watermark`: Create TAG based on the watermark of the Sink input.
   
   If you choose Watermark, you may need to specify the time zone of watermark, if watermark is not in the
   UTC time zone, please configure `'sink.watermark-time-zone'`.
   
   **Option 2: Choose Creation Period**
   
   What frequency is used to generate tags. You can choose `'daily'`, `'hourly'` and `'two-hours'` for `'tag.creation-period'`.
   
   If you need to wait for late data, you can configure a delay time: `'tag.creation-delay'`.
   
   **Option 3: Automatic deletion of tags**
   
   You can configure `'tag.num-retained-max'` to delete tags automatically.
   
   <!-- What is the purpose of the change -->
   
   ### Tests
   
   <!-- List UT and IT cases to verify this change -->
   
   ### API and Format
   
   <!-- Does this change affect API or storage format -->
   
   ### Documentation
   
   <!-- Does this change introduce a new feature -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-paimon] JingsongLi merged pull request #1588: [core] Automatic Creation for tags

Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #1588:
URL: https://github.com/apache/incubator-paimon/pull/1588


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org