[GitHub] [iceberg] stevenzwu commented on issue #2108: Flink: store watermark as iceberg table's property.

[GitBox <gi...@apache.org>]

stevenzwu commented on issue #2108:
URL: https://github.com/apache/iceberg/issues/2108#issuecomment-1223091861

   There are generally two ways. Interesting to get inputs from the community.
   
   * Publish Flink watermark as a snapshot metadata field or table property
       * Pro: reuse Flink watermark concept. might seems more natural.
       * Con: Is the Flink watermark always a good completion signal for the Iceberg table?
   * Extract watermark signal using min-max column stats for the timestamp column that is used to compute the table partitions.
       * Pro: compute the watermark based on the timestamp field used for table partition
       * Con: maybe a bit more complex to implement and to users
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org