You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Tawfek Yasser Tawfek <TY...@nu.edu.eg> on 2022/11/14 12:00:57 UTC

Understanding the Internals of Watermark Generation | Actual Implementation

Dear Flink Developers,

Hope all is well,

I'm trying to understand how flink in runtime generates and emits watermarks,
I think that the TimestampsAndWatermarksOperator class is responsible for assigning timestamps and generating watermarks actually,
based on the specified watermark strategy in the DataStream API.

If this is correct, please how could I understand how this operator works, else can you please guide me on where should I work to understand the watermark generation process?

Thank you so much.


Best Regards.


[https://lh6.googleusercontent.com/gwaS1SR2iejRdgnwu7EZRmqp6XnYEdkf8nLoDs1YqEyXL9tgDMhRXCUfIidQwgSw5RpwcIl1i9r-A2ks6tQTTxZVens5XUI9lULU21NL1pZqJ19BcHtIdV3ACHtNZnVzgNNn4prfiaohFmfDmvlZy1fXwfHhycJDietmyqjJ3JbmQ6GCGw2xEYifvg]

      [https://lh4.googleusercontent.com/-Alfe_t6TtKrNqUPaVDM0mPuwlKVUeZmK5n-jTDJKo70dgD8OXsNSmPv3PbkEMH-1iHoxiIuz_czeq1CkpSPdxmFbKZkRCt5YZktDRrfvUS5s9QnfqByTfVPZc8NqMqeV3sbdnyTIhuBqRPRWxOnCh9ZYncxZWSOXFLy04JXhT8jfaoVrRO4AUk3Yg] <http://linkedin.com/in/tawfikyasser>

 Tawfik Yasser

 Teaching Assistant, Nile University | M.Sc. INF

 Artificial Intelligence Program, ITCS

 26th of July Corridor, Sheikh Zayed City, Giza, Egypt

 www.nu.edu.eg<http://www.nu.edu.eg>