You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@iceberg.apache.org by "lintingbin2009 (via GitHub)" <gi...@apache.org> on 2023/03/10 04:03:21 UTC

[GitHub] [iceberg] lintingbin2009 commented on issue #4190: flink:FlinkSink support dynamically changed schema

lintingbin2009 commented on issue #4190:
URL: https://github.com/apache/iceberg/issues/4190#issuecomment-1463221550

   @leichangqing You can refer to the last two commits of my branch https://github.com/lintingbin2009/iceberg/tree/flink-sink-dynamically-change. We have put this part of the code in our own production environment and executed it for half a year, and it seems that there is no problem so far.
   <img width="1125" alt="image" src="https://user-images.githubusercontent.com/5699014/224219390-eac0d0e2-1578-44d8-a6d5-6ba97362e02e.png">
   Corresponding to 1, 2, 3 in the above picture, you need to prepare:
   1. There needs to be a broadcast node that can subscribe to your schema changes.
   2. The data processing node can generate RowData according to the latest schema processing data.
   3. This is based on the above code modification so that the iceberg writer node can receive the latest schema and apply it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org