You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2022/03/01 12:07:00 UTC

[jira] [Created] (FLINK-26423) Integrate log store to StoreSink

Jingsong Lee created FLINK-26423:
------------------------------------

             Summary: Integrate log store to StoreSink
                 Key: FLINK-26423
                 URL: https://issues.apache.org/jira/browse/FLINK-26423
             Project: Flink
          Issue Type: Sub-task
          Components: Table Store
            Reporter: Jingsong Lee
            Assignee: Jingsong Lee
             Fix For: table-store-0.1.0


StoreSink is a hybrid sink. We need:
 * Introduce LocalCommitterOperator, kafka can only use the same produceId when committing, because starting multiple instances of a producer with a single produceId is not allowed by the kafka server. So we have to reuse the producer instance within the same process to commit.
 * Committable can not be serialized, Kafka reuses producer instance in Committable. and where the producer will not be serialized.
 * Integrate log store to StoreSink.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)