You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Zichen Liu (Jira)" <ji...@apache.org> on 2022/01/24 19:07:00 UTC

[jira] [Created] (FLINK-25792) Async Sink Base is too being flushed too frequently resulting in backpressure even when buffer is near empty

Zichen Liu created FLINK-25792:
----------------------------------

             Summary: Async Sink Base is too being flushed too frequently resulting in backpressure even when buffer is near empty
                 Key: FLINK-25792
                 URL: https://issues.apache.org/jira/browse/FLINK-25792
             Project: Flink
          Issue Type: New Feature
          Components: Connectors / Kinesis
            Reporter: Zichen Liu
            Assignee: Ahmed Hamdy
             Fix For: 1.15.0


h2. Motivation

*User stories:*
As a Flink user, I’d like to use the Table API for the new Kinesis Data Streams  sink.

*Scope:*
 * Introduce {{AsyncDynamicTableSink}} that enables Sinking Tables into Async Implementations.
 * Implement a new {{KinesisDynamicTableSink}} that uses {{KinesisDataStreamSink}} Async Implementation and implements {{{}AsyncDynamicTableSink{}}}.
 * The implementation introduces Async Sink configurations as optional options in the table definition, with default values derived from the {{KinesisDataStream}} default values.
 * Unit/Integration testing. modify KinesisTableAPI tests for the new implementation, add unit tests for {{AsyncDynamicTableSink}} and {{KinesisDynamicTableSink}} and {{{}KinesisDynamicTableSinkFactory{}}}.
 * Java / code-level docs.

h2. References

More details to be found [https://cwiki.apache.org/confluence/display/FLINK/FLIP-171%3A+Async+Sink]



--
This message was sent by Atlassian Jira
(v8.20.1#820001)