You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Danny Cranmer (Jira)" <ji...@apache.org> on 2021/09/30 15:56:00 UTC

[jira] [Created] (FLINK-24431) [Kinesis][EFO] EAGER registration strategy does not work when job fails over

Danny Cranmer created FLINK-24431:
-------------------------------------

             Summary: [Kinesis][EFO] EAGER registration strategy does not work when job fails over
                 Key: FLINK-24431
                 URL: https://issues.apache.org/jira/browse/FLINK-24431
             Project: Flink
          Issue Type: Bug
          Components: Connectors / Kinesis
    Affects Versions: 1.13.2, 1.12.5, 1.14.0
            Reporter: Danny Cranmer
             Fix For: 1.12.6, 1.13.3, 1.15.0, 1.14.1


*Background*
The EFO Kinesis connector will register and de-register stream consumers based on the configured [registration strategy|https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/connectors/datastream/kinesis/#efo-stream-consumer-registrationderegistration]. When {{EAGER}} is used, the client (usually job manager) will register the consumer and then the task managers will de-register the consumer when job stops/fails. If the job is configured to restart on fail, then the consumer will not exist and the job will continuously fail over.

*Solution*
The proposal is to not deregister the stream consumer when {{EAGER}} is used. The documentation should be updated to reflect this.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)