You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Tudor Plugaru (Jira)" <ji...@apache.org> on 2023/05/08 08:40:00 UTC

[jira] [Updated] (FLINK-32028) Error handling for ElasticSearch sink

     [ https://issues.apache.org/jira/browse/FLINK-32028?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tudor Plugaru updated FLINK-32028:
----------------------------------
    Description: 
The deprecated ElasticsearchSink supports setting an error handler via a [public method |https://github.com/apache/flink-connector-elasticsearch/blob/8f75d4e059c09b55cc3a44bab3e64330b1246d27/flink-connector-elasticsearch7/src/main/java/org/apache/flink/streaming/connectors/elasticsearch7/ElasticsearchSink.java#L216] but the new sink, does not.

Ideally there would be a way to handle ES specific exceptions and be able to skip items from being retried on ES indefinitely and not block entirely the pipeline.  

  was:
The deprecated ElasticsearchSink supports setting an error handler via a [public method |[https://github.com/apache/flink-connector-elasticsearch/blob/8f75d4e059c09b55cc3a44bab3e64330b1246d27/flink-connector-elasticsearch7/src/main/java/org/apache/flink/streaming/connectors/elasticsearch7/ElasticsearchSink.java#L216],] but the new sink, does not.

Ideally there would be a way to handle ES specific exceptions and be able to skip items from being retried on ES indefinitely and not block entirely the pipeline.  


> Error handling for ElasticSearch sink
> -------------------------------------
>
>                 Key: FLINK-32028
>                 URL: https://issues.apache.org/jira/browse/FLINK-32028
>             Project: Flink
>          Issue Type: Improvement
>          Components: Connectors / ElasticSearch
>    Affects Versions: 1.16.1
>            Reporter: Tudor Plugaru
>            Priority: Major
>
> The deprecated ElasticsearchSink supports setting an error handler via a [public method |https://github.com/apache/flink-connector-elasticsearch/blob/8f75d4e059c09b55cc3a44bab3e64330b1246d27/flink-connector-elasticsearch7/src/main/java/org/apache/flink/streaming/connectors/elasticsearch7/ElasticsearchSink.java#L216] but the new sink, does not.
> Ideally there would be a way to handle ES specific exceptions and be able to skip items from being retried on ES indefinitely and not block entirely the pipeline.  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)