You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Alexander Preuss (Jira)" <ji...@apache.org> on 2022/02/21 13:24:00 UTC

[jira] [Created] (FLINK-26281) Test Elasticsearch connector End2End

Alexander Preuss created FLINK-26281:
----------------------------------------

             Summary: Test Elasticsearch connector End2End
                 Key: FLINK-26281
                 URL: https://issues.apache.org/jira/browse/FLINK-26281
             Project: Flink
          Issue Type: Improvement
          Components: Connectors / ElasticSearch
    Affects Versions: 1.15.0
            Reporter: Alexander Preuss


Feature introduced in https://issues.apache.org/jira/browse/FLINK-24323


As 1.15 deprecated the SinkFunction-based Elasticsearch connector and introduces the new connector based on the Sink interface we should test it behaves correctly and as the user expects.

 

Some suggestions what to test:
 * Test delivery guarantees (none, at-least-once) (exactly-once should not run)
 * Write a simple job that is inserting/upserting data into Elasticsearch
 * Write a simple job that is inserting/upserting data into Elasticsearch and use a non-default parallelism
 * Write a simple job in both datastream api and table api
 * Test restarting jobs and scaling up/down
 * Test against Elasticsearch 6.X and 7.X with the respective connectors

When testing please also consider the following things:
 - Is the documentation easy to understand
 - Are the error messages, log messages, APIs etc. easy to understand
 - Is the feature working as expected under normal conditions
 - Is the feature working / failing as expected with invalid input, induced errors etc.
 -  

If you find a problem during testing, please file a ticket and link it in this testing ticket.
During the testing, and once you are finished, please write a short summary of all things you have tested.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)