You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Tzu-Li (Gordon) Tai (JIRA)" <ji...@apache.org> on 2018/05/09 09:34:00 UTC

[jira] [Created] (FLINK-9322) Add exception throwing map function that simulates failures to the general purpose DataStream job

Tzu-Li (Gordon) Tai created FLINK-9322:
------------------------------------------

             Summary: Add exception throwing map function that simulates failures to the general purpose DataStream job
                 Key: FLINK-9322
                 URL: https://issues.apache.org/jira/browse/FLINK-9322
             Project: Flink
          Issue Type: Sub-task
          Components: Tests
            Reporter: Tzu-Li (Gordon) Tai
            Assignee: Tzu-Li (Gordon) Tai


The general purpose DataStream job currently does not have any functionality to simulate user job failures.

We can achieve this by:
- Adding a simple-pass map function, that throws exceptions after a certain criteria is met
- To allow for the end-to-end tests that we have in mind, criteria could be to fail after 1) processing X records, and 2) Y completed checkpoints (see FLINK-8977)

- We should also allow specifying how many times to fail. Some chaos monkey tests (see FLINK-8973) would need to continuously fail several times, while FLINK-8977, for example, only needs to fail once.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)