You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Hung Tran (JIRA)" <ji...@apache.org> on 2017/11/09 17:50:00 UTC

[jira] [Created] (GOBBLIN-310) Skip rerunning completed tasks on mapper reattempts

Hung Tran created GOBBLIN-310:
---------------------------------

             Summary: Skip rerunning completed tasks on mapper reattempts
                 Key: GOBBLIN-310
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-310
             Project: Apache Gobblin
          Issue Type: Bug
            Reporter: Hung Tran


Subsequent executions of a failed mapper will rerun completed tasks. This can result in duplicate data or errors due to collisions when publishing.

The state of completed mappers should be recorded and completed mappers should be skipped on subsequent attemps.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)