[jira] [Created] (GOBBLIN-1384) Fix task cancellation to ensure task commit is invoked only after task completes

["Sudarshan Vasudevan (Jira)" <ji...@apache.org>]

Sudarshan Vasudevan created GOBBLIN-1384:
--------------------------------------------

             Summary: Fix task cancellation to ensure task commit is invoked only after task completes
                 Key: GOBBLIN-1384
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1384
             Project: Apache Gobblin
          Issue Type: Bug
          Components: gobblin-core
    Affects Versions: 0.16.0
            Reporter: Sudarshan Vasudevan
            Assignee: Abhishek Tiwari
             Fix For: 0.16.0


Per the current behavior, the task is marked as completed as soon as task cancellation is invoked, which interrupts the task, and immediately decrements a latch counting the number of running tasks. This implies that GobblinMultiTaskAttempt which monitors this countdown latch, can invoke task commit before the task has completed. This can lead to incorrect behavior in batch mode and potential resource leak in the streaming mode where commit failures potentially leaves some resources open.  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)