You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Sudarshan Vasudevan (Jira)" <ji...@apache.org> on 2021/01/27 02:02:00 UTC

[jira] [Created] (GOBBLIN-1374) Generate a unique staging path in FS SpecProducer for writing job specs

Sudarshan Vasudevan created GOBBLIN-1374:
--------------------------------------------

             Summary: Generate a unique staging path in FS SpecProducer for writing job specs  
                 Key: GOBBLIN-1374
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1374
             Project: Apache Gobblin
          Issue Type: Improvement
          Components: gobblin-cluster
    Affects Versions: 0.16.0
            Reporter: Sudarshan Vasudevan
            Assignee: Hung Tran
             Fix For: 0.16.0


Current implementation writes the job specs to a fixed staging location before the specs get renamed to a final publish location. To avoid concurrent producers writing to the same file, we generate a unique staging location. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)