You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@gobblin.apache.org by "Matthew Ho (Jira)" <ji...@apache.org> on 2022/08/22 14:48:00 UTC

[jira] [Created] (GOBBLIN-1684) Interface / Stub for HDFS Writer for Dynamic Work Unit Allocation Communication

Matthew Ho created GOBBLIN-1684:
-----------------------------------

             Summary: Interface / Stub for HDFS Writer for Dynamic Work Unit Allocation Communication
                 Key: GOBBLIN-1684
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-1684
             Project: Apache Gobblin
          Issue Type: New Feature
            Reporter: Matthew Ho


As part of the initial implementation for Helix Dynamic Workunit Allocation, the application master and task runners will communicate via HDFS by writing to a path and then the task runner needs to poll that path for new files



--
This message was sent by Atlassian Jira
(v8.20.10#820010)