You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@gobblin.apache.org by "Jin Hyuk Chang (JIRA)" <ji...@apache.org> on 2017/09/12 23:05:00 UTC

[jira] [Created] (GOBBLIN-251) Having UpdateProviderFactory able to instantiate FileSystem with URI

Jin Hyuk Chang created GOBBLIN-251:
--------------------------------------

             Summary: Having UpdateProviderFactory able to instantiate FileSystem with URI
                 Key: GOBBLIN-251
                 URL: https://issues.apache.org/jira/browse/GOBBLIN-251
             Project: Apache Gobblin
          Issue Type: Improvement
            Reporter: Jin Hyuk Chang


Having UpdateProviderFactory able to instantiate FileSystem with URI.
Use case: We can pass specific file system URI to HiveSource where the only way we can use same file system uri on HdfsBasedUpdateProvider currently is to pass default filesystem uri into job property where this can break behavior of other instances that uses FileSystem.

Same as what HiveSource did, UpdateProviderFactory will accept "hive.unit.updateProvider.fs.uri" to instantiate FileSystem where it not given it will fallback to previous logic.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)