You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@gobblin.apache.org by ap...@gmail.com on 2019/04/13 02:49:06 UTC

Apache Gobblin Gitter messages at 2019/04/12 19:49:02

####  ![](https://avatars2.githubusercontent.com/u/5017402?v=4&s=60) Jay Sen
(jhsenjaliya)

**[2019-04-12T22:15:47.025Z]** Hi, i m seeing that even though fs.uri=
"file:///" it gets the hdfs FileSystem probably because i have HADOOP_HOME is
set and hadoop config is getting picked up. is that right or I m missing
something here ?

* * *

####  ![](https://avatars2.githubusercontent.com/u/5017402?v=4&s=60) Jay Sen
(jhsenjaliya)

**[2019-04-12T22:16:19.109Z]** for ex: this line `this.jobConfDirFileSystem =
this.jobConfDirPath.getFileSystem(new Configuration());` should get local file
system when fs.uri is set to "file:///" right?

* * *

####  ![](https://avatars2.githubusercontent.com/u/5017402?v=4&s=60) Jay Sen
(jhsenjaliya)

**[2019-04-12T22:27:48.353Z]** basically we are using hadooo configuration
class to get the utilmate configs and `Configuration.get(name="fs.defaultFS",
defaultValue="file:///")` will always get fs.defaultFS from `core-site.xml`
since that is in the classpath.

* * *

####  ![](https://avatars2.githubusercontent.com/u/5017402?v=4&s=60) Jay Sen
(jhsenjaliya)

**[2019-04-12T22:28:13.342Z]** can somebody please verify and tell if there is
a way to enforce FileSystem to be local ( basically use`fs.uri` from gobblin
config) ? Thanks

* * *