You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@samza.apache.org by fredji97 <gi...@git.apache.org> on 2017/03/27 22:29:17 UTC
[GitHub] samza pull request #97: SAMZA-1143 Include fs..impl.* subkeys to Yar...
GitHub user fredji97 opened a pull request:
https://github.com/apache/samza/pull/97
SAMZA-1143 Include fs.<scheme>.impl.* subkeys to YarnConfiguration used in YarnJobFactory and YarnClusterResourceManager
SAMZA-1143 Include fs.<scheme>.impl.* subkeys, in addition to fs.<scheme>.impl, to YarnConfiguration used in YarnJobFactory and YarnClusterResourceManager.
When there are additional subconfigurations under fs.myScheme.impl, such as fs.myScheme.impl.client, we need to keep the set of configuration completed in YarnJobFactory and YarnClusterResourceManager. When the context is set for localizing the resource in ClientHelper and YarnContainerRunner, it may rely on this configuration to get the FileStatus information, which may or may not depends on fs.<scheme>.impl and all possible fs.<scheme>.impl.* sub-configuration.
This is an enhanced feature to the PR#90.
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/fredji97/samza fsImplSubkeys
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/samza/pull/97.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #97
----
commit 988d43573656c7d795b251c824c7fad3c6f5d9f3
Author: Fred Ji <fj...@linkedin.com>
Date: 2017-03-27T22:19:26Z
SAMZA-1143 Copy fs.<scheme>.impl.* subkeys, in addition to fs.<scheme>.impl, to YarnConfiguration used in YarnJobFactory and YarnClusterResourceManager. When there are additional subconfigurations under fs.<scheme>.impl, such as fs.<scheme>.impl.client, we need to keep the set of configuration completed.
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] samza pull request #97: SAMZA-1143 Include fs..impl.* subkeys to Yar...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/samza/pull/97
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---