You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@samza.apache.org by "Chris Riccomini (JIRA)" <ji...@apache.org> on 2013/10/23 20:31:45 UTC
[jira] [Updated] (SAMZA-63) Wrong package path for HttpFileSystem
is hard coded
[ https://issues.apache.org/jira/browse/SAMZA-63?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Riccomini updated SAMZA-63:
---------------------------------
Attachment: SAMZA-63.0.patch
Attaching a fix.
https://reviews.apache.org/r/14879/
Verified that the patch yields a path of:
{noformat}
org.apache.samza.util.hadoop.HttpFileSystem
{noformat}
> Wrong package path for HttpFileSystem is hard coded
> ---------------------------------------------------
>
> Key: SAMZA-63
> URL: https://issues.apache.org/jira/browse/SAMZA-63
> Project: Samza
> Issue Type: Bug
> Components: yarn
> Affects Versions: 0.6.0
> Reporter: Chris Riccomini
> Assignee: Chris Riccomini
> Fix For: 0.7.0
>
> Attachments: SAMZA-63.0.patch
>
>
> For convenience, we have hard coded the HTTP file system into Samza's YARN integration. This makes it easy to deploy Samza jobs from an HTTP file server:
> {noformat}
> ./samza-yarn/src/main/scala/org/apache/samza/job/yarn/SamzaAppMaster.scala: hConfig.set("fs.http.impl", "samza.util.hadoop.HttpFileSystem")
> ./samza-yarn/src/main/scala/org/apache/samza/job/yarn/YarnJobFactory.scala: hConfig.set("fs.http.impl", "samza.util.hadoop.HttpFileSystem")
> {noformat}
> As you can see, the package path is hard coded, and didn't get cleaned up in the package refactor when we moved to Apache.
--
This message was sent by Atlassian JIRA
(v6.1#6144)