You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org> on 2009/06/01 08:16:07 UTC
[jira] Commented: (HADOOP-2914) extend DistributedCache to work
locally (LocalJobRunner)
[ https://issues.apache.org/jira/browse/HADOOP-2914?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12714988#action_12714988 ]
Amareshwari Sriramadasu commented on HADOOP-2914:
-------------------------------------------------
bq. It's my belief that SVN r696957 (HADOOP-249) turned off the symlink feature and that it hasn't worked since then. That said, I haven't yet written the test that would confirm this.
symlinks are not created TaskRunner.run(). They are created in setupWorkDir(), called from child. This is an optimization introduced in HADOOP-249. The test TestMiniMRDFSCaching tests DistributedCache and symlinks in it also .
> extend DistributedCache to work locally (LocalJobRunner)
> --------------------------------------------------------
>
> Key: HADOOP-2914
> URL: https://issues.apache.org/jira/browse/HADOOP-2914
> Project: Hadoop Core
> Issue Type: Improvement
> Components: mapred
> Reporter: sam rash
> Assignee: Philip Zeyliger
> Priority: Minor
> Attachments: HADOOP-2914-v1-full.patch, HADOOP-2914-v1-since-4041.patch
>
>
> The DistributedCache does not work locally when using the outlined recipe at http://hadoop.apache.org/core/docs/r0.16.0/api/org/apache/hadoop/filecache/DistributedCache.html
> Ideally, LocalJobRunner would take care of populating the JobConf and copying remote files to the local file sytem (http, assume hdfs = default fs = local fs when doing local development.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.