[jira] [Resolved] (MAPREDUCE-458) Adding caching to Hadoop which is independent of the task trackers.

["Harsh J (Resolved) (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAPREDUCE-458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Harsh J resolved MAPREDUCE-458.
-------------------------------

    Resolution: Not A Problem

This discussion has gone stale. I wonder if we see major issues with current DistributedCache features today that does proper caching and works across jobs too.
                
> Adding caching to Hadoop which is independent of the task trackers.
> -------------------------------------------------------------------
>
>                 Key: MAPREDUCE-458
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-458
>             Project: Hadoop Map/Reduce
>          Issue Type: New Feature
>            Reporter: Mahadev konar
>            Assignee: Owen O'Malley
>            Priority: Minor
>
> It would be nice to have a feature in Hadoop that could cache files locally that is independent of TaskTrackers and JobTrackers. Hadoop-288 caching is dependent on the tasktrackers. In an environment where you would dynamically bring up and down the TaskTrackers for resource sharing, that is problematic. It would be good to have this feature wherein you can install tasktrackers/jobtrackers on these machines using this caching mechanism. The caching feature could use something like Bittorent /http/rsync to copy the main hadoop.jar.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira