You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Vinod K V (JIRA)" <ji...@apache.org> on 2009/08/31 06:57:32 UTC

[jira] Commented: (MAPREDUCE-752) DistributedCache.addArchiveToClassPath doesn't work

    [ https://issues.apache.org/jira/browse/MAPREDUCE-752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12749378#action_12749378 ] 

Vinod K V commented on MAPREDUCE-752:
-------------------------------------

On trunk, DistributedCache related code in TaskRunner was moved to TaskDistributedCacheManager via MAPREDUCE-476 and was aggressively refactored. I am not very sure whether the bug you are pointing here exists any longer or not. Can you please check?

> DistributedCache.addArchiveToClassPath doesn't work
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-752
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-752
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.20.1, 0.21.0
>            Reporter: Vladimir Klimontovich
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-752-ver2.patch, MAPREDUCE-752-ver3.patch, MAPREDUCE-752.patch, MAPREDUCE-752.zip
>
>
> addArchiveToClassPath is a method of DistributedCache class. It should be called before running a task. It accepts path to a jar file on a DFS. After it
> this method should put this jar file on sitribuuted cache and than add this file to classpath to each map/reduce process on job tracker. 
> This method don't work:
> in TaskRunner there is an algorithm that looks for correspondence between DFS paths and local paths in distributed cache.
> It compares
> if (archives[i].getPath().equals(
> archiveClasspaths[j].toString())){
> instead of
> if (archives[i].toString().equals(
> archiveClasspaths[j].toString())) 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.