You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Vladimir Klimontovich (JIRA)" <ji...@apache.org> on 2009/07/12 15:25:14 UTC

[jira] Created: (MAPREDUCE-752) DistributedCache.addArchiveToClassPath doesn't work

DistributedCache.addArchiveToClassPath doesn't work
---------------------------------------------------

                 Key: MAPREDUCE-752
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-752
             Project: Hadoop Map/Reduce
          Issue Type: Bug
            Reporter: Vladimir Klimontovich


addArchiveToClassPath is a method of DistributedCache class. It should be called before running a task. It accepts path to a jar file on a DFS. After it
this method should put this jar file on sitribuuted cache and than add this file to classpath to each map/reduce process on job tracker. 

This method don't work:

in TaskRunner there is an algorithm that looks for correspondence between DFS paths and local paths in distributed cache.
It compares

if (archives[i].getPath().equals(
archiveClasspaths[j].toString())){

instead of

if (archives[i].toString().equals(
archiveClasspaths[j].toString())) 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Reopened: (MAPREDUCE-752) DistributedCache.addArchiveToClassPath doesn't work

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer reopened MAPREDUCE-752:
----------------------------------------


We need a fix for 0.20, since 0.21 seems to be months away yet.

Thanks.

> DistributedCache.addArchiveToClassPath doesn't work
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-752
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-752
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.20.1, 0.21.0
>            Reporter: Vladimir Klimontovich
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-752-ver2.patch, MAPREDUCE-752-ver3.patch, MAPREDUCE-752.patch, MAPREDUCE-752.zip
>
>
> addArchiveToClassPath is a method of DistributedCache class. It should be called before running a task. It accepts path to a jar file on a DFS. After it
> this method should put this jar file on sitribuuted cache and than add this file to classpath to each map/reduce process on job tracker. 
> This method don't work:
> in TaskRunner there is an algorithm that looks for correspondence between DFS paths and local paths in distributed cache.
> It compares
> if (archives[i].getPath().equals(
> archiveClasspaths[j].toString())){
> instead of
> if (archives[i].toString().equals(
> archiveClasspaths[j].toString())) 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (MAPREDUCE-752) DistributedCache.addArchiveToClassPath doesn't work

Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amareshwari Sriramadasu resolved MAPREDUCE-752.
-----------------------------------------------

    Resolution: Duplicate

Fixed by MAPREDUCE-787.

> DistributedCache.addArchiveToClassPath doesn't work
> ---------------------------------------------------
>
>                 Key: MAPREDUCE-752
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-752
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>    Affects Versions: 0.20.1, 0.21.0
>            Reporter: Vladimir Klimontovich
>             Fix For: 0.21.0
>
>         Attachments: MAPREDUCE-752-ver2.patch, MAPREDUCE-752-ver3.patch, MAPREDUCE-752.patch, MAPREDUCE-752.zip
>
>
> addArchiveToClassPath is a method of DistributedCache class. It should be called before running a task. It accepts path to a jar file on a DFS. After it
> this method should put this jar file on sitribuuted cache and than add this file to classpath to each map/reduce process on job tracker. 
> This method don't work:
> in TaskRunner there is an algorithm that looks for correspondence between DFS paths and local paths in distributed cache.
> It compares
> if (archives[i].getPath().equals(
> archiveClasspaths[j].toString())){
> instead of
> if (archives[i].toString().equals(
> archiveClasspaths[j].toString())) 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.