You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2013/11/11 23:22:17 UTC

[jira] [Commented] (PIG-3563) support adding archives to the distributed cache

    [ https://issues.apache.org/jira/browse/PIG-3563?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13819504#comment-13819504 ] 

Rohini Palaniswamy commented on PIG-3563:
-----------------------------------------

I am good. [~jdonofrio], do you want to update the pattern to check for symlinks as well or this is sufficient to support your usecase? Currently it only looks for files ending with .tar, .zip, etc. 

> support adding archives to the distributed cache
> ------------------------------------------------
>
>                 Key: PIG-3563
>                 URL: https://issues.apache.org/jira/browse/PIG-3563
>             Project: Pig
>          Issue Type: Improvement
>            Reporter: Jim Donofrio
>            Assignee: Jim Donofrio
>            Priority: Minor
>              Labels: distributed_cache
>         Attachments: PIG-3563.patch
>
>
> Support adding archives to the distributed cache by calling DistributedCacheFile.addCacheArchive instead of addCacheFile in JobControlCompiler.setupDistributedCache for common archive endings: .zip, .tgz, .tar.gz, .tar which are the extensions checked in downloadCacheObject in org.apache.hadoop.filecache.TrackerDistributedCacheManager



--
This message was sent by Atlassian JIRA
(v6.1#6144)