You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2014/08/04 06:55:11 UTC

[jira] [Created] (TEZ-1373) Download files in parallel in RelocalizationUtils.processAdditionalResources

Rajesh Balamohan created TEZ-1373:
-------------------------------------

             Summary: Download files in parallel in RelocalizationUtils.processAdditionalResources
                 Key: TEZ-1373
                 URL: https://issues.apache.org/jira/browse/TEZ-1373
             Project: Apache Tez
          Issue Type: Bug
    Affects Versions: 0.5.0
            Reporter: Rajesh Balamohan


DAGAppMaster-->startDAGExecution() downloads any local resources relevant for the job.  (e.g "add jar datafu.jar" in the case of Hive or "register" statements in the case of pig). 

Currently, these files are downloaded in sequential manner.  Based on the number of files and their sizes, couple of seconds are spent on this.  Purpose of this jira is to parallelize the download.



--
This message was sent by Atlassian JIRA
(v6.2#6252)