You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tez.apache.org by "Rajesh Balamohan (JIRA)" <ji...@apache.org> on 2014/08/04 06:55:11 UTC
[jira] [Created] (TEZ-1373) Download files in parallel in
RelocalizationUtils.processAdditionalResources
Rajesh Balamohan created TEZ-1373:
-------------------------------------
Summary: Download files in parallel in RelocalizationUtils.processAdditionalResources
Key: TEZ-1373
URL: https://issues.apache.org/jira/browse/TEZ-1373
Project: Apache Tez
Issue Type: Bug
Affects Versions: 0.5.0
Reporter: Rajesh Balamohan
DAGAppMaster-->startDAGExecution() downloads any local resources relevant for the job. (e.g "add jar datafu.jar" in the case of Hive or "register" statements in the case of pig).
Currently, these files are downloaded in sequential manner. Based on the number of files and their sizes, couple of seconds are spent on this. Purpose of this jira is to parallelize the download.
--
This message was sent by Atlassian JIRA
(v6.2#6252)