You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@tez.apache.org by "Kuhu Shukla (JIRA)" <ji...@apache.org> on 2016/07/20 16:21:20 UTC

[jira] [Created] (TEZ-3367) Add support for Multiple Files Fetch from the Shuffle Handler

Kuhu Shukla created TEZ-3367:
--------------------------------

             Summary: Add support for Multiple Files Fetch from the Shuffle Handler
                 Key: TEZ-3367
                 URL: https://issues.apache.org/jira/browse/TEZ-3367
             Project: Apache Tez
          Issue Type: Sub-task
            Reporter: Kuhu Shukla
            Assignee: Kuhu Shukla


Equip the Custom Shuffle Handler to read multiple file.out(s) at once. One of the possible ways is to fetch all files from a given directory. The design may need to address the possible scenario of too many files exhausting the Inodes on a given node.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)