You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Julia (JIRA)" <ji...@apache.org> on 2016/04/14 04:01:25 UTC

[jira] [Created] (REEF-1339) Adding IInputPartition.Cache() for data downlad and cache

Julia created REEF-1339:
---------------------------

             Summary: Adding IInputPartition.Cache() for data downlad and cache
                 Key: REEF-1339
                 URL: https://issues.apache.org/jira/browse/REEF-1339
             Project: REEF
          Issue Type: Task
            Reporter: Julia


Currently, in FileSystemInputPartition, data downloading is implemented in Initilaize() and called from GetPartitionHandle. It doesn't give client a flexibility to decide when to download data. Besides, if client wants to cache data in advance, they need to call GetPartitionHandle() and iterate the data. 

We would like to expose a new API Cache() in IInputPartition which performs data download to RAM, SSD, HDD, etc based on client's configuration. 

The method should be called in ContextStartHandler  in IMRU scenarios. 





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)