You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Andrew Chung (JIRA)" <ji...@apache.org> on 2016/04/15 19:56:25 UTC

[jira] [Assigned] (REEF-1339) Adding IInputPartition.Cache() for data download and cache

     [ https://issues.apache.org/jira/browse/REEF-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Chung reassigned REEF-1339:
----------------------------------

    Assignee: Andrew Chung

> Adding IInputPartition.Cache() for data download and cache
> ----------------------------------------------------------
>
>                 Key: REEF-1339
>                 URL: https://issues.apache.org/jira/browse/REEF-1339
>             Project: REEF
>          Issue Type: Task
>            Reporter: Julia
>            Assignee: Andrew Chung
>              Labels: FT
>
> Currently, in FileSystemInputPartition, data downloading is implemented in Initilaize() and called from GetPartitionHandle. It doesn't give client a flexibility to decide when to download data. Besides, if client wants to cache data in advance, they need to call GetPartitionHandle() and iterate the data. 
> We would like to expose a new API Cache() in IInputPartition which performs data download to RAM, SSD, HDD, etc based on client's configuration. 
> The method should be called in ContextStartHandler  in IMRU scenarios. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)