You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@reef.apache.org by "Andrew Chung (JIRA)" <ji...@apache.org> on 2016/04/15 19:56:25 UTC
[jira] [Assigned] (REEF-1339) Adding IInputPartition.Cache() for
data download and cache
[ https://issues.apache.org/jira/browse/REEF-1339?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Chung reassigned REEF-1339:
----------------------------------
Assignee: Andrew Chung
> Adding IInputPartition.Cache() for data download and cache
> ----------------------------------------------------------
>
> Key: REEF-1339
> URL: https://issues.apache.org/jira/browse/REEF-1339
> Project: REEF
> Issue Type: Task
> Reporter: Julia
> Assignee: Andrew Chung
> Labels: FT
>
> Currently, in FileSystemInputPartition, data downloading is implemented in Initilaize() and called from GetPartitionHandle. It doesn't give client a flexibility to decide when to download data. Besides, if client wants to cache data in advance, they need to call GetPartitionHandle() and iterate the data.
> We would like to expose a new API Cache() in IInputPartition which performs data download to RAM, SSD, HDD, etc based on client's configuration.
> The method should be called in ContextStartHandler in IMRU scenarios.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)