You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@datafu.apache.org by "Eyal Allweil (JIRA)" <ji...@apache.org> on 2016/03/03 20:35:18 UTC
[jira] [Updated] (DATAFU-115) Make TupleFromBag implement
Accumulator
[ https://issues.apache.org/jira/browse/DATAFU-115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eyal Allweil updated DATAFU-115:
--------------------------------
Attachment: DATAFU-115.patch
Relatively straightforward patch ... there's one difference from the previous behavior, that if an exception is thrown, I ignore it and try to continue iterating to the desired index.
I tried uploading it to the review board, see if [this link|https://reviews.apache.org/r/44351/] works.
> Make TupleFromBag implement Accumulator
> ---------------------------------------
>
> Key: DATAFU-115
> URL: https://issues.apache.org/jira/browse/DATAFU-115
> Project: DataFu
> Issue Type: Improvement
> Affects Versions: 1.3.0
> Reporter: Eyal Allweil
> Priority: Minor
> Labels: performance
> Fix For: 1.3.1
>
> Attachments: DATAFU-115.patch
>
>
> Similar to [DATAFU-114|https://issues.apache.org/jira/browse/DATAFU-114].
> TupleFromBag doesn't need to hold the bag in memory, and can iterate through it until it reaches the desired tuple. By implementing Accumulator, larger bags can be used and with a smaller memory footprint.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)