You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Luke Cwik (Jira)" <ji...@apache.org> on 2019/12/21 00:13:00 UTC

[jira] [Closed] (BEAM-9014) Update CachingShuffleBatchReader to record weights by size in bytes

     [ https://issues.apache.org/jira/browse/BEAM-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Luke Cwik closed BEAM-9014.
---------------------------
    Fix Version/s: 2.19.0
       Resolution: Fixed

> Update CachingShuffleBatchReader to record weights by size in bytes
> -------------------------------------------------------------------
>
>                 Key: BEAM-9014
>                 URL: https://issues.apache.org/jira/browse/BEAM-9014
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-dataflow
>            Reporter: Luke Cwik
>            Priority: Minor
>             Fix For: 2.19.0
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> Currently the CachingShuffleBatchReader caches based upon the number of batches and not the size of those batches. This task is about updating CachingShuffleBatchReader to cache based on the size of those batches.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)