You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by "Henning Rohde (JIRA)" <ji...@apache.org> on 2018/09/21 16:53:00 UTC

[jira] [Updated] (BEAM-3080) Improve the side input materialization for the DirectRunner/ULR from iterable to storing the multimap directly

     [ https://issues.apache.org/jira/browse/BEAM-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Henning Rohde updated BEAM-3080:
--------------------------------
    Issue Type: Improvement  (was: Sub-task)
        Parent:     (was: BEAM-2863)

> Improve the side input materialization for the DirectRunner/ULR from iterable to storing the multimap directly
> --------------------------------------------------------------------------------------------------------------
>
>                 Key: BEAM-3080
>                 URL: https://issues.apache.org/jira/browse/BEAM-3080
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-direct
>            Reporter: Luke Cwik
>            Priority: Minor
>              Labels: portability
>
> https://github.com/apache/beam/pull/4011 migrated to using a multimap as the materialization format for side inputs.
> The migration used a trivial multimap -> iterable -> multimap conversion within the DirectRunner for first pass implementation purposes. Note that this is no different then the current materialization from a performance perspective it just moves this logic within the purview of the runner.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)