You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Kenneth Knowles (Jira)" <ji...@apache.org> on 2020/07/29 18:30:00 UTC

[jira] [Updated] (BEAM-10603) Large Source Recording for Interarctive Runner

     [ https://issues.apache.org/jira/browse/BEAM-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kenneth Knowles updated BEAM-10603:
-----------------------------------
    Status: Open  (was: Triage Needed)

> Large Source Recording for Interarctive Runner
> ----------------------------------------------
>
>                 Key: BEAM-10603
>                 URL: https://issues.apache.org/jira/browse/BEAM-10603
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-py-interactive
>            Reporter: Sam Rohde
>            Assignee: Sam Rohde
>            Priority: P1
>
> This changes the Interactive Runner to create a long-running background caching job that is decoupled from the user pipeline. When a user invokes a collect() or show(), it will read from the cache to compute the requested PCollections. Previously, the user would have to wait for the cache to be fully written to. This allows for the user to start experimenting immediately.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)