You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Anonymous (Jira)" <ji...@apache.org> on 2023/04/13 11:03:00 UTC

[jira] [Updated] (BEAM-10603) Large Source Recording for Interarctive Runner

     [ https://issues.apache.org/jira/browse/BEAM-10603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anonymous updated BEAM-10603:
-----------------------------
    Status: Triage Needed  (was: Resolved)

> Large Source Recording for Interarctive Runner
> ----------------------------------------------
>
>                 Key: BEAM-10603
>                 URL: https://issues.apache.org/jira/browse/BEAM-10603
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-py-interactive
>            Reporter: Sam Rohde
>            Priority: P2
>             Fix For: Missing
>
>          Time Spent: 44h 20m
>  Remaining Estimate: 0h
>
> This changes the Interactive Runner to create a long-running background caching job that is decoupled from the user pipeline. When a user invokes a collect() or show(), it will read from the cache to compute the requested PCollections. Previously, the user would have to wait for the cache to be fully written to. This allows for the user to start experimenting immediately.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)