[jira] [Commented] (BEAM-8457) Instrument Dataflow jobs that are launched from Notebooks

["Kenneth Knowles (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16958115#comment-16958115 ] 

Kenneth Knowles commented on BEAM-8457:
---------------------------------------

This seems like a feature that needs to either catch the release train or catch the next one. Since you have a PR open I assume it will make it. You might miss the release branch cut, so I assume you will cherrypick right away and will leave Fix Version = 2.17.0 so the release manager knows about your intent.

> Instrument Dataflow jobs that are launched from Notebooks
> ---------------------------------------------------------
>
>                 Key: BEAM-8457
>                 URL: https://issues.apache.org/jira/browse/BEAM-8457
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-py-interactive
>            Reporter: Ning Kang
>            Assignee: Ning Kang
>            Priority: Blocker
>             Fix For: 2.17.0
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> Dataflow needs the capability to tell how many Dataflow jobs are launched from the Notebook environment, i.e., the Interactive Runner.
>  # Change the pipeline.run() API to allow supply a runner and an option parameter so that a pipeline initially bundled w/ an interactive runner can be directly run by other runners from notebook.
>  # Implicitly add the necessary source information through user labels when the user does p.run(runner=DataflowRunner()).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)