You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Ning Kang (Jira)" <ji...@apache.org> on 2019/11/11 19:08:00 UTC

[jira] [Updated] (BEAM-8457) Instrument Dataflow jobs that are launched from Notebooks

     [ https://issues.apache.org/jira/browse/BEAM-8457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ning Kang updated BEAM-8457:
----------------------------
    Fix Version/s:     (was: 2.17.0)
                   2.18.0
      Description: 
Dataflow needs the capability to tell how many Dataflow jobs are launched from the Notebook environment.

We are doing it by checking if the current execution path is with ipython and if the ipython kernel is connected to a notebook frontend.

  was:
Dataflow needs the capability to tell how many Dataflow jobs are launched from the Notebook environment, i.e., the Interactive Runner.
 # Change the pipeline.run() API to allow supply a runner and an option parameter so that a pipeline initially bundled w/ an interactive runner can be directly run by other runners from notebook.
 # Implicitly add the necessary source information through user labels when the user does p.run(runner=DataflowRunner()).


> Instrument Dataflow jobs that are launched from Notebooks
> ---------------------------------------------------------
>
>                 Key: BEAM-8457
>                 URL: https://issues.apache.org/jira/browse/BEAM-8457
>             Project: Beam
>          Issue Type: Improvement
>          Components: runner-py-interactive
>            Reporter: Ning Kang
>            Assignee: Ning Kang
>            Priority: Major
>             Fix For: 2.18.0
>
>          Time Spent: 9h 40m
>  Remaining Estimate: 0h
>
> Dataflow needs the capability to tell how many Dataflow jobs are launched from the Notebook environment.
> We are doing it by checking if the current execution path is with ipython and if the ipython kernel is connected to a notebook frontend.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)