You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Victor Chen (Jira)" <ji...@apache.org> on 2022/02/01 23:55:00 UTC

[jira] [Created] (BEAM-13799) Create an Interactive Beam Dataproc package for users to manage clusters with

Victor Chen created BEAM-13799:
----------------------------------

             Summary: Create an Interactive Beam Dataproc package for users to manage clusters with
                 Key: BEAM-13799
                 URL: https://issues.apache.org/jira/browse/BEAM-13799
             Project: Beam
          Issue Type: New Feature
          Components: runner-py-interactive
            Reporter: Victor Chen


* Adds code to automatically create a Dataproc cluster configured with Docker and Flink if a user instantiates an InteractiveRunner using underlying_runner='FlinkRunner'
 * By default, the created Dataproc cluster will be called 'interactive-beam-cluster' and will persist even after the kernel is interrupted
 * Users additionally will have the ability to:
 ** specify a name of their choosing for the created cluster, a warning is raised to notify the user that they will have to delete the cluster on their own
 ** toggle an automatic deletion of the cluster with the default name, 'interactive-beam-cluster' when the kernel is interrupted
 ** delete the cluster with the default name, 'interactive-beam-cluster'



--
This message was sent by Atlassian Jira
(v8.20.1#820001)