You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by ni...@apache.org on 2022/11/17 18:36:01 UTC

[beam] 01/01: Issue#24161 Updated docstring for Clusters class

This is an automated email from the ASF dual-hosted git repository.

ningk pushed a commit to branch Issue#24161
in repository https://gitbox.apache.org/repos/asf/beam.git

commit 000f77fdd0341473ac03cb74134548483760361c
Author: Ning Kang <ni...@gmail.com>
AuthorDate: Thu Nov 17 10:35:53 2022 -0800

    Issue#24161 Updated docstring for Clusters class
    
    Emphasizes that interactive_beam.Clusters class only manages clusters implicitly created by Beam.
    This class is not needed and should not be used otherwise.
---
 .../apache_beam/runners/interactive/interactive_beam.py     | 13 +++++++++++--
 1 file changed, 11 insertions(+), 2 deletions(-)

diff --git a/sdks/python/apache_beam/runners/interactive/interactive_beam.py b/sdks/python/apache_beam/runners/interactive/interactive_beam.py
index d07113fe5e3..d5253f5009e 100644
--- a/sdks/python/apache_beam/runners/interactive/interactive_beam.py
+++ b/sdks/python/apache_beam/runners/interactive/interactive_beam.py
@@ -342,8 +342,17 @@ class Recordings():
 
 
 class Clusters:
-  """An interface to manage clusters running workers that are connected with
-  the current interactive environment.
+  """An interface to control clusters implicitly created and managed by
+  the current interactive environment. This class is not needed and
+  should not be used otherwise.
+  
+  Do not use it for clusters a user explicitly manages: e.g., if you have
+  a Flink cluster running somewhere and provides the flink master when
+  running a pipeline with the FlinkRunner, the cluster will not be tracked
+  or managed by Beam.
+  To reuse the same cluster for your pipelines, use the same pipeline
+  options: e.g., a pipeline option with the same flink master if you are
+  using FlinkRunner.
 
   This module is experimental. No backwards-compatibility guarantees.