Re: [PR] Timeout execution tree creation for SDK worker ops. [beam]

["tvalentyn (via GitHub)" <gi...@apache.org>]

tvalentyn commented on code in PR #36200:
URL: https://github.com/apache/beam/pull/36200#discussion_r2393210921


##########
sdks/python/apache_beam/runners/worker/bundle_processor.py:
##########
@@ -1130,7 +1132,25 @@ def __init__(
         'fnapi-step-%s' % self.process_bundle_descriptor.id,
         self.counter_factory)
 
-    self.ops = self.create_execution_tree(self.process_bundle_descriptor)
+    with concurrent.futures.ThreadPoolExecutor(
+        max_workers=1, thread_name_prefix='ExecutionTreeCreator') as executor:
+      future = executor.submit(
+          self.create_execution_tree, self.process_bundle_descriptor)
+      try:
+        self.ops = future.result(timeout=3600)

Review Comment:
   i am looking at some of those issues since this work is related. I might merge this PR as is before next release but still looking to see if we can get a more general solution here 



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org