You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2020/12/24 03:14:16 UTC

[GitHub] [beam] tvalentyn edited a comment on pull request #13475: Do not add unnecessary experiment use_multiple_sdk_containers.

tvalentyn edited a comment on pull request #13475:
URL: https://github.com/apache/beam/pull/13475#issuecomment-750719561


   Hi, @psobot, thanks for reaching out! I would be curious to learn more about your observations of  performance difference between
    -  setting a `--experiment=no_use_multiple_sdk_containers` and using a multi-core VM 
   
   vs
    -  using a singlecore VM 
   
   on the use-cases that you mention.
   
   There is no exact alternative to `--experiment=no_use_multiple_sdk_containers` right now, but this was never documented as a supported customization. We don't have tests targeting this functionality and noticed that it stopped working on 2.25.0 and newer SDKs on Dataflow Runner V2, due to a combination of SDK + Dataflow service changes, but may start working again after another series of service changes rolls out.
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org