You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 23:32:54 UTC

[GitHub] [beam] damccorm opened a new issue, #21447: Add batch_size back off in RunInferenceBase

damccorm opened a new issue, #21447:
URL: https://github.com/apache/beam/issues/21447

   Add batch_size back off in the case there are functional
   reasons large batch sizes cannot be handled.
   
   Imported from Jira [BEAM-14208](https://issues.apache.org/jira/browse/BEAM-14208). Original Jira may contain additional context.
   Reported by: Ryan.Thompson.
   Subtask of issue #21435


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] AnandInguva commented on issue #21447: Add batch_size back off in RunInferenceBase

Posted by GitBox <gi...@apache.org>.
AnandInguva commented on issue #21447:
URL: https://github.com/apache/beam/issues/21447#issuecomment-1239800762

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] ryanthompson591 commented on issue #21447: Add batch_size back off in RunInferenceBase

Posted by GitBox <gi...@apache.org>.
ryanthompson591 commented on issue #21447:
URL: https://github.com/apache/beam/issues/21447#issuecomment-1239956465

   I filed this at someone else's suggestion. I think there was a worry that if our batch size grows too large and causes the framework to error out we should have a sort of backoff.
   
   I think this will be even more relevant when there are implementations that make RPC calls.  How, it should work exactly --- I'm not sure at this point.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org