You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 19:02:54 UTC

[GitHub] [beam] damccorm opened a new issue, #20711: BigQuery: add maxStreamingBatchSize for Python streaming inserts

damccorm opened a new issue, #20711:
URL: https://github.com/apache/beam/issues/20711

   Java SDK has maxStreamingBatchSize.
   Implementing something similar for Python would prevent 400 HTTP errors from BigQuery when batches are too large. Instead, Beam should try to split batches and log a warning (once) when trying to insert a single very large row.
   
   Imported from Jira [BEAM-11521](https://issues.apache.org/jira/browse/BEAM-11521). Original Jira may contain additional context.
   Reported by: udim.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] Abacn closed issue #20711: BigQuery: add maxStreamingBatchSize for Python streaming inserts

Posted by "Abacn (via GitHub)" <gi...@apache.org>.
Abacn closed issue #20711: BigQuery: add maxStreamingBatchSize for Python streaming inserts
URL: https://github.com/apache/beam/issues/20711


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] ahmedabu98 commented on issue #20711: BigQuery: add maxStreamingBatchSize for Python streaming inserts

Posted by GitBox <gi...@apache.org>.
ahmedabu98 commented on issue #20711:
URL: https://github.com/apache/beam/issues/20711#issuecomment-1379504387

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org