You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/10/14 09:23:39 UTC

[GitHub] [beam] singhravidutt commented on issue #23588: [Bug]: use_grpc_for_gcs experiment broken by big dataoss library upgrade from 2.2.6 to 2.2.8

singhravidutt commented on issue #23588:
URL: https://github.com/apache/beam/issues/23588#issuecomment-1278733622

   [lukecwik](https://github.com/lukecwik) A recent change in the gcs-grpc write APIs broke the write path for file size > 40MB. We are working on fixing this.  In the meanwhile, as a workaround, clients can configure a higher writeBufferSize using `fs.gs.grpc.write.buffered.requests`. 
   Default value for this configuration is 20 (with each chunk size of 2MB this corresponds to the 40MB limit).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org