You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/17 17:12:20 UTC

[GitHub] [beam] lukecwik opened a new issue, #21927: [Feature Request]: Compress BoundedSourceAsSdfWrapper element and restriction coders

lukecwik opened a new issue, #21927:
URL: https://github.com/apache/beam/issues/21927

   ### What would you like to happen?
   
   A typical BoundedSource may be split into many BoundedSource instances during initial splitting. Doing a simple test of the BigtableSource shows that encoding 10 instances after splitting took on average 102660 bytes while compressing each instance separately after encoding took 1639 bytes for a >60x improvement.
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: sdk-java-core


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] pabloem closed issue #21927: [Feature Request]: Compress (Un)BoundedSourceAsSdfWrapper element and restriction coders

Posted by GitBox <gi...@apache.org>.

pabloem closed issue #21927: [Feature Request]: Compress (Un)BoundedSourceAsSdfWrapper element and restriction coders
URL: https://github.com/apache/beam/issues/21927


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org