You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/07/14 21:03:12 UTC

[GitHub] [beam] steveniemitz commented on pull request #17783: [BEAM-14534] Allow users to compress values being shuffled in dataflow

steveniemitz commented on PR #17783:
URL: https://github.com/apache/beam/pull/17783#issuecomment-1184894472

   > Have you tried the pipeline visitor using a SnappyCoder that wraps existing encodings?
   
   now that we have compression working well end-to-end in our internal fork (and a good baseline for performance), I was going to re-evaluate options for making a "coder wrapper" that can do the compression/decompression.  I really do agree that a coder-wrapper would be much cleaner here, I'm just worried we won't be able to reach the same level of performance with that interface.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org