You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@uniffle.apache.org by GitBox <gi...@apache.org> on 2023/01/12 11:37:25 UTC

[GitHub] [incubator-uniffle] advancedxy commented on issue #476: [FEATURE] Respect "spark.shuffle.compress" configuration in Uniffle

advancedxy commented on issue #476:
URL: https://github.com/apache/incubator-uniffle/issues/476#issuecomment-1380199120

   I believe Uniffle uses `org.apache.uniffle.common.compression.Codec.NOOP` to disable compress. But it's never used in production and may have other hidden issues. cc @zuston.
   
   I'm also in favor of respect compute engine's shuffle options. I just did a quick overview the codec' usage and seems that it's only used in client side. Maybe we should reconsider this part, just let the client(MR or Spark) delegates its compression codec to Spark's or MR's.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org