You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@celeborn.apache.org by "senthh (via GitHub)" <gi...@apache.org> on 2026/10/06 10:29:28 UTC

[PR] [FLINK] Fix Flink uncompressed shuffle failing to load codec NONE [celeborn]

senthh opened a new pull request, #3861:
URL: https://github.com/apache/celeborn/pull/3861

   Mirror the write-side NONE guard (RemoteShuffleResultPartitionFactory.getBufferCompressor) into RemoteShuffleInputGateFactory.create()/createInputGate(). When the shuffle compression codec is NONE, the read path passed the literal string 'NONE' to CelebornFlinkShim.createBufferDecompressor, which builds a Flink BufferDecompressor that resolves the value as a class name and throws ClassNotFoundException. Return a null decompressor instead; decompression is gated on buffer.isCompressed() and NONE writes never produce compressed buffers, so null is safe.
   
   <!--
   Thanks for sending a pull request!  Here are some tips for you:
     - Make sure the PR title start w/ a JIRA ticket, e.g. '[CELEBORN-XXXX] Your PR title ...'.
     - Be sure to keep the PR description updated to reflect all changes.
     - Please write your PR title to summarize what this PR proposes.
     - If possible, provide a concise example to reproduce the issue for a faster review.
   -->
   
   ### What changes were proposed in this pull request?
   
   
   
   ### Why are the changes needed?
   
   
   
   ### Does this PR resolve a correctness bug?
   
   <!-- Check if yes. The `correctness` label will be added/removed automatically. -->
   - [ ] Yes
   
   ### Does this PR introduce _any_ user-facing change?
   
   <!-- Check if yes. -->
   - [ ] Yes
   
   
   ### How was this patch tested?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE [celeborn]

Posted by "RexXiong (via GitHub)" <gi...@apache.org>.
RexXiong closed pull request #3861: [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE
URL: https://github.com/apache/celeborn/pull/3861


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE [celeborn]

Posted by "RexXiong (via GitHub)" <gi...@apache.org>.
RexXiong commented on PR #3861:
URL: https://github.com/apache/celeborn/pull/3861#issuecomment-6072860895

   **Merge Summary:**
   - merged into main https://github.com/apache/celeborn/commit/f43f424c
   - merged into branch-0.7 https://github.com/apache/celeborn/commit/41ecc79f
   
   *Posted by `merge_pr.py`*


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE [celeborn]

Posted by "senthh (via GitHub)" <gi...@apache.org>.
senthh commented on PR #3861:
URL: https://github.com/apache/celeborn/pull/3861#issuecomment-6056667725

   @RexXiong @yew1eb Thank you reviewing and approving this PR


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] [CELEBORN-2471] Fix Flink uncompressed shuffle failing to load codec NONE [celeborn]

Posted by "yew1eb (via GitHub)" <gi...@apache.org>.
yew1eb commented on PR #3861:
URL: https://github.com/apache/celeborn/pull/3861#issuecomment-6054834241

   Thanks for your contribution! LGTM.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@celeborn.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org