You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "carloea2 (via GitHub)" <gi...@apache.org> on 2026/08/31 05:21:25 UTC
[I] Python hash normalization can change shuffle receivers [texera]
carloea2 opened a new issue, #8253:
URL: https://github.com/apache/texera/issues/8253
### Current behavior
Python reserves hash value `-1` and rewrites it to `-2` when the `hash` builtin calls an object's hash method. Texera's tuple method can correctly calculate Java hash `-1`, but the Python hash shuffle passes it through the builtin and selects a different receiver from the JVM.
Before: Java tuple hash -1 becomes Python hash -2 and routes to receiver A
After: the partitioner uses the raw tuple hash and routes to receiver B like the JVM
### Steps to reproduce
On `50321e403c82df299a13deb50a7f9849dd93bdba`, hash-shuffle an integer key of `-32` across receivers A and B.
Observed result:
```text
raw_java_hash=-1 builtin_hash=-2 receiver=A
```
### Expected behavior
Hash shuffle should use the tuple's raw Java-compatible hash before floor-mod routing so Python's reserved hash normalization cannot change the partition.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Python hash normalization can change shuffle receivers [texera]
Posted by "carloea2 (via GitHub)" <gi...@apache.org>.
carloea2 commented on issue #8253:
URL: https://github.com/apache/texera/issues/8253#issuecomment-5548200922
/take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Python hash normalization can change shuffle receivers [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8253:
URL: https://github.com/apache/texera/issues/8253#issuecomment-5484761516
<!-- texera:template-compliance -->
👋 Thanks for opening this issue, @carloea2!
It looks like the issue description doesn't quite follow our template yet:
- The **Feature Summary** section is missing; please keep the template's headings.
- The **Proposed Solution or Design** section is missing; please keep the template's headings.
Filling out the template helps reviewers understand and triage your contribution faster. Please edit the description to complete it. This message will disappear automatically once the template is followed.
You can find the template prompts by editing the description, or see [CONTRIBUTING.md](https://github.com/apache/texera/blob/main/CONTRIBUTING.md) for the full contribution flow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Python hash normalization can change shuffle receivers [texera]
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #8253:
URL: https://github.com/apache/texera/issues/8253#issuecomment-5474095782
<!-- texera:template-compliance -->
👋 Thanks for opening this issue, @carloea2!
It looks like the issue description doesn't quite follow our template yet:
- This issue doesn't appear to use one of our templates (Bug, Feature, or Task). Please open it using a template so the required details are captured.
Filling out the template helps reviewers understand and triage your contribution faster. Please edit the description to complete it. This message will disappear automatically once the template is followed.
You can find the template prompts by editing the description, or see [CONTRIBUTING.md](https://github.com/apache/texera/blob/main/CONTRIBUTING.md) for the full contribution flow.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org