You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2025/11/03 20:52:28 UTC
[I] [datafusion-cli] `shuffle.slt` Intermittent CI failure for `SELECT shuffle([1, 2, 3, 4, 5, NULL]) != [1, 2, 3, 4, 5, NULL];` [datafusion]
alamb opened a new issue, #18476:
URL: https://github.com/apache/datafusion/issues/18476
### Describe the bug
A test in shuffle.slt fails intermittently but passes on rerun
### To Reproduce
Here is an example:
https://github.com/apache/datafusion/actions/runs/19022758025/job/54320962649
```
Running bin/sqllogictests.rs (target/ci/deps/sqllogictests-3c0c5297e9072553)
External error: 1 errors in file /__w/datafusion/datafusion/datafusion/sqllogictest/test_files/spark/array/shuffle.slt
1. query result mismatch:
[SQL] SELECT shuffle([1, 2, 3, 4, 5, NULL]) != [1, 2, 3, 4, 5, NULL];
[Diff] (-expected|+actual)
- true
+ false
at /__w/datafusion/datafusion/datafusion/sqllogictest/test_files/spark/array/shuffle.slt:24
```
### Expected behavior
Test should always pass
### Additional context
I suspect the issue is that in very rare occasions the two calls to shuffle result in the exact same output
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [datafusion-cli] `shuffle.slt` Intermittent CI failure for `SELECT shuffle([1, 2, 3, 4, 5, NULL]) != [1, 2, 3, 4, 5, NULL];` [datafusion]
Posted by "Jefffrey (via GitHub)" <gi...@apache.org>.
Jefffrey closed issue #18476: [datafusion-cli] `shuffle.slt` Intermittent CI failure for `SELECT shuffle([1, 2, 3, 4, 5, NULL]) != [1, 2, 3, 4, 5, NULL];`
URL: https://github.com/apache/datafusion/issues/18476
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [datafusion-cli] `shuffle.slt` Intermittent CI failure for `SELECT shuffle([1, 2, 3, 4, 5, NULL]) != [1, 2, 3, 4, 5, NULL];` [datafusion]
Posted by "Jefffrey (via GitHub)" <gi...@apache.org>.
Jefffrey commented on issue #18476:
URL: https://github.com/apache/datafusion/issues/18476#issuecomment-3483371330
This was something I was concerned about in the original PR; either we implement seed support for the function (#17686) or we disable these flaky tests
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [datafusion-cli] `shuffle.slt` Intermittent CI failure for `SELECT shuffle([1, 2, 3, 4, 5, NULL]) != [1, 2, 3, 4, 5, NULL];` [datafusion]
Posted by "chenkovsky (via GitHub)" <gi...@apache.org>.
chenkovsky commented on issue #18476:
URL: https://github.com/apache/datafusion/issues/18476#issuecomment-3496403683
should I add seed into udf temporary or remove the test?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [datafusion-cli] `shuffle.slt` Intermittent CI failure for `SELECT shuffle([1, 2, 3, 4, 5, NULL]) != [1, 2, 3, 4, 5, NULL];` [datafusion]
Posted by "chenkovsky (via GitHub)" <gi...@apache.org>.
chenkovsky commented on issue #18476:
URL: https://github.com/apache/datafusion/issues/18476#issuecomment-3498252015
@Jefffrey could you please help me review the fix.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [datafusion-cli] `shuffle.slt` Intermittent CI failure for `SELECT shuffle([1, 2, 3, 4, 5, NULL]) != [1, 2, 3, 4, 5, NULL];` [datafusion]
Posted by "Jefffrey (via GitHub)" <gi...@apache.org>.
Jefffrey commented on issue #18476:
URL: https://github.com/apache/datafusion/issues/18476#issuecomment-3496764069
Is there any major downside to implementing the seed without support for having different seeds per recordbatch/partition (per #17686)? if not then it would be nice to have that functionality
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org