You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uniffle.apache.org by "zuston (via GitHub)" <gi...@apache.org> on 2023/02/16 06:21:06 UTC
[GitHub] [incubator-uniffle] zuston opened a new issue, #610: Flaky Test: RssShuffleWriterTest#writeTest
zuston opened a new issue, #610:
URL: https://github.com/apache/incubator-uniffle/issues/610
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.
### Describe the flaky test
```
Error: Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 17.413 s <<< FAILURE! - in org.apache.spark.shuffle.writer.RssShuffleWriterTest
Error: writeTest Time elapsed: 2.387 s <<< ERROR!
java.util.ConcurrentModificationException
at java.util.HashMap$HashIterator.nextNode(HashMap.java:1469)
at java.util.HashMap$KeyIterator.next(HashMap.java:1493)
at java.util.AbstractSet.removeAll(AbstractSet.java:174)
at org.apache.spark.shuffle.writer.RssShuffleWriter.checkBlockSendResult(RssShuffleWriter.java:303)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.shuffle.writer.RssShuffleWriter.checkBlockSendResult(RssShuffleWriter.java:289)
at org.apache.spark.shuffle.writer.RssShuffleWriter.writeImpl(RssShuffleWriter.java:194)
at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:418)
[INFO]
[INFO] Results:
[INFO]
Error: Errors:
Error: RssShuffleWriterTest.writeTest ยป ConcurrentModification
[INFO]
```
### Actions URL
https://github.com/apache/incubator-uniffle/actions/runs/4191190002/jobs/7265371289
### Parent issue
#1733
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #610: Flaky Test: RssShuffleWriterTest#writeTest
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #610:
URL: https://github.com/apache/incubator-uniffle/issues/610#issuecomment-1432826053
OK
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston closed issue #610: Flaky Test: RssShuffleWriterTest#writeTest
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston closed issue #610: Flaky Test: RssShuffleWriterTest#writeTest
URL: https://github.com/apache/incubator-uniffle/issues/610
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #610: Flaky Test: RssShuffleWriterTest#writeTest
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #610:
URL: https://github.com/apache/incubator-uniffle/issues/610#issuecomment-1444970734
> If it is hard to fix and fails often, we can revert the `-T1C` option.
This has been reverted, let's close this. cc @kaijchen
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] kaijchen commented on issue #610: Flaky Test: RssShuffleWriterTest#writeTest
Posted by "kaijchen (via GitHub)" <gi...@apache.org>.
kaijchen commented on issue #610:
URL: https://github.com/apache/incubator-uniffle/issues/610#issuecomment-1432817006
If it is hard to fix and fails often, we can revert the `-T1C` option.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #610: Flaky Test: RssShuffleWriterTest#writeTest
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #610:
URL: https://github.com/apache/incubator-uniffle/issues/610#issuecomment-1432812957
Yes. Maybe it uses the same sparkContext
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] kaijchen commented on issue #610: Flaky Test: RssShuffleWriterTest#writeTest
Posted by "kaijchen (via GitHub)" <gi...@apache.org>.
kaijchen commented on issue #610:
URL: https://github.com/apache/incubator-uniffle/issues/610#issuecomment-1432602912
Tip: We have enabled `mvn -T1C` in CI. Maybe it's due to some shared static objects.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org