You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2024/02/20 01:57:44 UTC
[PR] [SPARK-47097][CONNECT][TESTS] Deflake interrupt tag at SparkSessionE2ESuite [spark]
HyukjinKwon opened a new pull request, #45173:
URL: https://github.com/apache/spark/pull/45173
### What changes were proposed in this pull request?
This PR proposes to deflake increase interrupt tag at `SparkSessionE2ESuite` by:
- Increase timeout for interrupt tag at `SparkSessionE2ESuite`.
- Reduce the number of tasks in parallel.
### Why are the changes needed?
To fix the flakiness:
```
- interrupt tag *** FAILED ***
The code passed to eventually never returned normally. Attempted 30 times over 20.037421464999998 seconds. Last failure message: ListBuffer("2beba4ac-a994-45f5-bd46-fca3e43fb5ef") had length 1 instead of expected length 2 Interrupted operations: ListBuffer(2beba4ac-a994-45f5-bd46-fca3e43fb5ef).. (SparkSessionE2ESuite.scala:216)
```
https://github.com/apache/spark/actions/runs/7959951623/job/21727929211
The test failed because the interruption took more than 20 seconds, and it launches too many tasks to run.
### Does this PR introduce _any_ user-facing change?
No, test-only.
### How was this patch tested?
CI in this PR should validate them. The flakiness can't easily be reproduced in my local.
### Was this patch authored or co-authored using generative AI tooling?
No.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47097][CONNECT][TESTS] Deflake interrupt tag at SparkSessionE2ESuite [spark]
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon commented on PR #45173:
URL: https://github.com/apache/spark/pull/45173#issuecomment-1953429255
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-47097][CONNECT][TESTS] Deflake interrupt tag at SparkSessionE2ESuite [spark]
Posted by "HyukjinKwon (via GitHub)" <gi...@apache.org>.
HyukjinKwon closed pull request #45173: [SPARK-47097][CONNECT][TESTS] Deflake interrupt tag at SparkSessionE2ESuite
URL: https://github.com/apache/spark/pull/45173
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org