You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/08/26 10:06:44 UTC
[PR] [SPARK-58932][SS][4.1] Close the accepted socket in TransformWithStateInPySparkStateServer [spark]
j1wonpark opened a new pull request, #58309:
URL: https://github.com/apache/spark/pull/58309
### What changes were proposed in this pull request?
Backport of #58205 to branch-4.1: run the request loop of `TransformWithStateInPySparkStateServer.run()` inside `Utils.tryWithResource` so the accepted socket is always closed. This branch does not have SPARK-58977, so unlike master the `accept()` call is unchanged.
### Why are the changes needed?
The accepted socket is never closed, leaking one file descriptor per task until the executor exhausts the ephemeral port range (`java.net.BindException`). See #58205 for details.
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
The two tests added in #58205 are included; `TransformWithStateInPySparkStateServerSuite` passes locally on this branch.
### Was this patch authored or co-authored using generative AI tooling?
Yes. Generated-by: Claude Opus 5
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-58932][SS][4.1] Close the accepted socket in TransformWithStateInPySparkStateServer [spark]
Posted by "HeartSaVioR (via GitHub)" <gi...@apache.org>.
HeartSaVioR commented on PR #58309:
URL: https://github.com/apache/spark/pull/58309#issuecomment-5434640696
Merged via https://github.com/apache/spark/pull/58308
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
Re: [PR] [SPARK-58932][SS][4.1] Close the accepted socket in TransformWithStateInPySparkStateServer [spark]
Posted by "HeartSaVioR (via GitHub)" <gi...@apache.org>.
HeartSaVioR closed pull request #58309: [SPARK-58932][SS][4.1] Close the accepted socket in TransformWithStateInPySparkStateServer
URL: https://github.com/apache/spark/pull/58309
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org