You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2022/11/16 19:20:11 UTC
[GitHub] [spark] xinrong-meng opened a new pull request, #38677: [SPARK-41150][PYTHON][DOC] Memory Profile for UDFs
xinrong-meng opened a new pull request, #38677:
URL: https://github.com/apache/spark/pull/38677
### What changes were proposed in this pull request?
Document how to debug Python/Pandas UDFs with the PySpark memory profiler.
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
No. Documentation changes only.
### How was this patch tested?
Existing tests.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon commented on pull request #38677: [SPARK-41150][PYTHON][DOCS] Document debugging with PySpark memory profiler
Posted by GitBox <gi...@apache.org>.
HyukjinKwon commented on PR #38677:
URL: https://github.com/apache/spark/pull/38677#issuecomment-1317938038
Merged to master.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] xinrong-meng commented on pull request #38677: [SPARK-41150][PYTHON][DOCS] Document debugging with PySpark memory profiler
Posted by GitBox <gi...@apache.org>.
xinrong-meng commented on PR #38677:
URL: https://github.com/apache/spark/pull/38677#issuecomment-1317723627
```
FAIL [2.213s]: test_termination_sigterm (pyspark.tests.test_daemon.DaemonTests)
Ensure that daemon and workers terminate on SIGTERM.
----------------------------------------------------------------------
Traceback (most recent call last):
File "/__w/spark/spark/python/pyspark/tests/test_daemon.py", line 77, in test_termination_sigterm
self.do_termination_test(lambda daemon: os.kill(daemon.pid, SIGTERM))
File "/__w/spark/spark/python/pyspark/tests/test_daemon.py", line 67, in do_termination_test
self.fail("Expected EnvironmentError to be raised")
AssertionError: Expected EnvironmentError to be raised
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org
[GitHub] [spark] HyukjinKwon closed pull request #38677: [SPARK-41150][PYTHON][DOCS] Document debugging with PySpark memory profiler
Posted by GitBox <gi...@apache.org>.
HyukjinKwon closed pull request #38677: [SPARK-41150][PYTHON][DOCS] Document debugging with PySpark memory profiler
URL: https://github.com/apache/spark/pull/38677
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org