[GitHub] [spark] HyukjinKwon commented on pull request #34245: [SPARK-37088][PYSPARK][SQL] Writer thread must not access input after task completion listener returns

[GitBox <gi...@apache.org>]

HyukjinKwon commented on pull request #34245:
URL: https://github.com/apache/spark/pull/34245#issuecomment-950250234


   Hm, the UDF tests (`test_udf_with_column_vector`) became flaky IMO from this PR:
   
   ```
   #
   # A fatal error has been detected by the Java Runtime Environment:
   #
   #  SIGSEGV (0xb) at pc=0x00007f1cf90527b5, pid=49084, tid=0x00007f1ca0bed700
   #
   # JRE version: OpenJDK Runtime Environment (8.0_292-b10) (build 1.8.0_292-8u292-b10-0ubuntu1~20.04-b10)
   # Java VM: OpenJDK 64-Bit Server VM (25.292-b10 mixed mode linux-amd64 compressed oops)
   # Problematic frame:
   # v  ~StubRoutines::jlong_disjoint_arraycopy
   #
   # Core dump written. Default location: /__w/spark/spark/core or core.49084
   #
   # An error report file with more information is saved as:
   # /__w/spark/spark/hs_err_pid49084.log
   #
   # If you would like to submit a bug report, please visit:
   #   http://bugreport.java.com/bugreport/crash.jsp
   #
   ```
   
   https://github.com/apache/spark/runs/3981850943?check_suite_focus=true
   https://github.com/apache/spark/runs/3981850943?check_suite_focus=true
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org