You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2025/12/25 09:01:00 UTC
[jira] [Updated] (SPARK-54842) Fix test_arrow_udf_chained_iii in Python-Only MacOS26
[ https://issues.apache.org/jira/browse/SPARK-54842?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ruifeng Zheng updated SPARK-54842:
----------------------------------
Issue Type: Test (was: Improvement)
> Fix test_arrow_udf_chained_iii in Python-Only MacOS26
> -----------------------------------------------------
>
> Key: SPARK-54842
> URL: https://issues.apache.org/jira/browse/SPARK-54842
> Project: Spark
> Issue Type: Test
> Components: PySpark, Tests
> Affects Versions: 4.2.0
> Reporter: Ruifeng Zheng
> Priority: Major
>
> {code:java}
> Caused by: org.apache.spark.api.python.PythonException: Traceback (most recent call last):
> File "/Users/runner/work/spark/spark/python/lib/pyspark.zip/pyspark/worker.py", line 3511, in main
> process()
> File "/Users/runner/work/spark/spark/python/lib/pyspark.zip/pyspark/worker.py", line 3502, in process
> serializer.dump_stream(out_iter, outfile)
> File "/Users/runner/work/spark/spark/python/lib/pyspark.zip/pyspark/sql/pandas/serializers.py", line 781, in dump_stream
> return ArrowStreamSerializer.dump_stream(self, wrap_and_init_stream(), stream)
> ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
> File "/Users/runner/work/spark/spark/python/lib/pyspark.zip/pyspark/sql/pandas/serializers.py", line 120, in dump_stream
> for batch in iterator:
> File "/Users/runner/work/spark/spark/python/lib/pyspark.zip/pyspark/sql/pandas/serializers.py", line 765, in wrap_and_init_stream
> for packed in iterator:
> File "/Users/runner/work/spark/spark/python/lib/pyspark.zip/pyspark/worker.py", line 2954, in func
> for result_batch, result_type in result_iter:
> File "/Users/runner/work/spark/spark/python/pyspark/sql/tests/arrow/test_arrow_udf_scalar.py", line 930, in <lambda>
> lambda it: map(lambda x: pa.compute.subtract(x, 1), it),
> ^^^^^^^^^^
> AttributeError: module 'pyarrow' has no attribute 'compute' {code}
>
> https://github.com/apache/spark/actions/runs/20495264978/job/58904792835
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org