You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2025/11/25 04:58:00 UTC
[jira] [Updated] (SPARK-54494) Reeanble test_memory_profiler_map_in_pandas_not_supported / test_memory_profiler_pandas_udf_iterator_not_supported
[ https://issues.apache.org/jira/browse/SPARK-54494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-54494:
---------------------------------
Description:
{code}
======================================================================
FAIL [0.222s]: test_memory_profiler_map_in_pandas_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerParityTests.test_memory_profiler_map_in_pandas_not_supported)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 395, in test_memory_profiler_map_in_pandas_not_supported
self.assertEqual(0, len(self.profile_results), str(self.profile_results.keys()))
AssertionError: 0 != 1 : dict_keys([29615])
======================================================================
FAIL [0.593s]: test_memory_profiler_pandas_udf_iterator_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerParityTests.test_memory_profiler_pandas_udf_iterator_not_supported)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 370, in test_memory_profiler_pandas_udf_iterator_not_supported
self.assertEqual(1, len(self.profile_results), str(self.profile_results.keys()))
AssertionError: 1 != 3 : dict_keys([29647, 29648, 29650])
======================================================================
FAIL [0.217s]: test_memory_profiler_map_in_pandas_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerWithoutPlanCacheParityTests.test_memory_profiler_map_in_pandas_not_supported)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 395, in test_memory_profiler_map_in_pandas_not_supported
self.assertEqual(0, len(self.profile_results), str(self.profile_results.keys()))
AssertionError: 0 != 1 : dict_keys([30115])
======================================================================
FAIL [0.622s]: test_memory_profiler_pandas_udf_iterator_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerWithoutPlanCacheParityTests.test_memory_profiler_pandas_udf_iterator_not_supported)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 370, in test_memory_profiler_pandas_udf_iterator_not_supported
self.assertEqual(1, len(self.profile_results), str(self.profile_results.keys()))
AssertionError: 1 != 3 : dict_keys([30147, 30148, 30150])
----------------------------------------------------------------------
Ran 33 tests in 13.199s
FAILED (failures=4)
{code}
was:
```
======================================================================
FAIL [0.222s]: test_memory_profiler_map_in_pandas_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerParityTests.test_memory_profiler_map_in_pandas_not_supported)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 395, in test_memory_profiler_map_in_pandas_not_supported
self.assertEqual(0, len(self.profile_results), str(self.profile_results.keys()))
AssertionError: 0 != 1 : dict_keys([29615])
======================================================================
FAIL [0.593s]: test_memory_profiler_pandas_udf_iterator_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerParityTests.test_memory_profiler_pandas_udf_iterator_not_supported)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 370, in test_memory_profiler_pandas_udf_iterator_not_supported
self.assertEqual(1, len(self.profile_results), str(self.profile_results.keys()))
AssertionError: 1 != 3 : dict_keys([29647, 29648, 29650])
======================================================================
FAIL [0.217s]: test_memory_profiler_map_in_pandas_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerWithoutPlanCacheParityTests.test_memory_profiler_map_in_pandas_not_supported)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 395, in test_memory_profiler_map_in_pandas_not_supported
self.assertEqual(0, len(self.profile_results), str(self.profile_results.keys()))
AssertionError: 0 != 1 : dict_keys([30115])
======================================================================
FAIL [0.622s]: test_memory_profiler_pandas_udf_iterator_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerWithoutPlanCacheParityTests.test_memory_profiler_pandas_udf_iterator_not_supported)
----------------------------------------------------------------------
Traceback (most recent call last):
File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 370, in test_memory_profiler_pandas_udf_iterator_not_supported
self.assertEqual(1, len(self.profile_results), str(self.profile_results.keys()))
AssertionError: 1 != 3 : dict_keys([30147, 30148, 30150])
----------------------------------------------------------------------
Ran 33 tests in 13.199s
FAILED (failures=4)
```
> Reeanble test_memory_profiler_map_in_pandas_not_supported / test_memory_profiler_pandas_udf_iterator_not_supported
> -------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-54494
> URL: https://issues.apache.org/jira/browse/SPARK-54494
> Project: Spark
> Issue Type: Sub-task
> Components: Tests
> Affects Versions: 4.1.0, 4.0.1, 4.2.0
> Reporter: Hyukjin Kwon
> Priority: Major
>
> {code}
> ======================================================================
> FAIL [0.222s]: test_memory_profiler_map_in_pandas_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerParityTests.test_memory_profiler_map_in_pandas_not_supported)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 395, in test_memory_profiler_map_in_pandas_not_supported
> self.assertEqual(0, len(self.profile_results), str(self.profile_results.keys()))
> AssertionError: 0 != 1 : dict_keys([29615])
> ======================================================================
> FAIL [0.593s]: test_memory_profiler_pandas_udf_iterator_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerParityTests.test_memory_profiler_pandas_udf_iterator_not_supported)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 370, in test_memory_profiler_pandas_udf_iterator_not_supported
> self.assertEqual(1, len(self.profile_results), str(self.profile_results.keys()))
> AssertionError: 1 != 3 : dict_keys([29647, 29648, 29650])
> ======================================================================
> FAIL [0.217s]: test_memory_profiler_map_in_pandas_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerWithoutPlanCacheParityTests.test_memory_profiler_map_in_pandas_not_supported)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 395, in test_memory_profiler_map_in_pandas_not_supported
> self.assertEqual(0, len(self.profile_results), str(self.profile_results.keys()))
> AssertionError: 0 != 1 : dict_keys([30115])
> ======================================================================
> FAIL [0.622s]: test_memory_profiler_pandas_udf_iterator_not_supported (pyspark.sql.tests.connect.test_parity_memory_profiler.MemoryProfilerWithoutPlanCacheParityTests.test_memory_profiler_pandas_udf_iterator_not_supported)
> ----------------------------------------------------------------------
> Traceback (most recent call last):
> File "/home/runner/work/spark/spark-4.0/python/pyspark/tests/test_memory_profiler.py", line 370, in test_memory_profiler_pandas_udf_iterator_not_supported
> self.assertEqual(1, len(self.profile_results), str(self.profile_results.keys()))
> AssertionError: 1 != 3 : dict_keys([30147, 30148, 30150])
> ----------------------------------------------------------------------
> Ran 33 tests in 13.199s
> FAILED (failures=4)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org