You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/11/09 02:35:00 UTC
[jira] [Resolved] (SPARK-37247) Failed
test_create_nan_decimal_dataframe
(pyspark.sql.tests.test_dataframe.DataFrameTests)
[ https://issues.apache.org/jira/browse/SPARK-37247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xinrong Meng resolved SPARK-37247.
----------------------------------
Resolution: Invalid
> Failed test_create_nan_decimal_dataframe (pyspark.sql.tests.test_dataframe.DataFrameTests)
> ------------------------------------------------------------------------------------------
>
> Key: SPARK-37247
> URL: https://issues.apache.org/jira/browse/SPARK-37247
> Project: Spark
> Issue Type: Sub-task
> Components: PySpark
> Affects Versions: 3.3.0
> Reporter: Xinrong Meng
> Priority: Major
>
> {code:java}
> File "/Users/xinrong.meng/spark/python/pyspark/sql/tests/test_dataframe.py", line 957, in test_create_nan_decimal_dataframe
> self.spark.createDataFrame(data=[Decimal('NaN')], schema='decimal').collect(),
> File "/Users/xinrong.meng/spark/python/pyspark/sql/dataframe.py", line 751, in collect
> sock_info = self._jdf.collectToPython()
> File "/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/java_gateway.py", line 1309, in __call__
> return_value = get_return_value(
> File "/Users/xinrong.meng/spark/python/pyspark/sql/utils.py", line 178, in deco
> return f(*a, **kw)
> File "/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/protocol.py", line 326, in get_return_value
> raise Py4JJavaError(
> py4j.protocol.Py4JJavaError: An error occurred while calling o135.collectToPython.
> : org.apache.spark.SparkException: Job aborted due to stage failure: Task 3 in stage 2.0 failed 1 times, most recent failure: Lost task 3.0 in stage 2.0 (TID 7) (172.16.203.223 executor driver): net.razorvine.pickle.PickleException: problem construction object: java.lang.reflect.InvocationTargetException
> ...{code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org