You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/11/09 16:10:00 UTC
[jira] [Updated] (SPARK-37251) Failed _joinAsOf doctest
[ https://issues.apache.org/jira/browse/SPARK-37251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Dongjoon Hyun updated SPARK-37251:
----------------------------------
Parent: (was: SPARK-37246)
Issue Type: Bug (was: Sub-task)
> Failed _joinAsOf doctest
> ------------------------
>
> Key: SPARK-37251
> URL: https://issues.apache.org/jira/browse/SPARK-37251
> Project: Spark
> Issue Type: Bug
> Components: PySpark
> Affects Versions: 3.3.0
> Reporter: Xinrong Meng
> Priority: Major
>
> {code:java}
> File "/Users/xinrong.meng/spark/python/pyspark/sql/dataframe.py", line 1523, in pyspark.sql.dataframe.DataFrame._joinAsOf
> Failed example:
> left._joinAsOf(
> right, leftAsOfColumn="a", rightAsOfColumn="a", how="left", tolerance=F.lit(1)
> ).select(left.a, 'left_val', 'right_val').sort("a").collect()
> Exception raised:
> Traceback (most recent call last):
> File "/opt/miniconda3/envs/py10/lib/python3.10/doctest.py", line 1348, in __run
> exec(compile(example.source, filename, "single",
> File "<doctest pyspark.sql.dataframe.DataFrame._joinAsOf[5]>", line 1, in <module>
> left._joinAsOf(
> File "/Users/xinrong.meng/spark/python/pyspark/sql/dataframe.py", line 1578, in _joinAsOf
> jdf = self._jdf.joinAsOf(
> File "/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/java_gateway.py", line 1309, in __call__
> return_value = get_return_value(
> File "/Users/xinrong.meng/spark/python/pyspark/sql/utils.py", line 178, in deco
> return f(*a, **kw)
> File "/Users/xinrong.meng/spark/python/lib/py4j-0.10.9.2-src.zip/py4j/protocol.py", line 330, in get_return_value
> raise Py4JError(
> py4j.protocol.Py4JError: An error occurred while calling o283.joinAsOf. Trace:
> py4j.Py4JException: Method joinAsOf([class org.apache.spark.sql.Dataset, class org.apache.spark.sql.Column, class org.apache.spark.sql.Column, null, class java.lang.String, class org.apache.spark.sql.Column, class java.lang.Boolean, class java.lang.String]) does not exist
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org