You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2020/06/03 01:02:00 UTC
[jira] [Created] (SPARK-31895) df.explain("mode") should work in
PySpark side as well for consistency
Hyukjin Kwon created SPARK-31895:
------------------------------------
Summary: df.explain("mode") should work in PySpark side as well for consistency
Key: SPARK-31895
URL: https://issues.apache.org/jira/browse/SPARK-31895
Project: Spark
Issue Type: Bug
Components: PySpark
Affects Versions: 3.0.0
Reporter: Hyukjin Kwon
Scala:
{code}
scala> spark.range(10).explain("cost")
== Optimized Logical Plan ==
Range (0, 10, step=1, splits=Some(12)), Statistics(sizeInBytes=80.0 B)
== Physical Plan ==
*(1) Range (0, 10, step=1, splits=12)
{code}
PySpark:
{code}
>>> spark.range(10).explain("cost")
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
File "/.../spark/python/pyspark/sql/dataframe.py", line 333, in explain
raise TypeError(err_msg)
TypeError: extended (optional) should be provided as bool, got <class 'str'>
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org