You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2020/06/03 01:02:00 UTC

[jira] [Created] (SPARK-31895) df.explain("mode") should work in PySpark side as well for consistency

Hyukjin Kwon created SPARK-31895:
------------------------------------

             Summary: df.explain("mode") should work in PySpark side as well for consistency
                 Key: SPARK-31895
                 URL: https://issues.apache.org/jira/browse/SPARK-31895
             Project: Spark
          Issue Type: Bug
          Components: PySpark
    Affects Versions: 3.0.0
            Reporter: Hyukjin Kwon


Scala:

{code}
scala> spark.range(10).explain("cost")
== Optimized Logical Plan ==
Range (0, 10, step=1, splits=Some(12)), Statistics(sizeInBytes=80.0 B)

== Physical Plan ==
*(1) Range (0, 10, step=1, splits=12)
{code}

PySpark:

{code}
>>> spark.range(10).explain("cost")
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/.../spark/python/pyspark/sql/dataframe.py", line 333, in explain
    raise TypeError(err_msg)
TypeError: extended (optional) should be provided as bool, got <class 'str'>
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org