You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2017/10/28 15:40:00 UTC
[jira] [Commented] (SPARK-22369) PySpark: Document methods of
spark.catalog interface
[ https://issues.apache.org/jira/browse/SPARK-22369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16223591#comment-16223591 ]
Apache Spark commented on SPARK-22369:
--------------------------------------
User 'HyukjinKwon' has created a pull request for this issue:
https://github.com/apache/spark/pull/19596
> PySpark: Document methods of spark.catalog interface
> ----------------------------------------------------
>
> Key: SPARK-22369
> URL: https://issues.apache.org/jira/browse/SPARK-22369
> Project: Spark
> Issue Type: Documentation
> Components: PySpark
> Affects Versions: 2.2.0
> Reporter: Andreas Maier
>
> The following methods from the {{spark.catalog}} interface are not documented.
> {code:java}
> $ pyspark
> >>> dir(spark.catalog)
> ['__class__', '__delattr__', '__dict__', '__dir__', '__doc__', '__eq__', '__format__', '__ge__', '__getattribute__', '__gt__', '__hash__', '__init__', '__init_subclass__', '__le__', '__lt__', '__module__', '__ne__', '__new__', '__reduce__', '__reduce_ex__', '__repr__', '__setattr__', '__sizeof__', '__str__', '__subclasshook__', '__weakref__', '_jcatalog', '_jsparkSession', '_reset', '_sparkSession', 'cacheTable', 'clearCache', 'createExternalTable', 'createTable', 'currentDatabase', 'dropGlobalTempView', 'dropTempView', 'isCached', 'listColumns', 'listDatabases', 'listFunctions', 'listTables', 'recoverPartitions', 'refreshByPath', 'refreshTable', 'registerFunction', 'setCurrentDatabase', 'uncacheTable']
> {code}
> As a user I would like to have these methods documented on
> http://spark.apache.org/docs/latest/api/python/pyspark.sql.html . Old methods of the SQLContext (e.g. {{pyspark.sql.SQLContext.cacheTable()}} vs. {{pyspark.sql.SparkSession.catalog.cacheTable()}} or {{pyspark.sql.HiveContext.refreshTable()}} vs. {{pyspark.sql.SparkSession.catalog.refreshTable()}} ) should point to the new method.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org