You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2023/02/25 00:36:00 UTC

[jira] [Commented] (SPARK-42561) Add TempView APIs to Dataset

    [ https://issues.apache.org/jira/browse/SPARK-42561?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17693388#comment-17693388 ] 

Apache Spark commented on SPARK-42561:
--------------------------------------

User 'amaliujia' has created a pull request for this issue:
https://github.com/apache/spark/pull/40167

> Add TempView APIs to Dataset
> ----------------------------
>
>                 Key: SPARK-42561
>                 URL: https://issues.apache.org/jira/browse/SPARK-42561
>             Project: Spark
>          Issue Type: New Feature
>          Components: Connect
>    Affects Versions: 3.4.0
>            Reporter: Herman van Hövell
>            Assignee: Rui Wang
>            Priority: Major
>
> Add all temp view APIs to connect's Dataset.
> {code:java}
> /**
> * Registers this Dataset as a temporary table using the given name. The lifetime of this
> * temporary table is tied to the [[SparkSession]] that was used to create this Dataset.
> *
> * @group basic
> * @since 1.6.0
> */
> @deprecated("Use createOrReplaceTempView(viewName) instead.", "2.0.0")
> def registerTempTable(tableName: String): Unit
> /**
> * Creates a local temporary view using the given name. The lifetime of this
> * temporary view is tied to the [[SparkSession]] that was used to create this Dataset.
> *
> * Local temporary view is session-scoped. Its lifetime is the lifetime of the session that
> * created it, i.e. it will be automatically dropped when the session terminates. It's not
> * tied to any databases, i.e. we can't use `db1.view1` to reference a local temporary view.
> *
> * @throws AnalysisException if the view name is invalid or already exists
> *
> * @group basic
> * @since 2.0.0
> */
> @throws[AnalysisException]
> def createTempView(viewName: String): Unit
> /**
> * Creates a local temporary view using the given name. The lifetime of this
> * temporary view is tied to the [[SparkSession]] that was used to create this Dataset.
> *
> * @group basic
> * @since 2.0.0
> */
> def createOrReplaceTempView(viewName: String): Unit
> /**
> * Creates a global temporary view using the given name. The lifetime of this
> * temporary view is tied to this Spark application.
> *
> * Global temporary view is cross-session. Its lifetime is the lifetime of the Spark application,
> * i.e. it will be automatically dropped when the application terminates. It's tied to a system
> * preserved database `global_temp`, and we must use the qualified name to refer a global temp
> * view, e.g. `SELECT * FROM global_temp.view1`.
> *
> * @throws AnalysisException if the view name is invalid or already exists
> *
> * @group basic
> * @since 2.1.0
> */
> @throws[AnalysisException]
> def createGlobalTempView(viewName: String): Unit
> /**
> * Creates or replaces a global temporary view using the given name. The lifetime of this
> * temporary view is tied to this Spark application.
> *
> * Global temporary view is cross-session. Its lifetime is the lifetime of the Spark application,
> * i.e. it will be automatically dropped when the application terminates. It's tied to a system
> * preserved database `global_temp`, and we must use the qualified name to refer a global temp
> * view, e.g. `SELECT * FROM global_temp.view1`.
> *
> * @group basic
> * @since 2.2.0
> */
> def createOrReplaceGlobalTempView(viewName: String): Unit {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org