You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/02/25 18:05:00 UTC
[jira] [Resolved] (SPARK-42561) Add TempView APIs to Dataset
[ https://issues.apache.org/jira/browse/SPARK-42561?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Herman van Hövell resolved SPARK-42561.
---------------------------------------
Fix Version/s: 3.4.1
Resolution: Fixed
> Add TempView APIs to Dataset
> ----------------------------
>
> Key: SPARK-42561
> URL: https://issues.apache.org/jira/browse/SPARK-42561
> Project: Spark
> Issue Type: New Feature
> Components: Connect
> Affects Versions: 3.4.0
> Reporter: Herman van Hövell
> Assignee: Rui Wang
> Priority: Major
> Fix For: 3.4.1
>
>
> Add all temp view APIs to connect's Dataset.
> {code:java}
> /**
> * Registers this Dataset as a temporary table using the given name. The lifetime of this
> * temporary table is tied to the [[SparkSession]] that was used to create this Dataset.
> *
> * @group basic
> * @since 1.6.0
> */
> @deprecated("Use createOrReplaceTempView(viewName) instead.", "2.0.0")
> def registerTempTable(tableName: String): Unit
> /**
> * Creates a local temporary view using the given name. The lifetime of this
> * temporary view is tied to the [[SparkSession]] that was used to create this Dataset.
> *
> * Local temporary view is session-scoped. Its lifetime is the lifetime of the session that
> * created it, i.e. it will be automatically dropped when the session terminates. It's not
> * tied to any databases, i.e. we can't use `db1.view1` to reference a local temporary view.
> *
> * @throws AnalysisException if the view name is invalid or already exists
> *
> * @group basic
> * @since 2.0.0
> */
> @throws[AnalysisException]
> def createTempView(viewName: String): Unit
> /**
> * Creates a local temporary view using the given name. The lifetime of this
> * temporary view is tied to the [[SparkSession]] that was used to create this Dataset.
> *
> * @group basic
> * @since 2.0.0
> */
> def createOrReplaceTempView(viewName: String): Unit
> /**
> * Creates a global temporary view using the given name. The lifetime of this
> * temporary view is tied to this Spark application.
> *
> * Global temporary view is cross-session. Its lifetime is the lifetime of the Spark application,
> * i.e. it will be automatically dropped when the application terminates. It's tied to a system
> * preserved database `global_temp`, and we must use the qualified name to refer a global temp
> * view, e.g. `SELECT * FROM global_temp.view1`.
> *
> * @throws AnalysisException if the view name is invalid or already exists
> *
> * @group basic
> * @since 2.1.0
> */
> @throws[AnalysisException]
> def createGlobalTempView(viewName: String): Unit
> /**
> * Creates or replaces a global temporary view using the given name. The lifetime of this
> * temporary view is tied to this Spark application.
> *
> * Global temporary view is cross-session. Its lifetime is the lifetime of the Spark application,
> * i.e. it will be automatically dropped when the application terminates. It's tied to a system
> * preserved database `global_temp`, and we must use the qualified name to refer a global temp
> * view, e.g. `SELECT * FROM global_temp.view1`.
> *
> * @group basic
> * @since 2.2.0
> */
> def createOrReplaceGlobalTempView(viewName: String): Unit {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org