You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/10/23 00:19:00 UTC
[jira] [Updated] (SPARK-44406) DataFrame depending on temp view fail after the view is dropped
[ https://issues.apache.org/jira/browse/SPARK-44406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated SPARK-44406:
-----------------------------------
Labels: pull-request-available (was: )
> DataFrame depending on temp view fail after the view is dropped
> ---------------------------------------------------------------
>
> Key: SPARK-44406
> URL: https://issues.apache.org/jira/browse/SPARK-44406
> Project: Spark
> Issue Type: Bug
> Components: Connect
> Affects Versions: 3.5.0
> Reporter: Ruifeng Zheng
> Priority: Major
> Labels: pull-request-available
>
> In vanilla Spark:
> {code:java}
> In [1]: df = spark.createDataFrame([(1, 4), (2, 4), (3, 6)], ["A", "B"])
> In [2]: df.createOrReplaceTempView("t")
> In [3]: df2 = spark.sql("select * from t")
> In [4]: df2.show()
> +---+---+
> | A| B|
> +---+---+
> | 1| 4|
> | 2| 4|
> | 3| 6|
> +---+---+
> In [5]: spark.catalog.dropTempView("t")
> Out[5]: True
> In [6]: df2.show()
> +---+---+
> | A| B|
> +---+---+
> | 1| 4|
> | 2| 4|
> | 3| 6|
> +---+---+
> {code}
> In Spark Connect:
> {code:java}
> In [1]: df = spark.createDataFrame([(1, 4), (2, 4), (3, 6)], ["A", "B"])
> In [2]: df.createOrReplaceTempView("t")
> In [3]: df2 = spark.sql("select * from t")
> In [4]: df2.show()
> +---+---+
> | A| B|
> +---+---+
> | 1| 4|
> | 2| 4|
> | 3| 6|
> +---+---+
> In [5]: spark.catalog.dropTempView("t")
> Out[5]: True
> In [6]: df2.show()
> 23/07/13 11:57:18 ERROR SparkConnectService: Error during: execute. UserId: ruifeng.zheng. SessionId: 1fc234fd-07da-4ad0-9ec5-2d818cef6033.
> org.apache.spark.sql.AnalysisException: [TABLE_OR_VIEW_NOT_FOUND] The table or view `t` cannot be found. Verify the spelling and correctness of the schema and catalog.
> If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
> To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS.; line 1 pos 14;
> 'Project [*]
> +- 'UnresolvedRelation [t], [], false
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org