You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2020/09/21 23:40:00 UTC
[jira] [Created] (SPARK-32960) Provide better exception on
temporary view against DataFrameWriterV2
Jungtaek Lim created SPARK-32960:
------------------------------------
Summary: Provide better exception on temporary view against DataFrameWriterV2
Key: SPARK-32960
URL: https://issues.apache.org/jira/browse/SPARK-32960
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.1.0
Reporter: Jungtaek Lim
DataFrameWriterV2 doesn't handle fail-back if catalog.loadTable doesn't provide any Table instance. This ends up leading temp view to NoSuchTableException.
It's OK to fail for such case unless we want to resolve it later like DataFrameWriter.insertInto, but throwing NoSuchTableException is probably confusing, as view is loaded via catalog.loadTable and fails with capability check, not NoSuchTableException.
We could check in prior whether the table identifier refers temp view, and provide better exception.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org