You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2020/10/08 02:13:00 UTC
[jira] [Resolved] (SPARK-32960) Provide better exception on
temporary view against DataFrameWriterV2
[ https://issues.apache.org/jira/browse/SPARK-32960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jungtaek Lim resolved SPARK-32960.
----------------------------------
Resolution: Won't Fix
Superceded by SPARK-33087
> Provide better exception on temporary view against DataFrameWriterV2
> --------------------------------------------------------------------
>
> Key: SPARK-32960
> URL: https://issues.apache.org/jira/browse/SPARK-32960
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.1.0
> Reporter: Jungtaek Lim
> Priority: Minor
>
> DataFrameWriterV2 doesn't handle fail-back if catalog.loadTable doesn't provide any Table instance. This ends up leading temp view to NoSuchTableException.
> It's OK to fail for such case unless we want to resolve it later like DataFrameWriter.insertInto, but throwing NoSuchTableException is probably confusing, as view is loaded via catalog.loadTable and fails with capability check, not NoSuchTableException.
> We could check in prior whether the table identifier refers temp view, and provide better exception.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org