You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/10/12 03:10:00 UTC
[jira] [Updated] (SPARK-36971) Query files directly with SQL is
broken (with Glue)
[ https://issues.apache.org/jira/browse/SPARK-36971?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hyukjin Kwon updated SPARK-36971:
---------------------------------
Priority: Major (was: Critical)
> Query files directly with SQL is broken (with Glue)
> ---------------------------------------------------
>
> Key: SPARK-36971
> URL: https://issues.apache.org/jira/browse/SPARK-36971
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 3.1.2
> Environment: Databricks Runtime 9.1 and 10.0 Beta
> Reporter: Lauri Koobas
> Priority: Major
>
> This is broken in DBR 9.1 (and 10.0 Beta):
> {{ select * from json.`filename`}}
> [https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select-file.html]
> I have tried with JSON and Parquet files.
> The error:
> {color:#FF0000}{{Error in SQL statement: SparkException: Unable to fetch tables of db json}}{color}
> Down in the stack trace this also exists:
> {{{color:#FF0000}Caused by: NoSuchObjectException(message:Database json not found. (Service: AWSGlue; Status Code: 400; Error Code: EntityNotFoundException; ... )){color}}}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org