You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Xiao Li (JIRA)" <ji...@apache.org> on 2016/05/24 22:16:12 UTC
[jira] [Updated] (SPARK-15515) Error Handling in Running SQL
Directly On Files
[ https://issues.apache.org/jira/browse/SPARK-15515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiao Li updated SPARK-15515:
----------------------------
Description:
For ORC source format, we are reporting the strange error message when we did not enable Hive support:
{noformat}
Table or view not found: `org.apache.spark.sql.hive.orc`.`file_path`
{noformat}
The example query is like
{noformat}
sql(s"select id from `org.apache.spark.sql.hive.orc`.`file_path`")
{noformat}
Instead, we should issue the error message like:
{noformat}
"The ORC data source must be used with Hive support enabled"
{noformat}
For the Avro format, we still report the error message like:
{noformat}
Table or view not found: `com.databricks.spark.avro`.`file_path`
{noformat}
The example query is like
{noformat}
sql(s"select id from `avro`.`file_path`")
sql(s"select id from `com.databricks.spark.avro`.`file_path`")
{noformat}
The desired message should be like:
{noformat}
Failed to find data source: avro. Please use Spark package http://spark-packages.org/package/databricks/spark-avro"
{noformat}
was:
For ORC source format, we are reporting the strange error message when we did not enable Hive support:
{noformat}
Table or view not found: `org.apache.spark.sql.hive.orc`.`file_path`
{noformat}
The example query is like
{noformat}
sql(s"select id from `org.apache.spark.sql.hive.orc`.`file_path`")
{noformat}
Instead, we should issue the error message like:
{noformat}
"The ORC data source must be used with Hive support enabled"
{noformat}
For the Avro format, we still report the error message like:
sql(s"select id from `com.databricks.spark.avro`.`file_path`")
{noformat}
Table or view not found: `com.databricks.spark.avro`.`file_path`
{noformat}
The example query is like
{noformat}
sql(s"select id from `avro`.`file_path`")
sql(s"select id from `com.databricks.spark.avro`.`file_path`")
{noformat}
The desired message should be like:
{noformat}
Failed to find data source: avro. Please use Spark package http://spark-packages.org/package/databricks/spark-avro"
{noformat}
> Error Handling in Running SQL Directly On Files
> -----------------------------------------------
>
> Key: SPARK-15515
> URL: https://issues.apache.org/jira/browse/SPARK-15515
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.0
> Reporter: Xiao Li
>
> For ORC source format, we are reporting the strange error message when we did not enable Hive support:
> {noformat}
> Table or view not found: `org.apache.spark.sql.hive.orc`.`file_path`
> {noformat}
> The example query is like
> {noformat}
> sql(s"select id from `org.apache.spark.sql.hive.orc`.`file_path`")
> {noformat}
> Instead, we should issue the error message like:
> {noformat}
> "The ORC data source must be used with Hive support enabled"
> {noformat}
> For the Avro format, we still report the error message like:
> {noformat}
> Table or view not found: `com.databricks.spark.avro`.`file_path`
> {noformat}
> The example query is like
> {noformat}
> sql(s"select id from `avro`.`file_path`")
> sql(s"select id from `com.databricks.spark.avro`.`file_path`")
> {noformat}
> The desired message should be like:
> {noformat}
> Failed to find data source: avro. Please use Spark package http://spark-packages.org/package/databricks/spark-avro"
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org