You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Mohammed Guller <mo...@glassbeam.com> on 2015/08/04 20:45:19 UTC

Spark SQL unable to recognize schema name 

Hi -

I am running the Thrift JDBC/ODBC server (v1.4.1) and encountered a problem when querying tables using fully qualified table names(schemaName.tableName). The following query works fine from the beeline tool:

SELECT * from test;

However, the following query throws an exception, even though the table “test” does exist under the “default” schema:

SELECT * from default.test;

Error: org.apache.spark.sql.AnalysisException: no such table default.test; line 1 pos 22 (state=,code=0)

Here is the exception trace on the Thrift Server console:

15/08/04 14:27:03 WARN ThriftCLIService: Error executing statement:
org.apache.hive.service.cli.HiveSQLException: org.apache.spark.sql.AnalysisException: no such table default.test; line 1 pos 22
        at org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.run(Shim13.scala:206)
        at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:231)
        at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:218)
        at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:606)
        at org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:79)
        at org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:37)
        at org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:64)
        at java.security.AccessController.doPrivileged(Native Method)


Is it a bug in 1.4.1 or am I missing some configuration parameter?

Mohammed

Re: Spark SQL unable to recognize schema name

Posted by Ted Yu <yu...@gmail.com>.
This should have been fixed by:
    [SPARK-7943] [SPARK-8105] [SPARK-8435] [SPARK-8714] [SPARK-8561] Fixes
multi-database support

The fix is in the upcoming 1.5.0

FYI

On Tue, Aug 4, 2015 at 11:45 AM, Mohammed Guller <mo...@glassbeam.com>
wrote:

> Hi -
>
>
>
> I am running the Thrift JDBC/ODBC server (v1.4.1) and encountered a
> problem when querying tables using fully qualified table
> names(schemaName.tableName). The following query works fine from the
> beeline tool:
>
>
>
> SELECT * from test;
>
>
>
> However, the following query throws an exception, even though the table
> “test” does exist under the “default” schema:
>
>
>
> SELECT * from default.test;
>
>
>
> Error: org.apache.spark.sql.AnalysisException: no such table default.test;
> line 1 pos 22 (state=,code=0)
>
>
>
> Here is the exception trace on the Thrift Server console:
>
>
>
> 15/08/04 14:27:03 WARN ThriftCLIService: Error executing statement:
>
> org.apache.hive.service.cli.HiveSQLException:
> org.apache.spark.sql.AnalysisException: no such table default.test; line 1
> pos 22
>
>         at
> org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.run(Shim13.scala:206)
>
>         at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:231)
>
>         at
> org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:218)
>
>         at sun.reflect.GeneratedMethodAccessor65.invoke(Unknown Source)
>
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
>         at java.lang.reflect.Method.invoke(Method.java:606)
>
>         at
> org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:79)
>
>         at
> org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:37)
>
>         at
> org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:64)
>
>         at java.security.AccessController.doPrivileged(Native Method)
>
>
>
>
>
> Is it a bug in 1.4.1 or am I missing some configuration parameter?
>
>
>
> Mohammed
>
>
>