You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by David Du <dd...@bcmcgroup.com> on 2020/02/12 18:27:56 UTC
Error: DATA_READ ERROR: The JDBC storage plugin failed while trying
setup the SQL query
Hi
1. I installed the 4.1.4 community version of dremio, and from its web UI,
created Demo workspace, then used the samples csv file Samples."
samples.dremio.com"."SF weather 2018-2019.csv" and saved as weather into
the Demo workspace, so when clicked on Demo workspace, on the right side
panel the weather name showed up, the copied path is Demo.weather.
2. I installed the apache-drill-1.17.0 and dropped the jdbc file:
dremio-jdbc-driver-4.1.4-202001240912140359-a90eb503.jar into the
jars/3rdparty folder and jdbc-driver folder.
3. Started apache drill with ./drill-embedded command, then went to drill
web UI, created storage plugin: dremiodemo:
{
"type": "jdbc",
"driver": "com.dremio.jdbc.Driver",
"url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
"username": "admin",
"password": "",
"caseInsensitiveTableNames": true,
"enabled": true
}
since apache drill is also using 31010, I changed the dremio jdbc port to
41010 in the conf file.
4. from drill started session, type show databases;
dremiodemo.demo is listed as one of the schema names,
then:
type select * from dremiodemo.demo.weather;
I got error: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query.
sql SELECT *
FROM "DREMIO"."Demo"."weather"
plugin dremiodemo
Fragment 0:0
in the Dremio server.log file, it showed erro:
Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table
'DREMIO.Demo.weather' not found
Any clues? thanks for help.
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by David Du <dd...@bcmcgroup.com>.
show *schemas*;
+-------------------------------------------+
| * SCHEMA_NAME * |
+-------------------------------------------+
| cp.default |
| dfs.default |
| dfs.root |
| dfs.tmp |
| dremiodemo.$scratch |
| dremiodemo.@admin |
| dremiodemo.demo |
| dremiodemo.dremio
dremiodemo.information_schema |
| dremiodemo.samples |
| dremiodemo.samples.samples.dremio.com |
| dremiodemo.sys |
| dremiodemo.sys.cache |
| dremiodemo.testspace |
| dremiodemo |
| information_schema |
| sys
*use* dremiodemo.demo;
+------+---------------------------------------------+
| * ok * | * summary * |
+------+---------------------------------------------+
| true | Default schema changed to [dremiodemo.demo] |
+------+---------------------------------------------+
1 row selected (0.109 seconds)
apache drill (dremiodemo.demo)> show *tables*;
+-----------------+------------+
| * TABLE_SCHEMA * | *TABLE_NAME* |
+-----------------+------------+
| dremiodemo.demo | topips |
| dremiodemo.demo | weather |
+-----------------+------------+
2 rows selected (0.229 seconds)
apache drill (dremiodemo.demo)> *describe* weather;
+-------------+-------------------+-------------+
| *COLUMN_NAME* | * DATA_TYPE * | *IS_NULLABLE* |
+-------------+-------------------+-------------+
| A | CHARACTER VARYING | YES |
| B | CHARACTER VARYING | YES |
| C | CHARACTER VARYING | YES |
| D | CHARACTER VARYING | YES |
| E | CHARACTER VARYING | YES |
| F | CHARACTER VARYING | YES |
| G | CHARACTER VARYING | YES |
| H | CHARACTER VARYING | YES |
| I | CHARACTER VARYING | YES |
| J | CHARACTER VARYING | YES |
| K | CHARACTER VARYING | YES |
| L | CHARACTER VARYING | YES |
+-------------+-------------------+-------------+
12 rows selected (0.601 seconds)
apache drill (dremiodemo.demo)> *select* * *from* weather;
Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
the SQL query.
sql SELECT *
FROM "DREMIO"."Demo"."weather"
plugin dremiodemo
Fragment 0:0
On Wed, Feb 12, 2020 at 1:35 PM Jaimes, Rafael <Ra...@ll.mit.edu>
wrote:
> Like Charles recommended, try backticks.
>
> Also:
>
> From the Drill shell what is the output of 'show schemas;' ?
> After 'use <schema>', what is the output of 'show tables;' ?
>
> On 2/12/20 1:32 PM, Charles Givre wrote:
> > Did you try removing the double quotes?
> > IE:
> > SELECT *
> > FROM dremio.`demo`.`weather`
> >
> >
> >> On Feb 12, 2020, at 1:27 PM, David Du <dd...@bcmcgroup.com> wrote:
> >>
> >> Hi
> >> 1. I installed the 4.1.4 community version of dremio, and from its web
> UI,
> >> created Demo workspace, then used the samples csv file Samples."
> >> samples.dremio.com"."SF weather 2018-2019.csv" and saved as weather
> into
> >> the Demo workspace, so when clicked on Demo workspace, on the right side
> >> panel the weather name showed up, the copied path is Demo.weather.
> >> 2. I installed the apache-drill-1.17.0 and dropped the jdbc file:
> >> dremio-jdbc-driver-4.1.4-202001240912140359-a90eb503.jar into the
> >> jars/3rdparty folder and jdbc-driver folder.
> >> 3. Started apache drill with ./drill-embedded command, then went to
> drill
> >> web UI, created storage plugin: dremiodemo:
> >> {
> >> "type": "jdbc",
> >> "driver": "com.dremio.jdbc.Driver",
> >> "url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
> >> "username": "admin",
> >> "password": "",
> >> "caseInsensitiveTableNames": true,
> >> "enabled": true
> >> }
> >> since apache drill is also using 31010, I changed the dremio jdbc port
> to
> >> 41010 in the conf file.
> >> 4. from drill started session, type show databases;
> >> dremiodemo.demo is listed as one of the schema names,
> >> then:
> >> type select * from dremiodemo.demo.weather;
> >> I got error: Error: DATA_READ ERROR: The JDBC storage plugin failed
> while
> >> trying setup the SQL query.
> >>
> >> sql SELECT *
> >>
> >> FROM "DREMIO"."Demo"."weather"
> >>
> >> plugin dremiodemo
> >>
> >> Fragment 0:0
> >>
> >> in the Dremio server.log file, it showed erro:
> >> Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table
> >> 'DREMIO.Demo.weather' not found
> >> Any clues? thanks for help.
> >>
> >> --
> >> ********************************************************
> >> DISCLAIMER: This
> >> e-mail, including any attached files,
> >> is confidential, may be legally
> >> privileged, and is
> >> solely for the intended recipient(s). If you received
> >>
> >> this e-mail in error, please destroy it and notify us
> >> immediately by reply
> >> e-mail. Any unauthorized
> >> use, dissemination, disclosure, copying or
> >> printing is
> >> strictly prohibited. - BCMC, LLC
>
>
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by "Jaimes, Rafael" <Ra...@ll.mit.edu>.
Like Charles recommended, try backticks.
Also:
From the Drill shell what is the output of 'show schemas;' ?
After 'use <schema>', what is the output of 'show tables;' ?
On 2/12/20 1:32 PM, Charles Givre wrote:
> Did you try removing the double quotes?
> IE:
> SELECT *
> FROM dremio.`demo`.`weather`
>
>
>> On Feb 12, 2020, at 1:27 PM, David Du <dd...@bcmcgroup.com> wrote:
>>
>> Hi
>> 1. I installed the 4.1.4 community version of dremio, and from its web UI,
>> created Demo workspace, then used the samples csv file Samples."
>> samples.dremio.com"."SF weather 2018-2019.csv" and saved as weather into
>> the Demo workspace, so when clicked on Demo workspace, on the right side
>> panel the weather name showed up, the copied path is Demo.weather.
>> 2. I installed the apache-drill-1.17.0 and dropped the jdbc file:
>> dremio-jdbc-driver-4.1.4-202001240912140359-a90eb503.jar into the
>> jars/3rdparty folder and jdbc-driver folder.
>> 3. Started apache drill with ./drill-embedded command, then went to drill
>> web UI, created storage plugin: dremiodemo:
>> {
>> "type": "jdbc",
>> "driver": "com.dremio.jdbc.Driver",
>> "url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
>> "username": "admin",
>> "password": "",
>> "caseInsensitiveTableNames": true,
>> "enabled": true
>> }
>> since apache drill is also using 31010, I changed the dremio jdbc port to
>> 41010 in the conf file.
>> 4. from drill started session, type show databases;
>> dremiodemo.demo is listed as one of the schema names,
>> then:
>> type select * from dremiodemo.demo.weather;
>> I got error: Error: DATA_READ ERROR: The JDBC storage plugin failed while
>> trying setup the SQL query.
>>
>> sql SELECT *
>>
>> FROM "DREMIO"."Demo"."weather"
>>
>> plugin dremiodemo
>>
>> Fragment 0:0
>>
>> in the Dremio server.log file, it showed erro:
>> Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table
>> 'DREMIO.Demo.weather' not found
>> Any clues? thanks for help.
>>
>> --
>> ********************************************************
>> DISCLAIMER: This
>> e-mail, including any attached files,
>> is confidential, may be legally
>> privileged, and is
>> solely for the intended recipient(s). If you received
>>
>> this e-mail in error, please destroy it and notify us
>> immediately by reply
>> e-mail. Any unauthorized
>> use, dissemination, disclosure, copying or
>> printing is
>> strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by David Du <dd...@bcmcgroup.com>.
I got dremio from this link:
https://download.dremio.com/community-server/4.1.4-202001240912140359-a90eb503/
then unzip, go to conf folder, open file dremio.conf, then change the port
from 31010 to 41010,
services: {
coordinator.enabled: true,
coordinator.master.enabled: true,
executor.enabled: true,
coordinator.client-endpoint.port: 41010
}
then go to bin directory and type: ./dremio start
since apache drill also use port 31010, this is a conflict.
Thanks
On Wed, Feb 19, 2020 at 7:10 PM Paul Rogers <pa...@yahoo.com.invalid>
wrote:
> Hi David,
>
> So I tried to reproduce the problem, but I could not get Dremio to start:
> it consistently crashes when I follow the GitHub community edition
> instructions. [1] Something about "Unable to find injectable based on
> javax.ws.rs.core.SecurityContext."
>
>
> I don't want to turn our attempt to diagnose a Drill issue into an attempt
> to diagnose my Dremo issue.
>
> What I had planned to do was to start the server, then use the Dremio JDBC
> driver to create a very simple Java program that uses JDBC to connect to
> Dremio and issues the query in question. Then, I planned to muck around
> with the table path: leaving out the schema part, etc. until I got Dremio
> to accept the query. This would tell us what Dremio wants.
>
> Once I had that information, I could then compare that with what Drill is
> sending and figure out how you might adjust your setup to get things to
> work.
>
> Given that I could not get past the step to get Dremio running, are you
> comfortable enough with Java to run the little experiment outlined above?
> Once you have a SELECT statement that works, we can move on to the next
> step above: working out how to get Drill to issue that statement.
>
> Thanks,
> - Paul
>
> [1] https://github.com/dremio/dremio-oss
>
>
>
>
> On Tuesday, February 18, 2020, 8:23:23 AM PST, David Du <
> ddu@bcmcgroup.com> wrote:
>
> Thanks for your response, from http://localhost:9047/space/Demo, then I
> run
> select * from weather, it works and got data back, then I reconfigured
> apache drill plugin:
> dremiodemo
> {
> "type": "jdbc",
> "driver": "com.dremio.jdbc.Driver",
> "url": "jdbc:dremio:direct=localhost:41010",
> "username": "admin",
> "password": "admin",
> "caseInsensitiveTableNames": true,
> "enabled": true
> }
>
> then restarted drill and run commands:
>
> apache drill (dremiodemo.demo)> show *databases*;
>
> +-------------------------------------------+
>
> | * SCHEMA_NAME * |
>
> +-------------------------------------------+
>
> | cp.default |
>
> | dfs.default |
>
> | dfs.root |
>
> | dfs.tmp |
>
> | dremiodemo.$scratch |
>
> | dremiodemo.@admin |
>
> | dremiodemo.demo |
>
> | dremiodemo.dremio
>
> dremiodemo.sys |
>
> | dremiodemo.sys.cache |
>
> | dremiodemo.testspace |
>
> | dremiodemo |
>
> | information_schema |
>
> | qi.admin
>
> apache drill (dremiodemo.demo)> *use* dremiodemo.demo;
>
> +------+---------------------------------------------+
>
> | * ok * | * summary * |
>
> +------+---------------------------------------------+
>
> | true | Default schema changed to [dremiodemo.demo] |
>
> +------+---------------------------------------------+
>
> 1 row selected (0.098 seconds)
>
> apache drill (dremiodemo.demo)> *use* dremiodemo.demo;
>
> +------+---------------------------------------------+
>
> | * ok * | * summary * |
>
> +------+---------------------------------------------+
>
> | true | Default schema changed to [dremiodemo.demo] |
>
> +------+---------------------------------------------+
>
> 1 row selected (0.121 seconds)
>
> apache drill (dremiodemo.demo)> show *tables*;
>
> +-----------------+------------+
>
> | * TABLE_SCHEMA * | *TABLE_NAME* |
>
> +-----------------+------------+
>
> | dremiodemo.demo | topips |
>
> | dremiodemo.demo | weather |
>
> +-----------------+------------+
>
> 2 rows selected (0.25 seconds)
>
> apache drill (dremiodemo.demo)> *select* * *from* weather;
>
> Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
> the SQL query.
>
>
> sql SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> plugin dremiodemo
>
> Fragment 0:0
>
>
> [Error Id: fb821614-d752-4ffb-896a-5a61f7e7cfd5 on
> 1672851h-t2349.noblis.org:31010] (state=,code=0)
>
> apache drill (dremiodemo.demo)>
>
>
> So in this test, I removed the schema=Demo part from the dremiodemo
> profile, and the weather table shows up from "show tables" command, but the
> query select * from weather; returned the same Data_READ ERROR, and the in
> the error message: FROM "DREMIO"."Demo"."weather", the word "DREMRIO" is
> added by drill, not me, not sure why, in the sqlline.log file, the error
> message is:
>
> org.apache.drill.common.exceptions.UserRemoteException: VALIDATION ERROR:
> Schema [[Demo]] is not valid with respect to either root schema or current
> default schema.
>
>
> Current default schema: dremiodemo.demo
>
>
> and in server.log file of dremio server log folder, this error message is:
>
> Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table
> 'DREMIO.Demo.weather' not found
>
>
>
> I also tested qi.admin schema, which I configured for postgres database, it
> worked perfectly when I queried some tables with the admin schema, got data
> back as expected.
>
>
> Any clues?
>
> Thanks for your help!
>
> On Fri, Feb 14, 2020 at 5:15 PM Paul Rogers <pa...@yahoo.com.invalid>
> wrote:
>
> > Hi David,
> >
> > Thanks much for the log files. I take it that one log is from Drill, the
> > other from Dremio?
> >
> > What I see is that Drill sends the query off to Dremio via JDBC. This
> > tells us that most of your configuration is correct: Drill did establish
> a
> > connection to Dremio. It is just the query that has an issue.
> >
> >
> > The Dremio logs (those with "com.dremio") show that Dremio plans the
> query
> > using its version of Calcite. Dremio then fails because it does not
> > recognize the "namespace".
> >
> > The code in Drill which raises the exception includes the translated SQL
> > query; the one that Drill tries to send to Dremio via JDBC. The
> translated
> > query seems to be the one from your e-mail:
> >
> > SELECT *
> >
> > FROM "DREMIO"."Demo"."weather"
> >
> > Your earlier e-mail included your config parameters, including the
> > connection string:
> >
> > "url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
> >
> > Dremio's explanation of their connection string is at [1]. The syntax is:
> >
> > jdbc:dremio:direct=<DREMIO_COORDINATOR>:31010[;schema=<OPTIONAL_SCHMEMA>]
> >
> > The above says that Drill is connecting (via the network) to a Dremo
> > server running on he same host. All good.
> >
> > The part that still has me concerned is the "schema=Demo" part.
> > Unfortunately, the Dremio page does not explain the "schema" parameter,
> but
> > we can guess that it gives the default namespace for resolving tables.
> That
> > is, if the default Schema is "Demo", then I'd expect the valid SQL to be:
> >
> > SELECT * FROM weather
> >
> > Let's try an experiment. From Dremio's UI, try selecting a schema
> (perhaps
> > with USE?) and run the full query. Then try running the simpler query.
> > Which worked?
> >
> > If only the simpler one worked, try changing your config url to omit the
> > schema.
> >
> > I don't yet understand where the "DREMIO" part of the table name is
> coming
> > from. I rather suspect that is also not needed. To test, try all three
> > various using the Dremio UI: DREMIO.Demo.weather, Demo.weather and just
> > weather
> >
> >
> > Hard to know if this is the problem just from reading logs, but it seems
> > worth a shot. Once we see what happens, we can figure out what to try
> next.
> >
> >
> > Thanks,
> > - Paul
> >
> > [1] JDBC · Dremio
>
>
> |
> |
> | |
> JDBC · Dremio
>
>
> |
>
> |
>
> |
>
>
>
> >
> > On Thursday, February 13, 2020, 6:31:08 AM PST, David Du <
> > ddu@bcmcgroup.com> wrote:
> >
> > Thanks for your help, my command is:
> >
> > apache drill> *select* * *from* dremiodemo.demo.weather;
> >
> >
> > this gave me error from console:
> >
> > Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
> > the SQL query.
> >
> >
> > sql SELECT *
> >
> > FROM "DREMIO"."Demo"."weather"
> >
> > plugin dremiodemo
> >
> > Fragment 0:0
> >
> >
> > [Error Id: dd01f1ff-c7c8-4f36-996f-5f4ed3839c43 on 172.24.30.68:31010]
> > (state=,code=0)
> >
> >
> >
> >
> > But the log file is:
> >
> >
> >
> > tail -f sqlline.log
> >
> > 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics
> -
> > Removing old metric since name matched newly registered metric. Metric
> > name: drill.allocator.root.used
> >
> > 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics
> -
> > Removing old metric since name matched newly registered metric. Metric
> > name: drill.allocator.root.peak
> >
> > 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
> > Foreman drillbit is 172.24.30.68
> >
> > 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
> > Successfully connected to server 172.24.30.68:31010
> >
> > 2020-02-13 09:24:02,371 [21baa3fc-c178-4227-5d3d-00bf55c59097:foreman]
> > INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> > 21baa3fc-c178-4227-5d3d-00bf55c59097 issued by anonymous: show databases
> >
> > 2020-02-13 09:24:04,145 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> > INFO o.a.d.e.w.fragment.FragmentExecutor -
> > 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested
> > AWAITING_ALLOCATION --> RUNNING
> >
> > 2020-02-13 09:24:04,156 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> > INFO o.a.d.e.w.f.FragmentStatusReporter -
> > 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: RUNNING
> >
> > 2020-02-13 09:24:04,401 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> > INFO o.a.d.e.c.ClassCompilerSelector - Java compiler policy: DEFAULT,
> > Debug option: true
> >
> > 2020-02-13 09:24:04,571 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> > INFO o.a.d.e.w.fragment.FragmentExecutor -
> > 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested RUNNING
> > --> FINISHED
> >
> > 2020-02-13 09:24:04,573 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> > INFO o.a.d.e.w.f.FragmentStatusReporter -
> > 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: FINISHED
> >
> > 2020-02-13 09:26:39,805 [21baa35f-ef83-15fe-f40b-8ff0415620f2:foreman]
> > INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> > 21baa35f-ef83-15fe-f40b-8ff0415620f2 issued by anonymous: select * from
> > dremiodemo.demo.weather
> >
> > 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> > INFO o.a.d.e.w.fragment.FragmentExecutor -
> > 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State change requested
> > AWAITING_ALLOCATION --> RUNNING
> >
> > 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> > INFO o.a.d.e.w.f.FragmentStatusReporter -
> > 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State to report: RUNNING
> >
> > 2020-02-13 09:26:40,472 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> > INFO o.a.d.e.store.jdbc.JdbcRecordReader - User Error Occurred: The JDBC
> > storage plugin failed while trying setup the SQL query. (VALIDATION
> ERROR:
> > Table 'DREMIO.Demo.weather' not found
> >
> >
> > SQL Query SELECT *
> >
> > FROM "DREMIO"."Demo"."weather"
> >
> > startLine 2
> >
> > startColumn 6
> >
> > endLine 2
> >
> > endColumn 13
> >
> >
> > [Error Id: b7ae16cc-80dc-4950-b7e1-7ccbd9cad7e8 on
> > 1672851h-t2349.noblis.org:41010]
> >
> >
> > (org.apache.calcite.runtime.CalciteContextException) From line 2, column
> > 6 to line 2, column 13: Table 'DREMIO.Demo.weather' not found
> >
> > sun.reflect.GeneratedConstructorAccessor149.newInstance():-1
> >
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
> >
> > java.lang.reflect.Constructor.newInstance():423
> >
> > org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
> >
> > org.apache.calcite.sql.SqlUtil.newContextException():803
> >
> > org.apache.calcite.sql.SqlUtil.newContextException():788
> >
> >
> >
> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
> >
> > org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
> >
> > org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
> >
> > org.apache.calcite.sql.validate.AbstractNamespace.validate():84
> >
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
> >
> > org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
> >
> > org.apache.calcite.sql.validate.AbstractNamespace.validate():84
> >
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
> >
> > org.apache.calcite.sql.SqlSelect.validate():226
> >
> >
> >
> >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
> >
> > com.dremio.exec.planner.sql.SqlConverter.validate():229
> >
> >
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
> >
> >
> >
> >
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
> >
> >
> >
> >
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
> >
> > com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
> >
> > com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
> >
> > com.dremio.exec.work.foreman.AttemptManager.plan():415
> >
> > com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
> >
> > com.dremio.service.commandpool.CommandWrapper.run():62
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> >
> > java.lang.Thread.run():748
> >
> > Caused By (org.apache.calcite.sql.validate.SqlValidatorException) Table
> > 'DREMIO.Demo.weather' not found
> >
> > sun.reflect.GeneratedConstructorAccessor148.newInstance():-1
> >
> > sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
> >
> > java.lang.reflect.Constructor.newInstance():423
> >
> > org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
> >
> > org.apache.calcite.runtime.Resources$ExInst.ex():572
> >
> > org.apache.calcite.sql.SqlUtil.newContextException():803
> >
> > org.apache.calcite.sql.SqlUtil.newContextException():788
> >
> >
> >
> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
> >
> > org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
> >
> > org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
> >
> > org.apache.calcite.sql.validate.AbstractNamespace.validate():84
> >
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
> >
> > org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
> >
> > org.apache.calcite.sql.validate.AbstractNamespace.validate():84
> >
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
> >
> > org.apache.calcite.sql.SqlSelect.validate():226
> >
> >
> >
> >
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
> >
> > org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
> >
> > com.dremio.exec.planner.sql.SqlConverter.validate():229
> >
> >
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
> >
> >
> >
> >
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
> >
> >
> >
> >
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
> >
> > com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
> >
> > com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
> >
> > com.dremio.exec.work.foreman.AttemptManager.plan():415
> >
> > com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
> >
> > com.dremio.service.commandpool.CommandWrapper.run():62
> >
> > java.util.concurrent.ThreadPoolExecutor.runWorker():1149
> >
> > java.util.concurrent.ThreadPoolExecutor$Worker.run():624
> >
> > java.lang.Thread.run():748
> >
> > On Thu, Feb 13, 2020 at 12:16 AM Paul Rogers <pa...@yahoo.com.invalid>
> > wrote:
> >
> > > The next step would be to take a look at the log file. Anything
> > > interesting there? Maybe an error or a stack trace?
> > >
> > > Thanks,
> > > - Paul
> > >
> > >
> > >
> > > On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers
> > > <pa...@yahoo.com.invalid> wrote:
> > >
> > > Going to take a wild guess. Since you configured the "Demo" schema in
> > the
> > > JDBC driver, you may not need it in the Drill query. Maybe try:
> > >
> > > SELECT * FROM dremiodemo.weather;
> > >
> > > Thanks,
> > > - Paul
> > >
> > >
> > >
> > > On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <
> > > ddu@bcmcgroup.com> wrote:
> > >
> > > My command is:
> > >
> > > *select* * *from* dremiodemo.demo.weather;
> > >
> > >
> > > there is no quotes, but for some reason, the error message returned
> with
> > > quotes
> > >
> > >
> > > Thanks for your help!
> > >
> > >
> > >
> >
> > --
> > ********************************************************
> > DISCLAIMER: This
> > e-mail, including any attached files,
> > is confidential, may be legally
> > privileged, and is
> > solely for the intended recipient(s). If you received
> >
> > this e-mail in error, please destroy it and notify us
> > immediately by reply
> > e-mail. Any unauthorized
> > use, dissemination, disclosure, copying or
> > printing is
> > strictly prohibited. - BCMC, LLC
>
> --
> ********************************************************
> DISCLAIMER: This
> e-mail, including any attached files,
> is confidential, may be legally
> privileged, and is
> solely for the intended recipient(s). If you received
>
> this e-mail in error, please destroy it and notify us
> immediately by reply
> e-mail. Any unauthorized
> use, dissemination, disclosure, copying or
> printing is
> strictly prohibited. - BCMC, LLC
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by Paul Rogers <pa...@yahoo.com.INVALID>.
Hi David,
So I tried to reproduce the problem, but I could not get Dremio to start: it consistently crashes when I follow the GitHub community edition instructions. [1] Something about "Unable to find injectable based on javax.ws.rs.core.SecurityContext."
I don't want to turn our attempt to diagnose a Drill issue into an attempt to diagnose my Dremo issue.
What I had planned to do was to start the server, then use the Dremio JDBC driver to create a very simple Java program that uses JDBC to connect to Dremio and issues the query in question. Then, I planned to muck around with the table path: leaving out the schema part, etc. until I got Dremio to accept the query. This would tell us what Dremio wants.
Once I had that information, I could then compare that with what Drill is sending and figure out how you might adjust your setup to get things to work.
Given that I could not get past the step to get Dremio running, are you comfortable enough with Java to run the little experiment outlined above? Once you have a SELECT statement that works, we can move on to the next step above: working out how to get Drill to issue that statement.
Thanks,
- Paul
[1] https://github.com/dremio/dremio-oss
On Tuesday, February 18, 2020, 8:23:23 AM PST, David Du <dd...@bcmcgroup.com> wrote:
Thanks for your response, from http://localhost:9047/space/Demo, then I run
select * from weather, it works and got data back, then I reconfigured
apache drill plugin:
dremiodemo
{
"type": "jdbc",
"driver": "com.dremio.jdbc.Driver",
"url": "jdbc:dremio:direct=localhost:41010",
"username": "admin",
"password": "admin",
"caseInsensitiveTableNames": true,
"enabled": true
}
then restarted drill and run commands:
apache drill (dremiodemo.demo)> show *databases*;
+-------------------------------------------+
| * SCHEMA_NAME * |
+-------------------------------------------+
| cp.default |
| dfs.default |
| dfs.root |
| dfs.tmp |
| dremiodemo.$scratch |
| dremiodemo.@admin |
| dremiodemo.demo |
| dremiodemo.dremio
dremiodemo.sys |
| dremiodemo.sys.cache |
| dremiodemo.testspace |
| dremiodemo |
| information_schema |
| qi.admin
apache drill (dremiodemo.demo)> *use* dremiodemo.demo;
+------+---------------------------------------------+
| * ok * | * summary * |
+------+---------------------------------------------+
| true | Default schema changed to [dremiodemo.demo] |
+------+---------------------------------------------+
1 row selected (0.098 seconds)
apache drill (dremiodemo.demo)> *use* dremiodemo.demo;
+------+---------------------------------------------+
| * ok * | * summary * |
+------+---------------------------------------------+
| true | Default schema changed to [dremiodemo.demo] |
+------+---------------------------------------------+
1 row selected (0.121 seconds)
apache drill (dremiodemo.demo)> show *tables*;
+-----------------+------------+
| * TABLE_SCHEMA * | *TABLE_NAME* |
+-----------------+------------+
| dremiodemo.demo | topips |
| dremiodemo.demo | weather |
+-----------------+------------+
2 rows selected (0.25 seconds)
apache drill (dremiodemo.demo)> *select* * *from* weather;
Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
the SQL query.
sql SELECT *
FROM "DREMIO"."Demo"."weather"
plugin dremiodemo
Fragment 0:0
[Error Id: fb821614-d752-4ffb-896a-5a61f7e7cfd5 on
1672851h-t2349.noblis.org:31010] (state=,code=0)
apache drill (dremiodemo.demo)>
So in this test, I removed the schema=Demo part from the dremiodemo
profile, and the weather table shows up from "show tables" command, but the
query select * from weather; returned the same Data_READ ERROR, and the in
the error message: FROM "DREMIO"."Demo"."weather", the word "DREMRIO" is
added by drill, not me, not sure why, in the sqlline.log file, the error
message is:
org.apache.drill.common.exceptions.UserRemoteException: VALIDATION ERROR:
Schema [[Demo]] is not valid with respect to either root schema or current
default schema.
Current default schema: dremiodemo.demo
and in server.log file of dremio server log folder, this error message is:
Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table
'DREMIO.Demo.weather' not found
I also tested qi.admin schema, which I configured for postgres database, it
worked perfectly when I queried some tables with the admin schema, got data
back as expected.
Any clues?
Thanks for your help!
On Fri, Feb 14, 2020 at 5:15 PM Paul Rogers <pa...@yahoo.com.invalid>
wrote:
> Hi David,
>
> Thanks much for the log files. I take it that one log is from Drill, the
> other from Dremio?
>
> What I see is that Drill sends the query off to Dremio via JDBC. This
> tells us that most of your configuration is correct: Drill did establish a
> connection to Dremio. It is just the query that has an issue.
>
>
> The Dremio logs (those with "com.dremio") show that Dremio plans the query
> using its version of Calcite. Dremio then fails because it does not
> recognize the "namespace".
>
> The code in Drill which raises the exception includes the translated SQL
> query; the one that Drill tries to send to Dremio via JDBC. The translated
> query seems to be the one from your e-mail:
>
> SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> Your earlier e-mail included your config parameters, including the
> connection string:
>
> "url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
>
> Dremio's explanation of their connection string is at [1]. The syntax is:
>
> jdbc:dremio:direct=<DREMIO_COORDINATOR>:31010[;schema=<OPTIONAL_SCHMEMA>]
>
> The above says that Drill is connecting (via the network) to a Dremo
> server running on he same host. All good.
>
> The part that still has me concerned is the "schema=Demo" part.
> Unfortunately, the Dremio page does not explain the "schema" parameter, but
> we can guess that it gives the default namespace for resolving tables. That
> is, if the default Schema is "Demo", then I'd expect the valid SQL to be:
>
> SELECT * FROM weather
>
> Let's try an experiment. From Dremio's UI, try selecting a schema (perhaps
> with USE?) and run the full query. Then try running the simpler query.
> Which worked?
>
> If only the simpler one worked, try changing your config url to omit the
> schema.
>
> I don't yet understand where the "DREMIO" part of the table name is coming
> from. I rather suspect that is also not needed. To test, try all three
> various using the Dremio UI: DREMIO.Demo.weather, Demo.weather and just
> weather
>
>
> Hard to know if this is the problem just from reading logs, but it seems
> worth a shot. Once we see what happens, we can figure out what to try next.
>
>
> Thanks,
> - Paul
>
> [1] JDBC · Dremio
|
|
| |
JDBC · Dremio
|
|
|
>
> On Thursday, February 13, 2020, 6:31:08 AM PST, David Du <
> ddu@bcmcgroup.com> wrote:
>
> Thanks for your help, my command is:
>
> apache drill> *select* * *from* dremiodemo.demo.weather;
>
>
> this gave me error from console:
>
> Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
> the SQL query.
>
>
> sql SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> plugin dremiodemo
>
> Fragment 0:0
>
>
> [Error Id: dd01f1ff-c7c8-4f36-996f-5f4ed3839c43 on 172.24.30.68:31010]
> (state=,code=0)
>
>
>
>
> But the log file is:
>
>
>
> tail -f sqlline.log
>
> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
> Removing old metric since name matched newly registered metric. Metric
> name: drill.allocator.root.used
>
> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
> Removing old metric since name matched newly registered metric. Metric
> name: drill.allocator.root.peak
>
> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
> Foreman drillbit is 172.24.30.68
>
> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
> Successfully connected to server 172.24.30.68:31010
>
> 2020-02-13 09:24:02,371 [21baa3fc-c178-4227-5d3d-00bf55c59097:foreman]
> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> 21baa3fc-c178-4227-5d3d-00bf55c59097 issued by anonymous: show databases
>
> 2020-02-13 09:24:04,145 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested
> AWAITING_ALLOCATION --> RUNNING
>
> 2020-02-13 09:24:04,156 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: RUNNING
>
> 2020-02-13 09:24:04,401 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.c.ClassCompilerSelector - Java compiler policy: DEFAULT,
> Debug option: true
>
> 2020-02-13 09:24:04,571 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested RUNNING
> --> FINISHED
>
> 2020-02-13 09:24:04,573 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: FINISHED
>
> 2020-02-13 09:26:39,805 [21baa35f-ef83-15fe-f40b-8ff0415620f2:foreman]
> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> 21baa35f-ef83-15fe-f40b-8ff0415620f2 issued by anonymous: select * from
> dremiodemo.demo.weather
>
> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State change requested
> AWAITING_ALLOCATION --> RUNNING
>
> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State to report: RUNNING
>
> 2020-02-13 09:26:40,472 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.store.jdbc.JdbcRecordReader - User Error Occurred: The JDBC
> storage plugin failed while trying setup the SQL query. (VALIDATION ERROR:
> Table 'DREMIO.Demo.weather' not found
>
>
> SQL Query SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> startLine 2
>
> startColumn 6
>
> endLine 2
>
> endColumn 13
>
>
> [Error Id: b7ae16cc-80dc-4950-b7e1-7ccbd9cad7e8 on
> 1672851h-t2349.noblis.org:41010]
>
>
> (org.apache.calcite.runtime.CalciteContextException) From line 2, column
> 6 to line 2, column 13: Table 'DREMIO.Demo.weather' not found
>
> sun.reflect.GeneratedConstructorAccessor149.newInstance():-1
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>
> java.lang.reflect.Constructor.newInstance():423
>
> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>
> org.apache.calcite.sql.SqlUtil.newContextException():803
>
> org.apache.calcite.sql.SqlUtil.newContextException():788
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>
> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>
> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>
> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.SqlSelect.validate():226
>
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>
> com.dremio.exec.planner.sql.SqlConverter.validate():229
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>
> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>
> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>
> com.dremio.exec.work.foreman.AttemptManager.plan():415
>
> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>
> com.dremio.service.commandpool.CommandWrapper.run():62
>
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>
> java.lang.Thread.run():748
>
> Caused By (org.apache.calcite.sql.validate.SqlValidatorException) Table
> 'DREMIO.Demo.weather' not found
>
> sun.reflect.GeneratedConstructorAccessor148.newInstance():-1
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>
> java.lang.reflect.Constructor.newInstance():423
>
> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>
> org.apache.calcite.runtime.Resources$ExInst.ex():572
>
> org.apache.calcite.sql.SqlUtil.newContextException():803
>
> org.apache.calcite.sql.SqlUtil.newContextException():788
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>
> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>
> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>
> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.SqlSelect.validate():226
>
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>
> com.dremio.exec.planner.sql.SqlConverter.validate():229
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>
> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>
> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>
> com.dremio.exec.work.foreman.AttemptManager.plan():415
>
> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>
> com.dremio.service.commandpool.CommandWrapper.run():62
>
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>
> java.lang.Thread.run():748
>
> On Thu, Feb 13, 2020 at 12:16 AM Paul Rogers <pa...@yahoo.com.invalid>
> wrote:
>
> > The next step would be to take a look at the log file. Anything
> > interesting there? Maybe an error or a stack trace?
> >
> > Thanks,
> > - Paul
> >
> >
> >
> > On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers
> > <pa...@yahoo.com.invalid> wrote:
> >
> > Going to take a wild guess. Since you configured the "Demo" schema in
> the
> > JDBC driver, you may not need it in the Drill query. Maybe try:
> >
> > SELECT * FROM dremiodemo.weather;
> >
> > Thanks,
> > - Paul
> >
> >
> >
> > On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <
> > ddu@bcmcgroup.com> wrote:
> >
> > My command is:
> >
> > *select* * *from* dremiodemo.demo.weather;
> >
> >
> > there is no quotes, but for some reason, the error message returned with
> > quotes
> >
> >
> > Thanks for your help!
> >
> >
> >
>
> --
> ********************************************************
> DISCLAIMER: This
> e-mail, including any attached files,
> is confidential, may be legally
> privileged, and is
> solely for the intended recipient(s). If you received
>
> this e-mail in error, please destroy it and notify us
> immediately by reply
> e-mail. Any unauthorized
> use, dissemination, disclosure, copying or
> printing is
> strictly prohibited. - BCMC, LLC
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by David Du <dd...@bcmcgroup.com>.
Thanks for your response, from http://localhost:9047/space/Demo, then I run
select * from weather, it works and got data back, then I reconfigured
apache drill plugin:
dremiodemo
{
"type": "jdbc",
"driver": "com.dremio.jdbc.Driver",
"url": "jdbc:dremio:direct=localhost:41010",
"username": "admin",
"password": "admin",
"caseInsensitiveTableNames": true,
"enabled": true
}
then restarted drill and run commands:
apache drill (dremiodemo.demo)> show *databases*;
+-------------------------------------------+
| * SCHEMA_NAME * |
+-------------------------------------------+
| cp.default |
| dfs.default |
| dfs.root |
| dfs.tmp |
| dremiodemo.$scratch |
| dremiodemo.@admin |
| dremiodemo.demo |
| dremiodemo.dremio
dremiodemo.sys |
| dremiodemo.sys.cache |
| dremiodemo.testspace |
| dremiodemo |
| information_schema |
| qi.admin
apache drill (dremiodemo.demo)> *use* dremiodemo.demo;
+------+---------------------------------------------+
| * ok * | * summary * |
+------+---------------------------------------------+
| true | Default schema changed to [dremiodemo.demo] |
+------+---------------------------------------------+
1 row selected (0.098 seconds)
apache drill (dremiodemo.demo)> *use* dremiodemo.demo;
+------+---------------------------------------------+
| * ok * | * summary * |
+------+---------------------------------------------+
| true | Default schema changed to [dremiodemo.demo] |
+------+---------------------------------------------+
1 row selected (0.121 seconds)
apache drill (dremiodemo.demo)> show *tables*;
+-----------------+------------+
| * TABLE_SCHEMA * | *TABLE_NAME* |
+-----------------+------------+
| dremiodemo.demo | topips |
| dremiodemo.demo | weather |
+-----------------+------------+
2 rows selected (0.25 seconds)
apache drill (dremiodemo.demo)> *select* * *from* weather;
Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
the SQL query.
sql SELECT *
FROM "DREMIO"."Demo"."weather"
plugin dremiodemo
Fragment 0:0
[Error Id: fb821614-d752-4ffb-896a-5a61f7e7cfd5 on
1672851h-t2349.noblis.org:31010] (state=,code=0)
apache drill (dremiodemo.demo)>
So in this test, I removed the schema=Demo part from the dremiodemo
profile, and the weather table shows up from "show tables" command, but the
query select * from weather; returned the same Data_READ ERROR, and the in
the error message: FROM "DREMIO"."Demo"."weather", the word "DREMRIO" is
added by drill, not me, not sure why, in the sqlline.log file, the error
message is:
org.apache.drill.common.exceptions.UserRemoteException: VALIDATION ERROR:
Schema [[Demo]] is not valid with respect to either root schema or current
default schema.
Current default schema: dremiodemo.demo
and in server.log file of dremio server log folder, this error message is:
Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table
'DREMIO.Demo.weather' not found
I also tested qi.admin schema, which I configured for postgres database, it
worked perfectly when I queried some tables with the admin schema, got data
back as expected.
Any clues?
Thanks for your help!
On Fri, Feb 14, 2020 at 5:15 PM Paul Rogers <pa...@yahoo.com.invalid>
wrote:
> Hi David,
>
> Thanks much for the log files. I take it that one log is from Drill, the
> other from Dremio?
>
> What I see is that Drill sends the query off to Dremio via JDBC. This
> tells us that most of your configuration is correct: Drill did establish a
> connection to Dremio. It is just the query that has an issue.
>
>
> The Dremio logs (those with "com.dremio") show that Dremio plans the query
> using its version of Calcite. Dremio then fails because it does not
> recognize the "namespace".
>
> The code in Drill which raises the exception includes the translated SQL
> query; the one that Drill tries to send to Dremio via JDBC. The translated
> query seems to be the one from your e-mail:
>
> SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> Your earlier e-mail included your config parameters, including the
> connection string:
>
> "url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
>
> Dremio's explanation of their connection string is at [1]. The syntax is:
>
> jdbc:dremio:direct=<DREMIO_COORDINATOR>:31010[;schema=<OPTIONAL_SCHMEMA>]
>
> The above says that Drill is connecting (via the network) to a Dremo
> server running on he same host. All good.
>
> The part that still has me concerned is the "schema=Demo" part.
> Unfortunately, the Dremio page does not explain the "schema" parameter, but
> we can guess that it gives the default namespace for resolving tables. That
> is, if the default Schema is "Demo", then I'd expect the valid SQL to be:
>
> SELECT * FROM weather
>
> Let's try an experiment. From Dremio's UI, try selecting a schema (perhaps
> with USE?) and run the full query. Then try running the simpler query.
> Which worked?
>
> If only the simpler one worked, try changing your config url to omit the
> schema.
>
> I don't yet understand where the "DREMIO" part of the table name is coming
> from. I rather suspect that is also not needed. To test, try all three
> various using the Dremio UI: DREMIO.Demo.weather, Demo.weather and just
> weather
>
>
> Hard to know if this is the problem just from reading logs, but it seems
> worth a shot. Once we see what happens, we can figure out what to try next.
>
>
> Thanks,
> - Paul
>
> [1] https://docs.dremio.com/drivers/dremio-jdbc-driver.html
>
> On Thursday, February 13, 2020, 6:31:08 AM PST, David Du <
> ddu@bcmcgroup.com> wrote:
>
> Thanks for your help, my command is:
>
> apache drill> *select* * *from* dremiodemo.demo.weather;
>
>
> this gave me error from console:
>
> Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
> the SQL query.
>
>
> sql SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> plugin dremiodemo
>
> Fragment 0:0
>
>
> [Error Id: dd01f1ff-c7c8-4f36-996f-5f4ed3839c43 on 172.24.30.68:31010]
> (state=,code=0)
>
>
>
>
> But the log file is:
>
>
>
> tail -f sqlline.log
>
> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
> Removing old metric since name matched newly registered metric. Metric
> name: drill.allocator.root.used
>
> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
> Removing old metric since name matched newly registered metric. Metric
> name: drill.allocator.root.peak
>
> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
> Foreman drillbit is 172.24.30.68
>
> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
> Successfully connected to server 172.24.30.68:31010
>
> 2020-02-13 09:24:02,371 [21baa3fc-c178-4227-5d3d-00bf55c59097:foreman]
> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> 21baa3fc-c178-4227-5d3d-00bf55c59097 issued by anonymous: show databases
>
> 2020-02-13 09:24:04,145 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested
> AWAITING_ALLOCATION --> RUNNING
>
> 2020-02-13 09:24:04,156 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: RUNNING
>
> 2020-02-13 09:24:04,401 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.c.ClassCompilerSelector - Java compiler policy: DEFAULT,
> Debug option: true
>
> 2020-02-13 09:24:04,571 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested RUNNING
> --> FINISHED
>
> 2020-02-13 09:24:04,573 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: FINISHED
>
> 2020-02-13 09:26:39,805 [21baa35f-ef83-15fe-f40b-8ff0415620f2:foreman]
> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> 21baa35f-ef83-15fe-f40b-8ff0415620f2 issued by anonymous: select * from
> dremiodemo.demo.weather
>
> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State change requested
> AWAITING_ALLOCATION --> RUNNING
>
> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State to report: RUNNING
>
> 2020-02-13 09:26:40,472 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.store.jdbc.JdbcRecordReader - User Error Occurred: The JDBC
> storage plugin failed while trying setup the SQL query. (VALIDATION ERROR:
> Table 'DREMIO.Demo.weather' not found
>
>
> SQL Query SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> startLine 2
>
> startColumn 6
>
> endLine 2
>
> endColumn 13
>
>
> [Error Id: b7ae16cc-80dc-4950-b7e1-7ccbd9cad7e8 on
> 1672851h-t2349.noblis.org:41010]
>
>
> (org.apache.calcite.runtime.CalciteContextException) From line 2, column
> 6 to line 2, column 13: Table 'DREMIO.Demo.weather' not found
>
> sun.reflect.GeneratedConstructorAccessor149.newInstance():-1
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>
> java.lang.reflect.Constructor.newInstance():423
>
> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>
> org.apache.calcite.sql.SqlUtil.newContextException():803
>
> org.apache.calcite.sql.SqlUtil.newContextException():788
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>
> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>
> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>
> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.SqlSelect.validate():226
>
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>
> com.dremio.exec.planner.sql.SqlConverter.validate():229
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>
> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>
> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>
> com.dremio.exec.work.foreman.AttemptManager.plan():415
>
> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>
> com.dremio.service.commandpool.CommandWrapper.run():62
>
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>
> java.lang.Thread.run():748
>
> Caused By (org.apache.calcite.sql.validate.SqlValidatorException) Table
> 'DREMIO.Demo.weather' not found
>
> sun.reflect.GeneratedConstructorAccessor148.newInstance():-1
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>
> java.lang.reflect.Constructor.newInstance():423
>
> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>
> org.apache.calcite.runtime.Resources$ExInst.ex():572
>
> org.apache.calcite.sql.SqlUtil.newContextException():803
>
> org.apache.calcite.sql.SqlUtil.newContextException():788
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>
> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>
> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>
> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.SqlSelect.validate():226
>
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>
> com.dremio.exec.planner.sql.SqlConverter.validate():229
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>
> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>
> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>
> com.dremio.exec.work.foreman.AttemptManager.plan():415
>
> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>
> com.dremio.service.commandpool.CommandWrapper.run():62
>
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>
> java.lang.Thread.run():748
>
> On Thu, Feb 13, 2020 at 12:16 AM Paul Rogers <pa...@yahoo.com.invalid>
> wrote:
>
> > The next step would be to take a look at the log file. Anything
> > interesting there? Maybe an error or a stack trace?
> >
> > Thanks,
> > - Paul
> >
> >
> >
> > On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers
> > <pa...@yahoo.com.invalid> wrote:
> >
> > Going to take a wild guess. Since you configured the "Demo" schema in
> the
> > JDBC driver, you may not need it in the Drill query. Maybe try:
> >
> > SELECT * FROM dremiodemo.weather;
> >
> > Thanks,
> > - Paul
> >
> >
> >
> > On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <
> > ddu@bcmcgroup.com> wrote:
> >
> > My command is:
> >
> > *select* * *from* dremiodemo.demo.weather;
> >
> >
> > there is no quotes, but for some reason, the error message returned with
> > quotes
> >
> >
> > Thanks for your help!
> >
> >
> >
>
> --
> ********************************************************
> DISCLAIMER: This
> e-mail, including any attached files,
> is confidential, may be legally
> privileged, and is
> solely for the intended recipient(s). If you received
>
> this e-mail in error, please destroy it and notify us
> immediately by reply
> e-mail. Any unauthorized
> use, dissemination, disclosure, copying or
> printing is
> strictly prohibited. - BCMC, LLC
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by Paul Rogers <pa...@yahoo.com.INVALID>.
Hi David,
Thanks much for the log files. I take it that one log is from Drill, the other from Dremio?
What I see is that Drill sends the query off to Dremio via JDBC. This tells us that most of your configuration is correct: Drill did establish a connection to Dremio. It is just the query that has an issue.
The Dremio logs (those with "com.dremio") show that Dremio plans the query using its version of Calcite. Dremio then fails because it does not recognize the "namespace".
The code in Drill which raises the exception includes the translated SQL query; the one that Drill tries to send to Dremio via JDBC. The translated query seems to be the one from your e-mail:
SELECT *
FROM "DREMIO"."Demo"."weather"
Your earlier e-mail included your config parameters, including the connection string:
"url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
Dremio's explanation of their connection string is at [1]. The syntax is:
jdbc:dremio:direct=<DREMIO_COORDINATOR>:31010[;schema=<OPTIONAL_SCHMEMA>]
The above says that Drill is connecting (via the network) to a Dremo server running on he same host. All good.
The part that still has me concerned is the "schema=Demo" part. Unfortunately, the Dremio page does not explain the "schema" parameter, but we can guess that it gives the default namespace for resolving tables. That is, if the default Schema is "Demo", then I'd expect the valid SQL to be:
SELECT * FROM weather
Let's try an experiment. From Dremio's UI, try selecting a schema (perhaps with USE?) and run the full query. Then try running the simpler query. Which worked?
If only the simpler one worked, try changing your config url to omit the schema.
I don't yet understand where the "DREMIO" part of the table name is coming from. I rather suspect that is also not needed. To test, try all three various using the Dremio UI: DREMIO.Demo.weather, Demo.weather and just weather
Hard to know if this is the problem just from reading logs, but it seems worth a shot. Once we see what happens, we can figure out what to try next.
Thanks,
- Paul
[1] https://docs.dremio.com/drivers/dremio-jdbc-driver.html
On Thursday, February 13, 2020, 6:31:08 AM PST, David Du <dd...@bcmcgroup.com> wrote:
Thanks for your help, my command is:
apache drill> *select* * *from* dremiodemo.demo.weather;
this gave me error from console:
Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
the SQL query.
sql SELECT *
FROM "DREMIO"."Demo"."weather"
plugin dremiodemo
Fragment 0:0
[Error Id: dd01f1ff-c7c8-4f36-996f-5f4ed3839c43 on 172.24.30.68:31010]
(state=,code=0)
But the log file is:
tail -f sqlline.log
2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
Removing old metric since name matched newly registered metric. Metric
name: drill.allocator.root.used
2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
Removing old metric since name matched newly registered metric. Metric
name: drill.allocator.root.peak
2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
Foreman drillbit is 172.24.30.68
2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
Successfully connected to server 172.24.30.68:31010
2020-02-13 09:24:02,371 [21baa3fc-c178-4227-5d3d-00bf55c59097:foreman]
INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
21baa3fc-c178-4227-5d3d-00bf55c59097 issued by anonymous: show databases
2020-02-13 09:24:04,145 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.w.fragment.FragmentExecutor -
21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested
AWAITING_ALLOCATION --> RUNNING
2020-02-13 09:24:04,156 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.w.f.FragmentStatusReporter -
21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: RUNNING
2020-02-13 09:24:04,401 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.c.ClassCompilerSelector - Java compiler policy: DEFAULT,
Debug option: true
2020-02-13 09:24:04,571 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.w.fragment.FragmentExecutor -
21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested RUNNING
--> FINISHED
2020-02-13 09:24:04,573 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.w.f.FragmentStatusReporter -
21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: FINISHED
2020-02-13 09:26:39,805 [21baa35f-ef83-15fe-f40b-8ff0415620f2:foreman]
INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
21baa35f-ef83-15fe-f40b-8ff0415620f2 issued by anonymous: select * from
dremiodemo.demo.weather
2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
INFO o.a.d.e.w.fragment.FragmentExecutor -
21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State change requested
AWAITING_ALLOCATION --> RUNNING
2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
INFO o.a.d.e.w.f.FragmentStatusReporter -
21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State to report: RUNNING
2020-02-13 09:26:40,472 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
INFO o.a.d.e.store.jdbc.JdbcRecordReader - User Error Occurred: The JDBC
storage plugin failed while trying setup the SQL query. (VALIDATION ERROR:
Table 'DREMIO.Demo.weather' not found
SQL Query SELECT *
FROM "DREMIO"."Demo"."weather"
startLine 2
startColumn 6
endLine 2
endColumn 13
[Error Id: b7ae16cc-80dc-4950-b7e1-7ccbd9cad7e8 on
1672851h-t2349.noblis.org:41010]
(org.apache.calcite.runtime.CalciteContextException) From line 2, column
6 to line 2, column 13: Table 'DREMIO.Demo.weather' not found
sun.reflect.GeneratedConstructorAccessor149.newInstance():-1
sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
java.lang.reflect.Constructor.newInstance():423
org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
org.apache.calcite.sql.SqlUtil.newContextException():803
org.apache.calcite.sql.SqlUtil.newContextException():788
org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
org.apache.calcite.sql.validate.AbstractNamespace.validate():84
org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
org.apache.calcite.sql.validate.AbstractNamespace.validate():84
org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
org.apache.calcite.sql.SqlSelect.validate():226
org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
com.dremio.exec.planner.sql.SqlConverter.validate():229
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
com.dremio.exec.work.foreman.AttemptManager.plan():415
com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
com.dremio.service.commandpool.CommandWrapper.run():62
java.util.concurrent.ThreadPoolExecutor.runWorker():1149
java.util.concurrent.ThreadPoolExecutor$Worker.run():624
java.lang.Thread.run():748
Caused By (org.apache.calcite.sql.validate.SqlValidatorException) Table
'DREMIO.Demo.weather' not found
sun.reflect.GeneratedConstructorAccessor148.newInstance():-1
sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
java.lang.reflect.Constructor.newInstance():423
org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
org.apache.calcite.runtime.Resources$ExInst.ex():572
org.apache.calcite.sql.SqlUtil.newContextException():803
org.apache.calcite.sql.SqlUtil.newContextException():788
org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
org.apache.calcite.sql.validate.AbstractNamespace.validate():84
org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
org.apache.calcite.sql.validate.AbstractNamespace.validate():84
org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
org.apache.calcite.sql.SqlSelect.validate():226
org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
com.dremio.exec.planner.sql.SqlConverter.validate():229
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
com.dremio.exec.work.foreman.AttemptManager.plan():415
com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
com.dremio.service.commandpool.CommandWrapper.run():62
java.util.concurrent.ThreadPoolExecutor.runWorker():1149
java.util.concurrent.ThreadPoolExecutor$Worker.run():624
java.lang.Thread.run():748
On Thu, Feb 13, 2020 at 12:16 AM Paul Rogers <pa...@yahoo.com.invalid>
wrote:
> The next step would be to take a look at the log file. Anything
> interesting there? Maybe an error or a stack trace?
>
> Thanks,
> - Paul
>
>
>
> On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers
> <pa...@yahoo.com.invalid> wrote:
>
> Going to take a wild guess. Since you configured the "Demo" schema in the
> JDBC driver, you may not need it in the Drill query. Maybe try:
>
> SELECT * FROM dremiodemo.weather;
>
> Thanks,
> - Paul
>
>
>
> On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <
> ddu@bcmcgroup.com> wrote:
>
> My command is:
>
> *select* * *from* dremiodemo.demo.weather;
>
>
> there is no quotes, but for some reason, the error message returned with
> quotes
>
>
> Thanks for your help!
>
>
>
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by Charles Givre <cg...@gmail.com>.
Hi David,
A few questions:
How are you querying Drill? The queries you are sending in the emails do not look syntactically correct to begin with. I'm referring to the use of quotation marks and backticks. These make a HUGE difference with Drill so it is really important to use the correct ones. It is therefore difficult to offer suggestions if we are seeing queries like that.
Can you query other schemata in Dremio? Do they work?
Are you first executing a USE query? If so have you tried removing the schema and table names?
IE:
USE dremiodemo
Then
SELECT * FROM `demo`
Is your Dremio installation running on the same box as Drill? Out of mere curiosity, what is the use case for querying Dremio via Drill?
Best,
-- C
> On Feb 14, 2020, at 11:19 AM, David Du <dd...@bcmcgroup.com> wrote:
>
> Anybody has any ideas about this issue?
>
> Thanks
>
> On Thu, Feb 13, 2020 at 10:05 AM David Du <dd...@bcmcgroup.com> wrote:
>
>> I used this command:
>>
>> *select* * *from* dremiodemo.demo.weather;
>>
>>
>> since dremiodemo.demo is the schema name listed from show
>> databases command.
>>
>>
>> But why the drill generated a different query as?:
>>
>> sql SELECT *
>>
>> FROM "DREMIO"."Demo"."weather"
>>
>> plugin dremiodemo
>>
>>
>> Why "DREMIO" is added instead of "dremiodemo"?
>>
>>
>> Thanks
>>
>>
>>
>>
>>
>>
>> On Thu, Feb 13, 2020 at 9:30 AM David Du <dd...@bcmcgroup.com> wrote:
>>
>>> Thanks for your help, my command is:
>>>
>>> apache drill> *select* * *from* dremiodemo.demo.weather;
>>>
>>>
>>> this gave me error from console:
>>>
>>> Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
>>> the SQL query.
>>>
>>>
>>> sql SELECT *
>>>
>>> FROM "DREMIO"."Demo"."weather"
>>>
>>> plugin dremiodemo
>>>
>>> Fragment 0:0
>>>
>>>
>>> [Error Id: dd01f1ff-c7c8-4f36-996f-5f4ed3839c43 on 172.24.30.68:31010]
>>> (state=,code=0)
>>>
>>>
>>>
>>>
>>> But the log file is:
>>>
>>>
>>>
>>> tail -f sqlline.log
>>>
>>> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics
>>> - Removing old metric since name matched newly registered metric. Metric
>>> name: drill.allocator.root.used
>>>
>>> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics
>>> - Removing old metric since name matched newly registered metric. Metric
>>> name: drill.allocator.root.peak
>>>
>>> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
>>> Foreman drillbit is 172.24.30.68
>>>
>>> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
>>> Successfully connected to server 172.24.30.68:31010
>>>
>>> 2020-02-13 09:24:02,371 [21baa3fc-c178-4227-5d3d-00bf55c59097:foreman]
>>> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
>>> 21baa3fc-c178-4227-5d3d-00bf55c59097 issued by anonymous: show databases
>>>
>>> 2020-02-13 09:24:04,145 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>>> INFO o.a.d.e.w.fragment.FragmentExecutor -
>>> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested
>>> AWAITING_ALLOCATION --> RUNNING
>>>
>>> 2020-02-13 09:24:04,156 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>>> INFO o.a.d.e.w.f.FragmentStatusReporter -
>>> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: RUNNING
>>>
>>> 2020-02-13 09:24:04,401 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>>> INFO o.a.d.e.c.ClassCompilerSelector - Java compiler policy: DEFAULT,
>>> Debug option: true
>>>
>>> 2020-02-13 09:24:04,571 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>>> INFO o.a.d.e.w.fragment.FragmentExecutor -
>>> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested RUNNING
>>> --> FINISHED
>>>
>>> 2020-02-13 09:24:04,573 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>>> INFO o.a.d.e.w.f.FragmentStatusReporter -
>>> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: FINISHED
>>>
>>> 2020-02-13 09:26:39,805 [21baa35f-ef83-15fe-f40b-8ff0415620f2:foreman]
>>> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
>>> 21baa35f-ef83-15fe-f40b-8ff0415620f2 issued by anonymous: select * from
>>> dremiodemo.demo.weather
>>>
>>> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
>>> INFO o.a.d.e.w.fragment.FragmentExecutor -
>>> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State change requested
>>> AWAITING_ALLOCATION --> RUNNING
>>>
>>> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
>>> INFO o.a.d.e.w.f.FragmentStatusReporter -
>>> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State to report: RUNNING
>>>
>>> 2020-02-13 09:26:40,472 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
>>> INFO o.a.d.e.store.jdbc.JdbcRecordReader - User Error Occurred: The JDBC
>>> storage plugin failed while trying setup the SQL query. (VALIDATION ERROR:
>>> Table 'DREMIO.Demo.weather' not found
>>>
>>>
>>> SQL Query SELECT *
>>>
>>> FROM "DREMIO"."Demo"."weather"
>>>
>>> startLine 2
>>>
>>> startColumn 6
>>>
>>> endLine 2
>>>
>>> endColumn 13
>>>
>>>
>>> [Error Id: b7ae16cc-80dc-4950-b7e1-7ccbd9cad7e8 on
>>> 1672851h-t2349.noblis.org:41010]
>>>
>>>
>>> (org.apache.calcite.runtime.CalciteContextException) From line 2,
>>> column 6 to line 2, column 13: Table 'DREMIO.Demo.weather' not found
>>>
>>> sun.reflect.GeneratedConstructorAccessor149.newInstance():-1
>>>
>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>>>
>>> java.lang.reflect.Constructor.newInstance():423
>>>
>>> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>>>
>>> org.apache.calcite.sql.SqlUtil.newContextException():803
>>>
>>> org.apache.calcite.sql.SqlUtil.newContextException():788
>>>
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>>>
>>> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>>>
>>> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>>>
>>> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>>>
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>>>
>>> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>>>
>>> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>>>
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>>>
>>> org.apache.calcite.sql.SqlSelect.validate():226
>>>
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>>>
>>> com.dremio.exec.planner.sql.SqlConverter.validate():229
>>>
>>>
>>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>>>
>>>
>>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>>>
>>>
>>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>>>
>>> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>>>
>>> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>>>
>>> com.dremio.exec.work.foreman.AttemptManager.plan():415
>>>
>>> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>>>
>>> com.dremio.service.commandpool.CommandWrapper.run():62
>>>
>>> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>>>
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>>>
>>> java.lang.Thread.run():748
>>>
>>> Caused By (org.apache.calcite.sql.validate.SqlValidatorException) Table
>>> 'DREMIO.Demo.weather' not found
>>>
>>> sun.reflect.GeneratedConstructorAccessor148.newInstance():-1
>>>
>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>>>
>>> java.lang.reflect.Constructor.newInstance():423
>>>
>>> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>>>
>>> org.apache.calcite.runtime.Resources$ExInst.ex():572
>>>
>>> org.apache.calcite.sql.SqlUtil.newContextException():803
>>>
>>> org.apache.calcite.sql.SqlUtil.newContextException():788
>>>
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>>>
>>> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>>>
>>> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>>>
>>> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>>>
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>>>
>>> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>>>
>>> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>>>
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>>>
>>> org.apache.calcite.sql.SqlSelect.validate():226
>>>
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>>>
>>> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>>>
>>> com.dremio.exec.planner.sql.SqlConverter.validate():229
>>>
>>>
>>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>>>
>>>
>>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>>>
>>>
>>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>>>
>>> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>>>
>>> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>>>
>>> com.dremio.exec.work.foreman.AttemptManager.plan():415
>>>
>>> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>>>
>>> com.dremio.service.commandpool.CommandWrapper.run():62
>>>
>>> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>>>
>>> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>>>
>>> java.lang.Thread.run():748
>>>
>>> On Thu, Feb 13, 2020 at 12:16 AM Paul Rogers <pa...@yahoo.com.invalid>
>>> wrote:
>>>
>>>> The next step would be to take a look at the log file. Anything
>>>> interesting there? Maybe an error or a stack trace?
>>>>
>>>> Thanks,
>>>> - Paul
>>>>
>>>>
>>>>
>>>> On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers
>>>> <pa...@yahoo.com.invalid> wrote:
>>>>
>>>> Going to take a wild guess. Since you configured the "Demo" schema in
>>>> the JDBC driver, you may not need it in the Drill query. Maybe try:
>>>>
>>>> SELECT * FROM dremiodemo.weather;
>>>>
>>>> Thanks,
>>>> - Paul
>>>>
>>>>
>>>>
>>>> On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <
>>>> ddu@bcmcgroup.com> wrote:
>>>>
>>>> My command is:
>>>>
>>>> *select* * *from* dremiodemo.demo.weather;
>>>>
>>>>
>>>> there is no quotes, but for some reason, the error message returned with
>>>> quotes
>>>>
>>>>
>>>> Thanks for your help!
>>>>
>>>>
>>>>
>>>
>>>
>
> --
> ********************************************************
> DISCLAIMER: This
> e-mail, including any attached files,
> is confidential, may be legally
> privileged, and is
> solely for the intended recipient(s). If you received
>
> this e-mail in error, please destroy it and notify us
> immediately by reply
> e-mail. Any unauthorized
> use, dissemination, disclosure, copying or
> printing is
> strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by David Du <dd...@bcmcgroup.com>.
Anybody has any ideas about this issue?
Thanks
On Thu, Feb 13, 2020 at 10:05 AM David Du <dd...@bcmcgroup.com> wrote:
> I used this command:
>
> *select* * *from* dremiodemo.demo.weather;
>
>
> since dremiodemo.demo is the schema name listed from show
> databases command.
>
>
> But why the drill generated a different query as?:
>
> sql SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> plugin dremiodemo
>
>
> Why "DREMIO" is added instead of "dremiodemo"?
>
>
> Thanks
>
>
>
>
>
>
> On Thu, Feb 13, 2020 at 9:30 AM David Du <dd...@bcmcgroup.com> wrote:
>
>> Thanks for your help, my command is:
>>
>> apache drill> *select* * *from* dremiodemo.demo.weather;
>>
>>
>> this gave me error from console:
>>
>> Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
>> the SQL query.
>>
>>
>> sql SELECT *
>>
>> FROM "DREMIO"."Demo"."weather"
>>
>> plugin dremiodemo
>>
>> Fragment 0:0
>>
>>
>> [Error Id: dd01f1ff-c7c8-4f36-996f-5f4ed3839c43 on 172.24.30.68:31010]
>> (state=,code=0)
>>
>>
>>
>>
>> But the log file is:
>>
>>
>>
>> tail -f sqlline.log
>>
>> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics
>> - Removing old metric since name matched newly registered metric. Metric
>> name: drill.allocator.root.used
>>
>> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics
>> - Removing old metric since name matched newly registered metric. Metric
>> name: drill.allocator.root.peak
>>
>> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
>> Foreman drillbit is 172.24.30.68
>>
>> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
>> Successfully connected to server 172.24.30.68:31010
>>
>> 2020-02-13 09:24:02,371 [21baa3fc-c178-4227-5d3d-00bf55c59097:foreman]
>> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
>> 21baa3fc-c178-4227-5d3d-00bf55c59097 issued by anonymous: show databases
>>
>> 2020-02-13 09:24:04,145 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>> INFO o.a.d.e.w.fragment.FragmentExecutor -
>> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested
>> AWAITING_ALLOCATION --> RUNNING
>>
>> 2020-02-13 09:24:04,156 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>> INFO o.a.d.e.w.f.FragmentStatusReporter -
>> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: RUNNING
>>
>> 2020-02-13 09:24:04,401 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>> INFO o.a.d.e.c.ClassCompilerSelector - Java compiler policy: DEFAULT,
>> Debug option: true
>>
>> 2020-02-13 09:24:04,571 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>> INFO o.a.d.e.w.fragment.FragmentExecutor -
>> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested RUNNING
>> --> FINISHED
>>
>> 2020-02-13 09:24:04,573 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
>> INFO o.a.d.e.w.f.FragmentStatusReporter -
>> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: FINISHED
>>
>> 2020-02-13 09:26:39,805 [21baa35f-ef83-15fe-f40b-8ff0415620f2:foreman]
>> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
>> 21baa35f-ef83-15fe-f40b-8ff0415620f2 issued by anonymous: select * from
>> dremiodemo.demo.weather
>>
>> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
>> INFO o.a.d.e.w.fragment.FragmentExecutor -
>> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State change requested
>> AWAITING_ALLOCATION --> RUNNING
>>
>> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
>> INFO o.a.d.e.w.f.FragmentStatusReporter -
>> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State to report: RUNNING
>>
>> 2020-02-13 09:26:40,472 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
>> INFO o.a.d.e.store.jdbc.JdbcRecordReader - User Error Occurred: The JDBC
>> storage plugin failed while trying setup the SQL query. (VALIDATION ERROR:
>> Table 'DREMIO.Demo.weather' not found
>>
>>
>> SQL Query SELECT *
>>
>> FROM "DREMIO"."Demo"."weather"
>>
>> startLine 2
>>
>> startColumn 6
>>
>> endLine 2
>>
>> endColumn 13
>>
>>
>> [Error Id: b7ae16cc-80dc-4950-b7e1-7ccbd9cad7e8 on
>> 1672851h-t2349.noblis.org:41010]
>>
>>
>> (org.apache.calcite.runtime.CalciteContextException) From line 2,
>> column 6 to line 2, column 13: Table 'DREMIO.Demo.weather' not found
>>
>> sun.reflect.GeneratedConstructorAccessor149.newInstance():-1
>>
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>>
>> java.lang.reflect.Constructor.newInstance():423
>>
>> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>>
>> org.apache.calcite.sql.SqlUtil.newContextException():803
>>
>> org.apache.calcite.sql.SqlUtil.newContextException():788
>>
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>>
>> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>>
>> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>>
>> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>>
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>>
>> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>>
>> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>>
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>>
>> org.apache.calcite.sql.SqlSelect.validate():226
>>
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>>
>> com.dremio.exec.planner.sql.SqlConverter.validate():229
>>
>>
>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>>
>>
>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>>
>>
>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>>
>> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>>
>> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>>
>> com.dremio.exec.work.foreman.AttemptManager.plan():415
>>
>> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>>
>> com.dremio.service.commandpool.CommandWrapper.run():62
>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>>
>> java.lang.Thread.run():748
>>
>> Caused By (org.apache.calcite.sql.validate.SqlValidatorException) Table
>> 'DREMIO.Demo.weather' not found
>>
>> sun.reflect.GeneratedConstructorAccessor148.newInstance():-1
>>
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>>
>> java.lang.reflect.Constructor.newInstance():423
>>
>> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>>
>> org.apache.calcite.runtime.Resources$ExInst.ex():572
>>
>> org.apache.calcite.sql.SqlUtil.newContextException():803
>>
>> org.apache.calcite.sql.SqlUtil.newContextException():788
>>
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>>
>> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>>
>> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>>
>> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>>
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>>
>> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>>
>> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>>
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>>
>> org.apache.calcite.sql.SqlSelect.validate():226
>>
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>>
>> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>>
>> com.dremio.exec.planner.sql.SqlConverter.validate():229
>>
>>
>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>>
>>
>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>>
>>
>> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>>
>> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>>
>> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>>
>> com.dremio.exec.work.foreman.AttemptManager.plan():415
>>
>> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>>
>> com.dremio.service.commandpool.CommandWrapper.run():62
>>
>> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>>
>> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>>
>> java.lang.Thread.run():748
>>
>> On Thu, Feb 13, 2020 at 12:16 AM Paul Rogers <pa...@yahoo.com.invalid>
>> wrote:
>>
>>> The next step would be to take a look at the log file. Anything
>>> interesting there? Maybe an error or a stack trace?
>>>
>>> Thanks,
>>> - Paul
>>>
>>>
>>>
>>> On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers
>>> <pa...@yahoo.com.invalid> wrote:
>>>
>>> Going to take a wild guess. Since you configured the "Demo" schema in
>>> the JDBC driver, you may not need it in the Drill query. Maybe try:
>>>
>>> SELECT * FROM dremiodemo.weather;
>>>
>>> Thanks,
>>> - Paul
>>>
>>>
>>>
>>> On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <
>>> ddu@bcmcgroup.com> wrote:
>>>
>>> My command is:
>>>
>>> *select* * *from* dremiodemo.demo.weather;
>>>
>>>
>>> there is no quotes, but for some reason, the error message returned with
>>> quotes
>>>
>>>
>>> Thanks for your help!
>>>
>>>
>>>
>>
>>
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by David Du <dd...@bcmcgroup.com>.
I used this command:
*select* * *from* dremiodemo.demo.weather;
since dremiodemo.demo is the schema name listed from show
databases command.
But why the drill generated a different query as?:
sql SELECT *
FROM "DREMIO"."Demo"."weather"
plugin dremiodemo
Why "DREMIO" is added instead of "dremiodemo"?
Thanks
On Thu, Feb 13, 2020 at 9:30 AM David Du <dd...@bcmcgroup.com> wrote:
> Thanks for your help, my command is:
>
> apache drill> *select* * *from* dremiodemo.demo.weather;
>
>
> this gave me error from console:
>
> Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
> the SQL query.
>
>
> sql SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> plugin dremiodemo
>
> Fragment 0:0
>
>
> [Error Id: dd01f1ff-c7c8-4f36-996f-5f4ed3839c43 on 172.24.30.68:31010]
> (state=,code=0)
>
>
>
>
> But the log file is:
>
>
>
> tail -f sqlline.log
>
> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
> Removing old metric since name matched newly registered metric. Metric
> name: drill.allocator.root.used
>
> 2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
> Removing old metric since name matched newly registered metric. Metric
> name: drill.allocator.root.peak
>
> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
> Foreman drillbit is 172.24.30.68
>
> 2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
> Successfully connected to server 172.24.30.68:31010
>
> 2020-02-13 09:24:02,371 [21baa3fc-c178-4227-5d3d-00bf55c59097:foreman]
> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> 21baa3fc-c178-4227-5d3d-00bf55c59097 issued by anonymous: show databases
>
> 2020-02-13 09:24:04,145 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested
> AWAITING_ALLOCATION --> RUNNING
>
> 2020-02-13 09:24:04,156 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: RUNNING
>
> 2020-02-13 09:24:04,401 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.c.ClassCompilerSelector - Java compiler policy: DEFAULT,
> Debug option: true
>
> 2020-02-13 09:24:04,571 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested RUNNING
> --> FINISHED
>
> 2020-02-13 09:24:04,573 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: FINISHED
>
> 2020-02-13 09:26:39,805 [21baa35f-ef83-15fe-f40b-8ff0415620f2:foreman]
> INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
> 21baa35f-ef83-15fe-f40b-8ff0415620f2 issued by anonymous: select * from
> dremiodemo.demo.weather
>
> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.w.fragment.FragmentExecutor -
> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State change requested
> AWAITING_ALLOCATION --> RUNNING
>
> 2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.w.f.FragmentStatusReporter -
> 21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State to report: RUNNING
>
> 2020-02-13 09:26:40,472 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
> INFO o.a.d.e.store.jdbc.JdbcRecordReader - User Error Occurred: The JDBC
> storage plugin failed while trying setup the SQL query. (VALIDATION ERROR:
> Table 'DREMIO.Demo.weather' not found
>
>
> SQL Query SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> startLine 2
>
> startColumn 6
>
> endLine 2
>
> endColumn 13
>
>
> [Error Id: b7ae16cc-80dc-4950-b7e1-7ccbd9cad7e8 on
> 1672851h-t2349.noblis.org:41010]
>
>
> (org.apache.calcite.runtime.CalciteContextException) From line 2, column
> 6 to line 2, column 13: Table 'DREMIO.Demo.weather' not found
>
> sun.reflect.GeneratedConstructorAccessor149.newInstance():-1
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>
> java.lang.reflect.Constructor.newInstance():423
>
> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>
> org.apache.calcite.sql.SqlUtil.newContextException():803
>
> org.apache.calcite.sql.SqlUtil.newContextException():788
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>
> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>
> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>
> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.SqlSelect.validate():226
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>
> com.dremio.exec.planner.sql.SqlConverter.validate():229
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>
> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>
> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>
> com.dremio.exec.work.foreman.AttemptManager.plan():415
>
> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>
> com.dremio.service.commandpool.CommandWrapper.run():62
>
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>
> java.lang.Thread.run():748
>
> Caused By (org.apache.calcite.sql.validate.SqlValidatorException) Table
> 'DREMIO.Demo.weather' not found
>
> sun.reflect.GeneratedConstructorAccessor148.newInstance():-1
>
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
>
> java.lang.reflect.Constructor.newInstance():423
>
> org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
>
> org.apache.calcite.runtime.Resources$ExInst.ex():572
>
> org.apache.calcite.sql.SqlUtil.newContextException():803
>
> org.apache.calcite.sql.SqlUtil.newContextException():788
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
>
> org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
>
> org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
>
> org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
>
> org.apache.calcite.sql.validate.AbstractNamespace.validate():84
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
>
> org.apache.calcite.sql.SqlSelect.validate():226
>
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
>
> org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
>
> com.dremio.exec.planner.sql.SqlConverter.validate():229
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
>
>
> com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
>
> com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
>
> com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
>
> com.dremio.exec.work.foreman.AttemptManager.plan():415
>
> com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
>
> com.dremio.service.commandpool.CommandWrapper.run():62
>
> java.util.concurrent.ThreadPoolExecutor.runWorker():1149
>
> java.util.concurrent.ThreadPoolExecutor$Worker.run():624
>
> java.lang.Thread.run():748
>
> On Thu, Feb 13, 2020 at 12:16 AM Paul Rogers <pa...@yahoo.com.invalid>
> wrote:
>
>> The next step would be to take a look at the log file. Anything
>> interesting there? Maybe an error or a stack trace?
>>
>> Thanks,
>> - Paul
>>
>>
>>
>> On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers
>> <pa...@yahoo.com.invalid> wrote:
>>
>> Going to take a wild guess. Since you configured the "Demo" schema in
>> the JDBC driver, you may not need it in the Drill query. Maybe try:
>>
>> SELECT * FROM dremiodemo.weather;
>>
>> Thanks,
>> - Paul
>>
>>
>>
>> On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <
>> ddu@bcmcgroup.com> wrote:
>>
>> My command is:
>>
>> *select* * *from* dremiodemo.demo.weather;
>>
>>
>> there is no quotes, but for some reason, the error message returned with
>> quotes
>>
>>
>> Thanks for your help!
>>
>>
>>
>
>
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by David Du <dd...@bcmcgroup.com>.
Thanks for your help, my command is:
apache drill> *select* * *from* dremiodemo.demo.weather;
this gave me error from console:
Error: DATA_READ ERROR: The JDBC storage plugin failed while trying setup
the SQL query.
sql SELECT *
FROM "DREMIO"."Demo"."weather"
plugin dremiodemo
Fragment 0:0
[Error Id: dd01f1ff-c7c8-4f36-996f-5f4ed3839c43 on 172.24.30.68:31010]
(state=,code=0)
But the log file is:
tail -f sqlline.log
2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
Removing old metric since name matched newly registered metric. Metric
name: drill.allocator.root.used
2020-02-13 09:23:48,780 [main] WARN o.a.drill.exec.metrics.DrillMetrics -
Removing old metric since name matched newly registered metric. Metric
name: drill.allocator.root.peak
2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
Foreman drillbit is 172.24.30.68
2020-02-13 09:23:48,913 [main] INFO o.a.drill.exec.client.DrillClient -
Successfully connected to server 172.24.30.68:31010
2020-02-13 09:24:02,371 [21baa3fc-c178-4227-5d3d-00bf55c59097:foreman]
INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
21baa3fc-c178-4227-5d3d-00bf55c59097 issued by anonymous: show databases
2020-02-13 09:24:04,145 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.w.fragment.FragmentExecutor -
21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested
AWAITING_ALLOCATION --> RUNNING
2020-02-13 09:24:04,156 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.w.f.FragmentStatusReporter -
21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: RUNNING
2020-02-13 09:24:04,401 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.c.ClassCompilerSelector - Java compiler policy: DEFAULT,
Debug option: true
2020-02-13 09:24:04,571 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.w.fragment.FragmentExecutor -
21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State change requested RUNNING
--> FINISHED
2020-02-13 09:24:04,573 [21baa3fc-c178-4227-5d3d-00bf55c59097:frag:0:0]
INFO o.a.d.e.w.f.FragmentStatusReporter -
21baa3fc-c178-4227-5d3d-00bf55c59097:0:0: State to report: FINISHED
2020-02-13 09:26:39,805 [21baa35f-ef83-15fe-f40b-8ff0415620f2:foreman]
INFO o.a.drill.exec.work.foreman.Foreman - Query text for query with id
21baa35f-ef83-15fe-f40b-8ff0415620f2 issued by anonymous: select * from
dremiodemo.demo.weather
2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
INFO o.a.d.e.w.fragment.FragmentExecutor -
21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State change requested
AWAITING_ALLOCATION --> RUNNING
2020-02-13 09:26:40,308 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
INFO o.a.d.e.w.f.FragmentStatusReporter -
21baa35f-ef83-15fe-f40b-8ff0415620f2:0:0: State to report: RUNNING
2020-02-13 09:26:40,472 [21baa35f-ef83-15fe-f40b-8ff0415620f2:frag:0:0]
INFO o.a.d.e.store.jdbc.JdbcRecordReader - User Error Occurred: The JDBC
storage plugin failed while trying setup the SQL query. (VALIDATION ERROR:
Table 'DREMIO.Demo.weather' not found
SQL Query SELECT *
FROM "DREMIO"."Demo"."weather"
startLine 2
startColumn 6
endLine 2
endColumn 13
[Error Id: b7ae16cc-80dc-4950-b7e1-7ccbd9cad7e8 on
1672851h-t2349.noblis.org:41010]
(org.apache.calcite.runtime.CalciteContextException) From line 2, column
6 to line 2, column 13: Table 'DREMIO.Demo.weather' not found
sun.reflect.GeneratedConstructorAccessor149.newInstance():-1
sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
java.lang.reflect.Constructor.newInstance():423
org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
org.apache.calcite.sql.SqlUtil.newContextException():803
org.apache.calcite.sql.SqlUtil.newContextException():788
org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
org.apache.calcite.sql.validate.AbstractNamespace.validate():84
org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
org.apache.calcite.sql.validate.AbstractNamespace.validate():84
org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
org.apache.calcite.sql.SqlSelect.validate():226
org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
com.dremio.exec.planner.sql.SqlConverter.validate():229
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
com.dremio.exec.work.foreman.AttemptManager.plan():415
com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
com.dremio.service.commandpool.CommandWrapper.run():62
java.util.concurrent.ThreadPoolExecutor.runWorker():1149
java.util.concurrent.ThreadPoolExecutor$Worker.run():624
java.lang.Thread.run():748
Caused By (org.apache.calcite.sql.validate.SqlValidatorException) Table
'DREMIO.Demo.weather' not found
sun.reflect.GeneratedConstructorAccessor148.newInstance():-1
sun.reflect.DelegatingConstructorAccessorImpl.newInstance():45
java.lang.reflect.Constructor.newInstance():423
org.apache.calcite.runtime.Resources$ExInstWithCause.ex():463
org.apache.calcite.runtime.Resources$ExInst.ex():572
org.apache.calcite.sql.SqlUtil.newContextException():803
org.apache.calcite.sql.SqlUtil.newContextException():788
org.apache.calcite.sql.validate.SqlValidatorImpl.newValidationError():4470
org.apache.calcite.sql.validate.IdentifierNamespace.resolveImpl():104
org.apache.calcite.sql.validate.IdentifierNamespace.validateImpl():120
org.apache.calcite.sql.validate.AbstractNamespace.validate():84
org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2971
org.apache.calcite.sql.validate.SqlValidatorImpl.validateFrom():2956
org.apache.calcite.sql.validate.SqlValidatorImpl.validateSelect():3197
org.apache.calcite.sql.validate.SelectNamespace.validateImpl():60
org.apache.calcite.sql.validate.AbstractNamespace.validate():84
org.apache.calcite.sql.validate.SqlValidatorImpl.validateNamespace():943
org.apache.calcite.sql.validate.SqlValidatorImpl.validateQuery():924
org.apache.calcite.sql.SqlSelect.validate():226
org.apache.calcite.sql.validate.SqlValidatorImpl.validateScopedExpression():899
org.apache.calcite.sql.validate.SqlValidatorImpl.validate():609
com.dremio.exec.planner.sql.SqlConverter.validate():229
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateNode():184
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():173
com.dremio.exec.planner.sql.handlers.PrelTransformer.validateAndConvert():169
com.dremio.exec.planner.sql.handlers.query.NormalHandler.getPlan():43
com.dremio.exec.planner.sql.handlers.commands.HandlerToExec.plan():70
com.dremio.exec.work.foreman.AttemptManager.plan():415
com.dremio.exec.work.foreman.AttemptManager.lambda$run$0():324
com.dremio.service.commandpool.CommandWrapper.run():62
java.util.concurrent.ThreadPoolExecutor.runWorker():1149
java.util.concurrent.ThreadPoolExecutor$Worker.run():624
java.lang.Thread.run():748
On Thu, Feb 13, 2020 at 12:16 AM Paul Rogers <pa...@yahoo.com.invalid>
wrote:
> The next step would be to take a look at the log file. Anything
> interesting there? Maybe an error or a stack trace?
>
> Thanks,
> - Paul
>
>
>
> On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers
> <pa...@yahoo.com.invalid> wrote:
>
> Going to take a wild guess. Since you configured the "Demo" schema in the
> JDBC driver, you may not need it in the Drill query. Maybe try:
>
> SELECT * FROM dremiodemo.weather;
>
> Thanks,
> - Paul
>
>
>
> On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <
> ddu@bcmcgroup.com> wrote:
>
> My command is:
>
> *select* * *from* dremiodemo.demo.weather;
>
>
> there is no quotes, but for some reason, the error message returned with
> quotes
>
>
> Thanks for your help!
>
>
>
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by Paul Rogers <pa...@yahoo.com.INVALID>.
The next step would be to take a look at the log file. Anything interesting there? Maybe an error or a stack trace?
Thanks,
- Paul
On Wednesday, February 12, 2020, 8:12:19 PM PST, Paul Rogers <pa...@yahoo.com.invalid> wrote:
Going to take a wild guess. Since you configured the "Demo" schema in the JDBC driver, you may not need it in the Drill query. Maybe try:
SELECT * FROM dremiodemo.weather;
Thanks,
- Paul
On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <dd...@bcmcgroup.com> wrote:
My command is:
*select* * *from* dremiodemo.demo.weather;
there is no quotes, but for some reason, the error message returned with
quotes
Thanks for your help!
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by Paul Rogers <pa...@yahoo.com.INVALID>.
Going to take a wild guess. Since you configured the "Demo" schema in the JDBC driver, you may not need it in the Drill query. Maybe try:
SELECT * FROM dremiodemo.weather;
Thanks,
- Paul
On Wednesday, February 12, 2020, 10:34:35 AM PST, David Du <dd...@bcmcgroup.com> wrote:
My command is:
*select* * *from* dremiodemo.demo.weather;
there is no quotes, but for some reason, the error message returned with
quotes
Thanks for your help!
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by David Du <dd...@bcmcgroup.com>.
My command is:
*select* * *from* dremiodemo.demo.weather;
there is no quotes, but for some reason, the error message returned with
quotes
Thanks for your help!
On Wed, Feb 12, 2020 at 1:32 PM Charles Givre <cg...@gmail.com> wrote:
> Did you try removing the double quotes?
> IE:
> SELECT *
> FROM dremio.`demo`.`weather`
>
>
> > On Feb 12, 2020, at 1:27 PM, David Du <dd...@bcmcgroup.com> wrote:
> >
> > Hi
> > 1. I installed the 4.1.4 community version of dremio, and from its web
> UI,
> > created Demo workspace, then used the samples csv file Samples."
> > samples.dremio.com"."SF weather 2018-2019.csv" and saved as weather into
> > the Demo workspace, so when clicked on Demo workspace, on the right side
> > panel the weather name showed up, the copied path is Demo.weather.
> > 2. I installed the apache-drill-1.17.0 and dropped the jdbc file:
> > dremio-jdbc-driver-4.1.4-202001240912140359-a90eb503.jar into the
> > jars/3rdparty folder and jdbc-driver folder.
> > 3. Started apache drill with ./drill-embedded command, then went to drill
> > web UI, created storage plugin: dremiodemo:
> > {
> > "type": "jdbc",
> > "driver": "com.dremio.jdbc.Driver",
> > "url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
> > "username": "admin",
> > "password": "",
> > "caseInsensitiveTableNames": true,
> > "enabled": true
> > }
> > since apache drill is also using 31010, I changed the dremio jdbc port to
> > 41010 in the conf file.
> > 4. from drill started session, type show databases;
> > dremiodemo.demo is listed as one of the schema names,
> > then:
> > type select * from dremiodemo.demo.weather;
> > I got error: Error: DATA_READ ERROR: The JDBC storage plugin failed while
> > trying setup the SQL query.
> >
> > sql SELECT *
> >
> > FROM "DREMIO"."Demo"."weather"
> >
> > plugin dremiodemo
> >
> > Fragment 0:0
> >
> > in the Dremio server.log file, it showed erro:
> > Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table
> > 'DREMIO.Demo.weather' not found
> > Any clues? thanks for help.
> >
> > --
> > ********************************************************
> > DISCLAIMER: This
> > e-mail, including any attached files,
> > is confidential, may be legally
> > privileged, and is
> > solely for the intended recipient(s). If you received
> >
> > this e-mail in error, please destroy it and notify us
> > immediately by reply
> > e-mail. Any unauthorized
> > use, dissemination, disclosure, copying or
> > printing is
> > strictly prohibited. - BCMC, LLC
>
>
--
********************************************************
DISCLAIMER: This
e-mail, including any attached files,
is confidential, may be legally
privileged, and is
solely for the intended recipient(s). If you received
this e-mail in error, please destroy it and notify us
immediately by reply
e-mail. Any unauthorized
use, dissemination, disclosure, copying or
printing is
strictly prohibited. - BCMC, LLC
Re: Error: DATA_READ ERROR: The JDBC storage plugin failed while
trying setup the SQL query
Posted by Charles Givre <cg...@gmail.com>.
Did you try removing the double quotes?
IE:
SELECT *
FROM dremio.`demo`.`weather`
> On Feb 12, 2020, at 1:27 PM, David Du <dd...@bcmcgroup.com> wrote:
>
> Hi
> 1. I installed the 4.1.4 community version of dremio, and from its web UI,
> created Demo workspace, then used the samples csv file Samples."
> samples.dremio.com"."SF weather 2018-2019.csv" and saved as weather into
> the Demo workspace, so when clicked on Demo workspace, on the right side
> panel the weather name showed up, the copied path is Demo.weather.
> 2. I installed the apache-drill-1.17.0 and dropped the jdbc file:
> dremio-jdbc-driver-4.1.4-202001240912140359-a90eb503.jar into the
> jars/3rdparty folder and jdbc-driver folder.
> 3. Started apache drill with ./drill-embedded command, then went to drill
> web UI, created storage plugin: dremiodemo:
> {
> "type": "jdbc",
> "driver": "com.dremio.jdbc.Driver",
> "url": "jdbc:dremio:direct=localhost:41010;schema=Demo",
> "username": "admin",
> "password": "",
> "caseInsensitiveTableNames": true,
> "enabled": true
> }
> since apache drill is also using 31010, I changed the dremio jdbc port to
> 41010 in the conf file.
> 4. from drill started session, type show databases;
> dremiodemo.demo is listed as one of the schema names,
> then:
> type select * from dremiodemo.demo.weather;
> I got error: Error: DATA_READ ERROR: The JDBC storage plugin failed while
> trying setup the SQL query.
>
> sql SELECT *
>
> FROM "DREMIO"."Demo"."weather"
>
> plugin dremiodemo
>
> Fragment 0:0
>
> in the Dremio server.log file, it showed erro:
> Caused by: org.apache.calcite.sql.validate.SqlValidatorException: Table
> 'DREMIO.Demo.weather' not found
> Any clues? thanks for help.
>
> --
> ********************************************************
> DISCLAIMER: This
> e-mail, including any attached files,
> is confidential, may be legally
> privileged, and is
> solely for the intended recipient(s). If you received
>
> this e-mail in error, please destroy it and notify us
> immediately by reply
> e-mail. Any unauthorized
> use, dissemination, disclosure, copying or
> printing is
> strictly prohibited. - BCMC, LLC