You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by "Ahmad, Sami" <Sa...@dot.state.fl.us> on 2019/05/14 17:07:34 UTC
RE: WELCOME to user@drill.apache.org
I am not able to see any hive or hbase tables in drill , I get the schema fine , getting the error in the logfile shown below .
Regards
[root@hadoop1 bin]# ./drillbit.sh start
Starting drillbit, logging to /root/apache-drill-1.16.0/log/drillbit.out
[root@hadoop1 bin]#
[root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181
Apache Drill 1.16.0
"Say hello to my little Drill."
apache drill> show schemas;
+--------------------+
| SCHEMA_NAME |
+--------------------+
| cp.default |
| dfs.default |
| dfs.root |
| dfs.tmp |
| hbase |
| hive.aaronm |
| hive.default |
| hive.es_testdb |
| hive.guest |
| hive.ivann |
| hive.levic |
| hive.nasirq |
| hive.nipar |
| hive.rangertst |
| hive.richas |
| hive.roumig |
| hive.sami |
| hive.sandeeps |
| hive.sasmitap |
| hive.sid |
| hive.swaroopa |
| hive.tito |
| hive.usha |
| information_schema |
| sys |
+--------------------+
25 rows selected (1.869 seconds)
apache drill> use hive;
+------+----------------------------------+
| ok | summary |
+------+----------------------------------+
| true | Default schema changed to [hive] |
+------+----------------------------------+
1 row selected (0.103 seconds)
apache drill (hive)> show tables; <<<< NOT SHOWING ANY HIVE TABLES.
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
+--------------+------------+
No rows selected (0.601 seconds)
apache drill (hive)>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_112]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
Caused by: java.util.concurrent.ExecutionException: MetaException(message:Got exception: org.apache.thrift.TApplicationException Invalid method name: 'get_tables_by_type')
at org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:502) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:461) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:83) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:142) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2453) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2417) ~[drill-shaded-guava-23.0.jar:23.0]
at o
-----Original Message-----
From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
Sent: Tuesday, May 14, 2019 10:55 AM
To: Ahmad, Sami <Sa...@dot.state.fl.us>
Subject: WELCOME to user@drill.apache.org
EXTERNAL SENDER: Use caution with links and attachments.
Hi! This is the ezmlm program. I'm managing the user@drill.apache.org mailing list.
I'm working for my owner, who can be reached at user-owner@drill.apache.org.
Acknowledgment: I have added the address
Sami.Ahmad@dot.state.fl.us
to the user mailing list.
Welcome to user@drill.apache.org!
Please save this message so that you know the address you are subscribed under, in case you later want to unsubscribe or change your subscription address.
--- Administrative commands for the user list ---
I can handle administrative requests automatically. Please do not send them to the list address! Instead, send your message to the correct command address:
To subscribe to the list, send a message to:
<us...@drill.apache.org>
To remove your address from the list, send a message to:
<us...@drill.apache.org>
Send mail to the following for info and FAQ for this list:
<us...@drill.apache.org>
<us...@drill.apache.org>
Similar addresses exist for the digest list:
<us...@drill.apache.org>
<us...@drill.apache.org>
To get messages 123 through 145 (a maximum of 100 per request), mail:
<us...@drill.apache.org>
To get an index with subject and author for messages 123-456 , mail:
<us...@drill.apache.org>
They are always returned as sets of 100, max 2000 per request, so you'll actually get 100-499.
To receive all messages with the same subject as message 12345, send a short message to:
<us...@drill.apache.org>
The messages should contain one line or word of text to avoid being treated as sp@m, but I will ignore their content.
Only the ADDRESS you send to is important.
You can start a subscription for an alternate address, for example "john@host.domain", just add a hyphen and your address (with '=' instead of '@') after the command word:
<us...@drill.apache.org>
To stop subscription for this address, mail:
<us...@drill.apache.org>
In both cases, I'll send a confirmation message to that address. When you receive it, simply reply to it to complete your subscription.
If despite following these instructions, you do not get the desired results, please contact my owner at user-owner@drill.apache.org. Please be patient, my owner is a lot slower than I am ;-)
--- Enclosed is a copy of the request I received.
Return-Path: <Sa...@dot.state.fl.us>
Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15 -0000
Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019 14:55:15 +0000
Received: from localhost (localhost [127.0.0.1])
by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
for <us...@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
X-Spam-Flag: NO
X-Spam-Score: 0.549
X-Spam-Level:
X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75, RCVD_IN_DNSWL_NONE=-0.0001,
SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
autolearn=disabled
Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
dkim=pass (1024-bit key) header.d=dot.state.fl.us
Received: from mx1-lw-eu.apache.org ([10.40.0.8])
by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024)
with ESMTP id WIGqrOYFhOGS
for <us...@drill.apache.org>;
Tue, 14 May 2019 14:55:12 +0000 (UTC)
Received: from GCC01-CY1-obe.outbound.protection.outlook.com (mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
for <us...@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dot.state.fl.us; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63Oymn5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4UPRSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
Received: from BL0PR0901MB3154.namprd09.prod.outlook.com (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21; Tue, 14 May 2019 14:55:03 +0000
Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
([fe80::f8d0:42f:dc63:9883]) by BL0PR0901MB3154.namprd09.prod.outlook.com
([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14 May 2019
14:55:03 +0000
From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=dot.state.fl.us@drill.apache.org"
<us...@drill.apache.org>
Subject: RE: confirm subscribe to user@drill.apache.org
Thread-Topic: confirm subscribe to user@drill.apache.org
Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
Date: Tue, 14 May 2019 14:55:03 +0000
Message-ID:
<BL...@BL0PR0901MB3154.namprd09.prod.outlook.com>
References: <15...@drill.apache.org>
In-Reply-To: <15...@drill.apache.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=Sami.Ahmad@dot.state.fl.us;
x-originating-ip: [156.75.180.190]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 891d59b5-e680-490f-e77a-08d6d87c258a
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam:
BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605104)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
x-ms-traffictypediagnostic: BL0PR0901MB2481:
x-ms-exchange-purlcount: 1
x-microsoft-antispam-prvs:
<BL...@BL0PR0901MB2481.namprd09.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:6108;
x-forefront-prvs: 0037FD6480
x-forefront-antispam-report:
SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:BL0PR0901MB3154.namprd09.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
received-spf: None (protection.outlook.com: dot.state.fl.us does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info:
k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0YdXBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qiMhFl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNjj588uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEkozf2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc0s56hSVh4=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: dot.state.fl.us
X-MS-Exchange-CrossTenant-Network-Message-Id: 891d59b5-e680-490f-e77a-08d6d87c258a
X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019 14:55:03.6058
(UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
Here is the drill website , showing how to make a thrift connection , and I am doing exactly the same.
I understand that "derby" is the default embedded meta store but we don’t use it . we use remote mysql database as metastore which we connect to using thrift .
Regards
[cid:image001.png@01D50A6A.689DF090]
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org
Cc: user-help@drill.apache.org
Subject: Re: WELCOME to user@drill.apache.org
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: RE: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org<ma...@drill.apache.org> [mailto:user-help@drill.apache.org]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>>
> > Subject: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org<ma...@drill.apache.org> mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org<ma...@drill.apache.org>.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org<ma...@drill.apache.org>!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain<ma...@host.domain>", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org<ma...@drill.apache.org>.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org (HELO
> > spamd1-us-west.apache.org) (209.188.14.142)
> > by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org (ASF Mail Server at
> > spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us
> > Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> > mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> > by mx1-lw-eu.apache.org (ASF Mail Server at
> > mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>
> > Subject: RE: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Topic: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr<ma...@BL0PR0901MB3154.namprd09.pr>
> > od
> > .outlook.com
> > >
> > References: <15...@drill.apache.org>>
> > In-Reply-To: <15...@drill.apache.org>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr<ma...@BL0PR0901MB2481.namprd09.pr>
> > od
> > .outlook.com
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com: dot.state.fl.us does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
Hi Farraz
I am not sure what to put for the following since I am not using derby db. For hive metastore I use mysql database.
jdbc:derby:;databaseName=
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org
Cc: user-help@drill.apache.org
Subject: Re: WELCOME to user@drill.apache.org
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: RE: WELCOME to user@drill.apache.org
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: Re: WELCOME to user@drill.apache.org
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>
> > Subject: WELCOME to user@drill.apache.org
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>
> > <us...@drill.apache.org>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>
> > <us...@drill.apache.org>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org (HELO
> > spamd1-us-west.apache.org) (209.188.14.142)
> > by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org (ASF Mail Server at
> > spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us
> > Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> > mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> > by mx1-lw-eu.apache.org (ASF Mail Server at
> > mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>
> > Subject: RE: confirm subscribe to user@drill.apache.org
> > Thread-Topic: confirm subscribe to user@drill.apache.org
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr
> > od
> > .outlook.com
> > >
> > References: <15...@drill.apache.org>
> > In-Reply-To: <15...@drill.apache.org>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr
> > od
> > .outlook.com
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com: dot.state.fl.us does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by Kunal Khatua <ku...@apache.org>.
It could be related to Hive versions. You can try an older version of Drill to verify this... or upgrade to Hive 2.x which is not expected to be fully backward compatible with Hive 1.x (hence the major version change).
Also, if I would suggest you experiment with the back ticks to see if that makes a difference.
On 5/15/2019 10:21:13 AM, Ahmad, Sami <sa...@dot.state.fl.us> wrote:
Could this be version issue? I saw on web that dril 1.13 requires hive 2.3.X
I am using hive 1.2
regards
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 6:35 PM
To: user@drill.apache.org; Ahmad, Sami
Subject: Re: WELCOME to user@drill.apache.org
If you are using mySQL for hive metastore, your entries in Drill's hive storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://1.2.10.10:3306/hive?createDatabaseIfNotExist=true",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <>> wrote:
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org
Cc: user-help@drill.apache.org
Subject: Re: WELCOME to user@drill.apache.org
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: RE: WELCOME to user@drill.apache.org
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: Re: WELCOME to user@drill.apache.org
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; < not="" showing="">
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <>>
> > Subject: WELCOME to user@drill.apache.org
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <>>
> >
> > To remove your address from the list, send a message to:
> > <>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <>>
> > <>>
> >
> > Similar addresses exist for the digest list:
> > <>>
> > <>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <>>
> >
> > To stop subscription for this address, mail:
> > <>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org (HELO
> > spamd1-us-west.apache.org) (209.188.14.142)
> > by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org (ASF Mail Server at
> > spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> > for
> > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us
> > Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for
> > dot.state.fl.us@drill.apache.org>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> > mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> > by mx1-lw-eu.apache.org (ASF Mail Server at
> > mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
> > for
> > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org"
> >
> > dot.state.fl.us@drill.apache.org>
> > Subject: RE: confirm subscribe to user@drill.apache.org
> > Thread-Topic: confirm subscribe to user@drill.apache.org
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <>
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr
> > od
> > .outlook.com
> > >
> > References: <>>
> > In-Reply-To: <>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <>
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr
> > od
> > .outlook.com
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com: dot.state.fl.us does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
Could this be version issue? I saw on web that dril 1.13 requires hive 2.3.X
I am using hive 1.2
regards
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 6:35 PM
To: user@drill.apache.org; Ahmad, Sami <Sa...@dot.state.fl.us>
Subject: Re: WELCOME to user@drill.apache.org
If you are using mySQL for hive metastore, your entries in Drill's hive storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A9083&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424731822&sdata=I46ULqkp5zD12nOKgkzKAVxc%2FlLYt4u46faSLO7lZbg%3D&reserved=0>",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://1.2.10.10:3306/hive?createDatabaseIfNotExist=true<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A3306%2Fhive%3FcreateDatabaseIfNotExist%3Dtrue&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=amlo2YnFi9gW4elCLwblGP4ePemYmusxjX1PZKeL7Do%3D&reserved=0>",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=FoLsiXTaLRhfm6pi7ZNmRJkm6LDziPRjMiFnkkw9hLg%3D&reserved=0>": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>> wrote:
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org<ma...@drill.apache.org>
Cc: user-help@drill.apache.org<ma...@drill.apache.org>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: RE: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=Zc0Zoo5bAv%2Fb23f76A3mUu3dpV8GCV8VGMkBZ%2BPN3Dc%3D&reserved=0>": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org<ma...@drill.apache.org> [mailto:user-help@drill.apache.org<ma...@drill.apache.org>]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>>
> > Subject: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org<ma...@drill.apache.org> mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org<ma...@drill.apache.org>.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org<ma...@drill.apache.org>!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain<ma...@host.domain>", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org<ma...@drill.apache.org>.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpnap-us-west-generic-nat.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hLpywAuoNN%2FL08Ic2qOmhXDYH4%2F5mzGYktMYvJ8VvT0%3D&reserved=0> (HELO
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hBXrfNwfWF22QzOQ9fPYMgIJohHtJNaP%2BWyAcZpZERo%3D&reserved=0>) (209.188.14.142)
> > by apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=FroeRI4fLrwSu4fNJ5lwV08j34VvOQQjS2%2Fdz3R%2BQcg%3D&reserved=0> (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=uYkwEvD5HDzhF6cu%2FG2Bnovz239qQkEUk%2FhHGOq%2Fsac%3D&reserved=0> (ASF Mail Server at
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0> (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=ou1eaFOWehZcTjW8106BRqzZm8fnYn2PktKA8V%2FAaXM%3D&reserved=0>
> > Received: from mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=neQN6Kp1Bg3DWgz%2B6YkO%2B0YurkIguz89DZmmTLpztsE%3D&reserved=0> ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=Ezcb%2FBF0YnCEVkKnnMFnrkZx8F5aSNU4on%2Fz%2Bsh0maw%3D&reserved=0> [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FGCC01-CY1-obe.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=xfC1m1seZuAjLiXRreE0leDMSuV5BqA1yxxxac9%2F%2Bsg%3D&reserved=0> (
> > mail-eopbgr830121.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail-eopbgr830121.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=%2FaYSdkXewX0ZxAtVU38g%2FtnheRA3l%2Bh7H%2FgWWSiTOZU%3D&reserved=0> [40.107.83.121])
> > by mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0> (ASF Mail Server at
> > mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0>) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=nC2xMrg6kd2D1u3wZyPlEX9rUuO3Ttbk661tGXUo%2Ba8%3D&reserved=0>; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=OjinMKuhsyQ8Vq%2BwAr8x9EQklilyVQrG0jmq%2BJf3KrM%3D&reserved=0>
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB2481.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=xU0d1A7p4U%2FE5Yio9fwnHLWqsg0ph7vxY9FzPEXK3l4%3D&reserved=0>
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>
> > Subject: RE: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Topic: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr<ma...@BL0PR0901MB3154.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > References: <15...@drill.apache.org>>
> > In-Reply-To: <15...@drill.apache.org>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr<ma...@BL0PR0901MB2481.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=ZTLf4FLAPV0Tm%2FzpabIRxfeu59t1joJ04Wg9v6MmGvg%3D&reserved=0>
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fprotection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=f1Wsjle%2Bi1pcGOCABlC0NPcYabXLiW9e46AW7nt%2B82M%3D&reserved=0>: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=tx8AikDGNvLpL9i3s6ygnvJ5z9OPF9dXYvn3JsfH2yU%3D&reserved=0> does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424851753&sdata=F1euZ7qrtQxBsL1XVSeg1kl5xhm%2BXZhx3TCYTt%2BYdQU%3D&reserved=0>
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
As you can see hive has the table in default database but drill cant find it
hive> select * from default.test;
OK
2 cooper
4 Peter
1 levi
3 JOHN
Time taken: 1.946 seconds, Fetched: 4 row(s)
hive> exit
>
> ;
[root@hadoop1 bin]#
[root@hadoop1 bin]#
[root@hadoop1 bin]#
[root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181
Apache Drill 1.16.0
"This isn't your grandfather's SQL."
apache drill> select * from hive.`default`.test;
>
Error: VALIDATION ERROR: From line 1, column 15 to line 1, column 18: Object 'test' not found within 'hive.default'
[Error Id: b4c73c9b-9460-4483-8010-a1bdaf97a4d0 ] (state=,code=0)
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 6:35 PM
To: user@drill.apache.org; Ahmad, Sami <Sa...@dot.state.fl.us>
Subject: Re: WELCOME to user@drill.apache.org
If you are using mySQL for hive metastore, your entries in Drill's hive storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A9083&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424731822&sdata=I46ULqkp5zD12nOKgkzKAVxc%2FlLYt4u46faSLO7lZbg%3D&reserved=0>",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://1.2.10.10:3306/hive?createDatabaseIfNotExist=true<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A3306%2Fhive%3FcreateDatabaseIfNotExist%3Dtrue&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=amlo2YnFi9gW4elCLwblGP4ePemYmusxjX1PZKeL7Do%3D&reserved=0>",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=FoLsiXTaLRhfm6pi7ZNmRJkm6LDziPRjMiFnkkw9hLg%3D&reserved=0>": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>> wrote:
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org<ma...@drill.apache.org>
Cc: user-help@drill.apache.org<ma...@drill.apache.org>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: RE: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=Zc0Zoo5bAv%2Fb23f76A3mUu3dpV8GCV8VGMkBZ%2BPN3Dc%3D&reserved=0>": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org<ma...@drill.apache.org> [mailto:user-help@drill.apache.org<ma...@drill.apache.org>]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>>
> > Subject: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org<ma...@drill.apache.org> mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org<ma...@drill.apache.org>.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org<ma...@drill.apache.org>!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain<ma...@host.domain>", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org<ma...@drill.apache.org>.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpnap-us-west-generic-nat.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hLpywAuoNN%2FL08Ic2qOmhXDYH4%2F5mzGYktMYvJ8VvT0%3D&reserved=0> (HELO
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hBXrfNwfWF22QzOQ9fPYMgIJohHtJNaP%2BWyAcZpZERo%3D&reserved=0>) (209.188.14.142)
> > by apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=FroeRI4fLrwSu4fNJ5lwV08j34VvOQQjS2%2Fdz3R%2BQcg%3D&reserved=0> (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=uYkwEvD5HDzhF6cu%2FG2Bnovz239qQkEUk%2FhHGOq%2Fsac%3D&reserved=0> (ASF Mail Server at
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0> (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=ou1eaFOWehZcTjW8106BRqzZm8fnYn2PktKA8V%2FAaXM%3D&reserved=0>
> > Received: from mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=neQN6Kp1Bg3DWgz%2B6YkO%2B0YurkIguz89DZmmTLpztsE%3D&reserved=0> ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=Ezcb%2FBF0YnCEVkKnnMFnrkZx8F5aSNU4on%2Fz%2Bsh0maw%3D&reserved=0> [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FGCC01-CY1-obe.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=xfC1m1seZuAjLiXRreE0leDMSuV5BqA1yxxxac9%2F%2Bsg%3D&reserved=0> (
> > mail-eopbgr830121.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail-eopbgr830121.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=%2FaYSdkXewX0ZxAtVU38g%2FtnheRA3l%2Bh7H%2FgWWSiTOZU%3D&reserved=0> [40.107.83.121])
> > by mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0> (ASF Mail Server at
> > mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0>) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=nC2xMrg6kd2D1u3wZyPlEX9rUuO3Ttbk661tGXUo%2Ba8%3D&reserved=0>; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=OjinMKuhsyQ8Vq%2BwAr8x9EQklilyVQrG0jmq%2BJf3KrM%3D&reserved=0>
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB2481.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=xU0d1A7p4U%2FE5Yio9fwnHLWqsg0ph7vxY9FzPEXK3l4%3D&reserved=0>
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>
> > Subject: RE: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Topic: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr<ma...@BL0PR0901MB3154.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > References: <15...@drill.apache.org>>
> > In-Reply-To: <15...@drill.apache.org>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr<ma...@BL0PR0901MB2481.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=ZTLf4FLAPV0Tm%2FzpabIRxfeu59t1joJ04Wg9v6MmGvg%3D&reserved=0>
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fprotection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=f1Wsjle%2Bi1pcGOCABlC0NPcYabXLiW9e46AW7nt%2B82M%3D&reserved=0>: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=tx8AikDGNvLpL9i3s6ygnvJ5z9OPF9dXYvn3JsfH2yU%3D&reserved=0> does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424851753&sdata=F1euZ7qrtQxBsL1XVSeg1kl5xhm%2BXZhx3TCYTt%2BYdQU%3D&reserved=0>
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
I have put this parameter to false since we are not using sasl
"hive.metastore.sasl.enabled": "false",
From: Ahmad, Sami
Sent: Wednesday, May 15, 2019 10:39 AM
To: Khurram Faraaz <kf...@mapr.com>; user@drill.apache.org
Subject: RE: WELCOME to user@drill.apache.org
Changed it as per your instructions but still no good
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://hadoop2:9083",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://hadoop2:3306/hive?createDatabaseIfNotExist=true",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "xxxxx",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
apache drill> use hive;
+------+----------------------------------+
| ok | summary |
+------+----------------------------------+
| true | Default schema changed to [hive] |
+------+----------------------------------+
1 row selected (0.099 seconds)
apache drill (hive)> show tables;
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
+--------------+------------+
No rows selected (0.593 seconds)
apache drill (hive)> use hive.`default`;
+------+------------------------------------------+
| ok | summary |
+------+------------------------------------------+
| true | Default schema changed to [hive.default] |
+------+------------------------------------------+
1 row selected (0.084 seconds)
apache drill (hive.default)> show tables;
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
+--------------+------------+
No rows selected (0.321 seconds)
apache drill (hive.default)>
The logfile reporting the same old error :
2019-05-15 10:36:03,735 [2323dc2c-055d-fd58-61fb-967cddc8e620:frag:0:0] WARN o.a.d.e.s.h.s.HiveDatabaseSchema - Exception was thrown while getting table names and type for db 'default'.
org.apache.thrift.TException: java.util.concurrent.ExecutionException: MetaException(message:Got exception: org.apache.thrift.TApplicationException Invalid method name: 'get_tables_by_type')
at org.apache.drill.exec.store.hive.client.HiveMetadataCache.getTableNamesAndTypes(HiveMetadataCache.java:116) ~[drill-storage-hive-core-1.16.0.jar:1.16.0]
at org.apache.drill.exec.store.hive.client.DrillHiveMetaStoreClient.getTableNamesAndTypes(DrillHiveMetaStoreClient.java:90) ~[drill-storage-hive-core-1.16.0.jar:1.16.0]
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 6:35 PM
To: user@drill.apache.org<ma...@drill.apache.org>; Ahmad, Sami <Sa...@dot.state.fl.us>>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
If you are using mySQL for hive metastore, your entries in Drill's hive storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A9083&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424731822&sdata=I46ULqkp5zD12nOKgkzKAVxc%2FlLYt4u46faSLO7lZbg%3D&reserved=0>",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://1.2.10.10:3306/hive?createDatabaseIfNotExist=true<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A3306%2Fhive%3FcreateDatabaseIfNotExist%3Dtrue&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=amlo2YnFi9gW4elCLwblGP4ePemYmusxjX1PZKeL7Do%3D&reserved=0>",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=FoLsiXTaLRhfm6pi7ZNmRJkm6LDziPRjMiFnkkw9hLg%3D&reserved=0>": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>> wrote:
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org<ma...@drill.apache.org>
Cc: user-help@drill.apache.org<ma...@drill.apache.org>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: RE: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=Zc0Zoo5bAv%2Fb23f76A3mUu3dpV8GCV8VGMkBZ%2BPN3Dc%3D&reserved=0>": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org<ma...@drill.apache.org> [mailto:user-help@drill.apache.org<ma...@drill.apache.org>]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>>
> > Subject: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org<ma...@drill.apache.org> mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org<ma...@drill.apache.org>.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org<ma...@drill.apache.org>!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain<ma...@host.domain>", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org<ma...@drill.apache.org>.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpnap-us-west-generic-nat.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hLpywAuoNN%2FL08Ic2qOmhXDYH4%2F5mzGYktMYvJ8VvT0%3D&reserved=0> (HELO
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hBXrfNwfWF22QzOQ9fPYMgIJohHtJNaP%2BWyAcZpZERo%3D&reserved=0>) (209.188.14.142)
> > by apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=FroeRI4fLrwSu4fNJ5lwV08j34VvOQQjS2%2Fdz3R%2BQcg%3D&reserved=0> (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=uYkwEvD5HDzhF6cu%2FG2Bnovz239qQkEUk%2FhHGOq%2Fsac%3D&reserved=0> (ASF Mail Server at
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0> (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=ou1eaFOWehZcTjW8106BRqzZm8fnYn2PktKA8V%2FAaXM%3D&reserved=0>
> > Received: from mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=neQN6Kp1Bg3DWgz%2B6YkO%2B0YurkIguz89DZmmTLpztsE%3D&reserved=0> ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=Ezcb%2FBF0YnCEVkKnnMFnrkZx8F5aSNU4on%2Fz%2Bsh0maw%3D&reserved=0> [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FGCC01-CY1-obe.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=xfC1m1seZuAjLiXRreE0leDMSuV5BqA1yxxxac9%2F%2Bsg%3D&reserved=0> (
> > mail-eopbgr830121.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail-eopbgr830121.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=%2FaYSdkXewX0ZxAtVU38g%2FtnheRA3l%2Bh7H%2FgWWSiTOZU%3D&reserved=0> [40.107.83.121])
> > by mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0> (ASF Mail Server at
> > mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0>) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=nC2xMrg6kd2D1u3wZyPlEX9rUuO3Ttbk661tGXUo%2Ba8%3D&reserved=0>; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=OjinMKuhsyQ8Vq%2BwAr8x9EQklilyVQrG0jmq%2BJf3KrM%3D&reserved=0>
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB2481.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=xU0d1A7p4U%2FE5Yio9fwnHLWqsg0ph7vxY9FzPEXK3l4%3D&reserved=0>
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>
> > Subject: RE: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Topic: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr<ma...@BL0PR0901MB3154.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > References: <15...@drill.apache.org>>
> > In-Reply-To: <15...@drill.apache.org>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr<ma...@BL0PR0901MB2481.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=ZTLf4FLAPV0Tm%2FzpabIRxfeu59t1joJ04Wg9v6MmGvg%3D&reserved=0>
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fprotection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=f1Wsjle%2Bi1pcGOCABlC0NPcYabXLiW9e46AW7nt%2B82M%3D&reserved=0>: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=tx8AikDGNvLpL9i3s6ygnvJ5z9OPF9dXYvn3JsfH2yU%3D&reserved=0> does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424851753&sdata=F1euZ7qrtQxBsL1XVSeg1kl5xhm%2BXZhx3TCYTt%2BYdQU%3D&reserved=0>
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
I am using apache drill 1.16 , its not letting me use this plugin .. I get an error
"Please retry: Error while creating / updating storage : null"
Why ?
Changed it as per your instructions but still no good
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://hadoop2:9083",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://hadoop2:3306/hive?createDatabaseIfNotExist=true",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "xxxxx",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
apache drill> use hive;
+------+----------------------------------+
| ok | summary |
+------+----------------------------------+
| true | Default schema changed to [hive] |
+------+----------------------------------+
1 row selected (0.099 seconds)
apache drill (hive)> show tables;
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
+--------------+------------+
No rows selected (0.593 seconds)
apache drill (hive)> use hive.`default`;
+------+------------------------------------------+
| ok | summary |
+------+------------------------------------------+
| true | Default schema changed to [hive.default] |
+------+------------------------------------------+
1 row selected (0.084 seconds)
apache drill (hive.default)> show tables;
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
+--------------+------------+
No rows selected (0.321 seconds)
apache drill (hive.default)>
The logfile reporting the same old error :
2019-05-15 10:36:03,735 [2323dc2c-055d-fd58-61fb-967cddc8e620:frag:0:0] WARN o.a.d.e.s.h.s.HiveDatabaseSchema - Exception was thrown while getting table names and type for db 'default'.
org.apache.thrift.TException: java.util.concurrent.ExecutionException: MetaException(message:Got exception: org.apache.thrift.TApplicationException Invalid method name: 'get_tables_by_type')
at org.apache.drill.exec.store.hive.client.HiveMetadataCache.getTableNamesAndTypes(HiveMetadataCache.java:116) ~[drill-storage-hive-core-1.16.0.jar:1.16.0]
at org.apache.drill.exec.store.hive.client.DrillHiveMetaStoreClient.getTableNamesAndTypes(DrillHiveMetaStoreClient.java:90) ~[drill-storage-hive-core-1.16.0.jar:1.16.0]
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 6:35 PM
To: user@drill.apache.org; Ahmad, Sami <Sa...@dot.state.fl.us>
Subject: Re: WELCOME to user@drill.apache.org
If you are using mySQL for hive metastore, your entries in Drill's hive storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A9083&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803095071&sdata=EcjrW1shZUd%2B1jynpwK5%2FCkhfQsJcBZzEtNF1AAE7Vk%3D&reserved=0>",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://1.2.10.10:3306/hive?createDatabaseIfNotExist=true<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A3306%2Fhive%3FcreateDatabaseIfNotExist%3Dtrue&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803095071&sdata=14rp9GerK1EDqFZNVcU5LCjw3v%2B%2BAE5TqbjUJmIBxow%3D&reserved=0>",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803095071&sdata=d5uf1%2B2iNK5yl8O2BhIdcoEFU%2BgM04A5Inpp5gAz6Bs%3D&reserved=0>": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>> wrote:
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org<ma...@drill.apache.org>
Cc: user-help@drill.apache.org<ma...@drill.apache.org>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami
> [mailto:Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: RE: WELCOME to
> user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803095071&sdata=d5uf1%2B2iNK5yl8O2BhIdcoEFU%2BgM04A5Inpp5gAz6Bs%3D&reserved=0>": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz
> [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: Re: WELCOME to
> user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org<ma...@drill.apache.org>
> > [mailto:user-help@drill.apache.org<mailto:user-help@drill.apache.org
> > >]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami
> > <Sa...@dot.state.fl.us>>
> > Subject: WELCOME to
> > user@drill.apache.org<ma...@drill.apache.org>
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org<ma...@drill.apache.org> mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org<ma...@drill.apache.org>.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org<ma...@drill.apache.org>!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> >
> > <user-subscribe@drill.apache.org<mailto:user-subscribe@drill.apache.
> > org>>
> >
> > To remove your address from the list, send a message to:
> >
> > <user-unsubscribe@drill.apache.org<mailto:user-unsubscribe@drill.apa
> > che.org>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>>
> >
> > <user-digest-unsubscribe@drill.apache.org<mailto:user-digest-unsubsc
> > ribe@drill.apache.org>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> >
> > <user-get.123_145@drill.apache.org<mailto:user-get.123_145@drill.apa
> > che.org>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> >
> > <user-index.123_456@drill.apache.org<mailto:user-index.123_456@drill
> > .apache.org>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> >
> > <user-thread.12345@drill.apache.org<mailto:user-thread.12345@drill.a
> > pache.org>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain<ma...@host.domain>", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <user-subscribe-john=host.domain@drill.apache.org<mailto:host.domain
> > @drill.apache.org>>
> >
> > To stop subscription for this address, mail:
> > <user-unsubscribe-john=host.domain@drill.apache.org<mailto:host.doma
> > in@drill.apache.org>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org<ma...@drill.apache.org>.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path:
> > <Sa...@dot.state.fl.us>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from
> > pnap-us-west-generic-nat.apache.org<https://gcc01.safelinks.protecti
> > on.outlook.com/?url=http%3A%2F%2Fpnap-us-west-generic-nat.apache.org
> > &data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749
> > c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C6369352
> > 79803095071&sdata=P%2BfB8lX5laOo%2BvekdVGJoy3rmeWC2HWvHh%2BaofNG
> > vUg%3D&reserved=0> (HELO
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdata=SjsgS84%2FUcbNaXf3TcnuI1mjxEy1pp6oKuV%2FFdXHL7s%3D&reserved=0>) (209.188.14.142)
> > by
> > apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%
> > 3A%2F%2Fapache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7
> > C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada
> > %7C0%7C0%7C636935279803105066&sdata=UaU8wGTQNSws6MpyUwPXKrE0N8Ll
> > ZSN0o56JnRFXQ%2Bk%3D&reserved=0> (qpsmtpd/0.29) with ESMTP; Tue,
> > 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook
> > .com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7C
> > Sami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb
> > 21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdat
> > a=SjsgS84%2FUcbNaXf3TcnuI1mjxEy1pp6oKuV%2FFdXHL7s%3D&reserved=0>
> > (ASF Mail Server at
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdata=SjsgS84%2FUcbNaXf3TcnuI1mjxEy1pp6oKuV%2FFdXHL7s%3D&reserved=0>) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<mailto:dot.state.fl.us@drill.apache
> > .org>>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook
> > .com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7C
> > Sami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb
> > 21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdat
> > a=SjsgS84%2FUcbNaXf3TcnuI1mjxEy1pp6oKuV%2FFdXHL7s%3D&reserved=0>
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdata=SjsgS84%2FUcbNaXf3TcnuI1mjxEy1pp6oKuV%2FFdXHL7s%3D&reserved=0> (amavisd-new);
> > dkim=pass (1024-bit key)
> > header.d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.
> > com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%
> > 40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c4
> > 20c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdata=Vkj9eenQf
> > 0X%2F64j6DXa7BxQHcC1mhUutK8GodlzoB5A%3D&reserved=0>
> > Received: from mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdata=Rt8C6s5M8pOZzyTpA4KHeQCzcLYLifFLzGP3MAM1l08%3D&reserved=0> ([10.40.0.8])
> > by localhost
> > (spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdata=SjsgS84%2FUcbNaXf3TcnuI1mjxEy1pp6oKuV%2FFdXHL7s%3D&reserved=0> [10.40.0.7]) (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from
> > GCC01-CY1-obe.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FGCC01-CY1-obe.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803105066&sdata=g5T4%2FEycJChpQUgz8egJRScxDJ%2FylxqOUDj9yJvcHxo%3D&reserved=0> ( mail-eopbgr830121.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail-eopbgr830121.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803115060&sdata=LIcCHdVkW9weyUjMgEzO9t9qT2zBnYbea8lCF%2FPpUuA%3D&reserved=0> [40.107.83.121])
> > by
> > mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/
> > ?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad
> > %40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c
> > 420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803115060&sdata=kKPF3WlU
> > bJVdgt3109z0iPIEwFoisQU555wcZsnITns%3D&reserved=0> (ASF Mail
> > Server at
> > mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803115060&sdata=kKPF3WlUbJVdgt3109z0iPIEwFoisQU555wcZsnITns%3D&reserved=0>) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<mailto:dot.state.fl.us@drill.apache
> > .org>>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?ur
> > l=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.s
> > tate.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f
> > 8f08f85b5ada%7C0%7C0%7C636935279803115060&sdata=zhIjk3jv8t0eZRTW
> > 9S9lC1OUYOzYH7F%2BwY4TtM5JwZs%3D&reserved=0>; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.pr
> > otection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod
> > .outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4
> > ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7
> > C0%7C636935279803115060&sdata=hnD3GqLqfCrN1bsWA4Epw4WE1lzE7Pu7MT
> > u7fu8DsVo%3D&reserved=0>
> > (20.177.243.145) by
> > BL0PR0901MB2481.namprd09.prod.outlook.com<https://gcc01.safelinks.pr
> > otection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB2481.namprd09.prod
> > .outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4
> > ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7
> > C0%7C636935279803115060&sdata=nLOUmzWxPFAPG1k7CLbmP4NtJZUhcasoY1
> > 8XJ77ZS5g%3D&reserved=0>
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.pr
> > otection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod
> > .outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4
> > ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7
> > C0%7C636935279803115060&sdata=hnD3GqLqfCrN1bsWA4Epw4WE1lzE7Pu7MT
> > u7fu8DsVo%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.pr
> > otection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod
> > .outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4
> > ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7
> > C0%7C636935279803115060&sdata=hnD3GqLqfCrN1bsWA4Epw4WE1lzE7Pu7MT
> > u7fu8DsVo%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami"
> > <Sa...@dot.state.fl.us>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<mailto:dot.state.fl.us@drill.apache
> > .org>>
> > Subject: RE: confirm subscribe to
> > user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Topic: confirm subscribe to
> > user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr
> > <mailto:BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.nam
> > prd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=htt
> > p%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.u
> > s%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5
> > ada%7C0%7C0%7C636935279803115060&sdata=n78CD8qHU5n1Ef0OqOsNhi03R
> > eD%2F%2F80flTYRaWi9CO0%3D&reserved=0>
> > >
> > References:
> > <1557845487.3588.ezmlm@drill.apache.org<mailto:1557845487.3588.ezmlm
> > @drill.apache.org>>
> > In-Reply-To:
> > <1557845487.3588.ezmlm@drill.apache.org<mailto:1557845487.3588.ezmlm
> > @drill.apache.org>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr
> > <mailto:BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.nam
> > prd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=htt
> > p%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.u
> > s%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5
> > ada%7C0%7C0%7C636935279803125056&sdata=Rnov8oBN66bjZOuH92e4eJ1CF
> > Nnqvt1pSOZqHlDm7Ag%3D&reserved=0>
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.pr
> > otection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod
> > .outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C542d4
> > ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7
> > C0%7C636935279803125056&sdata=cBgc1mmUHxotyq5QREOeBSHEroKYhj9ZrM
> > rv09PlRSc%3D&reserved=0>
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None
> > (protection.outlook.com<https://gcc01.safelinks.protection.outlook.c
> > om/?url=http%3A%2F%2Fprotection.outlook.com&data=02%7C01%7CSami.
> > Ahmad%40dot.state.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5
> > dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636935279803125056&sdata=Bsj
> > YCe60HkCki7Htj16rI3rbiO%2BuoJTkl5DnKht4pBo%3D&reserved=0>:
> > dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=
> > http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.sta
> > te.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f
> > 08f85b5ada%7C0%7C0%7C636935279803125056&sdata=99f7wnqUwz6qS0uISD
> > Pzw2yEO9bgAoC5xqWt908NT3w%3D&reserved=0> does not designate
> > permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg:
> > dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=
> > http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.sta
> > te.fl.us%7C542d4ca08a144a749c4b08d6d943290b%7Cdb21de5dbc9c420c8f3f8f
> > 08f85b5ada%7C0%7C0%7C636935279803125056&sdata=99f7wnqUwz6qS0uISD
> > Pzw2yEO9bgAoC5xqWt908NT3w%3D&reserved=0>
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
Changed it as per your instructions but still no good
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://hadoop2:9083",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://hadoop2:3306/hive?createDatabaseIfNotExist=true",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "xxxxx",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
apache drill> use hive;
+------+----------------------------------+
| ok | summary |
+------+----------------------------------+
| true | Default schema changed to [hive] |
+------+----------------------------------+
1 row selected (0.099 seconds)
apache drill (hive)> show tables;
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
+--------------+------------+
No rows selected (0.593 seconds)
apache drill (hive)> use hive.`default`;
+------+------------------------------------------+
| ok | summary |
+------+------------------------------------------+
| true | Default schema changed to [hive.default] |
+------+------------------------------------------+
1 row selected (0.084 seconds)
apache drill (hive.default)> show tables;
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
+--------------+------------+
No rows selected (0.321 seconds)
apache drill (hive.default)>
The logfile reporting the same old error :
2019-05-15 10:36:03,735 [2323dc2c-055d-fd58-61fb-967cddc8e620:frag:0:0] WARN o.a.d.e.s.h.s.HiveDatabaseSchema - Exception was thrown while getting table names and type for db 'default'.
org.apache.thrift.TException: java.util.concurrent.ExecutionException: MetaException(message:Got exception: org.apache.thrift.TApplicationException Invalid method name: 'get_tables_by_type')
at org.apache.drill.exec.store.hive.client.HiveMetadataCache.getTableNamesAndTypes(HiveMetadataCache.java:116) ~[drill-storage-hive-core-1.16.0.jar:1.16.0]
at org.apache.drill.exec.store.hive.client.DrillHiveMetaStoreClient.getTableNamesAndTypes(DrillHiveMetaStoreClient.java:90) ~[drill-storage-hive-core-1.16.0.jar:1.16.0]
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 6:35 PM
To: user@drill.apache.org; Ahmad, Sami <Sa...@dot.state.fl.us>
Subject: Re: WELCOME to user@drill.apache.org
If you are using mySQL for hive metastore, your entries in Drill's hive storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A9083&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424731822&sdata=I46ULqkp5zD12nOKgkzKAVxc%2FlLYt4u46faSLO7lZbg%3D&reserved=0>",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://1.2.10.10:3306/hive?createDatabaseIfNotExist=true<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A3306%2Fhive%3FcreateDatabaseIfNotExist%3Dtrue&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=amlo2YnFi9gW4elCLwblGP4ePemYmusxjX1PZKeL7Do%3D&reserved=0>",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=FoLsiXTaLRhfm6pi7ZNmRJkm6LDziPRjMiFnkkw9hLg%3D&reserved=0>": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>> wrote:
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org<ma...@drill.apache.org>
Cc: user-help@drill.apache.org<ma...@drill.apache.org>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: RE: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=Zc0Zoo5bAv%2Fb23f76A3mUu3dpV8GCV8VGMkBZ%2BPN3Dc%3D&reserved=0>": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org<ma...@drill.apache.org> [mailto:user-help@drill.apache.org<ma...@drill.apache.org>]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>>
> > Subject: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org<ma...@drill.apache.org> mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org<ma...@drill.apache.org>.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org<ma...@drill.apache.org>!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain<ma...@host.domain>", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org<ma...@drill.apache.org>.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpnap-us-west-generic-nat.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hLpywAuoNN%2FL08Ic2qOmhXDYH4%2F5mzGYktMYvJ8VvT0%3D&reserved=0> (HELO
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hBXrfNwfWF22QzOQ9fPYMgIJohHtJNaP%2BWyAcZpZERo%3D&reserved=0>) (209.188.14.142)
> > by apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=FroeRI4fLrwSu4fNJ5lwV08j34VvOQQjS2%2Fdz3R%2BQcg%3D&reserved=0> (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=uYkwEvD5HDzhF6cu%2FG2Bnovz239qQkEUk%2FhHGOq%2Fsac%3D&reserved=0> (ASF Mail Server at
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0> (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=ou1eaFOWehZcTjW8106BRqzZm8fnYn2PktKA8V%2FAaXM%3D&reserved=0>
> > Received: from mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=neQN6Kp1Bg3DWgz%2B6YkO%2B0YurkIguz89DZmmTLpztsE%3D&reserved=0> ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=Ezcb%2FBF0YnCEVkKnnMFnrkZx8F5aSNU4on%2Fz%2Bsh0maw%3D&reserved=0> [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FGCC01-CY1-obe.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=xfC1m1seZuAjLiXRreE0leDMSuV5BqA1yxxxac9%2F%2Bsg%3D&reserved=0> (
> > mail-eopbgr830121.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail-eopbgr830121.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=%2FaYSdkXewX0ZxAtVU38g%2FtnheRA3l%2Bh7H%2FgWWSiTOZU%3D&reserved=0> [40.107.83.121])
> > by mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0> (ASF Mail Server at
> > mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0>) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=nC2xMrg6kd2D1u3wZyPlEX9rUuO3Ttbk661tGXUo%2Ba8%3D&reserved=0>; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=OjinMKuhsyQ8Vq%2BwAr8x9EQklilyVQrG0jmq%2BJf3KrM%3D&reserved=0>
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB2481.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=xU0d1A7p4U%2FE5Yio9fwnHLWqsg0ph7vxY9FzPEXK3l4%3D&reserved=0>
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>
> > Subject: RE: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Topic: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr<ma...@BL0PR0901MB3154.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > References: <15...@drill.apache.org>>
> > In-Reply-To: <15...@drill.apache.org>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr<ma...@BL0PR0901MB2481.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=ZTLf4FLAPV0Tm%2FzpabIRxfeu59t1joJ04Wg9v6MmGvg%3D&reserved=0>
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fprotection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=f1Wsjle%2Bi1pcGOCABlC0NPcYabXLiW9e46AW7nt%2B82M%3D&reserved=0>: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=tx8AikDGNvLpL9i3s6ygnvJ5z9OPF9dXYvn3JsfH2yU%3D&reserved=0> does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424851753&sdata=F1euZ7qrtQxBsL1XVSeg1kl5xhm%2BXZhx3TCYTt%2BYdQU%3D&reserved=0>
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
Hi Khurram the hive plugin is working now . I used the following configuration
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://hadoop2:9083",
"hive.metastore.sasl.enabled": "false",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name": "hdfs:///"
},
"enabled": true
}
Thanks a lot for your help
Regards
Sami
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Thursday, May 23, 2019 6:01 PM
To: Ahmad, Sami <Sa...@dot.state.fl.us>; user@drill.apache.org
Subject: Re: WELCOME to user@drill.apache.org
The suggestion was to upgrade to Hive 2.x ( preferable Hive 2.3 ) and not Hive 3.0
You should try with drill 1.16.0 and Hive 2.3
Thanks,
Khurram
On Thu, May 23, 2019 at 2:26 PM Ahmad, Sami <Sa...@dot.state.fl.us>> wrote:
I upgraded my hive to hive3.0 and using apache drill 1.16 but now hive storage plugin is not liking the config file
It says “please rety: Error while creating/update storage: null
Please help
From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
Sent: Tuesday, May 14, 2019 6:35 PM
To: user@drill.apache.org<ma...@drill.apache.org>; Ahmad, Sami <Sa...@dot.state.fl.us>>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
If you are using mySQL for hive metastore, your entries in Drill's hive storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A9083&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772805364&sdata=3Dh77jKZ566rKsOZr0WQW4v2WOVAnYaeNWxcFRLImO0%3D&reserved=0>",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://1.2.10.10:3306/hive?createDatabaseIfNotExist=true<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A3306%2Fhive%3FcreateDatabaseIfNotExist%3Dtrue&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772815351&sdata=owv4eRnhoSOaS4ieiorqSJTP%2Fa3CxTx1%2ByN%2BiA1EWQE%3D&reserved=0>",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772815351&sdata=ZFK7f4wH4d40JBS4dXMwIRz1s%2FYaMsvkUgmbCL%2FHSKc%3D&reserved=0>": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>> wrote:
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org<ma...@drill.apache.org>
Cc: user-help@drill.apache.org<ma...@drill.apache.org>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: RE: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772825344&sdata=wX1smD2KJeNXgRefAFVHeDQhqAIrCtWB5aspW8iMjpg%3D&reserved=0>": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org<ma...@drill.apache.org> [mailto:user-help@drill.apache.org<ma...@drill.apache.org>]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>>
> > Subject: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org<ma...@drill.apache.org> mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org<ma...@drill.apache.org>.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org<ma...@drill.apache.org>!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain<ma...@host.domain>", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org<ma...@drill.apache.org>.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpnap-us-west-generic-nat.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772825344&sdata=Iv6DnZRllcZnfNKvICe%2FIgXbbqwgWVxkl3OYgurnmSI%3D&reserved=0> (HELO
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772835341&sdata=WFKEBQAFmQP3Mm3TZV7nagu7DKA%2FCRAO%2FHGARG%2Ftodk%3D&reserved=0>) (209.188.14.142)
> > by apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772835341&sdata=4FoLCv99URFBRzNy3zIasz00traRgZIBUyZCEJQ6xdo%3D&reserved=0> (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772845338&sdata=8vRaBtKqigLkUORhJE61Sjgi05OPe5a6q6cqgEijJG8%3D&reserved=0> (ASF Mail Server at
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772845338&sdata=8vRaBtKqigLkUORhJE61Sjgi05OPe5a6q6cqgEijJG8%3D&reserved=0>) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772855328&sdata=AdGSDQzl1ZDqpS%2FmkNc2E1UaVpFf5umBYTRuPsXiONY%3D&reserved=0>
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772855328&sdata=AdGSDQzl1ZDqpS%2FmkNc2E1UaVpFf5umBYTRuPsXiONY%3D&reserved=0> (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772865322&sdata=r7AHVH94VSTf0X7JiuwzbpDAklOvBUiwaVEk%2FkIE%2BoY%3D&reserved=0>
> > Received: from mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772865322&sdata=vD1WlmBvMyOLdKoDsH55oavUig4RF247SkJREnhuD20%3D&reserved=0> ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772875316&sdata=SV2mKELjaTESyGaokxVso35rV9S0DRHVlnWsSjnmGh0%3D&reserved=0> [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FGCC01-CY1-obe.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772875316&sdata=5Vqv8Z0eKpvVe8UXWZLIjkr8FXYGd%2B2JLnz%2FDBE9cvA%3D&reserved=0> (
> > mail-eopbgr830121.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail-eopbgr830121.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772885307&sdata=3lT3v33KbxRldIE0GLCGwaBX4vFqsVDLb7yoKirADSU%3D&reserved=0> [40.107.83.121])
> > by mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772885307&sdata=9GJsfXwstZdvnmbWB4Vas4FCDfnPGgxCjaIEpb0MMac%3D&reserved=0> (ASF Mail Server at
> > mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772895303&sdata=NxFSxcNvmFP11FXE7wqDCTLf0726jMy38CzlqmwdAwU%3D&reserved=0>) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772895303&sdata=yb4NZOxlC88gvWAc2vQXoCICOakM0haNx8jf%2BPCU4ic%3D&reserved=0>; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772905302&sdata=60yzvG4ApVOh11OAxjluzsXNdR0GXplsCpB0LRfTg20%3D&reserved=0>
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB2481.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772905302&sdata=t3s6%2BL9UjZFZhEbjRsKnGCY6iuSGh0S058bgxAaZEe0%3D&reserved=0>
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772915288&sdata=YDoN%2FH14NuoeLAMxPhO65UERIG9r426cLC4dG6CYjZQ%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772915288&sdata=YDoN%2FH14NuoeLAMxPhO65UERIG9r426cLC4dG6CYjZQ%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>
> > Subject: RE: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Topic: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr<ma...@BL0PR0901MB3154.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772925290&sdata=KkLpAzWKswJNjS5gw5x4b4N0HSX4SxUbnMAueblsFkY%3D&reserved=0>
> > >
> > References: <15...@drill.apache.org>>
> > In-Reply-To: <15...@drill.apache.org>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr<ma...@BL0PR0901MB2481.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772925290&sdata=KkLpAzWKswJNjS5gw5x4b4N0HSX4SxUbnMAueblsFkY%3D&reserved=0>
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772935284&sdata=y47x8KMoP3Q3RWd1%2FA9J58WxmenB67Rts5XDusidxko%3D&reserved=0>
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fprotection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772935284&sdata=CWUyBJYcg%2FAmFiu4%2BMCu%2FXk5iRd5VdJmCoptnGt6yWw%3D&reserved=0>: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772935284&sdata=6blO%2BICAtHPw3Z%2BC7JXQI22sKCtXBvY%2F73by5bfZGyU%3D&reserved=0> does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7Cdadaa91c78ce41c3f8c608d6dfca2cf8%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636942456772945277&sdata=8trF9gij%2BYfHghhQdw4NW4Gt9fJ7D2i952YpKU9M27w%3D&reserved=0>
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
Re: WELCOME to user@drill.apache.org
Posted by Khurram Faraaz <kf...@mapr.com>.
The suggestion was to upgrade to Hive 2.x ( preferable Hive 2.3 ) and not
Hive 3.0
You should try with drill 1.16.0 and Hive 2.3
Thanks,
Khurram
On Thu, May 23, 2019 at 2:26 PM Ahmad, Sami <Sa...@dot.state.fl.us>
wrote:
> I upgraded my hive to hive3.0 and using apache drill 1.16 but now hive
> storage plugin is not liking the config file
>
>
>
> It says “please rety: Error while creating/update storage: null
>
>
>
> Please help
>
>
>
> *From:* Khurram Faraaz [mailto:kfaraaz@mapr.com]
> *Sent:* Tuesday, May 14, 2019 6:35 PM
> *To:* user@drill.apache.org; Ahmad, Sami <Sa...@dot.state.fl.us>
> *Subject:* Re: WELCOME to user@drill.apache.org
>
>
>
> If you are using mySQL for hive metastore, your entries in Drill's hive
> storage plugin should like below
>
>
>
> {
>
> "type": "hive",
>
> "configProps": {
>
> "hive.metastore.uris": "thrift://1.2.10.10:9083
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A9083&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424731822&sdata=I46ULqkp5zD12nOKgkzKAVxc%2FlLYt4u46faSLO7lZbg%3D&reserved=0>
> ",
>
> "javax.jdo.option.ConnectionURL": "jdbc:mysql://
> 1.2.10.10:3306/hive?createDatabaseIfNotExist=true
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A3306%2Fhive%3FcreateDatabaseIfNotExist%3Dtrue&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=amlo2YnFi9gW4elCLwblGP4ePemYmusxjX1PZKeL7Do%3D&reserved=0>
> ",
>
> "javax.jdo.option.ConnectionUserName": "root",
>
> "javax.jdo.option.ConnectionPassword": "test",
>
> "hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
>
> "fs.default.name
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=FoLsiXTaLRhfm6pi7ZNmRJkm6LDziPRjMiFnkkw9hLg%3D&reserved=0>":
> "file:///",
>
> "hive.metastore.sasl.enabled": "true",
>
> "datanucleus.schema.autoCreateAll": "true"
>
> },
>
> "enabled": true
>
> }
>
>
>
> On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>
> wrote:
>
> I see bunch of hive jar files in the jars\3rdparty directory but they are
> different version than my hive jars .
> I tried copying the hive jars from my hive environment to this 3rdparty
> folder but it didn’t help also
>
> [root@hadoop1 3rdparty]# pwd
> /root/apache-drill-1.16.0/jars/3rdparty
>
> [root@hadoop1 3rdparty]# ls -ltr hive*
> -rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
> -rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
> -rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
>
>
> I copied the files below to the jars\3rdparty folder .
>
> -rw-r--r-- 1 root root 6345039 May 14 15:51
> hive-metastore-1.2.1000.2.6.5.0-292.jar
> -rw-r--r-- 1 root root 122581 May 14 15:52
> hive-contrib-1.2.1000.2.6.5.0-292.jar
> -rw-r--r-- 1 root root 120473 May 14 15:52
> hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
> [root@hadoop1 3rdparty]#
> [root@hadoop1 3rdparty]# pwd
> /root/apache-drill-1.16.0/jars/3rdparty
> You have mail in /var/spool/mail/root
> [root@hadoop1 3rdparty]#
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> Sent: Tuesday, May 14, 2019 3:10 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: Re: WELCOME to user@drill.apache.org
>
> Looking at you Hive storage plugin, there are two entries (see below) that
> are missing, can you please add them with appropriate values to Hive
> storage plugin and give it a try ?
>
> "javax.jdo.option.ConnectionURL":
> "jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
> "hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>
> wrote:
>
> > Same problem I have with hbase , it wont show the tables.
> > Hbase version is 1.1.2
> >
> > Here is the storage plugin for hbase I am using
> >
> > {
> > "type": "hbase",
> > "config": {
> > "hbase.zookeeper.quorum": "hadoop1",
> > "hbase.zookeeper.property.clientPort": "2181"
> > },
> > "size.calculator.enabled": false,
> > "enabled": true
> > }
> >
> > -----Original Message-----
> > From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us]
> > Sent: Tuesday, May 14, 2019 2:25 PM
> > To: user@drill.apache.org
> > Cc: user-help@drill.apache.org
> > Subject: RE: WELCOME to user@drill.apache.org
> >
> > Hi Khurram
> >
> > 1- yes the show tables command work from hive shell
> >
> > hive> show tables
> > > ;
> > OK
> > test
> > test_orc_richa1116
> > test_orc_txn
> > tweets
> > users2
> > xyz
> > Time taken: 1.385 s
> >
> >
> >
> > 2- hive version is 1.2.1
> >
> > 3- storage plugin in shown below
> >
> > {
> > "type": "hive",
> > "configProps": {
> > "hive.metastore.uris": "thrift://hadoop2:9083",
> > "hive.metastore.sasl.enabled": "false",
> > "fs.default.name
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=Zc0Zoo5bAv%2Fb23f76A3mUu3dpV8GCV8VGMkBZ%2BPN3Dc%3D&reserved=0>":
> "hdfs:///"
> > },
> > "enabled": true
> > }
> >
> >
> > Regards
> > Sami
> >
> > -----Original Message-----
> > From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> > Sent: Tuesday, May 14, 2019 2:18 PM
> > To: user@drill.apache.org
> > Cc: user-help@drill.apache.org
> > Subject: Re: WELCOME to user@drill.apache.org
> >
> > Hi Ahmad,
> >
> > Does the "show tables" command work for you from Hive shell ?
> > Can you please share you Hive version that is being used ?
> >
> > And share the content from your Hive storage plugin, which is
> > available on the storage tab on Drill web UI.
> >
> > Thanks,
> > Khurram
> >
> > On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> > <Sa...@dot.state.fl.us>
> > wrote:
> >
> > > I am not able to see any hive or hbase tables in drill , I get the
> > > schema fine , getting the error in the logfile shown below .
> > >
> > > Regards
> > >
> > >
> > >
> > > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > > to /root/apache-drill-1.16.0/log/drillbit.out
> > >
> > >
> > > [root@hadoop1 bin]#
> > > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > > Drill 1.16.0 "Say hello to my little Drill."
> > > apache drill> show schemas;
> > > +--------------------+
> > > | SCHEMA_NAME |
> > > +--------------------+
> > > | cp.default |
> > > | dfs.default |
> > > | dfs.root |
> > > | dfs.tmp |
> > > | hbase |
> > > | hive.aaronm |
> > > | hive.default |
> > > | hive.es_testdb |
> > > | hive.guest |
> > > | hive.ivann |
> > > | hive.levic |
> > > | hive.nasirq |
> > > | hive.nipar |
> > > | hive.rangertst |
> > > | hive.richas |
> > > | hive.roumig |
> > > | hive.sami |
> > > | hive.sandeeps |
> > > | hive.sasmitap |
> > > | hive.sid |
> > > | hive.swaroopa |
> > > | hive.tito |
> > > | hive.usha |
> > > | information_schema |
> > > | sys |
> > > +--------------------+
> > > 25 rows selected (1.869 seconds)
> > > apache drill> use hive;
> > > +------+----------------------------------+
> > > | ok | summary |
> > > +------+----------------------------------+
> > > | true | Default schema changed to [hive] |
> > > +------+----------------------------------+
> > > 1 row selected (0.103 seconds)
> > > apache drill (hive)> show tables; <<<< NOT
> SHOWING
> > > ANY HIVE TABLES.
> > > +--------------+------------+
> > > | TABLE_SCHEMA | TABLE_NAME |
> > > +--------------+------------+
> > > +--------------+------------+
> > > No rows selected (0.601 seconds)
> > > apache drill (hive)>
> > >
> > >
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > > java:617)
> > > [na:1.8.0_112]
> > > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > > Caused
> > > by: java.util.concurrent.ExecutionException:
> > > MetaException(message:Got exception:
> > > org.apache.thrift.TApplicationException Invalid method name:
> > > 'get_tables_by_type')
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > > ra
> > > ctFuture.getDoneValue(AbstractFuture.java:502)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > > ra
> > > ctFuture.get(AbstractFuture.java:461)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > > ra
> > > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > > te
> > > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > > me
> > > nt.getAndRecordStats(LocalCache.java:2453)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > > me
> > > nt.loadSync(LocalCache.java:2417)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at o
> > >
> > >
> > > -----Original Message-----
> > > From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> > > Sent: Tuesday, May 14, 2019 10:55 AM
> > > To: Ahmad, Sami <Sa...@dot.state.fl.us>
> > > Subject: WELCOME to user@drill.apache.org
> > >
> > > EXTERNAL SENDER: Use caution with links and attachments.
> > >
> > >
> > > Hi! This is the ezmlm program. I'm managing the
> > > user@drill.apache.org mailing list.
> > >
> > > I'm working for my owner, who can be reached at
> > > user-owner@drill.apache.org.
> > >
> > > Acknowledgment: I have added the address
> > >
> > > Sami.Ahmad@dot.state.fl.us
> > >
> > > to the user mailing list.
> > >
> > > Welcome to user@drill.apache.org!
> > >
> > > Please save this message so that you know the address you are
> > > subscribed under, in case you later want to unsubscribe or change
> > > your subscription address.
> > >
> > >
> > > --- Administrative commands for the user list ---
> > >
> > > I can handle administrative requests automatically. Please do not
> > > send them to the list address! Instead, send your message to the
> > > correct command
> > > address:
> > >
> > > To subscribe to the list, send a message to:
> > > <us...@drill.apache.org>
> > >
> > > To remove your address from the list, send a message to:
> > > <us...@drill.apache.org>
> > >
> > > Send mail to the following for info and FAQ for this list:
> > > <us...@drill.apache.org>
> > > <us...@drill.apache.org>
> > >
> > > Similar addresses exist for the digest list:
> > > <us...@drill.apache.org>
> > > <us...@drill.apache.org>
> > >
> > > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > > <us...@drill.apache.org>
> > >
> > > To get an index with subject and author for messages 123-456 , mail:
> > > <us...@drill.apache.org>
> > >
> > > They are always returned as sets of 100, max 2000 per request, so
> > > you'll actually get 100-499.
> > >
> > > To receive all messages with the same subject as message 12345, send
> > > a short message to:
> > > <us...@drill.apache.org>
> > >
> > > The messages should contain one line or word of text to avoid being
> > > treated as sp@m, but I will ignore their content.
> > > Only the ADDRESS you send to is important.
> > >
> > > You can start a subscription for an alternate address, for example
> > > "john@host.domain", just add a hyphen and your address (with '='
> > > instead of '@') after the command word:
> > > <us...@drill.apache.org>
> > >
> > > To stop subscription for this address, mail:
> > > <us...@drill.apache.org>
> > >
> > > In both cases, I'll send a confirmation message to that address.
> > > When you receive it, simply reply to it to complete your subscription.
> > >
> > > If despite following these instructions, you do not get the desired
> > > results, please contact my owner at user-owner@drill.apache.org.
> > > Please be patient, my owner is a lot slower than I am ;-)
> > >
> > > --- Enclosed is a copy of the request I received.
> > >
> > > Return-Path: <Sa...@dot.state.fl.us>
> > > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > > -0000
> > > Received: from pnap-us-west-generic-nat.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpnap-us-west-generic-nat.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hLpywAuoNN%2FL08Ic2qOmhXDYH4%2F5mzGYktMYvJ8VvT0%3D&reserved=0>
> (HELO
> > > spamd1-us-west.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hBXrfNwfWF22QzOQ9fPYMgIJohHtJNaP%2BWyAcZpZERo%3D&reserved=0>)
> (209.188.14.142)
> > > by apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=FroeRI4fLrwSu4fNJ5lwV08j34VvOQQjS2%2Fdz3R%2BQcg%3D&reserved=0>
> (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > > 14:55:15
> > > +0000
> > > Received: from localhost (localhost [127.0.0.1])
> > > by spamd1-us-west.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=uYkwEvD5HDzhF6cu%2FG2Bnovz239qQkEUk%2FhHGOq%2Fsac%3D&reserved=0>
> (ASF Mail Server at
> > > spamd1-us-west.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>)
> with ESMTP id 42BBFC5B46
> > > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000
> > > (UTC)
> > > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>
> > > X-Spam-Flag: NO
> > > X-Spam-Score: 0.549
> > > X-Spam-Level:
> > > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > > RCVD_IN_DNSWL_NONE=-0.0001,
> > > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > > autolearn=disabled
> > > Authentication-Results: spamd1-us-west.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>
> (amavisd-new);
> > > dkim=pass (1024-bit key) header.d=dot.state.fl.us
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=ou1eaFOWehZcTjW8106BRqzZm8fnYn2PktKA8V%2FAaXM%3D&reserved=0>
> > > Received: from mx1-lw-eu.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=neQN6Kp1Bg3DWgz%2B6YkO%2B0YurkIguz89DZmmTLpztsE%3D&reserved=0>
> ([10.40.0.8])
> > > by localhost (spamd1-us-west.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=Ezcb%2FBF0YnCEVkKnnMFnrkZx8F5aSNU4on%2Fz%2Bsh0maw%3D&reserved=0>
> [10.40.0.7])
> > > (amavisd-new, port 10024)
> > > with ESMTP id WIGqrOYFhOGS
> > > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org>;
> > > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > > Received: from GCC01-CY1-obe.outbound.protection.outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FGCC01-CY1-obe.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=xfC1m1seZuAjLiXRreE0leDMSuV5BqA1yxxxac9%2F%2Bsg%3D&reserved=0>
> (
> > > mail-eopbgr830121.outbound.protection.outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail-eopbgr830121.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=%2FaYSdkXewX0ZxAtVU38g%2FtnheRA3l%2Bh7H%2FgWWSiTOZU%3D&reserved=0>
> [40.107.83.121])
> > > by mx1-lw-eu.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0>
> (ASF Mail Server at
> > > mx1-lw-eu.apache.org
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0>)
> with ESMTPS id 385AA5FB42
> > > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000
> > > (UTC)
> > > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > > d=dot.state.fl.us
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=nC2xMrg6kd2D1u3wZyPlEX9rUuO3Ttbk661tGXUo%2Ba8%3D&reserved=0>;
> s=selector1;
> > > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> > >
> > >
> > > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > > ym
> > > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > > UP
> > > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=OjinMKuhsyQ8Vq%2BwAr8x9EQklilyVQrG0jmq%2BJf3KrM%3D&reserved=0>
> > > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB2481.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=xU0d1A7p4U%2FE5Yio9fwnHLWqsg0ph7vxY9FzPEXK3l4%3D&reserved=0>
> > > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > > Tue,
> > > 14 May 2019 14:55:03 +0000
> > > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > > ([fe80::f8d0:42f:dc63:9883]) by
> > > BL0PR0901MB3154.namprd09.prod.outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > > May
> > > 2019
> > > 14:55:03 +0000
> > > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
> > > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org"
> > > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org>
> > > Subject: RE: confirm subscribe to user@drill.apache.org
> > > Thread-Topic: confirm subscribe to user@drill.apache.org
> > > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > > Date: Tue, 14 May 2019 14:55:03 +0000
> > > Message-ID:
> > > <
> > > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr
> > > od
> > > .outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > > >
> > > References: <15...@drill.apache.org>
> > > In-Reply-To: <15...@drill.apache.org>
> > > Accept-Language: en-US
> > > Content-Language: en-US
> > > X-MS-Has-Attach:
> > > X-MS-TNEF-Correlator:
> > > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > > Sami.Ahmad@dot.state.fl.us;
> > > x-originating-ip: [156.75.180.190]
> > > x-ms-publictraffictype: Email
> > > x-ms-office365-filtering-correlation-id:
> > > 891d59b5-e680-490f-e77a-08d6d87c258a
> > > x-ms-office365-filtering-ht: Tenant
> > > x-microsoft-antispam:
> > >
> > >
> > > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > > 72
> > > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > > x-ms-exchange-purlcount: 1
> > > x-microsoft-antispam-prvs:
> > > <
> > > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr
> > > od
> > > .outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > > >
> > > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > > x-forefront-prvs: 0037FD6480
> > > x-forefront-antispam-report:
> > >
> > >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > > BL0PR0901MB3154.namprd09.prod.outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=ZTLf4FLAPV0Tm%2FzpabIRxfeu59t1joJ04Wg9v6MmGvg%3D&reserved=0>
> > > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > > received-spf: None (protection.outlook.com
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fprotection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=f1Wsjle%2Bi1pcGOCABlC0NPcYabXLiW9e46AW7nt%2B82M%3D&reserved=0>:
> dot.state.fl.us
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=tx8AikDGNvLpL9i3s6ygnvJ5z9OPF9dXYvn3JsfH2yU%3D&reserved=0>
> does not
> > > designate permitted sender hosts)
> > > x-ms-exchange-senderadcheck: 1
> > > x-microsoft-antispam-message-info:
> > >
> > >
> > > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > > Yd
> > > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > > j5
> > > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > > zf
> > > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > > 0s
> > > 56hSVh4=
> > > Content-Type: text/plain; charset="us-ascii"
> > > Content-Transfer-Encoding: quoted-printable
> > > MIME-Version: 1.0
> > > X-OriginatorOrg: dot.state.fl.us
> <https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424851753&sdata=F1euZ7qrtQxBsL1XVSeg1kl5xhm%2BXZhx3TCYTt%2BYdQU%3D&reserved=0>
> > > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > > 891d59b5-e680-490f-e77a-08d6d87c258a
> > > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > > 14:55:03.6058
> > > (UTC)
> > > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> > >
> > >
> >
>
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
I upgraded my hive to hive3.0 and using apache drill 1.16 but now hive storage plugin is not liking the config file
It says “please rety: Error while creating/update storage: null
Please help
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 6:35 PM
To: user@drill.apache.org; Ahmad, Sami <Sa...@dot.state.fl.us>
Subject: Re: WELCOME to user@drill.apache.org
If you are using mySQL for hive metastore, your entries in Drill's hive storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A9083&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424731822&sdata=I46ULqkp5zD12nOKgkzKAVxc%2FlLYt4u46faSLO7lZbg%3D&reserved=0>",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://1.2.10.10:3306/hive?createDatabaseIfNotExist=true<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2F1.2.10.10%3A3306%2Fhive%3FcreateDatabaseIfNotExist%3Dtrue&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=amlo2YnFi9gW4elCLwblGP4ePemYmusxjX1PZKeL7Do%3D&reserved=0>",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424741817&sdata=FoLsiXTaLRhfm6pi7ZNmRJkm6LDziPRjMiFnkkw9hLg%3D&reserved=0>": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>> wrote:
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org<ma...@drill.apache.org>
Cc: user-help@drill.apache.org<ma...@drill.apache.org>
Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: RE: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Ffs.default.name&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=Zc0Zoo5bAv%2Fb23f76A3mUu3dpV8GCV8VGMkBZ%2BPN3Dc%3D&reserved=0>": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com<ma...@mapr.com>]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org<ma...@drill.apache.org>
> Cc: user-help@drill.apache.org<ma...@drill.apache.org>
> Subject: Re: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org<ma...@drill.apache.org> [mailto:user-help@drill.apache.org<ma...@drill.apache.org>]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>>
> > Subject: WELCOME to user@drill.apache.org<ma...@drill.apache.org>
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org<ma...@drill.apache.org> mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org<ma...@drill.apache.org>.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org<ma...@drill.apache.org>!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>>
> > <us...@drill.apache.org>>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain<ma...@host.domain>", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org<ma...@drill.apache.org>.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fpnap-us-west-generic-nat.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hLpywAuoNN%2FL08Ic2qOmhXDYH4%2F5mzGYktMYvJ8VvT0%3D&reserved=0> (HELO
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424751811&sdata=hBXrfNwfWF22QzOQ9fPYMgIJohHtJNaP%2BWyAcZpZERo%3D&reserved=0>) (209.188.14.142)
> > by apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fapache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=FroeRI4fLrwSu4fNJ5lwV08j34VvOQQjS2%2Fdz3R%2BQcg%3D&reserved=0> (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424761806&sdata=uYkwEvD5HDzhF6cu%2FG2Bnovz239qQkEUk%2FhHGOq%2Fsac%3D&reserved=0> (ASF Mail Server at
> > spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0>
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424771799&sdata=%2Bx6tRHi1slNp0QePX7LoAxov9MIpNNncXMY%2B41vT1OM%3D&reserved=0> (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=ou1eaFOWehZcTjW8106BRqzZm8fnYn2PktKA8V%2FAaXM%3D&reserved=0>
> > Received: from mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424781794&sdata=neQN6Kp1Bg3DWgz%2B6YkO%2B0YurkIguz89DZmmTLpztsE%3D&reserved=0> ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fspamd1-us-west.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=Ezcb%2FBF0YnCEVkKnnMFnrkZx8F5aSNU4on%2Fz%2Bsh0maw%3D&reserved=0> [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FGCC01-CY1-obe.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=xfC1m1seZuAjLiXRreE0leDMSuV5BqA1yxxxac9%2F%2Bsg%3D&reserved=0> (
> > mail-eopbgr830121.outbound.protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmail-eopbgr830121.outbound.protection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424791789&sdata=%2FaYSdkXewX0ZxAtVU38g%2FtnheRA3l%2Bh7H%2FgWWSiTOZU%3D&reserved=0> [40.107.83.121])
> > by mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0> (ASF Mail Server at
> > mx1-lw-eu.apache.org<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fmx1-lw-eu.apache.org&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424801781&sdata=msXLb0e3HRrCq%2Frtd0kNFGnqX%2FMDhkMW2t9Hbg%2BQs4Y%3D&reserved=0>) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=nC2xMrg6kd2D1u3wZyPlEX9rUuO3Ttbk661tGXUo%2Ba8%3D&reserved=0>; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=OjinMKuhsyQ8Vq%2BwAr8x9EQklilyVQrG0jmq%2BJf3KrM%3D&reserved=0>
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB2481.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424811776&sdata=xU0d1A7p4U%2FE5Yio9fwnHLWqsg0ph7vxY9FzPEXK3l4%3D&reserved=0>
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424821768&sdata=MAcF5qQxx4z4zFzdEumQA8cN5fYaHwftB%2BN3vKSyPs8%3D&reserved=0>
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org<ma...@drill.apache.org>>
> > Subject: RE: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Topic: confirm subscribe to user@drill.apache.org<ma...@drill.apache.org>
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr<ma...@BL0PR0901MB3154.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > References: <15...@drill.apache.org>>
> > In-Reply-To: <15...@drill.apache.org>>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us<ma...@dot.state.fl.us>;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr<ma...@BL0PR0901MB2481.namprd09.pr>
> > od
> > .outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Foutlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=gKaNj0DZ2xAynd9wb8T706i3DYPJ%2FZ9Yf%2FaabWEHAa0%3D&reserved=0>
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2FBL0PR0901MB3154.namprd09.prod.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424831769&sdata=ZTLf4FLAPV0Tm%2FzpabIRxfeu59t1joJ04Wg9v6MmGvg%3D&reserved=0>
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fprotection.outlook.com&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=f1Wsjle%2Bi1pcGOCABlC0NPcYabXLiW9e46AW7nt%2B82M%3D&reserved=0>: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424841762&sdata=tx8AikDGNvLpL9i3s6ygnvJ5z9OPF9dXYvn3JsfH2yU%3D&reserved=0> does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us<https://gcc01.safelinks.protection.outlook.com/?url=http%3A%2F%2Fdot.state.fl.us&data=02%7C01%7CSami.Ahmad%40dot.state.fl.us%7C0ce58726dc0d4eaca16308d6d8bc7cd2%7Cdb21de5dbc9c420c8f3f8f08f85b5ada%7C0%7C0%7C636934701424851753&sdata=F1euZ7qrtQxBsL1XVSeg1kl5xhm%2BXZhx3TCYTt%2BYdQU%3D&reserved=0>
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
Re: WELCOME to user@drill.apache.org
Posted by Khurram Faraaz <kf...@mapr.com>.
If you are using mySQL for hive metastore, your entries in Drill's hive
storage plugin should like below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://1.2.10.10:9083",
"javax.jdo.option.ConnectionURL": "jdbc:mysql://
1.2.10.10:3306/hive?createDatabaseIfNotExist=true",
"javax.jdo.option.ConnectionUserName": "root",
"javax.jdo.option.ConnectionPassword": "test",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
"fs.default.name": "file:///",
"hive.metastore.sasl.enabled": "true",
"datanucleus.schema.autoCreateAll": "true"
},
"enabled": true
}
On Tue, May 14, 2019 at 1:53 PM Ahmad, Sami <Sa...@dot.state.fl.us>
wrote:
> I see bunch of hive jar files in the jars\3rdparty directory but they are
> different version than my hive jars .
> I tried copying the hive jars from my hive environment to this 3rdparty
> folder but it didn’t help also
>
> [root@hadoop1 3rdparty]# pwd
> /root/apache-drill-1.16.0/jars/3rdparty
>
> [root@hadoop1 3rdparty]# ls -ltr hive*
> -rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
> -rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
> -rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
>
>
> I copied the files below to the jars\3rdparty folder .
>
> -rw-r--r-- 1 root root 6345039 May 14 15:51
> hive-metastore-1.2.1000.2.6.5.0-292.jar
> -rw-r--r-- 1 root root 122581 May 14 15:52
> hive-contrib-1.2.1000.2.6.5.0-292.jar
> -rw-r--r-- 1 root root 120473 May 14 15:52
> hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
> [root@hadoop1 3rdparty]#
> [root@hadoop1 3rdparty]# pwd
> /root/apache-drill-1.16.0/jars/3rdparty
> You have mail in /var/spool/mail/root
> [root@hadoop1 3rdparty]#
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> Sent: Tuesday, May 14, 2019 3:10 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: Re: WELCOME to user@drill.apache.org
>
> Looking at you Hive storage plugin, there are two entries (see below) that
> are missing, can you please add them with appropriate values to Hive
> storage plugin and give it a try ?
>
> "javax.jdo.option.ConnectionURL":
> "jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
> "hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>
> wrote:
>
> > Same problem I have with hbase , it wont show the tables.
> > Hbase version is 1.1.2
> >
> > Here is the storage plugin for hbase I am using
> >
> > {
> > "type": "hbase",
> > "config": {
> > "hbase.zookeeper.quorum": "hadoop1",
> > "hbase.zookeeper.property.clientPort": "2181"
> > },
> > "size.calculator.enabled": false,
> > "enabled": true
> > }
> >
> > -----Original Message-----
> > From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us]
> > Sent: Tuesday, May 14, 2019 2:25 PM
> > To: user@drill.apache.org
> > Cc: user-help@drill.apache.org
> > Subject: RE: WELCOME to user@drill.apache.org
> >
> > Hi Khurram
> >
> > 1- yes the show tables command work from hive shell
> >
> > hive> show tables
> > > ;
> > OK
> > test
> > test_orc_richa1116
> > test_orc_txn
> > tweets
> > users2
> > xyz
> > Time taken: 1.385 s
> >
> >
> >
> > 2- hive version is 1.2.1
> >
> > 3- storage plugin in shown below
> >
> > {
> > "type": "hive",
> > "configProps": {
> > "hive.metastore.uris": "thrift://hadoop2:9083",
> > "hive.metastore.sasl.enabled": "false",
> > "fs.default.name": "hdfs:///"
> > },
> > "enabled": true
> > }
> >
> >
> > Regards
> > Sami
> >
> > -----Original Message-----
> > From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> > Sent: Tuesday, May 14, 2019 2:18 PM
> > To: user@drill.apache.org
> > Cc: user-help@drill.apache.org
> > Subject: Re: WELCOME to user@drill.apache.org
> >
> > Hi Ahmad,
> >
> > Does the "show tables" command work for you from Hive shell ?
> > Can you please share you Hive version that is being used ?
> >
> > And share the content from your Hive storage plugin, which is
> > available on the storage tab on Drill web UI.
> >
> > Thanks,
> > Khurram
> >
> > On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> > <Sa...@dot.state.fl.us>
> > wrote:
> >
> > > I am not able to see any hive or hbase tables in drill , I get the
> > > schema fine , getting the error in the logfile shown below .
> > >
> > > Regards
> > >
> > >
> > >
> > > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > > to /root/apache-drill-1.16.0/log/drillbit.out
> > >
> > >
> > > [root@hadoop1 bin]#
> > > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > > Drill 1.16.0 "Say hello to my little Drill."
> > > apache drill> show schemas;
> > > +--------------------+
> > > | SCHEMA_NAME |
> > > +--------------------+
> > > | cp.default |
> > > | dfs.default |
> > > | dfs.root |
> > > | dfs.tmp |
> > > | hbase |
> > > | hive.aaronm |
> > > | hive.default |
> > > | hive.es_testdb |
> > > | hive.guest |
> > > | hive.ivann |
> > > | hive.levic |
> > > | hive.nasirq |
> > > | hive.nipar |
> > > | hive.rangertst |
> > > | hive.richas |
> > > | hive.roumig |
> > > | hive.sami |
> > > | hive.sandeeps |
> > > | hive.sasmitap |
> > > | hive.sid |
> > > | hive.swaroopa |
> > > | hive.tito |
> > > | hive.usha |
> > > | information_schema |
> > > | sys |
> > > +--------------------+
> > > 25 rows selected (1.869 seconds)
> > > apache drill> use hive;
> > > +------+----------------------------------+
> > > | ok | summary |
> > > +------+----------------------------------+
> > > | true | Default schema changed to [hive] |
> > > +------+----------------------------------+
> > > 1 row selected (0.103 seconds)
> > > apache drill (hive)> show tables; <<<< NOT
> SHOWING
> > > ANY HIVE TABLES.
> > > +--------------+------------+
> > > | TABLE_SCHEMA | TABLE_NAME |
> > > +--------------+------------+
> > > +--------------+------------+
> > > No rows selected (0.601 seconds)
> > > apache drill (hive)>
> > >
> > >
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > > java:617)
> > > [na:1.8.0_112]
> > > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > > Caused
> > > by: java.util.concurrent.ExecutionException:
> > > MetaException(message:Got exception:
> > > org.apache.thrift.TApplicationException Invalid method name:
> > > 'get_tables_by_type')
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > > ra
> > > ctFuture.getDoneValue(AbstractFuture.java:502)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > > ra
> > > ctFuture.get(AbstractFuture.java:461)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > > ra
> > > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > > te
> > > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > > me
> > > nt.getAndRecordStats(LocalCache.java:2453)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at
> > > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > > me
> > > nt.loadSync(LocalCache.java:2417)
> > > ~[drill-shaded-guava-23.0.jar:23.0]
> > > at o
> > >
> > >
> > > -----Original Message-----
> > > From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> > > Sent: Tuesday, May 14, 2019 10:55 AM
> > > To: Ahmad, Sami <Sa...@dot.state.fl.us>
> > > Subject: WELCOME to user@drill.apache.org
> > >
> > > EXTERNAL SENDER: Use caution with links and attachments.
> > >
> > >
> > > Hi! This is the ezmlm program. I'm managing the
> > > user@drill.apache.org mailing list.
> > >
> > > I'm working for my owner, who can be reached at
> > > user-owner@drill.apache.org.
> > >
> > > Acknowledgment: I have added the address
> > >
> > > Sami.Ahmad@dot.state.fl.us
> > >
> > > to the user mailing list.
> > >
> > > Welcome to user@drill.apache.org!
> > >
> > > Please save this message so that you know the address you are
> > > subscribed under, in case you later want to unsubscribe or change
> > > your subscription address.
> > >
> > >
> > > --- Administrative commands for the user list ---
> > >
> > > I can handle administrative requests automatically. Please do not
> > > send them to the list address! Instead, send your message to the
> > > correct command
> > > address:
> > >
> > > To subscribe to the list, send a message to:
> > > <us...@drill.apache.org>
> > >
> > > To remove your address from the list, send a message to:
> > > <us...@drill.apache.org>
> > >
> > > Send mail to the following for info and FAQ for this list:
> > > <us...@drill.apache.org>
> > > <us...@drill.apache.org>
> > >
> > > Similar addresses exist for the digest list:
> > > <us...@drill.apache.org>
> > > <us...@drill.apache.org>
> > >
> > > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > > <us...@drill.apache.org>
> > >
> > > To get an index with subject and author for messages 123-456 , mail:
> > > <us...@drill.apache.org>
> > >
> > > They are always returned as sets of 100, max 2000 per request, so
> > > you'll actually get 100-499.
> > >
> > > To receive all messages with the same subject as message 12345, send
> > > a short message to:
> > > <us...@drill.apache.org>
> > >
> > > The messages should contain one line or word of text to avoid being
> > > treated as sp@m, but I will ignore their content.
> > > Only the ADDRESS you send to is important.
> > >
> > > You can start a subscription for an alternate address, for example
> > > "john@host.domain", just add a hyphen and your address (with '='
> > > instead of '@') after the command word:
> > > <us...@drill.apache.org>
> > >
> > > To stop subscription for this address, mail:
> > > <us...@drill.apache.org>
> > >
> > > In both cases, I'll send a confirmation message to that address.
> > > When you receive it, simply reply to it to complete your subscription.
> > >
> > > If despite following these instructions, you do not get the desired
> > > results, please contact my owner at user-owner@drill.apache.org.
> > > Please be patient, my owner is a lot slower than I am ;-)
> > >
> > > --- Enclosed is a copy of the request I received.
> > >
> > > Return-Path: <Sa...@dot.state.fl.us>
> > > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > > -0000
> > > Received: from pnap-us-west-generic-nat.apache.org (HELO
> > > spamd1-us-west.apache.org) (209.188.14.142)
> > > by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > > 14:55:15
> > > +0000
> > > Received: from localhost (localhost [127.0.0.1])
> > > by spamd1-us-west.apache.org (ASF Mail Server at
> > > spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> > > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000
> > > (UTC)
> > > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> > > X-Spam-Flag: NO
> > > X-Spam-Score: 0.549
> > > X-Spam-Level:
> > > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > > RCVD_IN_DNSWL_NONE=-0.0001,
> > > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > > autolearn=disabled
> > > Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> > > dkim=pass (1024-bit key) header.d=dot.state.fl.us
> > > Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> > > by localhost (spamd1-us-west.apache.org [10.40.0.7])
> > > (amavisd-new, port 10024)
> > > with ESMTP id WIGqrOYFhOGS
> > > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org>;
> > > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > > Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> > > mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> > > by mx1-lw-eu.apache.org (ASF Mail Server at
> > > mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
> > > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000
> > > (UTC)
> > > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > > d=dot.state.fl.us; s=selector1;
> > > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> > >
> > >
> > > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > > ym
> > > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > > UP
> > > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> > > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > > Tue,
> > > 14 May 2019 14:55:03 +0000
> > > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > > ([fe80::f8d0:42f:dc63:9883]) by
> > > BL0PR0901MB3154.namprd09.prod.outlook.com
> > > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > > May
> > > 2019
> > > 14:55:03 +0000
> > > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
> > > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org"
> > > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > > dot.state.fl.us@drill.apache.org>
> > > Subject: RE: confirm subscribe to user@drill.apache.org
> > > Thread-Topic: confirm subscribe to user@drill.apache.org
> > > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > > Date: Tue, 14 May 2019 14:55:03 +0000
> > > Message-ID:
> > > <
> > > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr
> > > od
> > > .outlook.com
> > > >
> > > References: <15...@drill.apache.org>
> > > In-Reply-To: <15...@drill.apache.org>
> > > Accept-Language: en-US
> > > Content-Language: en-US
> > > X-MS-Has-Attach:
> > > X-MS-TNEF-Correlator:
> > > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > > Sami.Ahmad@dot.state.fl.us;
> > > x-originating-ip: [156.75.180.190]
> > > x-ms-publictraffictype: Email
> > > x-ms-office365-filtering-correlation-id:
> > > 891d59b5-e680-490f-e77a-08d6d87c258a
> > > x-ms-office365-filtering-ht: Tenant
> > > x-microsoft-antispam:
> > >
> > >
> > > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > > 72
> > > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > > x-ms-exchange-purlcount: 1
> > > x-microsoft-antispam-prvs:
> > > <
> > > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr
> > > od
> > > .outlook.com
> > > >
> > > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > > x-forefront-prvs: 0037FD6480
> > > x-forefront-antispam-report:
> > >
> > >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > > BL0PR0901MB3154.namprd09.prod.outlook.com
> > > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > > received-spf: None (protection.outlook.com: dot.state.fl.us does not
> > > designate permitted sender hosts)
> > > x-ms-exchange-senderadcheck: 1
> > > x-microsoft-antispam-message-info:
> > >
> > >
> > > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > > Yd
> > > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > > j5
> > > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > > zf
> > > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > > 0s
> > > 56hSVh4=
> > > Content-Type: text/plain; charset="us-ascii"
> > > Content-Transfer-Encoding: quoted-printable
> > > MIME-Version: 1.0
> > > X-OriginatorOrg: dot.state.fl.us
> > > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > > 891d59b5-e680-490f-e77a-08d6d87c258a
> > > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > > 14:55:03.6058
> > > (UTC)
> > > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> > >
> > >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
I see bunch of hive jar files in the jars\3rdparty directory but they are different version than my hive jars .
I tried copying the hive jars from my hive environment to this 3rdparty folder but it didn’t help also
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
[root@hadoop1 3rdparty]# ls -ltr hive*
-rw-r--r-- 1 root root 112869 Apr 24 15:05 hive-hbase-handler-2.3.2.jar
-rw-r--r-- 1 root root 125727 Apr 24 15:05 hive-contrib-2.3.2.jar
-rw-r--r-- 1 root root 8119261 Apr 24 15:05 hive-metastore-2.3.2.jar
I copied the files below to the jars\3rdparty folder .
-rw-r--r-- 1 root root 6345039 May 14 15:51 hive-metastore-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 122581 May 14 15:52 hive-contrib-1.2.1000.2.6.5.0-292.jar
-rw-r--r-- 1 root root 120473 May 14 15:52 hive-hbase-handler-1.2.1000.2.6.5.0-292.jar
[root@hadoop1 3rdparty]#
[root@hadoop1 3rdparty]# pwd
/root/apache-drill-1.16.0/jars/3rdparty
You have mail in /var/spool/mail/root
[root@hadoop1 3rdparty]#
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 3:10 PM
To: user@drill.apache.org
Cc: user-help@drill.apache.org
Subject: Re: WELCOME to user@drill.apache.org
Looking at you Hive storage plugin, there are two entries (see below) that are missing, can you please add them with appropriate values to Hive storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: RE: WELCOME to user@drill.apache.org
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: Re: WELCOME to user@drill.apache.org
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is
> available on the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami
> <Sa...@dot.state.fl.us>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging
> > to /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> > Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abst
> > ra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Unin
> > te
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Seg
> > me
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>
> > Subject: WELCOME to user@drill.apache.org
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the
> > user@drill.apache.org mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change
> > your subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not
> > send them to the list address! Instead, send your message to the
> > correct command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>
> > <us...@drill.apache.org>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>
> > <us...@drill.apache.org>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send
> > a short message to:
> > <us...@drill.apache.org>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>
> >
> > In both cases, I'll send a confirmation message to that address.
> > When you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15
> > -0000
> > Received: from pnap-us-west-generic-nat.apache.org (HELO
> > spamd1-us-west.apache.org) (209.188.14.142)
> > by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019
> > 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org (ASF Mail Server at
> > spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us
> > Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> > mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> > by mx1-lw-eu.apache.org (ASF Mail Server at
> > mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchan
> > ge -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63O
> > ym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4
> > UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21;
> > Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>
> > Subject: RE: confirm subscribe to user@drill.apache.org
> > Thread-Topic: confirm subscribe to user@drill.apache.org
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.pr
> > od
> > .outlook.com
> > >
> > References: <15...@drill.apache.org>
> > In-Reply-To: <15...@drill.apache.org>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(462
> > 72
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605
> > 10 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.pr
> > od
> > .outlook.com
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com: dot.state.fl.us does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0
> > Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qi
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+Mh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNj
> > j5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEko
> > zf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc
> > 0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
Re: WELCOME to user@drill.apache.org
Posted by Khurram Faraaz <kf...@mapr.com>.
Looking at you Hive storage plugin, there are two entries (see below) that
are missing, can you please add them with appropriate values to Hive
storage plugin and give it a try ?
"javax.jdo.option.ConnectionURL":
"jdbc:derby:;databaseName=../sample-data/drill_hive_db;create=true",
"hive.metastore.warehouse.dir": "/tmp/drill_hive_wh",
Thanks,
Khurram
On Tue, May 14, 2019 at 11:31 AM Ahmad, Sami <Sa...@dot.state.fl.us>
wrote:
> Same problem I have with hbase , it wont show the tables.
> Hbase version is 1.1.2
>
> Here is the storage plugin for hbase I am using
>
> {
> "type": "hbase",
> "config": {
> "hbase.zookeeper.quorum": "hadoop1",
> "hbase.zookeeper.property.clientPort": "2181"
> },
> "size.calculator.enabled": false,
> "enabled": true
> }
>
> -----Original Message-----
> From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us]
> Sent: Tuesday, May 14, 2019 2:25 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: RE: WELCOME to user@drill.apache.org
>
> Hi Khurram
>
> 1- yes the show tables command work from hive shell
>
> hive> show tables
> > ;
> OK
> test
> test_orc_richa1116
> test_orc_txn
> tweets
> users2
> xyz
> Time taken: 1.385 s
>
>
>
> 2- hive version is 1.2.1
>
> 3- storage plugin in shown below
>
> {
> "type": "hive",
> "configProps": {
> "hive.metastore.uris": "thrift://hadoop2:9083",
> "hive.metastore.sasl.enabled": "false",
> "fs.default.name": "hdfs:///"
> },
> "enabled": true
> }
>
>
> Regards
> Sami
>
> -----Original Message-----
> From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
> Sent: Tuesday, May 14, 2019 2:18 PM
> To: user@drill.apache.org
> Cc: user-help@drill.apache.org
> Subject: Re: WELCOME to user@drill.apache.org
>
> Hi Ahmad,
>
> Does the "show tables" command work for you from Hive shell ?
> Can you please share you Hive version that is being used ?
>
> And share the content from your Hive storage plugin, which is available on
> the storage tab on Drill web UI.
>
> Thanks,
> Khurram
>
> On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami <Sa...@dot.state.fl.us>
> wrote:
>
> > I am not able to see any hive or hbase tables in drill , I get the
> > schema fine , getting the error in the logfile shown below .
> >
> > Regards
> >
> >
> >
> > [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging to
> > /root/apache-drill-1.16.0/log/drillbit.out
> >
> >
> > [root@hadoop1 bin]#
> > [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> > Drill 1.16.0 "Say hello to my little Drill."
> > apache drill> show schemas;
> > +--------------------+
> > | SCHEMA_NAME |
> > +--------------------+
> > | cp.default |
> > | dfs.default |
> > | dfs.root |
> > | dfs.tmp |
> > | hbase |
> > | hive.aaronm |
> > | hive.default |
> > | hive.es_testdb |
> > | hive.guest |
> > | hive.ivann |
> > | hive.levic |
> > | hive.nasirq |
> > | hive.nipar |
> > | hive.rangertst |
> > | hive.richas |
> > | hive.roumig |
> > | hive.sami |
> > | hive.sandeeps |
> > | hive.sasmitap |
> > | hive.sid |
> > | hive.swaroopa |
> > | hive.tito |
> > | hive.usha |
> > | information_schema |
> > | sys |
> > +--------------------+
> > 25 rows selected (1.869 seconds)
> > apache drill> use hive;
> > +------+----------------------------------+
> > | ok | summary |
> > +------+----------------------------------+
> > | true | Default schema changed to [hive] |
> > +------+----------------------------------+
> > 1 row selected (0.103 seconds)
> > apache drill (hive)> show tables; <<<< NOT SHOWING
> > ANY HIVE TABLES.
> > +--------------+------------+
> > | TABLE_SCHEMA | TABLE_NAME |
> > +--------------+------------+
> > +--------------+------------+
> > No rows selected (0.601 seconds)
> > apache drill (hive)>
> >
> >
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> > java:617)
> > [na:1.8.0_112]
> > at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112] Caused
> > by: java.util.concurrent.ExecutionException:
> > MetaException(message:Got exception:
> > org.apache.thrift.TApplicationException Invalid method name:
> > 'get_tables_by_type')
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> > ctFuture.getDoneValue(AbstractFuture.java:502)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> > ctFuture.get(AbstractFuture.java:461)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> > ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.util.concurrent.Uninte
> > rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segme
> > nt.getAndRecordStats(LocalCache.java:2453)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at
> > org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segme
> > nt.loadSync(LocalCache.java:2417)
> > ~[drill-shaded-guava-23.0.jar:23.0]
> > at o
> >
> >
> > -----Original Message-----
> > From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> > Sent: Tuesday, May 14, 2019 10:55 AM
> > To: Ahmad, Sami <Sa...@dot.state.fl.us>
> > Subject: WELCOME to user@drill.apache.org
> >
> > EXTERNAL SENDER: Use caution with links and attachments.
> >
> >
> > Hi! This is the ezmlm program. I'm managing the user@drill.apache.org
> > mailing list.
> >
> > I'm working for my owner, who can be reached at
> > user-owner@drill.apache.org.
> >
> > Acknowledgment: I have added the address
> >
> > Sami.Ahmad@dot.state.fl.us
> >
> > to the user mailing list.
> >
> > Welcome to user@drill.apache.org!
> >
> > Please save this message so that you know the address you are
> > subscribed under, in case you later want to unsubscribe or change your
> > subscription address.
> >
> >
> > --- Administrative commands for the user list ---
> >
> > I can handle administrative requests automatically. Please do not send
> > them to the list address! Instead, send your message to the correct
> > command
> > address:
> >
> > To subscribe to the list, send a message to:
> > <us...@drill.apache.org>
> >
> > To remove your address from the list, send a message to:
> > <us...@drill.apache.org>
> >
> > Send mail to the following for info and FAQ for this list:
> > <us...@drill.apache.org>
> > <us...@drill.apache.org>
> >
> > Similar addresses exist for the digest list:
> > <us...@drill.apache.org>
> > <us...@drill.apache.org>
> >
> > To get messages 123 through 145 (a maximum of 100 per request), mail:
> > <us...@drill.apache.org>
> >
> > To get an index with subject and author for messages 123-456 , mail:
> > <us...@drill.apache.org>
> >
> > They are always returned as sets of 100, max 2000 per request, so
> > you'll actually get 100-499.
> >
> > To receive all messages with the same subject as message 12345, send a
> > short message to:
> > <us...@drill.apache.org>
> >
> > The messages should contain one line or word of text to avoid being
> > treated as sp@m, but I will ignore their content.
> > Only the ADDRESS you send to is important.
> >
> > You can start a subscription for an alternate address, for example
> > "john@host.domain", just add a hyphen and your address (with '='
> > instead of '@') after the command word:
> > <us...@drill.apache.org>
> >
> > To stop subscription for this address, mail:
> > <us...@drill.apache.org>
> >
> > In both cases, I'll send a confirmation message to that address. When
> > you receive it, simply reply to it to complete your subscription.
> >
> > If despite following these instructions, you do not get the desired
> > results, please contact my owner at user-owner@drill.apache.org.
> > Please be patient, my owner is a lot slower than I am ;-)
> >
> > --- Enclosed is a copy of the request I received.
> >
> > Return-Path: <Sa...@dot.state.fl.us>
> > Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15 -0000
> > Received: from pnap-us-west-generic-nat.apache.org (HELO
> > spamd1-us-west.apache.org) (209.188.14.142)
> > by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019 14:55:15
> > +0000
> > Received: from localhost (localhost [127.0.0.1])
> > by spamd1-us-west.apache.org (ASF Mail Server at
> > spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000
> > (UTC)
> > X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> > X-Spam-Flag: NO
> > X-Spam-Score: 0.549
> > X-Spam-Level:
> > X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> > tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> > DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> > RCVD_IN_DNSWL_NONE=-0.0001,
> > SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> > autolearn=disabled
> > Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> > dkim=pass (1024-bit key) header.d=dot.state.fl.us
> > Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> > by localhost (spamd1-us-west.apache.org [10.40.0.7])
> > (amavisd-new, port 10024)
> > with ESMTP id WIGqrOYFhOGS
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>;
> > Tue, 14 May 2019 14:55:12 +0000 (UTC)
> > Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> > mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> > by mx1-lw-eu.apache.org (ASF Mail Server at
> > mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
> > for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000
> > (UTC)
> > DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> > d=dot.state.fl.us; s=selector1;
> > h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange
> > -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
> >
> >
> > b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63Oym
> > n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4UP
> > RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> > (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> > cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21; Tue,
> > 14 May 2019 14:55:03 +0000
> > Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883]) by
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> > May
> > 2019
> > 14:55:03 +0000
> > From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
> > To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org"
> > <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> > dot.state.fl.us@drill.apache.org>
> > Subject: RE: confirm subscribe to user@drill.apache.org
> > Thread-Topic: confirm subscribe to user@drill.apache.org
> > Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> > Date: Tue, 14 May 2019 14:55:03 +0000
> > Message-ID:
> > <
> > BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.prod
> > .outlook.com
> > >
> > References: <15...@drill.apache.org>
> > In-Reply-To: <15...@drill.apache.org>
> > Accept-Language: en-US
> > Content-Language: en-US
> > X-MS-Has-Attach:
> > X-MS-TNEF-Correlator:
> > authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> > Sami.Ahmad@dot.state.fl.us;
> > x-originating-ip: [156.75.180.190]
> > x-ms-publictraffictype: Email
> > x-ms-office365-filtering-correlation-id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > x-ms-office365-filtering-ht: Tenant
> > x-microsoft-antispam:
> >
> >
> > BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(46272
> > 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(460510
> > 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> > x-ms-traffictypediagnostic: BL0PR0901MB2481:
> > x-ms-exchange-purlcount: 1
> > x-microsoft-antispam-prvs:
> > <
> > BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.prod
> > .outlook.com
> > >
> > x-ms-oob-tlc-oobclassifiers: OLM:6108;
> > x-forefront-prvs: 0037FD6480
> > x-forefront-antispam-report:
> >
> >
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> > BL0PR0901MB3154.namprd09.prod.outlook.com
> > ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> > received-spf: None (protection.outlook.com: dot.state.fl.us does not
> > designate permitted sender hosts)
> > x-ms-exchange-senderadcheck: 1
> > x-microsoft-antispam-message-info:
> >
> >
> > k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> > o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0Yd
> > XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qiMh
> > Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNjj5
> > 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEkozf
> > 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc0s
> > 56hSVh4=
> > Content-Type: text/plain; charset="us-ascii"
> > Content-Transfer-Encoding: quoted-printable
> > MIME-Version: 1.0
> > X-OriginatorOrg: dot.state.fl.us
> > X-MS-Exchange-CrossTenant-Network-Message-Id:
> > 891d59b5-e680-490f-e77a-08d6d87c258a
> > X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> > 14:55:03.6058
> > (UTC)
> > X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> > X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> > X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> > X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
> >
> >
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
Same problem I have with hbase , it wont show the tables.
Hbase version is 1.1.2
Here is the storage plugin for hbase I am using
{
"type": "hbase",
"config": {
"hbase.zookeeper.quorum": "hadoop1",
"hbase.zookeeper.property.clientPort": "2181"
},
"size.calculator.enabled": false,
"enabled": true
}
-----Original Message-----
From: Ahmad, Sami [mailto:Sami.Ahmad@dot.state.fl.us]
Sent: Tuesday, May 14, 2019 2:25 PM
To: user@drill.apache.org
Cc: user-help@drill.apache.org
Subject: RE: WELCOME to user@drill.apache.org
Hi Khurram
1- yes the show tables command work from hive shell
hive> show tables
> ;
OK
test
test_orc_richa1116
test_orc_txn
tweets
users2
xyz
Time taken: 1.385 s
2- hive version is 1.2.1
3- storage plugin in shown below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://hadoop2:9083",
"hive.metastore.sasl.enabled": "false",
"fs.default.name": "hdfs:///"
},
"enabled": true
}
Regards
Sami
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 2:18 PM
To: user@drill.apache.org
Cc: user-help@drill.apache.org
Subject: Re: WELCOME to user@drill.apache.org
Hi Ahmad,
Does the "show tables" command work for you from Hive shell ?
Can you please share you Hive version that is being used ?
And share the content from your Hive storage plugin, which is available on the storage tab on Drill web UI.
Thanks,
Khurram
On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami <Sa...@dot.state.fl.us>
wrote:
> I am not able to see any hive or hbase tables in drill , I get the
> schema fine , getting the error in the logfile shown below .
>
> Regards
>
>
>
> [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging to
> /root/apache-drill-1.16.0/log/drillbit.out
>
>
> [root@hadoop1 bin]#
> [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> Drill 1.16.0 "Say hello to my little Drill."
> apache drill> show schemas;
> +--------------------+
> | SCHEMA_NAME |
> +--------------------+
> | cp.default |
> | dfs.default |
> | dfs.root |
> | dfs.tmp |
> | hbase |
> | hive.aaronm |
> | hive.default |
> | hive.es_testdb |
> | hive.guest |
> | hive.ivann |
> | hive.levic |
> | hive.nasirq |
> | hive.nipar |
> | hive.rangertst |
> | hive.richas |
> | hive.roumig |
> | hive.sami |
> | hive.sandeeps |
> | hive.sasmitap |
> | hive.sid |
> | hive.swaroopa |
> | hive.tito |
> | hive.usha |
> | information_schema |
> | sys |
> +--------------------+
> 25 rows selected (1.869 seconds)
> apache drill> use hive;
> +------+----------------------------------+
> | ok | summary |
> +------+----------------------------------+
> | true | Default schema changed to [hive] |
> +------+----------------------------------+
> 1 row selected (0.103 seconds)
> apache drill (hive)> show tables; <<<< NOT SHOWING
> ANY HIVE TABLES.
> +--------------+------------+
> | TABLE_SCHEMA | TABLE_NAME |
> +--------------+------------+
> +--------------+------------+
> No rows selected (0.601 seconds)
> apache drill (hive)>
>
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:617)
> [na:1.8.0_112]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112] Caused
> by: java.util.concurrent.ExecutionException:
> MetaException(message:Got exception:
> org.apache.thrift.TApplicationException Invalid method name:
> 'get_tables_by_type')
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> ctFuture.getDoneValue(AbstractFuture.java:502)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> ctFuture.get(AbstractFuture.java:461)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Uninte
> rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segme
> nt.getAndRecordStats(LocalCache.java:2453)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segme
> nt.loadSync(LocalCache.java:2417)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at o
>
>
> -----Original Message-----
> From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> Sent: Tuesday, May 14, 2019 10:55 AM
> To: Ahmad, Sami <Sa...@dot.state.fl.us>
> Subject: WELCOME to user@drill.apache.org
>
> EXTERNAL SENDER: Use caution with links and attachments.
>
>
> Hi! This is the ezmlm program. I'm managing the user@drill.apache.org
> mailing list.
>
> I'm working for my owner, who can be reached at
> user-owner@drill.apache.org.
>
> Acknowledgment: I have added the address
>
> Sami.Ahmad@dot.state.fl.us
>
> to the user mailing list.
>
> Welcome to user@drill.apache.org!
>
> Please save this message so that you know the address you are
> subscribed under, in case you later want to unsubscribe or change your
> subscription address.
>
>
> --- Administrative commands for the user list ---
>
> I can handle administrative requests automatically. Please do not send
> them to the list address! Instead, send your message to the correct
> command
> address:
>
> To subscribe to the list, send a message to:
> <us...@drill.apache.org>
>
> To remove your address from the list, send a message to:
> <us...@drill.apache.org>
>
> Send mail to the following for info and FAQ for this list:
> <us...@drill.apache.org>
> <us...@drill.apache.org>
>
> Similar addresses exist for the digest list:
> <us...@drill.apache.org>
> <us...@drill.apache.org>
>
> To get messages 123 through 145 (a maximum of 100 per request), mail:
> <us...@drill.apache.org>
>
> To get an index with subject and author for messages 123-456 , mail:
> <us...@drill.apache.org>
>
> They are always returned as sets of 100, max 2000 per request, so
> you'll actually get 100-499.
>
> To receive all messages with the same subject as message 12345, send a
> short message to:
> <us...@drill.apache.org>
>
> The messages should contain one line or word of text to avoid being
> treated as sp@m, but I will ignore their content.
> Only the ADDRESS you send to is important.
>
> You can start a subscription for an alternate address, for example
> "john@host.domain", just add a hyphen and your address (with '='
> instead of '@') after the command word:
> <us...@drill.apache.org>
>
> To stop subscription for this address, mail:
> <us...@drill.apache.org>
>
> In both cases, I'll send a confirmation message to that address. When
> you receive it, simply reply to it to complete your subscription.
>
> If despite following these instructions, you do not get the desired
> results, please contact my owner at user-owner@drill.apache.org.
> Please be patient, my owner is a lot slower than I am ;-)
>
> --- Enclosed is a copy of the request I received.
>
> Return-Path: <Sa...@dot.state.fl.us>
> Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15 -0000
> Received: from pnap-us-west-generic-nat.apache.org (HELO
> spamd1-us-west.apache.org) (209.188.14.142)
> by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019 14:55:15
> +0000
> Received: from localhost (localhost [127.0.0.1])
> by spamd1-us-west.apache.org (ASF Mail Server at
> spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000
> (UTC)
> X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> X-Spam-Flag: NO
> X-Spam-Score: 0.549
> X-Spam-Level:
> X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> RCVD_IN_DNSWL_NONE=-0.0001,
> SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> autolearn=disabled
> Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> dkim=pass (1024-bit key) header.d=dot.state.fl.us
> Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> by localhost (spamd1-us-west.apache.org [10.40.0.7])
> (amavisd-new, port 10024)
> with ESMTP id WIGqrOYFhOGS
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>;
> Tue, 14 May 2019 14:55:12 +0000 (UTC)
> Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> by mx1-lw-eu.apache.org (ASF Mail Server at
> mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000
> (UTC)
> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> d=dot.state.fl.us; s=selector1;
> h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange
> -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
>
>
> b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63Oym
> n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4UP
> RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21; Tue,
> 14 May 2019 14:55:03 +0000
> Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> ([fe80::f8d0:42f:dc63:9883]) by
> BL0PR0901MB3154.namprd09.prod.outlook.com
> ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> May
> 2019
> 14:55:03 +0000
> From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
> To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org"
> <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>
> Subject: RE: confirm subscribe to user@drill.apache.org
> Thread-Topic: confirm subscribe to user@drill.apache.org
> Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> Date: Tue, 14 May 2019 14:55:03 +0000
> Message-ID:
> <
> BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.prod
> .outlook.com
> >
> References: <15...@drill.apache.org>
> In-Reply-To: <15...@drill.apache.org>
> Accept-Language: en-US
> Content-Language: en-US
> X-MS-Has-Attach:
> X-MS-TNEF-Correlator:
> authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> Sami.Ahmad@dot.state.fl.us;
> x-originating-ip: [156.75.180.190]
> x-ms-publictraffictype: Email
> x-ms-office365-filtering-correlation-id:
> 891d59b5-e680-490f-e77a-08d6d87c258a
> x-ms-office365-filtering-ht: Tenant
> x-microsoft-antispam:
>
>
> BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(46272
> 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(460510
> 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> x-ms-traffictypediagnostic: BL0PR0901MB2481:
> x-ms-exchange-purlcount: 1
> x-microsoft-antispam-prvs:
> <
> BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.prod
> .outlook.com
> >
> x-ms-oob-tlc-oobclassifiers: OLM:6108;
> x-forefront-prvs: 0037FD6480
> x-forefront-antispam-report:
>
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> BL0PR0901MB3154.namprd09.prod.outlook.com
> ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> received-spf: None (protection.outlook.com: dot.state.fl.us does not
> designate permitted sender hosts)
> x-ms-exchange-senderadcheck: 1
> x-microsoft-antispam-message-info:
>
>
> k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0Yd
> XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qiMh
> Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNjj5
> 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEkozf
> 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc0s
> 56hSVh4=
> Content-Type: text/plain; charset="us-ascii"
> Content-Transfer-Encoding: quoted-printable
> MIME-Version: 1.0
> X-OriginatorOrg: dot.state.fl.us
> X-MS-Exchange-CrossTenant-Network-Message-Id:
> 891d59b5-e680-490f-e77a-08d6d87c258a
> X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> 14:55:03.6058
> (UTC)
> X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
>
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
Hi Khurram
1- yes the show tables command work from hive shell
hive> show tables
> ;
OK
test
test_orc_richa1116
test_orc_txn
tweets
users2
xyz
Time taken: 1.385 s
2- hive version is 1.2.1
3- storage plugin in shown below
{
"type": "hive",
"configProps": {
"hive.metastore.uris": "thrift://hadoop2:9083",
"hive.metastore.sasl.enabled": "false",
"fs.default.name": "hdfs:///"
},
"enabled": true
}
Regards
Sami
-----Original Message-----
From: Khurram Faraaz [mailto:kfaraaz@mapr.com]
Sent: Tuesday, May 14, 2019 2:18 PM
To: user@drill.apache.org
Cc: user-help@drill.apache.org
Subject: Re: WELCOME to user@drill.apache.org
Hi Ahmad,
Does the "show tables" command work for you from Hive shell ?
Can you please share you Hive version that is being used ?
And share the content from your Hive storage plugin, which is available on the storage tab on Drill web UI.
Thanks,
Khurram
On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami <Sa...@dot.state.fl.us>
wrote:
> I am not able to see any hive or hbase tables in drill , I get the
> schema fine , getting the error in the logfile shown below .
>
> Regards
>
>
>
> [root@hadoop1 bin]# ./drillbit.sh start Starting drillbit, logging to
> /root/apache-drill-1.16.0/log/drillbit.out
>
>
> [root@hadoop1 bin]#
> [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache
> Drill 1.16.0 "Say hello to my little Drill."
> apache drill> show schemas;
> +--------------------+
> | SCHEMA_NAME |
> +--------------------+
> | cp.default |
> | dfs.default |
> | dfs.root |
> | dfs.tmp |
> | hbase |
> | hive.aaronm |
> | hive.default |
> | hive.es_testdb |
> | hive.guest |
> | hive.ivann |
> | hive.levic |
> | hive.nasirq |
> | hive.nipar |
> | hive.rangertst |
> | hive.richas |
> | hive.roumig |
> | hive.sami |
> | hive.sandeeps |
> | hive.sasmitap |
> | hive.sid |
> | hive.swaroopa |
> | hive.tito |
> | hive.usha |
> | information_schema |
> | sys |
> +--------------------+
> 25 rows selected (1.869 seconds)
> apache drill> use hive;
> +------+----------------------------------+
> | ok | summary |
> +------+----------------------------------+
> | true | Default schema changed to [hive] |
> +------+----------------------------------+
> 1 row selected (0.103 seconds)
> apache drill (hive)> show tables; <<<< NOT SHOWING
> ANY HIVE TABLES.
> +--------------+------------+
> | TABLE_SCHEMA | TABLE_NAME |
> +--------------+------------+
> +--------------+------------+
> No rows selected (0.601 seconds)
> apache drill (hive)>
>
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.
> java:617)
> [na:1.8.0_112]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112] Caused
> by: java.util.concurrent.ExecutionException:
> MetaException(message:Got exception:
> org.apache.thrift.TApplicationException Invalid method name:
> 'get_tables_by_type')
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> ctFuture.getDoneValue(AbstractFuture.java:502)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> ctFuture.get(AbstractFuture.java:461)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Abstra
> ctFuture$TrustedFuture.get(AbstractFuture.java:83)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Uninte
> rruptibles.getUninterruptibly(Uninterruptibles.java:142)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segme
> nt.getAndRecordStats(LocalCache.java:2453)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segme
> nt.loadSync(LocalCache.java:2417)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at o
>
>
> -----Original Message-----
> From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> Sent: Tuesday, May 14, 2019 10:55 AM
> To: Ahmad, Sami <Sa...@dot.state.fl.us>
> Subject: WELCOME to user@drill.apache.org
>
> EXTERNAL SENDER: Use caution with links and attachments.
>
>
> Hi! This is the ezmlm program. I'm managing the user@drill.apache.org
> mailing list.
>
> I'm working for my owner, who can be reached at
> user-owner@drill.apache.org.
>
> Acknowledgment: I have added the address
>
> Sami.Ahmad@dot.state.fl.us
>
> to the user mailing list.
>
> Welcome to user@drill.apache.org!
>
> Please save this message so that you know the address you are
> subscribed under, in case you later want to unsubscribe or change your
> subscription address.
>
>
> --- Administrative commands for the user list ---
>
> I can handle administrative requests automatically. Please do not send
> them to the list address! Instead, send your message to the correct
> command
> address:
>
> To subscribe to the list, send a message to:
> <us...@drill.apache.org>
>
> To remove your address from the list, send a message to:
> <us...@drill.apache.org>
>
> Send mail to the following for info and FAQ for this list:
> <us...@drill.apache.org>
> <us...@drill.apache.org>
>
> Similar addresses exist for the digest list:
> <us...@drill.apache.org>
> <us...@drill.apache.org>
>
> To get messages 123 through 145 (a maximum of 100 per request), mail:
> <us...@drill.apache.org>
>
> To get an index with subject and author for messages 123-456 , mail:
> <us...@drill.apache.org>
>
> They are always returned as sets of 100, max 2000 per request, so
> you'll actually get 100-499.
>
> To receive all messages with the same subject as message 12345, send a
> short message to:
> <us...@drill.apache.org>
>
> The messages should contain one line or word of text to avoid being
> treated as sp@m, but I will ignore their content.
> Only the ADDRESS you send to is important.
>
> You can start a subscription for an alternate address, for example
> "john@host.domain", just add a hyphen and your address (with '='
> instead of '@') after the command word:
> <us...@drill.apache.org>
>
> To stop subscription for this address, mail:
> <us...@drill.apache.org>
>
> In both cases, I'll send a confirmation message to that address. When
> you receive it, simply reply to it to complete your subscription.
>
> If despite following these instructions, you do not get the desired
> results, please contact my owner at user-owner@drill.apache.org.
> Please be patient, my owner is a lot slower than I am ;-)
>
> --- Enclosed is a copy of the request I received.
>
> Return-Path: <Sa...@dot.state.fl.us>
> Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15 -0000
> Received: from pnap-us-west-generic-nat.apache.org (HELO
> spamd1-us-west.apache.org) (209.188.14.142)
> by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019 14:55:15
> +0000
> Received: from localhost (localhost [127.0.0.1])
> by spamd1-us-west.apache.org (ASF Mail Server at
> spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000
> (UTC)
> X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> X-Spam-Flag: NO
> X-Spam-Score: 0.549
> X-Spam-Level:
> X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> RCVD_IN_DNSWL_NONE=-0.0001,
> SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> autolearn=disabled
> Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> dkim=pass (1024-bit key) header.d=dot.state.fl.us
> Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> by localhost (spamd1-us-west.apache.org [10.40.0.7])
> (amavisd-new, port 10024)
> with ESMTP id WIGqrOYFhOGS
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>;
> Tue, 14 May 2019 14:55:12 +0000 (UTC)
> Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> by mx1-lw-eu.apache.org (ASF Mail Server at
> mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000
> (UTC)
> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
> d=dot.state.fl.us; s=selector1;
> h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange
> -SenderADCheck; bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
>
>
> b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63Oym
> n5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4UP
> RSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com
> (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2,
> cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21; Tue,
> 14 May 2019 14:55:03 +0000
> Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> ([fe80::f8d0:42f:dc63:9883]) by
> BL0PR0901MB3154.namprd09.prod.outlook.com
> ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14
> May
> 2019
> 14:55:03 +0000
> From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
> To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org"
> <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>
> Subject: RE: confirm subscribe to user@drill.apache.org
> Thread-Topic: confirm subscribe to user@drill.apache.org
> Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> Date: Tue, 14 May 2019 14:55:03 +0000
> Message-ID:
> <
> BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.prod
> .outlook.com
> >
> References: <15...@drill.apache.org>
> In-Reply-To: <15...@drill.apache.org>
> Accept-Language: en-US
> Content-Language: en-US
> X-MS-Has-Attach:
> X-MS-TNEF-Correlator:
> authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> Sami.Ahmad@dot.state.fl.us;
> x-originating-ip: [156.75.180.190]
> x-ms-publictraffictype: Email
> x-ms-office365-filtering-correlation-id:
> 891d59b5-e680-490f-e77a-08d6d87c258a
> x-ms-office365-filtering-ht: Tenant
> x-microsoft-antispam:
>
>
> BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(46272
> 21)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(460510
> 4)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> x-ms-traffictypediagnostic: BL0PR0901MB2481:
> x-ms-exchange-purlcount: 1
> x-microsoft-antispam-prvs:
> <
> BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.prod
> .outlook.com
> >
> x-ms-oob-tlc-oobclassifiers: OLM:6108;
> x-forefront-prvs: 0037FD6480
> x-forefront-antispam-report:
>
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> BL0PR0901MB3154.namprd09.prod.outlook.com
> ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> received-spf: None (protection.outlook.com: dot.state.fl.us does not
> designate permitted sender hosts)
> x-ms-exchange-senderadcheck: 1
> x-microsoft-antispam-message-info:
>
>
> k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+
> o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0Yd
> XBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qiMh
> Fl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNjj5
> 88uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEkozf
> 2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc0s
> 56hSVh4=
> Content-Type: text/plain; charset="us-ascii"
> Content-Transfer-Encoding: quoted-printable
> MIME-Version: 1.0
> X-OriginatorOrg: dot.state.fl.us
> X-MS-Exchange-CrossTenant-Network-Message-Id:
> 891d59b5-e680-490f-e77a-08d6d87c258a
> X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019
> 14:55:03.6058
> (UTC)
> X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
>
>
Re: WELCOME to user@drill.apache.org
Posted by Khurram Faraaz <kf...@mapr.com>.
Hi Ahmad,
Does the "show tables" command work for you from Hive shell ?
Can you please share you Hive version that is being used ?
And share the content from your Hive storage plugin, which is available on
the storage tab on Drill web UI.
Thanks,
Khurram
On Tue, May 14, 2019 at 10:07 AM Ahmad, Sami <Sa...@dot.state.fl.us>
wrote:
> I am not able to see any hive or hbase tables in drill , I get the schema
> fine , getting the error in the logfile shown below .
>
> Regards
>
>
>
> [root@hadoop1 bin]# ./drillbit.sh start
> Starting drillbit, logging to /root/apache-drill-1.16.0/log/drillbit.out
>
>
> [root@hadoop1 bin]#
> [root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181
> Apache Drill 1.16.0
> "Say hello to my little Drill."
> apache drill> show schemas;
> +--------------------+
> | SCHEMA_NAME |
> +--------------------+
> | cp.default |
> | dfs.default |
> | dfs.root |
> | dfs.tmp |
> | hbase |
> | hive.aaronm |
> | hive.default |
> | hive.es_testdb |
> | hive.guest |
> | hive.ivann |
> | hive.levic |
> | hive.nasirq |
> | hive.nipar |
> | hive.rangertst |
> | hive.richas |
> | hive.roumig |
> | hive.sami |
> | hive.sandeeps |
> | hive.sasmitap |
> | hive.sid |
> | hive.swaroopa |
> | hive.tito |
> | hive.usha |
> | information_schema |
> | sys |
> +--------------------+
> 25 rows selected (1.869 seconds)
> apache drill> use hive;
> +------+----------------------------------+
> | ok | summary |
> +------+----------------------------------+
> | true | Default schema changed to [hive] |
> +------+----------------------------------+
> 1 row selected (0.103 seconds)
> apache drill (hive)> show tables; <<<< NOT SHOWING
> ANY HIVE TABLES.
> +--------------+------------+
> | TABLE_SCHEMA | TABLE_NAME |
> +--------------+------------+
> +--------------+------------+
> No rows selected (0.601 seconds)
> apache drill (hive)>
>
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_112]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112]
> Caused by: java.util.concurrent.ExecutionException:
> MetaException(message:Got exception:
> org.apache.thrift.TApplicationException Invalid method name:
> 'get_tables_by_type')
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:502)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:461)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:83)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:142)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2453)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at
> org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2417)
> ~[drill-shaded-guava-23.0.jar:23.0]
> at o
>
>
> -----Original Message-----
> From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
> Sent: Tuesday, May 14, 2019 10:55 AM
> To: Ahmad, Sami <Sa...@dot.state.fl.us>
> Subject: WELCOME to user@drill.apache.org
>
> EXTERNAL SENDER: Use caution with links and attachments.
>
>
> Hi! This is the ezmlm program. I'm managing the user@drill.apache.org
> mailing list.
>
> I'm working for my owner, who can be reached at
> user-owner@drill.apache.org.
>
> Acknowledgment: I have added the address
>
> Sami.Ahmad@dot.state.fl.us
>
> to the user mailing list.
>
> Welcome to user@drill.apache.org!
>
> Please save this message so that you know the address you are subscribed
> under, in case you later want to unsubscribe or change your subscription
> address.
>
>
> --- Administrative commands for the user list ---
>
> I can handle administrative requests automatically. Please do not send
> them to the list address! Instead, send your message to the correct command
> address:
>
> To subscribe to the list, send a message to:
> <us...@drill.apache.org>
>
> To remove your address from the list, send a message to:
> <us...@drill.apache.org>
>
> Send mail to the following for info and FAQ for this list:
> <us...@drill.apache.org>
> <us...@drill.apache.org>
>
> Similar addresses exist for the digest list:
> <us...@drill.apache.org>
> <us...@drill.apache.org>
>
> To get messages 123 through 145 (a maximum of 100 per request), mail:
> <us...@drill.apache.org>
>
> To get an index with subject and author for messages 123-456 , mail:
> <us...@drill.apache.org>
>
> They are always returned as sets of 100, max 2000 per request, so you'll
> actually get 100-499.
>
> To receive all messages with the same subject as message 12345, send a
> short message to:
> <us...@drill.apache.org>
>
> The messages should contain one line or word of text to avoid being
> treated as sp@m, but I will ignore their content.
> Only the ADDRESS you send to is important.
>
> You can start a subscription for an alternate address, for example
> "john@host.domain", just add a hyphen and your address (with '=' instead
> of '@') after the command word:
> <us...@drill.apache.org>
>
> To stop subscription for this address, mail:
> <us...@drill.apache.org>
>
> In both cases, I'll send a confirmation message to that address. When you
> receive it, simply reply to it to complete your subscription.
>
> If despite following these instructions, you do not get the desired
> results, please contact my owner at user-owner@drill.apache.org. Please
> be patient, my owner is a lot slower than I am ;-)
>
> --- Enclosed is a copy of the request I received.
>
> Return-Path: <Sa...@dot.state.fl.us>
> Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15 -0000
> Received: from pnap-us-west-generic-nat.apache.org (HELO
> spamd1-us-west.apache.org) (209.188.14.142)
> by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019 14:55:15
> +0000
> Received: from localhost (localhost [127.0.0.1])
> by spamd1-us-west.apache.org (ASF Mail Server at
> spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000 (UTC)
> X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
> X-Spam-Flag: NO
> X-Spam-Score: 0.549
> X-Spam-Level:
> X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
> tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
> DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75,
> RCVD_IN_DNSWL_NONE=-0.0001,
> SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
> autolearn=disabled
> Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
> dkim=pass (1024-bit key) header.d=dot.state.fl.us
> Received: from mx1-lw-eu.apache.org ([10.40.0.8])
> by localhost (spamd1-us-west.apache.org [10.40.0.7])
> (amavisd-new, port 10024)
> with ESMTP id WIGqrOYFhOGS
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>;
> Tue, 14 May 2019 14:55:12 +0000 (UTC)
> Received: from GCC01-CY1-obe.outbound.protection.outlook.com (
> mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
> by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org)
> with ESMTPS id 385AA5FB42
> for <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000 (UTC)
> DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dot.state.fl.us;
> s=selector1;
> h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
> bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
>
> b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63Oymn5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4UPRSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
> Received: from BL0PR0901MB3154.namprd09.prod.outlook.com (20.177.243.145)
> by BL0PR0901MB2481.namprd09.prod.outlook.com (52.132.19.143) with
> Microsoft SMTP Server (version=TLS1_2,
> cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21; Tue, 14
> May 2019 14:55:03 +0000
> Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
> ([fe80::f8d0:42f:dc63:9883]) by BL0PR0901MB3154.namprd09.prod.outlook.com
> ([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14 May
> 2019
> 14:55:03 +0000
> From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
> To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org"
> <user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=
> dot.state.fl.us@drill.apache.org>
> Subject: RE: confirm subscribe to user@drill.apache.org
> Thread-Topic: confirm subscribe to user@drill.apache.org
> Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
> Date: Tue, 14 May 2019 14:55:03 +0000
> Message-ID:
> <
> BL0PR0901MB3154E9E2D60AF474E6FA961689080@BL0PR0901MB3154.namprd09.prod.outlook.com
> >
> References: <15...@drill.apache.org>
> In-Reply-To: <15...@drill.apache.org>
> Accept-Language: en-US
> Content-Language: en-US
> X-MS-Has-Attach:
> X-MS-TNEF-Correlator:
> authentication-results: spf=none (sender IP is ) smtp.mailfrom=
> Sami.Ahmad@dot.state.fl.us;
> x-originating-ip: [156.75.180.190]
> x-ms-publictraffictype: Email
> x-ms-office365-filtering-correlation-id:
> 891d59b5-e680-490f-e77a-08d6d87c258a
> x-ms-office365-filtering-ht: Tenant
> x-microsoft-antispam:
>
> BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605104)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
> x-ms-traffictypediagnostic: BL0PR0901MB2481:
> x-ms-exchange-purlcount: 1
> x-microsoft-antispam-prvs:
> <
> BL0PR0901MB2481972FB739D8B1BBFC5EA889080@BL0PR0901MB2481.namprd09.prod.outlook.com
> >
> x-ms-oob-tlc-oobclassifiers: OLM:6108;
> x-forefront-prvs: 0037FD6480
> x-forefront-antispam-report:
>
> SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:
> BL0PR0901MB3154.namprd09.prod.outlook.com
> ;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
> received-spf: None (protection.outlook.com: dot.state.fl.us does not
> designate permitted sender hosts)
> x-ms-exchange-senderadcheck: 1
> x-microsoft-antispam-message-info:
>
> k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0YdXBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qiMhFl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNjj588uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEkozf2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc0s56hSVh4=
> Content-Type: text/plain; charset="us-ascii"
> Content-Transfer-Encoding: quoted-printable
> MIME-Version: 1.0
> X-OriginatorOrg: dot.state.fl.us
> X-MS-Exchange-CrossTenant-Network-Message-Id:
> 891d59b5-e680-490f-e77a-08d6d87c258a
> X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019 14:55:03.6058
> (UTC)
> X-MS-Exchange-CrossTenant-fromentityheader: Hosted
> X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
> X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
> X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481
>
>
RE: WELCOME to user@drill.apache.org
Posted by "Ahmad, Sami" <Sa...@dot.state.fl.us>.
Adding drill-dev
-----Original Message-----
From: Ahmad, Sami
Sent: Tuesday, May 14, 2019 1:08 PM
To: user-help@drill.apache.org
Cc: user@drill.apache.org
Subject: RE: WELCOME to user@drill.apache.org
I am not able to see any hive or hbase tables in drill , I get the schema fine , getting the error in the logfile shown below .
Regards
[root@hadoop1 bin]# ./drillbit.sh start
Starting drillbit, logging to /root/apache-drill-1.16.0/log/drillbit.out
[root@hadoop1 bin]#
[root@hadoop1 bin]# ./sqlline -u jdbc:drill:zk=hadoop1:2181 Apache Drill 1.16.0 "Say hello to my little Drill."
apache drill> show schemas;
+--------------------+
| SCHEMA_NAME |
+--------------------+
| cp.default |
| dfs.default |
| dfs.root |
| dfs.tmp |
| hbase |
| hive.aaronm |
| hive.default |
| hive.es_testdb |
| hive.guest |
| hive.ivann |
| hive.levic |
| hive.nasirq |
| hive.nipar |
| hive.rangertst |
| hive.richas |
| hive.roumig |
| hive.sami |
| hive.sandeeps |
| hive.sasmitap |
| hive.sid |
| hive.swaroopa |
| hive.tito |
| hive.usha |
| information_schema |
| sys |
+--------------------+
25 rows selected (1.869 seconds)
apache drill> use hive;
+------+----------------------------------+
| ok | summary |
+------+----------------------------------+
| true | Default schema changed to [hive] |
+------+----------------------------------+
1 row selected (0.103 seconds)
apache drill (hive)> show tables; <<<< NOT SHOWING ANY HIVE TABLES.
+--------------+------------+
| TABLE_SCHEMA | TABLE_NAME |
+--------------+------------+
+--------------+------------+
No rows selected (0.601 seconds)
apache drill (hive)>
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_112]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_112] Caused by: java.util.concurrent.ExecutionException: MetaException(message:Got exception: org.apache.thrift.TApplicationException Invalid method name: 'get_tables_by_type')
at org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture.getDoneValue(AbstractFuture.java:502) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture.get(AbstractFuture.java:461) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.util.concurrent.AbstractFuture$TrustedFuture.get(AbstractFuture.java:83) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.util.concurrent.Uninterruptibles.getUninterruptibly(Uninterruptibles.java:142) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segment.getAndRecordStats(LocalCache.java:2453) ~[drill-shaded-guava-23.0.jar:23.0]
at org.apache.drill.shaded.guava.com.google.common.cache.LocalCache$Segment.loadSync(LocalCache.java:2417) ~[drill-shaded-guava-23.0.jar:23.0]
at o
-----Original Message-----
From: user-help@drill.apache.org [mailto:user-help@drill.apache.org]
Sent: Tuesday, May 14, 2019 10:55 AM
To: Ahmad, Sami <Sa...@dot.state.fl.us>
Subject: WELCOME to user@drill.apache.org
EXTERNAL SENDER: Use caution with links and attachments.
Hi! This is the ezmlm program. I'm managing the user@drill.apache.org mailing list.
I'm working for my owner, who can be reached at user-owner@drill.apache.org.
Acknowledgment: I have added the address
Sami.Ahmad@dot.state.fl.us
to the user mailing list.
Welcome to user@drill.apache.org!
Please save this message so that you know the address you are subscribed under, in case you later want to unsubscribe or change your subscription address.
--- Administrative commands for the user list ---
I can handle administrative requests automatically. Please do not send them to the list address! Instead, send your message to the correct command address:
To subscribe to the list, send a message to:
<us...@drill.apache.org>
To remove your address from the list, send a message to:
<us...@drill.apache.org>
Send mail to the following for info and FAQ for this list:
<us...@drill.apache.org>
<us...@drill.apache.org>
Similar addresses exist for the digest list:
<us...@drill.apache.org>
<us...@drill.apache.org>
To get messages 123 through 145 (a maximum of 100 per request), mail:
<us...@drill.apache.org>
To get an index with subject and author for messages 123-456 , mail:
<us...@drill.apache.org>
They are always returned as sets of 100, max 2000 per request, so you'll actually get 100-499.
To receive all messages with the same subject as message 12345, send a short message to:
<us...@drill.apache.org>
The messages should contain one line or word of text to avoid being treated as sp@m, but I will ignore their content.
Only the ADDRESS you send to is important.
You can start a subscription for an alternate address, for example "john@host.domain", just add a hyphen and your address (with '=' instead of '@') after the command word:
<us...@drill.apache.org>
To stop subscription for this address, mail:
<us...@drill.apache.org>
In both cases, I'll send a confirmation message to that address. When you receive it, simply reply to it to complete your subscription.
If despite following these instructions, you do not get the desired results, please contact my owner at user-owner@drill.apache.org. Please be patient, my owner is a lot slower than I am ;-)
--- Enclosed is a copy of the request I received.
Return-Path: <Sa...@dot.state.fl.us>
Received: (qmail 12237 invoked by uid 99); 14 May 2019 14:55:15 -0000
Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142)
by apache.org (qpsmtpd/0.29) with ESMTP; Tue, 14 May 2019 14:55:15 +0000
Received: from localhost (localhost [127.0.0.1])
by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 42BBFC5B46
for <us...@drill.apache.org>; Tue, 14 May 2019 14:55:15 +0000 (UTC)
X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org
X-Spam-Flag: NO
X-Spam-Score: 0.549
X-Spam-Level:
X-Spam-Status: No, score=0.549 tagged_above=-999 required=6.31
tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1,
DKIM_VALID_EF=-0.1, KAM_INFOUSMEBIZ=0.75, RCVD_IN_DNSWL_NONE=-0.0001,
SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001]
autolearn=disabled
Authentication-Results: spamd1-us-west.apache.org (amavisd-new);
dkim=pass (1024-bit key) header.d=dot.state.fl.us
Received: from mx1-lw-eu.apache.org ([10.40.0.8])
by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024)
with ESMTP id WIGqrOYFhOGS
for <us...@drill.apache.org>;
Tue, 14 May 2019 14:55:12 +0000 (UTC)
Received: from GCC01-CY1-obe.outbound.protection.outlook.com (mail-eopbgr830121.outbound.protection.outlook.com [40.107.83.121])
by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 385AA5FB42
for <us...@drill.apache.org>; Tue, 14 May 2019 14:55:12 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dot.state.fl.us; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
bh=FG36ZZm24V/Sa+Cahhby4FdXeuNBBjVrqcw7MAftG3U=;
b=kubvI7tJmYr7oLS7lzYjZwd0rTfPHJgNKouDkKCD6sH5wfmOhKO0tMsh9Z4/X9Y63Oymn5dxz6j2wwV9M1d6YOsP1EPjy3/e5zBGZP/sUGpVCBXyTMrLzY7HdBb2NlUvi3vw6TD4UPRSsqALt8bf0dMr/TPhSoDnpHvkrXANaZM=
Received: from BL0PR0901MB3154.namprd09.prod.outlook.com (20.177.243.145) by BL0PR0901MB2481.namprd09.prod.outlook.com (52.132.19.143) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.1878.21; Tue, 14 May 2019 14:55:03 +0000
Received: from BL0PR0901MB3154.namprd09.prod.outlook.com
([fe80::f8d0:42f:dc63:9883]) by BL0PR0901MB3154.namprd09.prod.outlook.com
([fe80::f8d0:42f:dc63:9883%7]) with mapi id 15.20.1878.024; Tue, 14 May 2019
14:55:03 +0000
From: "Ahmad, Sami" <Sa...@dot.state.fl.us>
To: "user-sc.1557845487.ongognfnibknechabfkd-Sami.Ahmad=dot.state.fl.us@drill.apache.org"
<us...@drill.apache.org>
Subject: RE: confirm subscribe to user@drill.apache.org
Thread-Topic: confirm subscribe to user@drill.apache.org
Thread-Index: AQHVCmSDlyDdP1lRT0SYTvGULj1vtqZqtS8Q
Date: Tue, 14 May 2019 14:55:03 +0000
Message-ID:
<BL...@BL0PR0901MB3154.namprd09.prod.outlook.com>
References: <15...@drill.apache.org>
In-Reply-To: <15...@drill.apache.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
authentication-results: spf=none (sender IP is ) smtp.mailfrom=Sami.Ahmad@dot.state.fl.us;
x-originating-ip: [156.75.180.190]
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 891d59b5-e680-490f-e77a-08d6d87c258a
x-ms-office365-filtering-ht: Tenant
x-microsoft-antispam:
BCL:0;PCL:0;RULEID:(2390118)(7020095)(4652040)(8989299)(4534185)(4627221)(201703031133081)(201702281549075)(8990200)(5600141)(711020)(4605104)(4618075)(2017052603328)(7193020);SRVR:BL0PR0901MB2481;
x-ms-traffictypediagnostic: BL0PR0901MB2481:
x-ms-exchange-purlcount: 1
x-microsoft-antispam-prvs:
<BL...@BL0PR0901MB2481.namprd09.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:6108;
x-forefront-prvs: 0037FD6480
x-forefront-antispam-report:
SFV:NSPM;SFS:(10019020)(346002)(366004)(39860400002)(396003)(136003)(376002)(13464003)(199004)(189003)(786003)(74482002)(186003)(222073003)(316002)(53936002)(55016002)(6506007)(86362001)(66574012)(9686003)(6306002)(53546011)(81156014)(99286004)(7696005)(5660300002)(76176011)(8676002)(8936002)(68736007)(81166006)(71200400001)(71190400001)(74316002)(229853002)(66066001)(446003)(66946007)(66476007)(14454004)(64756008)(45080400002)(476003)(256004)(478600001)(66446008)(66556008)(52536014)(966005)(486006)(11346002)(2906002)(14444005)(5024004)(72206003)(19627235002)(26005)(3846002)(25786009)(6116002)(305945005)(7736002)(6436002)(73956011)(76116006)(33656002)(102836004)(6246003)(10126004)(30470500001);DIR:OUT;SFP:1102;SCL:1;SRVR:BL0PR0901MB2481;H:BL0PR0901MB3154.namprd09.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1;
received-spf: None (protection.outlook.com: dot.state.fl.us does not designate permitted sender hosts)
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam-message-info:
k2rNJMj8gMUewNyNOmI0SUR+UCyah3rez5r2HigVsxBskiAAZWkWINZXHfqqFEclRqF4i+o1zV6fLJgi21JXzH4zC2cUwLqjfAhQaVHkPf1tevLYvdIbmetRZPeLHXldcWQO2KfTn0YdXBGyQrv9CgAleETkSlJlU47PChYqxlDMkFyx5uwYItTRIJ+M1UMatfen4JeLkLqY38qiMhFl0k6vhEKMbf6bUGmhHFFSvRKTlMTD3jOepQ/0KDsq3bytE/g96JFoFcNJjlQ3YeYQNjj588uisRW7SMAYvlGZY5aVSoMmlQX5zDAX1C9Q4H07TfFGFgBWguBYlLrVYKQ5Lni8AEkozf2NfQVk5h1aPk62ANi/9njwEJwGfMn1S+LDn1zPveeTa65+FFTdsT8AZHAzl/cSJPpFwc0s56hSVh4=
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-OriginatorOrg: dot.state.fl.us
X-MS-Exchange-CrossTenant-Network-Message-Id: 891d59b5-e680-490f-e77a-08d6d87c258a
X-MS-Exchange-CrossTenant-originalarrivaltime: 14 May 2019 14:55:03.6058
(UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: db21de5d-bc9c-420c-8f3f-8f08f85b5ada
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL0PR0901MB2481