You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Shaik M <mu...@gmail.com> on 2015/11/17 16:10:45 UTC
Apche Drill Unable to Connect NameNode HA
Hi Team,
I am new to Drill, I have installed Apache Drill one of my Hadoop
environment on 3 datanodes.
We have enable NameNode HA. And I have configured storage plugins of HDFS
and Hive.
I have given "fs.default.name": "hdfs://active.namenode:8020" in hive
plugin. but when I tried to query hive data it is picking NN HA uri and
its failing with following exception.
0: jdbc:drill:drillbit=localhost> select * from test_data limit 10;
Error: SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
[Error Id: c6e69561-89af-4d98-9909-82f332437bba on hostname.com:31010]
(state=,code=0)
Please help me to fix this issue.
Thanks,
Shaik
Re: Apche Drill Unable to Connect NameNode HA
Posted by Shaik M <mu...@gmail.com>.
yes, I am using same active namenode uri *hdfs://active.namenode.com:8020
<http://active.namenode.com:8020>*,for HDFS plugin.
Same thing I used for Hive plugin as well.
On 20 November 2015 at 00:27, Andries Engelbrecht <aengelbrecht@maprtech.com
> wrote:
> Hmmm, I assume you used hdfs://active.namenode.com:8020 <hdfs://
> active.namenode.com:8020> for the DFS connection plugin config.
>
> Perhaps someone more familiar with the Hive plugin can provide more info.
>
> --Andries
>
> > On Nov 18, 2015, at 7:32 PM, Shaik M <mu...@gmail.com> wrote:
> >
> > Hi Andries,
> >
> > Thank you for your reply.
> >
> > DFS plugin working fine, I can able to query the data from HDFS.
> >
> > SELECT * FROM `dfs`.`root`.`tmp/yahoo_stocks.csv` LIMIT 100.
> >
> > Issue with Hive Plugin only. Below are my Hive Plugin conf...
> >
> > {
> > "type": "hive",
> > "enabled": true,
> > "configProps": {
> > "hive.metastore.uris": "thrift://meta.hive.com:9083",
> > "hive.metastore.warehouse.dir": "/apps/hive/warehouse",
> > "fs.default.name": "hdfs://active.namenode.com:8020",
> > "hive.metastore.sasl.enabled": "false",
> > "hive.server2.enable.doAs": "true",
> > "hive.metastore.execute.setugi": "true"
> > }
> > }
> >
> >
> > I have given here active Namenode Hostname, but when i try to query hive
> > data, it is looking for NN HA uri *(**bdp-lab-hadoop**)*. and showing
> > exception unable to find hostname.
> >
> > As I aware Drill wont able to find/support NN HA logical URI. I have
> > trying to trace the issue, but not able :(.
> >
> > I am not understanding, why it is looking beyond the conf?
> >
> > Please help to fix this.
> >
> > Thanks.
> >
> > On 19 November 2015 at 00:25, Andries Engelbrecht <
> aengelbrecht@maprtech.com
> >> wrote:
> >
> >> Have you configured just a DFS plugin to see if you can read from HDFS
> >> directly before configuring the Hive plugin?
> >>
> >> Also it may be good to double check your network config on all the nodes
> >> due to this SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
> >>
> >> --Andries
> >>
> >>
> >>
> >>> On Nov 18, 2015, at 6:31 AM, Shaik M <mu...@gmail.com> wrote:
> >>>
> >>> Team, Please let me to resolve this issue.
> >>>
> >>> On 17 November 2015 at 23:10, Shaik M <mu...@gmail.com> wrote:
> >>>
> >>>> Hi Team,
> >>>>
> >>>> I am new to Drill, I have installed Apache Drill one of my Hadoop
> >>>> environment on 3 datanodes.
> >>>>
> >>>> We have enable NameNode HA. And I have configured storage plugins of
> >> HDFS
> >>>> and Hive.
> >>>>
> >>>> I have given "fs.default.name": "hdfs://active.namenode:8020" in hive
> >>>> plugin. but when I tried to query hive data it is picking NN HA uri
> and
> >>>> its failing with following exception.
> >>>>
> >>>> 0: jdbc:drill:drillbit=localhost> select * from test_data limit 10;
> >>>> Error: SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
> >>>>
> >>>>
> >>>> [Error Id: c6e69561-89af-4d98-9909-82f332437bba on hostname.com:31010
> ]
> >>>> (state=,code=0)
> >>>>
> >>>> Please help me to fix this issue.
> >>>>
> >>>> Thanks,
> >>>> Shaik
> >>>>
> >>
> >>
>
>
Re: Apche Drill Unable to Connect NameNode HA
Posted by Andries Engelbrecht <ae...@maprtech.com>.
Hmmm, I assume you used hdfs://active.namenode.com:8020 <hdfs://active.namenode.com:8020> for the DFS connection plugin config.
Perhaps someone more familiar with the Hive plugin can provide more info.
--Andries
> On Nov 18, 2015, at 7:32 PM, Shaik M <mu...@gmail.com> wrote:
>
> Hi Andries,
>
> Thank you for your reply.
>
> DFS plugin working fine, I can able to query the data from HDFS.
>
> SELECT * FROM `dfs`.`root`.`tmp/yahoo_stocks.csv` LIMIT 100.
>
> Issue with Hive Plugin only. Below are my Hive Plugin conf...
>
> {
> "type": "hive",
> "enabled": true,
> "configProps": {
> "hive.metastore.uris": "thrift://meta.hive.com:9083",
> "hive.metastore.warehouse.dir": "/apps/hive/warehouse",
> "fs.default.name": "hdfs://active.namenode.com:8020",
> "hive.metastore.sasl.enabled": "false",
> "hive.server2.enable.doAs": "true",
> "hive.metastore.execute.setugi": "true"
> }
> }
>
>
> I have given here active Namenode Hostname, but when i try to query hive
> data, it is looking for NN HA uri *(**bdp-lab-hadoop**)*. and showing
> exception unable to find hostname.
>
> As I aware Drill wont able to find/support NN HA logical URI. I have
> trying to trace the issue, but not able :(.
>
> I am not understanding, why it is looking beyond the conf?
>
> Please help to fix this.
>
> Thanks.
>
> On 19 November 2015 at 00:25, Andries Engelbrecht <aengelbrecht@maprtech.com
>> wrote:
>
>> Have you configured just a DFS plugin to see if you can read from HDFS
>> directly before configuring the Hive plugin?
>>
>> Also it may be good to double check your network config on all the nodes
>> due to this SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
>>
>> --Andries
>>
>>
>>
>>> On Nov 18, 2015, at 6:31 AM, Shaik M <mu...@gmail.com> wrote:
>>>
>>> Team, Please let me to resolve this issue.
>>>
>>> On 17 November 2015 at 23:10, Shaik M <mu...@gmail.com> wrote:
>>>
>>>> Hi Team,
>>>>
>>>> I am new to Drill, I have installed Apache Drill one of my Hadoop
>>>> environment on 3 datanodes.
>>>>
>>>> We have enable NameNode HA. And I have configured storage plugins of
>> HDFS
>>>> and Hive.
>>>>
>>>> I have given "fs.default.name": "hdfs://active.namenode:8020" in hive
>>>> plugin. but when I tried to query hive data it is picking NN HA uri and
>>>> its failing with following exception.
>>>>
>>>> 0: jdbc:drill:drillbit=localhost> select * from test_data limit 10;
>>>> Error: SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
>>>>
>>>>
>>>> [Error Id: c6e69561-89af-4d98-9909-82f332437bba on hostname.com:31010]
>>>> (state=,code=0)
>>>>
>>>> Please help me to fix this issue.
>>>>
>>>> Thanks,
>>>> Shaik
>>>>
>>
>>
Re: Apche Drill Unable to Connect NameNode HA
Posted by Shaik M <mu...@gmail.com>.
Hi Andries,
Thank you for your reply.
DFS plugin working fine, I can able to query the data from HDFS.
SELECT * FROM `dfs`.`root`.`tmp/yahoo_stocks.csv` LIMIT 100.
Issue with Hive Plugin only. Below are my Hive Plugin conf...
{
"type": "hive",
"enabled": true,
"configProps": {
"hive.metastore.uris": "thrift://meta.hive.com:9083",
"hive.metastore.warehouse.dir": "/apps/hive/warehouse",
"fs.default.name": "hdfs://active.namenode.com:8020",
"hive.metastore.sasl.enabled": "false",
"hive.server2.enable.doAs": "true",
"hive.metastore.execute.setugi": "true"
}
}
I have given here active Namenode Hostname, but when i try to query hive
data, it is looking for NN HA uri *(**bdp-lab-hadoop**)*. and showing
exception unable to find hostname.
As I aware Drill wont able to find/support NN HA logical URI. I have
trying to trace the issue, but not able :(.
I am not understanding, why it is looking beyond the conf?
Please help to fix this.
Thanks.
On 19 November 2015 at 00:25, Andries Engelbrecht <aengelbrecht@maprtech.com
> wrote:
> Have you configured just a DFS plugin to see if you can read from HDFS
> directly before configuring the Hive plugin?
>
> Also it may be good to double check your network config on all the nodes
> due to this SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
>
> --Andries
>
>
>
> > On Nov 18, 2015, at 6:31 AM, Shaik M <mu...@gmail.com> wrote:
> >
> > Team, Please let me to resolve this issue.
> >
> > On 17 November 2015 at 23:10, Shaik M <mu...@gmail.com> wrote:
> >
> >> Hi Team,
> >>
> >> I am new to Drill, I have installed Apache Drill one of my Hadoop
> >> environment on 3 datanodes.
> >>
> >> We have enable NameNode HA. And I have configured storage plugins of
> HDFS
> >> and Hive.
> >>
> >> I have given "fs.default.name": "hdfs://active.namenode:8020" in hive
> >> plugin. but when I tried to query hive data it is picking NN HA uri and
> >> its failing with following exception.
> >>
> >> 0: jdbc:drill:drillbit=localhost> select * from test_data limit 10;
> >> Error: SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
> >>
> >>
> >> [Error Id: c6e69561-89af-4d98-9909-82f332437bba on hostname.com:31010]
> >> (state=,code=0)
> >>
> >> Please help me to fix this issue.
> >>
> >> Thanks,
> >> Shaik
> >>
>
>
Re: Apche Drill Unable to Connect NameNode HA
Posted by Andries Engelbrecht <ae...@maprtech.com>.
Have you configured just a DFS plugin to see if you can read from HDFS directly before configuring the Hive plugin?
Also it may be good to double check your network config on all the nodes due to this SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
--Andries
> On Nov 18, 2015, at 6:31 AM, Shaik M <mu...@gmail.com> wrote:
>
> Team, Please let me to resolve this issue.
>
> On 17 November 2015 at 23:10, Shaik M <mu...@gmail.com> wrote:
>
>> Hi Team,
>>
>> I am new to Drill, I have installed Apache Drill one of my Hadoop
>> environment on 3 datanodes.
>>
>> We have enable NameNode HA. And I have configured storage plugins of HDFS
>> and Hive.
>>
>> I have given "fs.default.name": "hdfs://active.namenode:8020" in hive
>> plugin. but when I tried to query hive data it is picking NN HA uri and
>> its failing with following exception.
>>
>> 0: jdbc:drill:drillbit=localhost> select * from test_data limit 10;
>> Error: SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
>>
>>
>> [Error Id: c6e69561-89af-4d98-9909-82f332437bba on hostname.com:31010]
>> (state=,code=0)
>>
>> Please help me to fix this issue.
>>
>> Thanks,
>> Shaik
>>
Re: Apche Drill Unable to Connect NameNode HA
Posted by Shaik M <mu...@gmail.com>.
Team, Please let me to resolve this issue.
On 17 November 2015 at 23:10, Shaik M <mu...@gmail.com> wrote:
> Hi Team,
>
> I am new to Drill, I have installed Apache Drill one of my Hadoop
> environment on 3 datanodes.
>
> We have enable NameNode HA. And I have configured storage plugins of HDFS
> and Hive.
>
> I have given "fs.default.name": "hdfs://active.namenode:8020" in hive
> plugin. but when I tried to query hive data it is picking NN HA uri and
> its failing with following exception.
>
> 0: jdbc:drill:drillbit=localhost> select * from test_data limit 10;
> Error: SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
>
>
> [Error Id: c6e69561-89af-4d98-9909-82f332437bba on hostname.com:31010]
> (state=,code=0)
>
> Please help me to fix this issue.
>
> Thanks,
> Shaik
>
Re: Apche Drill Unable to Connect NameNode HA
Posted by Shaik M <mu...@gmail.com>.
can i get any help on this issue?
On 18 November 2015 at 08:36, Shaik M <mu...@gmail.com> wrote:
> Please help me to fix this issue.
>
> Thanks
>
>
> On Tuesday, 17 November 2015, Shaik M <mu...@gmail.com> wrote:
>
>> Hi Team,
>>
>> I am new to Drill, I have installed Apache Drill one of my Hadoop
>> environment on 3 datanodes.
>>
>> We have enable NameNode HA. And I have configured storage plugins of HDFS
>> and Hive.
>>
>> I have given "fs.default.name": "hdfs://active.namenode:8020" in hive
>> plugin. but when I tried to query hive data it is picking NN HA uri and
>> its failing with following exception.
>>
>> 0: jdbc:drill:drillbit=localhost> select * from test_data limit 10;
>> Error: SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
>>
>>
>> [Error Id: c6e69561-89af-4d98-9909-82f332437bba on hostname.com:31010]
>> (state=,code=0)
>>
>> Please help me to fix this issue.
>>
>> Thanks,
>> Shaik
>>
>
Re: Apche Drill Unable to Connect NameNode HA
Posted by Shaik M <mu...@gmail.com>.
Please help me to fix this issue.
Thanks
On Tuesday, 17 November 2015, Shaik M <mu...@gmail.com> wrote:
> Hi Team,
>
> I am new to Drill, I have installed Apache Drill one of my Hadoop
> environment on 3 datanodes.
>
> We have enable NameNode HA. And I have configured storage plugins of HDFS
> and Hive.
>
> I have given "fs.default.name": "hdfs://active.namenode:8020" in hive
> plugin. but when I tried to query hive data it is picking NN HA uri and
> its failing with following exception.
>
> 0: jdbc:drill:drillbit=localhost> select * from test_data limit 10;
> Error: SYSTEM ERROR: UnknownHostException: bdp-lab-hadoop
>
>
> [Error Id: c6e69561-89af-4d98-9909-82f332437bba on hostname.com:31010]
> (state=,code=0)
>
> Please help me to fix this issue.
>
> Thanks,
> Shaik
>