You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Minnow Noir <mi...@gmail.com> on 2015/02/08 21:23:01 UTC

Connect to drillbit in VM from desktop Squirrel?

I am trying to access a drill bit running in a VM from Squirrel on my
desktop.  I'm unsure of the Squirrel alias syntax, and having an issue
troubleshooting because I can't access the web interface on 8047 in the
VM.  I'm trying this on a VM  before worrying about deploying it into a
real cluster.

1. I opened the VM FW for 8047 and 2181 so that I could hit them from my
desktop.  I also saved and restarted iptables.  Iptables is setup to accept
inbound requests from my desktop:

iptables -L
Chain INPUT (policy ACCEPT)
target     prot opt source               destination
ACCEPT     tcp  --  anywhere             anywhere            tcp
dpt:eforward
ACCEPT     tcp  --  anywhere             anywhere            tcp dpt:8047

Chain FORWARD (policy ACCEPT)
target     prot opt source               destination

Chain OUTPUT (policy ACCEPT)
target     prot opt source               destination

2. I installed and started 0.70 using -u jdbc:drill:zk=local, and then ran
some queries against files on "DFS," which worked fine.  Netstat says that
the drillbit is running on 8047, but that nothing is running on the ZK port.

# netstat -an | egrep "(8047|2181)"
tcp        0      0 :::8047                     :::*
LISTEN

3. I followed the Squirrel installation instructions, but got hung up
defining the driver and alias because the instructions appear to be for
people not running Drill in "local" mode.

4. I thought I'd look at the web UI to see if it gave me any clues about
how to connect Squirrel to the drillbit, but for some reason, I cannot
connect to the drillbit running on exposed port 8047.  (I can, however,
connect to Ambari running on 8080.)

Is it possible to connect Squirrel on the desktop to the local drillbit
running in the VM?


Thanks

Re: Connect to drillbit in VM from desktop Squirrel?

Posted by Jacques Nadeau <ja...@apache.org>.
You can run in embedded mode within Squirrel but you would need to use the
same classpath that the drillbit startup creates for your driver rather
than using the jdbc-driver jar  (the jdbc-driver jar doesn't support
embedded mode).  Once started in embedded, the web interface will be
available.

On Sun, Feb 8, 2015 at 2:40 PM, Andries Engelbrecht <
aengelbrecht@maprtech.com> wrote:

> Are you running Drill in embedded mode or using the Sandbox VM?
>
> I don’t believe you can connect to a VM running Drill in Embedded mode
> from the host using SquirreL with JDBC. JDBC connects via ZooKeeper.
> It may be best to consider using the Drill SandBox if you would like to
> use SQuirreL,
>
> What is on the VM where you run Drill? If it is running Amabri do you have
> ZK running on it?
>
>
>
> —Andries
>
>
>
> On Feb 8, 2015, at 12:23 PM, Minnow Noir <mi...@gmail.com> wrote:
>
> > I am trying to access a drill bit running in a VM from Squirrel on my
> > desktop.  I'm unsure of the Squirrel alias syntax, and having an issue
> > troubleshooting because I can't access the web interface on 8047 in the
> > VM.  I'm trying this on a VM  before worrying about deploying it into a
> > real cluster.
> >
> > 1. I opened the VM FW for 8047 and 2181 so that I could hit them from my
> > desktop.  I also saved and restarted iptables.  Iptables is setup to
> accept
> > inbound requests from my desktop:
> >
> > iptables -L
> > Chain INPUT (policy ACCEPT)
> > target     prot opt source               destination
> > ACCEPT     tcp  --  anywhere             anywhere            tcp
> > dpt:eforward
> > ACCEPT     tcp  --  anywhere             anywhere            tcp dpt:8047
> >
> > Chain FORWARD (policy ACCEPT)
> > target     prot opt source               destination
> >
> > Chain OUTPUT (policy ACCEPT)
> > target     prot opt source               destination
> >
> > 2. I installed and started 0.70 using -u jdbc:drill:zk=local, and then
> ran
> > some queries against files on "DFS," which worked fine.  Netstat says
> that
> > the drillbit is running on 8047, but that nothing is running on the ZK
> port.
> >
> > # netstat -an | egrep "(8047|2181)"
> > tcp        0      0 :::8047                     :::*
> > LISTEN
> >
> > 3. I followed the Squirrel installation instructions, but got hung up
> > defining the driver and alias because the instructions appear to be for
> > people not running Drill in "local" mode.
> >
> > 4. I thought I'd look at the web UI to see if it gave me any clues about
> > how to connect Squirrel to the drillbit, but for some reason, I cannot
> > connect to the drillbit running on exposed port 8047.  (I can, however,
> > connect to Ambari running on 8080.)
> >
> > Is it possible to connect Squirrel on the desktop to the local drillbit
> > running in the VM?
> >
> >
> > Thanks
>
>

Re: Connect to drillbit in VM from desktop Squirrel?

Posted by Andries Engelbrecht <ae...@maprtech.com>.
On the HDP try to connect Drill to the ZK and then use the Squirrel JDBC instructions.

Basically edit the <Drill-Home>/conf/drill-overrride.conf  file

Take note of the cluster-id in the conf file (as you will use that to connect to).
Then edit the zk.connect line for the node name with ZK on it. Also with HDP the port number is normally 2181, not 5181 (don’t have access to a HDP sandbox at the moment).

For more details look here
https://cwiki.apache.org/confluence/display/DRILL/Installing+Drill+in+Distributed+Mode

Once you edited the files you can start/restart the drillbit by using
 <Drill-Home>/bin/drillbit.sh start
or use restart

This will start drill in distributed mode and utilize ZK.

On the Squirrel system you also need to make sure that the OS can resolve the hostname of the VM properly (not sure what the HDP Sandbox hostname is). For Linux/Mac simple edit the /etc/hosts file, Windows it is c:/windows/system32/driver/etc/hosts. With some the Sandboxes the VM may use NAT, which means you have to use localhost or the 127.0.0.1 IP address for the specific hostname.
so add the line below in the hosts file (obviously substitute the actual hostname in.

127.0.0.1  <hostname of VM> 

If the VM has an actual IP address simple use that vs the 127 IP.

This will also allow you to use the hostname for the WebUI.

A best practice I have found is always to hostnames with ZK and not IP when you set up connections, also make sure the client system can ping the hostname of the system with Drill on it.

More info here
https://cwiki.apache.org/confluence/display/DRILL/Using+JDBC+to+Access+Apache+Drill+from+SQuirreL


In truth it looks complicated at first, but once you get the feel of it, it is actually pretty simple.


—Andries




On Feb 8, 2015, at 2:54 PM, Minnow Noir <mi...@gmail.com> wrote:

> Embedded mode, since I'm just experimenting with it.  I had it on another
> HDP sandbox VM a couple of months ago, and IIRC, was able to access the web
> UI from the host (unlike right now), but I never tried accessing it via a
> thick client from the host.
> 
> I'm using the HDP 2.2 sandbox VM.  ZK is on it and running.
> 
> 
> 
> On Sun, Feb 8, 2015 at 5:40 PM, Andries Engelbrecht <
> aengelbrecht@maprtech.com> wrote:
> 
>> Are you running Drill in embedded mode or using the Sandbox VM?
>> 
>> I don’t believe you can connect to a VM running Drill in Embedded mode
>> from the host using SquirreL with JDBC. JDBC connects via ZooKeeper.
>> It may be best to consider using the Drill SandBox if you would like to
>> use SQuirreL,
>> 
>> What is on the VM where you run Drill? If it is running Amabri do you have
>> ZK running on it?
>> 
>> 
>> 
>> —Andries
>> 
>> 
>> 
>> On Feb 8, 2015, at 12:23 PM, Minnow Noir <mi...@gmail.com> wrote:
>> 
>>> I am trying to access a drill bit running in a VM from Squirrel on my
>>> desktop.  I'm unsure of the Squirrel alias syntax, and having an issue
>>> troubleshooting because I can't access the web interface on 8047 in the
>>> VM.  I'm trying this on a VM  before worrying about deploying it into a
>>> real cluster.
>>> 
>>> 1. I opened the VM FW for 8047 and 2181 so that I could hit them from my
>>> desktop.  I also saved and restarted iptables.  Iptables is setup to
>> accept
>>> inbound requests from my desktop:
>>> 
>>> iptables -L
>>> Chain INPUT (policy ACCEPT)
>>> target     prot opt source               destination
>>> ACCEPT     tcp  --  anywhere             anywhere            tcp
>>> dpt:eforward
>>> ACCEPT     tcp  --  anywhere             anywhere            tcp dpt:8047
>>> 
>>> Chain FORWARD (policy ACCEPT)
>>> target     prot opt source               destination
>>> 
>>> Chain OUTPUT (policy ACCEPT)
>>> target     prot opt source               destination
>>> 
>>> 2. I installed and started 0.70 using -u jdbc:drill:zk=local, and then
>> ran
>>> some queries against files on "DFS," which worked fine.  Netstat says
>> that
>>> the drillbit is running on 8047, but that nothing is running on the ZK
>> port.
>>> 
>>> # netstat -an | egrep "(8047|2181)"
>>> tcp        0      0 :::8047                     :::*
>>> LISTEN
>>> 
>>> 3. I followed the Squirrel installation instructions, but got hung up
>>> defining the driver and alias because the instructions appear to be for
>>> people not running Drill in "local" mode.
>>> 
>>> 4. I thought I'd look at the web UI to see if it gave me any clues about
>>> how to connect Squirrel to the drillbit, but for some reason, I cannot
>>> connect to the drillbit running on exposed port 8047.  (I can, however,
>>> connect to Ambari running on 8080.)
>>> 
>>> Is it possible to connect Squirrel on the desktop to the local drillbit
>>> running in the VM?
>>> 
>>> 
>>> Thanks
>> 
>> 


Re: Connect to drillbit in VM from desktop Squirrel?

Posted by Minnow Noir <mi...@gmail.com>.
Embedded mode, since I'm just experimenting with it.  I had it on another
HDP sandbox VM a couple of months ago, and IIRC, was able to access the web
UI from the host (unlike right now), but I never tried accessing it via a
thick client from the host.

 I'm using the HDP 2.2 sandbox VM.  ZK is on it and running.



On Sun, Feb 8, 2015 at 5:40 PM, Andries Engelbrecht <
aengelbrecht@maprtech.com> wrote:

> Are you running Drill in embedded mode or using the Sandbox VM?
>
> I don’t believe you can connect to a VM running Drill in Embedded mode
> from the host using SquirreL with JDBC. JDBC connects via ZooKeeper.
> It may be best to consider using the Drill SandBox if you would like to
> use SQuirreL,
>
> What is on the VM where you run Drill? If it is running Amabri do you have
> ZK running on it?
>
>
>
> —Andries
>
>
>
> On Feb 8, 2015, at 12:23 PM, Minnow Noir <mi...@gmail.com> wrote:
>
> > I am trying to access a drill bit running in a VM from Squirrel on my
> > desktop.  I'm unsure of the Squirrel alias syntax, and having an issue
> > troubleshooting because I can't access the web interface on 8047 in the
> > VM.  I'm trying this on a VM  before worrying about deploying it into a
> > real cluster.
> >
> > 1. I opened the VM FW for 8047 and 2181 so that I could hit them from my
> > desktop.  I also saved and restarted iptables.  Iptables is setup to
> accept
> > inbound requests from my desktop:
> >
> > iptables -L
> > Chain INPUT (policy ACCEPT)
> > target     prot opt source               destination
> > ACCEPT     tcp  --  anywhere             anywhere            tcp
> > dpt:eforward
> > ACCEPT     tcp  --  anywhere             anywhere            tcp dpt:8047
> >
> > Chain FORWARD (policy ACCEPT)
> > target     prot opt source               destination
> >
> > Chain OUTPUT (policy ACCEPT)
> > target     prot opt source               destination
> >
> > 2. I installed and started 0.70 using -u jdbc:drill:zk=local, and then
> ran
> > some queries against files on "DFS," which worked fine.  Netstat says
> that
> > the drillbit is running on 8047, but that nothing is running on the ZK
> port.
> >
> > # netstat -an | egrep "(8047|2181)"
> > tcp        0      0 :::8047                     :::*
> > LISTEN
> >
> > 3. I followed the Squirrel installation instructions, but got hung up
> > defining the driver and alias because the instructions appear to be for
> > people not running Drill in "local" mode.
> >
> > 4. I thought I'd look at the web UI to see if it gave me any clues about
> > how to connect Squirrel to the drillbit, but for some reason, I cannot
> > connect to the drillbit running on exposed port 8047.  (I can, however,
> > connect to Ambari running on 8080.)
> >
> > Is it possible to connect Squirrel on the desktop to the local drillbit
> > running in the VM?
> >
> >
> > Thanks
>
>

Re: Connect to drillbit in VM from desktop Squirrel?

Posted by Andries Engelbrecht <ae...@maprtech.com>.
Are you running Drill in embedded mode or using the Sandbox VM?

I don’t believe you can connect to a VM running Drill in Embedded mode from the host using SquirreL with JDBC. JDBC connects via ZooKeeper. 
It may be best to consider using the Drill SandBox if you would like to use SQuirreL,

What is on the VM where you run Drill? If it is running Amabri do you have ZK running on it?



—Andries



On Feb 8, 2015, at 12:23 PM, Minnow Noir <mi...@gmail.com> wrote:

> I am trying to access a drill bit running in a VM from Squirrel on my
> desktop.  I'm unsure of the Squirrel alias syntax, and having an issue
> troubleshooting because I can't access the web interface on 8047 in the
> VM.  I'm trying this on a VM  before worrying about deploying it into a
> real cluster.
> 
> 1. I opened the VM FW for 8047 and 2181 so that I could hit them from my
> desktop.  I also saved and restarted iptables.  Iptables is setup to accept
> inbound requests from my desktop:
> 
> iptables -L
> Chain INPUT (policy ACCEPT)
> target     prot opt source               destination
> ACCEPT     tcp  --  anywhere             anywhere            tcp
> dpt:eforward
> ACCEPT     tcp  --  anywhere             anywhere            tcp dpt:8047
> 
> Chain FORWARD (policy ACCEPT)
> target     prot opt source               destination
> 
> Chain OUTPUT (policy ACCEPT)
> target     prot opt source               destination
> 
> 2. I installed and started 0.70 using -u jdbc:drill:zk=local, and then ran
> some queries against files on "DFS," which worked fine.  Netstat says that
> the drillbit is running on 8047, but that nothing is running on the ZK port.
> 
> # netstat -an | egrep "(8047|2181)"
> tcp        0      0 :::8047                     :::*
> LISTEN
> 
> 3. I followed the Squirrel installation instructions, but got hung up
> defining the driver and alias because the instructions appear to be for
> people not running Drill in "local" mode.
> 
> 4. I thought I'd look at the web UI to see if it gave me any clues about
> how to connect Squirrel to the drillbit, but for some reason, I cannot
> connect to the drillbit running on exposed port 8047.  (I can, however,
> connect to Ambari running on 8080.)
> 
> Is it possible to connect Squirrel on the desktop to the local drillbit
> running in the VM?
> 
> 
> Thanks