You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@drill.apache.org by Vince Gonzalez <vi...@gmail.com> on 2015/06/30 14:20:07 UTC

drill 1.0.0 and hive 0.13 with mapr security

I have a 3 node MapR 4.1 cluster in secure mode, and I've enabled
impersonation on both Drill and Hive. I've confirmed that Drill and Hive
work independently of each other - I can create and query tables in hive,
and I can query workspaces in Drill.

When I enable the hive workspace, Drill won't allow me to set
hive.metastore.sasl.enabled to true. While I'm able to switch to the hive
workspace with 'use hive', it takes tens of seconds. I also can't actually
query anything, as all the queries time out.

I'm unsure what to troubleshoot since I'm not really finding any
documentation on how to properly set up Drill with mapr security.

Any pointers?

Re: drill 1.0.0 and hive 0.13 with mapr security

Posted by Venki Korukanti <ve...@gmail.com>.
Drill 1.1 has support for Hive impersonation including connecting to
MetaStore with Kerbersos or native MapR security (works with MapR 4.1.0
version and Hive 1.0.0). There is some configuration that needs to be set.
Refer to the docs for more details.

Thanks
Venki

On Tue, Jun 30, 2015 at 9:24 AM, Jason Altekruse <al...@gmail.com>
wrote:

> We have upgraded the hive dependency to 1.0. I am almost certain that means
> we will not be able to run with 0.13 anymore, as we haven't been
> maintaining compatibility with multiple versions in parallel, so you would
> have to upgrade Hive as well.
>
> On Tue, Jun 30, 2015 at 9:19 AM, Vince Gonzalez <vi...@gmail.com>
> wrote:
>
> > That's great! Thanks. Presumably I could pull down a nightly and try it
> > out? Will drill still be expecting hive .13?
> >
> > On Tuesday, June 30, 2015, Jason Altekruse <al...@gmail.com>
> > wrote:
> >
> > > Venki can give more specifics on the status, but Hive impersonation was
> > > implemented in 1.1.0, which should be going out for a vote soon. I
> think
> > > there might have been some limitations on the scope, but I know we have
> > > verified the functionality with several security models.
> > >
> > > On Tue, Jun 30, 2015 at 9:11 AM, Vince Gonzalez <
> > vince.gonzalez@gmail.com
> > > <javascript:;>>
> > > wrote:
> > >
> > > > I'm not sure how I missed that. Thanks for pointing it out.
> > > >
> > > > On Tue, Jun 30, 2015 at 12:05 PM, Mustafa Engin Sözer <
> > > > mesoezer@goodgamestudios.com <javascript:;>> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > As far as I know, impersonation is not supported for Hive just yet.
> > > > > (according to current documentation
> > > > > https://drill.apache.org/docs/configuring-user-impersonation)
> > > > >
> > > > > On 30 June 2015 at 14:20, Vince Gonzalez <vince.gonzalez@gmail.com
> > > <javascript:;>>
> > > > wrote:
> > > > >
> > > > > > I have a 3 node MapR 4.1 cluster in secure mode, and I've enabled
> > > > > > impersonation on both Drill and Hive. I've confirmed that Drill
> and
> > > > Hive
> > > > > > work independently of each other - I can create and query tables
> in
> > > > hive,
> > > > > > and I can query workspaces in Drill.
> > > > > >
> > > > > > When I enable the hive workspace, Drill won't allow me to set
> > > > > > hive.metastore.sasl.enabled to true. While I'm able to switch to
> > the
> > > > hive
> > > > > > workspace with 'use hive', it takes tens of seconds. I also can't
> > > > > actually
> > > > > > query anything, as all the queries time out.
> > > > > >
> > > > > > I'm unsure what to troubleshoot since I'm not really finding any
> > > > > > documentation on how to properly set up Drill with mapr security.
> > > > > >
> > > > > > Any pointers?
> > > > > >
> > > > >
> > > > >
> > > > >
> > > > > --
> > > > >
> > > > > *M. Engin Sözer*
> > > > > Junior Datawarehouse Manager
> > > > > mesoezer@goodgamestudios.com <javascript:;>
> > > > >
> > > > > Goodgame Studios
> > > > > Theodorstr. 42-90, House 9
> > > > > 22761 Hamburg, Germany
> > > > > Phone: +49 (0)40 219 880 -0
> > > > > *www.goodgamestudios.com <http://www.goodgamestudios.com>*
> > > > >
> > > > > Goodgame Studios is a branch of Altigi GmbH
> > > > > Altigi GmbH, District court Hamburg, HRB 99869
> > > > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek,
> > Fabian
> > > > > Ritter
> > > > >
> > > >
> > >
> >
>

Re: drill 1.0.0 and hive 0.13 with mapr security

Posted by Jason Altekruse <al...@gmail.com>.
We have upgraded the hive dependency to 1.0. I am almost certain that means
we will not be able to run with 0.13 anymore, as we haven't been
maintaining compatibility with multiple versions in parallel, so you would
have to upgrade Hive as well.

On Tue, Jun 30, 2015 at 9:19 AM, Vince Gonzalez <vi...@gmail.com>
wrote:

> That's great! Thanks. Presumably I could pull down a nightly and try it
> out? Will drill still be expecting hive .13?
>
> On Tuesday, June 30, 2015, Jason Altekruse <al...@gmail.com>
> wrote:
>
> > Venki can give more specifics on the status, but Hive impersonation was
> > implemented in 1.1.0, which should be going out for a vote soon. I think
> > there might have been some limitations on the scope, but I know we have
> > verified the functionality with several security models.
> >
> > On Tue, Jun 30, 2015 at 9:11 AM, Vince Gonzalez <
> vince.gonzalez@gmail.com
> > <javascript:;>>
> > wrote:
> >
> > > I'm not sure how I missed that. Thanks for pointing it out.
> > >
> > > On Tue, Jun 30, 2015 at 12:05 PM, Mustafa Engin Sözer <
> > > mesoezer@goodgamestudios.com <javascript:;>> wrote:
> > >
> > > > Hi,
> > > >
> > > > As far as I know, impersonation is not supported for Hive just yet.
> > > > (according to current documentation
> > > > https://drill.apache.org/docs/configuring-user-impersonation)
> > > >
> > > > On 30 June 2015 at 14:20, Vince Gonzalez <vince.gonzalez@gmail.com
> > <javascript:;>>
> > > wrote:
> > > >
> > > > > I have a 3 node MapR 4.1 cluster in secure mode, and I've enabled
> > > > > impersonation on both Drill and Hive. I've confirmed that Drill and
> > > Hive
> > > > > work independently of each other - I can create and query tables in
> > > hive,
> > > > > and I can query workspaces in Drill.
> > > > >
> > > > > When I enable the hive workspace, Drill won't allow me to set
> > > > > hive.metastore.sasl.enabled to true. While I'm able to switch to
> the
> > > hive
> > > > > workspace with 'use hive', it takes tens of seconds. I also can't
> > > > actually
> > > > > query anything, as all the queries time out.
> > > > >
> > > > > I'm unsure what to troubleshoot since I'm not really finding any
> > > > > documentation on how to properly set up Drill with mapr security.
> > > > >
> > > > > Any pointers?
> > > > >
> > > >
> > > >
> > > >
> > > > --
> > > >
> > > > *M. Engin Sözer*
> > > > Junior Datawarehouse Manager
> > > > mesoezer@goodgamestudios.com <javascript:;>
> > > >
> > > > Goodgame Studios
> > > > Theodorstr. 42-90, House 9
> > > > 22761 Hamburg, Germany
> > > > Phone: +49 (0)40 219 880 -0
> > > > *www.goodgamestudios.com <http://www.goodgamestudios.com>*
> > > >
> > > > Goodgame Studios is a branch of Altigi GmbH
> > > > Altigi GmbH, District court Hamburg, HRB 99869
> > > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek,
> Fabian
> > > > Ritter
> > > >
> > >
> >
>

Re: drill 1.0.0 and hive 0.13 with mapr security

Posted by Vince Gonzalez <vi...@gmail.com>.
That's great! Thanks. Presumably I could pull down a nightly and try it
out? Will drill still be expecting hive .13?

On Tuesday, June 30, 2015, Jason Altekruse <al...@gmail.com> wrote:

> Venki can give more specifics on the status, but Hive impersonation was
> implemented in 1.1.0, which should be going out for a vote soon. I think
> there might have been some limitations on the scope, but I know we have
> verified the functionality with several security models.
>
> On Tue, Jun 30, 2015 at 9:11 AM, Vince Gonzalez <vince.gonzalez@gmail.com
> <javascript:;>>
> wrote:
>
> > I'm not sure how I missed that. Thanks for pointing it out.
> >
> > On Tue, Jun 30, 2015 at 12:05 PM, Mustafa Engin Sözer <
> > mesoezer@goodgamestudios.com <javascript:;>> wrote:
> >
> > > Hi,
> > >
> > > As far as I know, impersonation is not supported for Hive just yet.
> > > (according to current documentation
> > > https://drill.apache.org/docs/configuring-user-impersonation)
> > >
> > > On 30 June 2015 at 14:20, Vince Gonzalez <vince.gonzalez@gmail.com
> <javascript:;>>
> > wrote:
> > >
> > > > I have a 3 node MapR 4.1 cluster in secure mode, and I've enabled
> > > > impersonation on both Drill and Hive. I've confirmed that Drill and
> > Hive
> > > > work independently of each other - I can create and query tables in
> > hive,
> > > > and I can query workspaces in Drill.
> > > >
> > > > When I enable the hive workspace, Drill won't allow me to set
> > > > hive.metastore.sasl.enabled to true. While I'm able to switch to the
> > hive
> > > > workspace with 'use hive', it takes tens of seconds. I also can't
> > > actually
> > > > query anything, as all the queries time out.
> > > >
> > > > I'm unsure what to troubleshoot since I'm not really finding any
> > > > documentation on how to properly set up Drill with mapr security.
> > > >
> > > > Any pointers?
> > > >
> > >
> > >
> > >
> > > --
> > >
> > > *M. Engin Sözer*
> > > Junior Datawarehouse Manager
> > > mesoezer@goodgamestudios.com <javascript:;>
> > >
> > > Goodgame Studios
> > > Theodorstr. 42-90, House 9
> > > 22761 Hamburg, Germany
> > > Phone: +49 (0)40 219 880 -0
> > > *www.goodgamestudios.com <http://www.goodgamestudios.com>*
> > >
> > > Goodgame Studios is a branch of Altigi GmbH
> > > Altigi GmbH, District court Hamburg, HRB 99869
> > > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian
> > > Ritter
> > >
> >
>

Re: drill 1.0.0 and hive 0.13 with mapr security

Posted by Jason Altekruse <al...@gmail.com>.
Venki can give more specifics on the status, but Hive impersonation was
implemented in 1.1.0, which should be going out for a vote soon. I think
there might have been some limitations on the scope, but I know we have
verified the functionality with several security models.

On Tue, Jun 30, 2015 at 9:11 AM, Vince Gonzalez <vi...@gmail.com>
wrote:

> I'm not sure how I missed that. Thanks for pointing it out.
>
> On Tue, Jun 30, 2015 at 12:05 PM, Mustafa Engin Sözer <
> mesoezer@goodgamestudios.com> wrote:
>
> > Hi,
> >
> > As far as I know, impersonation is not supported for Hive just yet.
> > (according to current documentation
> > https://drill.apache.org/docs/configuring-user-impersonation)
> >
> > On 30 June 2015 at 14:20, Vince Gonzalez <vi...@gmail.com>
> wrote:
> >
> > > I have a 3 node MapR 4.1 cluster in secure mode, and I've enabled
> > > impersonation on both Drill and Hive. I've confirmed that Drill and
> Hive
> > > work independently of each other - I can create and query tables in
> hive,
> > > and I can query workspaces in Drill.
> > >
> > > When I enable the hive workspace, Drill won't allow me to set
> > > hive.metastore.sasl.enabled to true. While I'm able to switch to the
> hive
> > > workspace with 'use hive', it takes tens of seconds. I also can't
> > actually
> > > query anything, as all the queries time out.
> > >
> > > I'm unsure what to troubleshoot since I'm not really finding any
> > > documentation on how to properly set up Drill with mapr security.
> > >
> > > Any pointers?
> > >
> >
> >
> >
> > --
> >
> > *M. Engin Sözer*
> > Junior Datawarehouse Manager
> > mesoezer@goodgamestudios.com
> >
> > Goodgame Studios
> > Theodorstr. 42-90, House 9
> > 22761 Hamburg, Germany
> > Phone: +49 (0)40 219 880 -0
> > *www.goodgamestudios.com <http://www.goodgamestudios.com>*
> >
> > Goodgame Studios is a branch of Altigi GmbH
> > Altigi GmbH, District court Hamburg, HRB 99869
> > Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian
> > Ritter
> >
>

Re: drill 1.0.0 and hive 0.13 with mapr security

Posted by Vince Gonzalez <vi...@gmail.com>.
I'm not sure how I missed that. Thanks for pointing it out.

On Tue, Jun 30, 2015 at 12:05 PM, Mustafa Engin Sözer <
mesoezer@goodgamestudios.com> wrote:

> Hi,
>
> As far as I know, impersonation is not supported for Hive just yet.
> (according to current documentation
> https://drill.apache.org/docs/configuring-user-impersonation)
>
> On 30 June 2015 at 14:20, Vince Gonzalez <vi...@gmail.com> wrote:
>
> > I have a 3 node MapR 4.1 cluster in secure mode, and I've enabled
> > impersonation on both Drill and Hive. I've confirmed that Drill and Hive
> > work independently of each other - I can create and query tables in hive,
> > and I can query workspaces in Drill.
> >
> > When I enable the hive workspace, Drill won't allow me to set
> > hive.metastore.sasl.enabled to true. While I'm able to switch to the hive
> > workspace with 'use hive', it takes tens of seconds. I also can't
> actually
> > query anything, as all the queries time out.
> >
> > I'm unsure what to troubleshoot since I'm not really finding any
> > documentation on how to properly set up Drill with mapr security.
> >
> > Any pointers?
> >
>
>
>
> --
>
> *M. Engin Sözer*
> Junior Datawarehouse Manager
> mesoezer@goodgamestudios.com
>
> Goodgame Studios
> Theodorstr. 42-90, House 9
> 22761 Hamburg, Germany
> Phone: +49 (0)40 219 880 -0
> *www.goodgamestudios.com <http://www.goodgamestudios.com>*
>
> Goodgame Studios is a branch of Altigi GmbH
> Altigi GmbH, District court Hamburg, HRB 99869
> Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian
> Ritter
>

Re: drill 1.0.0 and hive 0.13 with mapr security

Posted by Mustafa Engin Sözer <me...@goodgamestudios.com>.
Hi,

As far as I know, impersonation is not supported for Hive just yet.
(according to current documentation
https://drill.apache.org/docs/configuring-user-impersonation)

On 30 June 2015 at 14:20, Vince Gonzalez <vi...@gmail.com> wrote:

> I have a 3 node MapR 4.1 cluster in secure mode, and I've enabled
> impersonation on both Drill and Hive. I've confirmed that Drill and Hive
> work independently of each other - I can create and query tables in hive,
> and I can query workspaces in Drill.
>
> When I enable the hive workspace, Drill won't allow me to set
> hive.metastore.sasl.enabled to true. While I'm able to switch to the hive
> workspace with 'use hive', it takes tens of seconds. I also can't actually
> query anything, as all the queries time out.
>
> I'm unsure what to troubleshoot since I'm not really finding any
> documentation on how to properly set up Drill with mapr security.
>
> Any pointers?
>



-- 

*M. Engin Sözer*
Junior Datawarehouse Manager
mesoezer@goodgamestudios.com

Goodgame Studios
Theodorstr. 42-90, House 9
22761 Hamburg, Germany
Phone: +49 (0)40 219 880 -0
*www.goodgamestudios.com <http://www.goodgamestudios.com>*

Goodgame Studios is a branch of Altigi GmbH
Altigi GmbH, District court Hamburg, HRB 99869
Board of directors: Dr. Kai Wawrzinek, Dr. Christian Wawrzinek, Fabian
Ritter