You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ranger.apache.org by arun kumar <pm...@hotmail.com> on 2017/08/03 16:01:06 UTC
Need configuration Documentation for Ranger 7.1 and mysql
Hi All
I am new to Apache Ranger and I am doing a POC on integrating Ranger with Kafka. I am unable to find a complete set of documentation on how to install and configure Ranger 0.7.1. Also I am planning to use mysql 5.6 community edition for which I require configuration documentation. Any insight on this is highly appriciated.
Thanks in Advance
Regards
Arunkumar Pichaimuthu
Re: Need configuration Documentation for Ranger 7.1 and mysql
Posted by arun kumar <pm...@hotmail.com>.
Thank you Colm
I appreciate your effort.
Thanks
Arunkumar
________________________________
From: Colm O hEigeartaigh <co...@apache.org>
Sent: Thursday, August 3, 2017 12:33 PM
To: user@ranger.apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Here is a blog post I wrote on getting Ranger to work with Kafka - also there is a link in it to another article on how to install the Ranger Admin service with mysql.
http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html
Open Source Security: Securing an Apache Kafka broker ...<http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html>
coheigea.blogspot.ie
This is the third in a series of blog posts about securing Apache Kafka. The first post looked at how to secure messages and authenticate clients using SSL.
Colm.
On Thu, Aug 3, 2017 at 5:01 PM, arun kumar <pm...@hotmail.com>> wrote:
Hi All
I am new to Apache Ranger and I am doing a POC on integrating Ranger with Kafka. I am unable to find a complete set of documentation on how to install and configure Ranger 0.7.1. Also I am planning to use mysql 5.6 community edition for which I require configuration documentation. Any insight on this is highly appriciated.
Thanks in Advance
Regards
Arunkumar Pichaimuthu
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Need configuration Documentation for Ranger 7.1 and mysql
Posted by Sailaja Polavarapu <sp...@hortonworks.com>.
You can also take a look at the article below for more information -
https://community.hortonworks.com/content/kbentry/105620/configuring-ranger-usersync-with-adldap-for-a-comm.html
From: Sailaja Polavarapu <sp...@hortonworks.com>
Reply-To: "user@ranger.apache.org" <us...@ranger.apache.org>
Date: Thursday, August 17, 2017 at 2:25 PM
To: "user@ranger.apache.org" <us...@ranger.apache.org>, "coheigea@apache.org" <co...@apache.org>
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Hi Arun,
Ldap tool is mainly used to help configure various parameters for usersync. Currently it doesn’t have support for ldaps. I see that you already know the url, binddn, usersearch base, and user search filter, you can configure these properties in usersync. Are you using Ambari? Or is it manual install? You can provide usersync logs in case of any errors with user or group sync.
-Sailaja.
From: arun kumar <pm...@hotmail.com>
Reply-To: "user@ranger.apache.org" <us...@ranger.apache.org>
Date: Thursday, August 17, 2017 at 1:49 PM
To: "user@ranger.apache.org" <us...@ranger.apache.org>, "coheigea@apache.org" <co...@apache.org>
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Hi All/Coheigea
I am able to install ranger admin and ranger-kafka plugin successfully. I am trying to get usersync service to work with LDAP and I am not able to make it . Any insight is highly appreciated.
When I try to run ldap tool run.sh I am seeing an error on log file.
ERROR: Failed to initialize the user sync properties java.lang.StringIndexOutOfBoundsException: String index out of range: -1
My configuration parameters are:
ranger.usersync.ldap.url = ldaps://xxxxxxxxxxxx:636
ranger.usersync.ldap.binddn =cn=xxxxx_admin,ou=xxxxxx,o=xxxxxxxxxxxx
ranger.usersync.ldap.bindpassword =
#ranger.usersync.ldap.user.searchbase ou=xxxxxxxxxxxx,ou=xxxxxxxx,o=xxxxxxxx
#ranger.usersync.ldap.user.searchfilter = (&(cn=xxxxxxxxxxxx)(objectclass=person))
ranger.admin.auth.sampleuser = cn=xxxxxxxxxx,ou=xxxxxxxxx,ou=xxxxxxxxx,o=xxxxxxxx
ranger.admin.auth.samplepassword =
Thanks in advance
Regards
Arunkumar
________________________________
From: Colm O hEigeartaigh <co...@apache.org>
Sent: Thursday, August 3, 2017 12:33 PM
To: user@ranger.apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Here is a blog post I wrote on getting Ranger to work with Kafka - also there is a link in it to another article on how to install the Ranger Admin service with mysql.
http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html
Open Source Security: Securing an Apache Kafka broker ...<http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html>
coheigea.blogspot.ie
This is the third in a series of blog posts about securing Apache Kafka. The first post looked at how to secure messages and authenticate clients using SSL.
Colm.
On Thu, Aug 3, 2017 at 5:01 PM, arun kumar <pm...@hotmail.com>> wrote:
Hi All
I am new to Apache Ranger and I am doing a POC on integrating Ranger with Kafka. I am unable to find a complete set of documentation on how to install and configure Ranger 0.7.1. Also I am planning to use mysql 5.6 community edition for which I require configuration documentation. Any insight on this is highly appriciated.
Thanks in Advance
Regards
Arunkumar Pichaimuthu
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Need configuration Documentation for Ranger 7.1 and mysql
Posted by arun kumar <pm...@hotmail.com>.
Also I would like to know if we have to have SSL certificates created for all the Clients connecting to Kafka nodes.
Thanks in advance
Arunkumar
________________________________
From: arun kumar <pm...@hotmail.com>
Sent: Thursday, August 17, 2017 5:54 PM
To: user@ranger.apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Hi Sailaja
Thank you for quick response. I am doing manual installation. Unfortunately I am not able to find the logs for usersync service. Also I have few more questions
1. Can we use Ranger for Authentication i.e if I create a user with the user and passcode on the admin screen and pass it on to the producer or consumer and when they connect to kafka node they will pass the credentials which can be authenticated and served based on successful login?
2. Also if you could let me know where to find the logs I can send it.
Thanks
Arunkumar
________________________________
From: Sailaja Polavarapu <sp...@hortonworks.com>
Sent: Thursday, August 17, 2017 5:25 PM
To: user@ranger.apache.org; coheigea@apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Hi Arun,
Ldap tool is mainly used to help configure various parameters for usersync. Currently it doesn’t have support for ldaps. I see that you already know the url, binddn, usersearch base, and user search filter, you can configure these properties in usersync. Are you using Ambari? Or is it manual install? You can provide usersync logs in case of any errors with user or group sync.
-Sailaja.
From: arun kumar <pm...@hotmail.com>
Reply-To: "user@ranger.apache.org" <us...@ranger.apache.org>
Date: Thursday, August 17, 2017 at 1:49 PM
To: "user@ranger.apache.org" <us...@ranger.apache.org>, "coheigea@apache.org" <co...@apache.org>
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Hi All/Coheigea
I am able to install ranger admin and ranger-kafka plugin successfully. I am trying to get usersync service to work with LDAP and I am not able to make it . Any insight is highly appreciated.
When I try to run ldap tool run.sh I am seeing an error on log file.
ERROR: Failed to initialize the user sync properties java.lang.StringIndexOutOfBoundsException: String index out of range: -1
My configuration parameters are:
ranger.usersync.ldap.url = ldaps://xxxxxxxxxxxx:636
ranger.usersync.ldap.binddn =cn=xxxxx_admin,ou=xxxxxx,o=xxxxxxxxxxxx
ranger.usersync.ldap.bindpassword =
#ranger.usersync.ldap.user.searchbase ou=xxxxxxxxxxxx,ou=xxxxxxxx,o=xxxxxxxx
#ranger.usersync.ldap.user.searchfilter = (&(cn=xxxxxxxxxxxx)(objectclass=person))
ranger.admin.auth.sampleuser = cn=xxxxxxxxxx,ou=xxxxxxxxx,ou=xxxxxxxxx,o=xxxxxxxx
ranger.admin.auth.samplepassword =
Thanks in advance
Regards
Arunkumar
________________________________
From: Colm O hEigeartaigh <co...@apache.org>
Sent: Thursday, August 3, 2017 12:33 PM
To: user@ranger.apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Here is a blog post I wrote on getting Ranger to work with Kafka - also there is a link in it to another article on how to install the Ranger Admin service with mysql.
http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html
Open Source Security: Securing an Apache Kafka broker ...<http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html>
coheigea.blogspot.ie
This is the third in a series of blog posts about securing Apache Kafka. The first post looked at how to secure messages and authenticate clients using SSL.
Open Source Security: Securing an Apache Kafka broker ...<http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html>
coheigea.blogspot.ie
This is the third in a series of blog posts about securing Apache Kafka. The first post looked at how to secure messages and authenticate clients using SSL.
Colm.
On Thu, Aug 3, 2017 at 5:01 PM, arun kumar <pm...@hotmail.com>> wrote:
Hi All
I am new to Apache Ranger and I am doing a POC on integrating Ranger with Kafka. I am unable to find a complete set of documentation on how to install and configure Ranger 0.7.1. Also I am planning to use mysql 5.6 community edition for which I require configuration documentation. Any insight on this is highly appriciated.
Thanks in Advance
Regards
Arunkumar Pichaimuthu
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Need configuration Documentation for Ranger 7.1 and mysql
Posted by arun kumar <pm...@hotmail.com>.
Hi Sailaja
Thank you for quick response. I am doing manual installation. Unfortunately I am not able to find the logs for usersync service. Also I have few more questions
1. Can we use Ranger for Authentication i.e if I create a user with the user and passcode on the admin screen and pass it on to the producer or consumer and when they connect to kafka node they will pass the credentials which can be authenticated and served based on successful login?
2. Also if you could let me know where to find the logs I can send it.
Thanks
Arunkumar
________________________________
From: Sailaja Polavarapu <sp...@hortonworks.com>
Sent: Thursday, August 17, 2017 5:25 PM
To: user@ranger.apache.org; coheigea@apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Hi Arun,
Ldap tool is mainly used to help configure various parameters for usersync. Currently it doesn’t have support for ldaps. I see that you already know the url, binddn, usersearch base, and user search filter, you can configure these properties in usersync. Are you using Ambari? Or is it manual install? You can provide usersync logs in case of any errors with user or group sync.
-Sailaja.
From: arun kumar <pm...@hotmail.com>
Reply-To: "user@ranger.apache.org" <us...@ranger.apache.org>
Date: Thursday, August 17, 2017 at 1:49 PM
To: "user@ranger.apache.org" <us...@ranger.apache.org>, "coheigea@apache.org" <co...@apache.org>
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Hi All/Coheigea
I am able to install ranger admin and ranger-kafka plugin successfully. I am trying to get usersync service to work with LDAP and I am not able to make it . Any insight is highly appreciated.
When I try to run ldap tool run.sh I am seeing an error on log file.
ERROR: Failed to initialize the user sync properties java.lang.StringIndexOutOfBoundsException: String index out of range: -1
My configuration parameters are:
ranger.usersync.ldap.url = ldaps://xxxxxxxxxxxx:636
ranger.usersync.ldap.binddn =cn=xxxxx_admin,ou=xxxxxx,o=xxxxxxxxxxxx
ranger.usersync.ldap.bindpassword =
#ranger.usersync.ldap.user.searchbase ou=xxxxxxxxxxxx,ou=xxxxxxxx,o=xxxxxxxx
#ranger.usersync.ldap.user.searchfilter = (&(cn=xxxxxxxxxxxx)(objectclass=person))
ranger.admin.auth.sampleuser = cn=xxxxxxxxxx,ou=xxxxxxxxx,ou=xxxxxxxxx,o=xxxxxxxx
ranger.admin.auth.samplepassword =
Thanks in advance
Regards
Arunkumar
________________________________
From: Colm O hEigeartaigh <co...@apache.org>
Sent: Thursday, August 3, 2017 12:33 PM
To: user@ranger.apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Here is a blog post I wrote on getting Ranger to work with Kafka - also there is a link in it to another article on how to install the Ranger Admin service with mysql.
http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html
Open Source Security: Securing an Apache Kafka broker ...<http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html>
coheigea.blogspot.ie
This is the third in a series of blog posts about securing Apache Kafka. The first post looked at how to secure messages and authenticate clients using SSL.
Open Source Security: Securing an Apache Kafka broker ...<http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html>
coheigea.blogspot.ie
This is the third in a series of blog posts about securing Apache Kafka. The first post looked at how to secure messages and authenticate clients using SSL.
Colm.
On Thu, Aug 3, 2017 at 5:01 PM, arun kumar <pm...@hotmail.com>> wrote:
Hi All
I am new to Apache Ranger and I am doing a POC on integrating Ranger with Kafka. I am unable to find a complete set of documentation on how to install and configure Ranger 0.7.1. Also I am planning to use mysql 5.6 community edition for which I require configuration documentation. Any insight on this is highly appriciated.
Thanks in Advance
Regards
Arunkumar Pichaimuthu
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Need configuration Documentation for Ranger 7.1 and mysql
Posted by Sailaja Polavarapu <sp...@hortonworks.com>.
Hi Arun,
Ldap tool is mainly used to help configure various parameters for usersync. Currently it doesn’t have support for ldaps. I see that you already know the url, binddn, usersearch base, and user search filter, you can configure these properties in usersync. Are you using Ambari? Or is it manual install? You can provide usersync logs in case of any errors with user or group sync.
-Sailaja.
From: arun kumar <pm...@hotmail.com>
Reply-To: "user@ranger.apache.org" <us...@ranger.apache.org>
Date: Thursday, August 17, 2017 at 1:49 PM
To: "user@ranger.apache.org" <us...@ranger.apache.org>, "coheigea@apache.org" <co...@apache.org>
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Hi All/Coheigea
I am able to install ranger admin and ranger-kafka plugin successfully. I am trying to get usersync service to work with LDAP and I am not able to make it . Any insight is highly appreciated.
When I try to run ldap tool run.sh I am seeing an error on log file.
ERROR: Failed to initialize the user sync properties java.lang.StringIndexOutOfBoundsException: String index out of range: -1
My configuration parameters are:
ranger.usersync.ldap.url = ldaps://xxxxxxxxxxxx:636
ranger.usersync.ldap.binddn =cn=xxxxx_admin,ou=xxxxxx,o=xxxxxxxxxxxx
ranger.usersync.ldap.bindpassword =
#ranger.usersync.ldap.user.searchbase ou=xxxxxxxxxxxx,ou=xxxxxxxx,o=xxxxxxxx
#ranger.usersync.ldap.user.searchfilter = (&(cn=xxxxxxxxxxxx)(objectclass=person))
ranger.admin.auth.sampleuser = cn=xxxxxxxxxx,ou=xxxxxxxxx,ou=xxxxxxxxx,o=xxxxxxxx
ranger.admin.auth.samplepassword =
Thanks in advance
Regards
Arunkumar
________________________________
From: Colm O hEigeartaigh <co...@apache.org>
Sent: Thursday, August 3, 2017 12:33 PM
To: user@ranger.apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Here is a blog post I wrote on getting Ranger to work with Kafka - also there is a link in it to another article on how to install the Ranger Admin service with mysql.
http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html
Open Source Security: Securing an Apache Kafka broker ...<http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html>
coheigea.blogspot.ie
This is the third in a series of blog posts about securing Apache Kafka. The first post looked at how to secure messages and authenticate clients using SSL.
Colm.
On Thu, Aug 3, 2017 at 5:01 PM, arun kumar <pm...@hotmail.com>> wrote:
Hi All
I am new to Apache Ranger and I am doing a POC on integrating Ranger with Kafka. I am unable to find a complete set of documentation on how to install and configure Ranger 0.7.1. Also I am planning to use mysql 5.6 community edition for which I require configuration documentation. Any insight on this is highly appriciated.
Thanks in Advance
Regards
Arunkumar Pichaimuthu
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Need configuration Documentation for Ranger 7.1 and mysql
Posted by arun kumar <pm...@hotmail.com>.
Hi All/Coheigea
I am able to install ranger admin and ranger-kafka plugin successfully. I am trying to get usersync service to work with LDAP and I am not able to make it . Any insight is highly appreciated.
When I try to run ldap tool run.sh I am seeing an error on log file.
ERROR: Failed to initialize the user sync properties java.lang.StringIndexOutOfBoundsException: String index out of range: -1
My configuration parameters are:
ranger.usersync.ldap.url = ldaps://xxxxxxxxxxxx:636
ranger.usersync.ldap.binddn =cn=xxxxx_admin,ou=xxxxxx,o=xxxxxxxxxxxx
ranger.usersync.ldap.bindpassword =
#ranger.usersync.ldap.user.searchbase ou=xxxxxxxxxxxx,ou=xxxxxxxx,o=xxxxxxxx
#ranger.usersync.ldap.user.searchfilter = (&(cn=xxxxxxxxxxxx)(objectclass=person))
ranger.admin.auth.sampleuser = cn=xxxxxxxxxx,ou=xxxxxxxxx,ou=xxxxxxxxx,o=xxxxxxxx
ranger.admin.auth.samplepassword =
Thanks in advance
Regards
Arunkumar
________________________________
From: Colm O hEigeartaigh <co...@apache.org>
Sent: Thursday, August 3, 2017 12:33 PM
To: user@ranger.apache.org
Subject: Re: Need configuration Documentation for Ranger 7.1 and mysql
Here is a blog post I wrote on getting Ranger to work with Kafka - also there is a link in it to another article on how to install the Ranger Admin service with mysql.
http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html
Open Source Security: Securing an Apache Kafka broker ...<http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html>
coheigea.blogspot.ie
This is the third in a series of blog posts about securing Apache Kafka. The first post looked at how to secure messages and authenticate clients using SSL.
Colm.
On Thu, Aug 3, 2017 at 5:01 PM, arun kumar <pm...@hotmail.com>> wrote:
Hi All
I am new to Apache Ranger and I am doing a POC on integrating Ranger with Kafka. I am unable to find a complete set of documentation on how to install and configure Ranger 0.7.1. Also I am planning to use mysql 5.6 community edition for which I require configuration documentation. Any insight on this is highly appriciated.
Thanks in Advance
Regards
Arunkumar Pichaimuthu
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com
Re: Need configuration Documentation for Ranger 7.1 and mysql
Posted by Colm O hEigeartaigh <co...@apache.org>.
Here is a blog post I wrote on getting Ranger to work with Kafka - also
there is a link in it to another article on how to install the Ranger Admin
service with mysql.
http://coheigea.blogspot.ie/2016/09/securing-apache-kafka-broker-part-iii.html
Colm.
On Thu, Aug 3, 2017 at 5:01 PM, arun kumar <pm...@hotmail.com> wrote:
> Hi All
>
>
> I am new to Apache Ranger and I am doing a POC on integrating Ranger with
> Kafka. I am unable to find a complete set of documentation on how to
> install and configure Ranger 0.7.1. Also I am planning to use mysql 5.6
> community edition for which I require configuration documentation. Any
> insight on this is highly appriciated.
>
>
> Thanks in Advance
>
>
> Regards
>
> Arunkumar Pichaimuthu
>
>
--
Colm O hEigeartaigh
Talend Community Coder
http://coders.talend.com