You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ranger.apache.org by Lune Silver <lu...@gmail.com> on 2015/11/22 09:51:41 UTC

Fwd: Question regarding postgresql pre-requisite

Hello everyone.

I sent this mail regarding to the postgresql pre-requisites in the
documentation.
Here is the concerned part :
RDBMS

MySQL 5.7+

Oracle - latest

Postgres - latest

SQL Server - latest

   1. Storing policies
   2. Storing Ranger Users and Groups
   3. Storing Audit Logs (Optional)


My questions are the following :

Q1 - I don't have the latest postgresql version on the server hosting the
postgresql server and database. I have postgresql 9.3.5. Will I encounter
problem ?

Q2 - The postgresql database will be hosted on another host than the one
hosting ranger components. I read this is possible from Ranger 0.5.0.
Mayyou just confirm this please ?

Best regards.

Lune

Re: Question regarding postgresql pre-requisite

Posted by Velmurugan Periasamy <vp...@hortonworks.com>.
Lune - postgres 9.3.5 should work fine.

From: Lune Silver <lu...@gmail.com>>
Reply-To: "user@ranger.incubator.apache.org<ma...@ranger.incubator.apache.org>" <us...@ranger.incubator.apache.org>>
Date: Monday, November 23, 2015 at 1:00 PM
To: "user@ranger.incubator.apache.org<ma...@ranger.incubator.apache.org>" <us...@ranger.incubator.apache.org>>
Subject: Re: Question regarding postgresql pre-requisite


Hello.

Indeed I wanted to use postgresql because I am already using postgresql for other components like hive, oozie and ambari.

I prefer to have not too many technologies in my cluster. I plan on using postgresql 9.3.5 because this is already the version I am using.

For auditing, is it ok to store the data in the hdfs on the audited cluster ?

Best regards.

Lune

Le 23 nov. 2015 18:54, "Don Bosco Durai" <bo...@apache.org>> a écrit :
>I sent this mail regarding to the postgresql pre-requisites in the documentation.
Which database are you planing to use? If it is MySQL or others, then you don't need postgresql. Probably Ranger team needs to update the document to make sure users don't assume that postgres is pre-requisite.

If you are starting fresh and don't have any specific preference for database, then I would suggest to use MySQL. It is easy to start and widely used in the Ranger community. Saying, I don't think Postgress shouldn't be an issue. But I have not used it. So someone else will have to answer your questions regarding versions supported.

For storing auditing, I would strongly recommend Solr and HDFS. HDFS for long term archival and Solr real-time querying.

Thanks

Bosco


From: Lune Silver <lu...@gmail.com>>
Reply-To: <us...@ranger.incubator.apache.org>>
Date: Sunday, November 22, 2015 at 12:51 AM
To: <us...@ranger.incubator.apache.org>>
Subject: Fwd: Question regarding postgresql pre-requisite

Hello everyone.

I sent this mail regarding to the postgresql pre-requisites in the documentation.
Here is the concerned part :
RDBMS

MySQL 5.7+

Oracle - latest

Postgres - latest

SQL Server - latest

  1.  Storing policies
  2.  Storing Ranger Users and Groups
  3.  Storing Audit Logs (Optional)

My questions are the following :

Q1 - I don't have the latest postgresql version on the server hosting the postgresql server and database. I have postgresql 9.3.5. Will I encounter problem ?

Q2 - The postgresql database will be hosted on another host than the one hosting ranger components. I read this is possible from Ranger 0.5.0. Mayyou just confirm this please ?

Best regards.

Lune

Re: Question regarding postgresql pre-requisite

Posted by Don Bosco Durai <bo...@apache.org>.
Postgres should work. I am not sure whether we are sensitive to any versions.

Regarding audits, it depends what your requirements are. If you have compliance requirement or want to do analysis in the future, then storing in HDFS is advisable. 

You can see audits in Ranger Admin UI also. For that, you need to send to either Solr or RDBMS. If your system is high volume, then I would recommend Solr. Also with Solr, you could hook up Banana and other external tools to write customized views and charts. 

Ranger supports sending audits to multiple destinations. So you could send Audits to both HDFS and Solr at the same time.

Thanks

Bloc


From:  Lune Silver <lu...@gmail.com>
Reply-To:  <us...@ranger.incubator.apache.org>
Date:  Monday, November 23, 2015 at 10:00 AM
To:  <us...@ranger.incubator.apache.org>
Subject:  Re: Question regarding postgresql pre-requisite


Hello. 

Indeed I wanted to use postgresql because I am already using postgresql for other components like hive, oozie and ambari. 

I prefer to have not too many technologies in my cluster. I plan on using postgresql 9.3.5 because this is already the version I am using.

For auditing, is it ok to store the data in the hdfs on the audited cluster ?

Best regards.

Lune

Le 23 nov. 2015 18:54, "Don Bosco Durai" <bo...@apache.org> a écrit :
>I sent this mail regarding to the postgresql pre-requisites in the documentation.
Which database are you planing to use? If it is MySQL or others, then you don’t need postgresql. Probably Ranger team needs to update the document to make sure users don’t assume that postgres is pre-requisite.

If you are starting fresh and don’t have any specific preference for database, then I would suggest to use MySQL. It is easy to start and widely used in the Ranger community. Saying, I don’t think Postgress shouldn’t be an issue. But I have not used it. So someone else will have to answer your questions regarding versions supported.

For storing auditing, I would strongly recommend Solr and HDFS. HDFS for long term archival and Solr real-time querying.

Thanks

Bosco


From:  Lune Silver <lu...@gmail.com>
Reply-To:  <us...@ranger.incubator.apache.org>
Date:  Sunday, November 22, 2015 at 12:51 AM
To:  <us...@ranger.incubator.apache.org>
Subject:  Fwd: Question regarding postgresql pre-requisite

Hello everyone.

I sent this mail regarding to the postgresql pre-requisites in the documentation.
Here is the concerned part :
RDBMS

MySQL 5.7+

Oracle - latest

Postgres - latest

SQL Server - latest
Storing policies
Storing Ranger Users and Groups
Storing Audit Logs (Optional)
My questions are the following :

Q1 - I don't have the latest postgresql version on the server hosting the postgresql server and database. I have postgresql 9.3.5. Will I encounter problem ?

Q2 - The postgresql database will be hosted on another host than the one hosting ranger components. I read this is possible from Ranger 0.5.0. Mayyou just confirm this please ?

Best regards.

Lune

Re: Question regarding postgresql pre-requisite

Posted by Lune Silver <lu...@gmail.com>.
Hello.

Indeed I wanted to use postgresql because I am already using postgresql for
other components like hive, oozie and ambari.

I prefer to have not too many technologies in my cluster. I plan on using
postgresql 9.3.5 because this is already the version I am using.

For auditing, is it ok to store the data in the hdfs on the audited cluster
?

Best regards.

Lune
Le 23 nov. 2015 18:54, "Don Bosco Durai" <bo...@apache.org> a écrit :

> >I sent this mail regarding to the postgresql pre-requisites in the
> documentation.
> Which database are you planing to use? If it is MySQL or others, then you
> don’t need postgresql. Probably Ranger team needs to update the document to
> make sure users don’t assume that postgres is pre-requisite.
>
> If you are starting fresh and don’t have any specific preference for
> database, then I would suggest to use MySQL. It is easy to start and widely
> used in the Ranger community. Saying, I don’t think Postgress shouldn’t be
> an issue. But I have not used it. So someone else will have to answer your
> questions regarding versions supported.
>
> For storing auditing, I would strongly recommend Solr and HDFS. HDFS for
> long term archival and Solr real-time querying.
>
> Thanks
>
> Bosco
>
>
> From: Lune Silver <lu...@gmail.com>
> Reply-To: <us...@ranger.incubator.apache.org>
> Date: Sunday, November 22, 2015 at 12:51 AM
> To: <us...@ranger.incubator.apache.org>
> Subject: Fwd: Question regarding postgresql pre-requisite
>
> Hello everyone.
>
> I sent this mail regarding to the postgresql pre-requisites in the
> documentation.
> Here is the concerned part :
> RDBMS
>
> MySQL 5.7+
>
> Oracle - latest
>
> Postgres - latest
>
> SQL Server - latest
>
>    1. Storing policies
>    2. Storing Ranger Users and Groups
>    3. Storing Audit Logs (Optional)
>
>
> My questions are the following :
>
> Q1 - I don't have the latest postgresql version on the server hosting the
> postgresql server and database. I have postgresql 9.3.5. Will I encounter
> problem ?
>
> Q2 - The postgresql database will be hosted on another host than the one
> hosting ranger components. I read this is possible from Ranger 0.5.0.
> Mayyou just confirm this please ?
>
> Best regards.
>
> Lune
>
>

Re: Question regarding postgresql pre-requisite

Posted by Don Bosco Durai <bo...@apache.org>.
>I sent this mail regarding to the postgresql pre-requisites in the documentation.
Which database are you planing to use? If it is MySQL or others, then you don’t need postgresql. Probably Ranger team needs to update the document to make sure users don’t assume that postgres is pre-requisite.

If you are starting fresh and don’t have any specific preference for database, then I would suggest to use MySQL. It is easy to start and widely used in the Ranger community. Saying, I don’t think Postgress shouldn’t be an issue. But I have not used it. So someone else will have to answer your questions regarding versions supported.

For storing auditing, I would strongly recommend Solr and HDFS. HDFS for long term archival and Solr real-time querying.

Thanks

Bosco


From:  Lune Silver <lu...@gmail.com>
Reply-To:  <us...@ranger.incubator.apache.org>
Date:  Sunday, November 22, 2015 at 12:51 AM
To:  <us...@ranger.incubator.apache.org>
Subject:  Fwd: Question regarding postgresql pre-requisite

Hello everyone.

I sent this mail regarding to the postgresql pre-requisites in the documentation.
Here is the concerned part :
RDBMS

MySQL 5.7+

Oracle - latest

Postgres - latest

SQL Server - latest
Storing policies
Storing Ranger Users and Groups
Storing Audit Logs (Optional)
My questions are the following :

Q1 - I don't have the latest postgresql version on the server hosting the postgresql server and database. I have postgresql 9.3.5. Will I encounter problem ?

Q2 - The postgresql database will be hosted on another host than the one hosting ranger components. I read this is possible from Ranger 0.5.0. Mayyou just confirm this please ?

Best regards.

Lune