You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ranger.apache.org by Gautam Borad <gb...@gmail.com> on 2015/02/07 13:13:53 UTC

Review Request 30760: RANGER-239: Support JDBC based SQL invocation for setup process

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30760/
-----------------------------------------------------------

Review request for ranger, Don Bosco Durai, Madhan Neethiraj, Ramesh Mani, Selvamohan Neethiraj, and Velmurugan Periasamy.


Bugs: RANGER-239
    https://issues.apache.org/jira/browse/RANGER-239


Repository: ranger


Description
-------

Currently Ranger setup executes SQL scripts via SQL command line tools to create DB schema.
Since it is not guaranteed to have SQL command line clients available on the host this becomes a prerequisite.
This can be addressed by a tool that can execute SQL scripts via JDBC (currenly supports Mysql)


Diffs
-----

  security-admin/db/create_dbversion_catalog.sql 9c90633 
  security-admin/db/create_dev_user.sh a59e264 
  security-admin/db/create_dev_user.sql bf475d0 
  security-admin/db/init/backup_mysql_db.sh ef66140 
  security-admin/db/init/create_dev_backup_mysql.sh db2e2a7 
  security-admin/db/init/create_dev_backup_mysql_loaded.sh c1905b6 
  security-admin/db/init/create_xa_core_db.sh 3c9483f 
  security-admin/db/init/mysql_seed_data.sql 8f992b1 
  security-admin/db/init/reset_db.sh 8a7632d 
  security-admin/db/init/reset_db_with_seed.sh 5670922 
  security-admin/db/init/schema_mysql.sql 1dd7420 
  security-admin/db/mysql/create_dbversion_catalog.sql PRE-CREATION 
  security-admin/db/mysql/create_dev_user.sh PRE-CREATION 
  security-admin/db/mysql/create_dev_user.sql PRE-CREATION 
  security-admin/db/mysql/init/backup_mysql_db.sh PRE-CREATION 
  security-admin/db/mysql/init/create_dev_backup_mysql.sh PRE-CREATION 
  security-admin/db/mysql/init/create_dev_backup_mysql_loaded.sh PRE-CREATION 
  security-admin/db/mysql/init/create_xa_core_db.sh PRE-CREATION 
  security-admin/db/mysql/init/mysql_seed_data.sql PRE-CREATION 
  security-admin/db/mysql/init/reset_db.sh PRE-CREATION 
  security-admin/db/mysql/init/reset_db_with_seed.sh PRE-CREATION 
  security-admin/db/mysql/init/schema_mysql.sql PRE-CREATION 
  security-admin/db/mysql/patches/001-groupsource.sql PRE-CREATION 
  security-admin/db/mysql/patches/002-policyname.sql PRE-CREATION 
  security-admin/db/mysql/patches/003-knoxrepo.sql PRE-CREATION 
  security-admin/db/mysql/patches/004-assetconfigsize.sql PRE-CREATION 
  security-admin/db/mysql/patches/005-xtrxlogcolumnsize.sql PRE-CREATION 
  security-admin/db/mysql/patches/006-createdefaultpublicgroup.sql PRE-CREATION 
  security-admin/db/mysql/patches/007-updateBlankPolicyName.sql PRE-CREATION 
  security-admin/db/mysql/patches/008-removeTrailingSlash.sql PRE-CREATION 
  security-admin/db/mysql/reset_asset.sql PRE-CREATION 
  security-admin/db/mysql/reset_audit_mysql.sh PRE-CREATION 
  security-admin/db/mysql/reset_core_mysql.sh PRE-CREATION 
  security-admin/db/mysql/resetdb_dev_mysql.sh PRE-CREATION 
  security-admin/db/mysql/xa_audit_db.sql PRE-CREATION 
  security-admin/db/mysql/xa_core_db.sql PRE-CREATION 
  security-admin/db/mysql/xa_db.sql PRE-CREATION 
  security-admin/db/mysql/xa_db_bare.sql PRE-CREATION 
  security-admin/db/oracle/patches/001-groupsource.sql cda2d15 
  security-admin/db/oracle/patches/002-policyname.sql be20751 
  security-admin/db/oracle/patches/003-knoxrepo.sql 422649c 
  security-admin/db/oracle/patches/006-createdefaultpublicgroup.sql 55c0cd5 
  security-admin/db/oracle/reset_audit_db_oracle.sql PRE-CREATION 
  security-admin/db/oracle/reset_core_db_oracle.sql PRE-CREATION 
  security-admin/db/oracle/xa_audit_db_oracle.sql 4e1a184 
  security-admin/db/oracle/xa_core_db_oracle.sql 449c461 
  security-admin/db/patches/001-groupsource.sql c49d8cb 
  security-admin/db/patches/002-policyname.sql 35927f5 
  security-admin/db/patches/003-knoxrepo.sql 04c050a 
  security-admin/db/patches/004-assetconfigsize.sql bec992b 
  security-admin/db/patches/005-xtrxlogcolumnsize.sql 4ec9a6d 
  security-admin/db/patches/006-createdefaultpublicgroup.sql ddb211e 
  security-admin/db/patches/007-updateBlankPolicyName.sql d251bc2 
  security-admin/db/patches/008-removeTrailingSlash.sql 2e00f5f 
  security-admin/db/reset_asset.sql 1d53819 
  security-admin/db/reset_audit_mysql.sh 51a5359 
  security-admin/db/reset_core_mysql.sh 26f7d46 
  security-admin/db/resetdb_dev_mysql.sh c2bf5fb 
  security-admin/db/xa_audit_db.sql dba98ce 
  security-admin/db/xa_core_db.sql 9d889a0 
  security-admin/db/xa_db.sql 4b2919f 
  security-admin/db/xa_db_bare.sql 8204f1d 
  security-admin/pom.xml 1149ee6 
  security-admin/scripts/db_setup.py PRE-CREATION 
  security-admin/scripts/install.properties b835bba 
  security-admin/scripts/setup.sh e9b69a6 
  src/main/assembly/admin-web.xml 8696252 

Diff: https://reviews.apache.org/r/30760/diff/


Testing
-------

Following testing was done to validate :
1] Create a tar with the attached patch
2] Copy tar to the host machine and perform install as per current design
3] Make sure the clients 'mysql' tool is not used in 2] above
4] After installation open localhost:6080 and login with admin/admin
5] Create a user/group and check if its persisted in db.


Thanks,

Gautam Borad


Re: Review Request 30760: RANGER-239: Support JDBC based SQL invocation for setup process

Posted by Gautam Borad <gb...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/30760/
-----------------------------------------------------------

(Updated Feb. 19, 2015, 2:38 p.m.)


Review request for ranger, Don Bosco Durai, Madhan Neethiraj, Ramesh Mani, Selvamohan Neethiraj, and Velmurugan Periasamy.


Changes
-------

updated patch after pluggable service model changes with
a) oracle schema for pluggable service model.
b) changed column name 'level' of table 'x_resource_def' to 'res_level'


Bugs: RANGER-239
    https://issues.apache.org/jira/browse/RANGER-239


Repository: ranger


Description
-------

Currently Ranger setup executes SQL scripts via SQL command line tools to create DB schema.
Since it is not guaranteed to have SQL command line clients available on the host this becomes a prerequisite.
This can be addressed by a tool that can execute SQL scripts via JDBC (currenly supports Mysql)


Diffs (updated)
-----

  agents-common/pom.xml ede7b9d 
  jisql/src/main/java/org/apache/util/sql/Jisql.java f3fab71 
  security-admin/db/create_dbversion_catalog.sql 9c90633 
  security-admin/db/create_dev_user.sh a59e264 
  security-admin/db/create_dev_user.sql bf475d0 
  security-admin/db/init/backup_mysql_db.sh ef66140 
  security-admin/db/init/create_dev_backup_mysql.sh db2e2a7 
  security-admin/db/init/create_dev_backup_mysql_loaded.sh c1905b6 
  security-admin/db/init/create_xa_core_db.sh 3c9483f 
  security-admin/db/init/mysql_seed_data.sql 8f992b1 
  security-admin/db/init/reset_db.sh 8a7632d 
  security-admin/db/init/reset_db_with_seed.sh 5670922 
  security-admin/db/init/schema_mysql.sql 1dd7420 
  security-admin/db/mysql/create_dbversion_catalog.sql PRE-CREATION 
  security-admin/db/mysql/create_dev_user.sh PRE-CREATION 
  security-admin/db/mysql/create_dev_user.sql PRE-CREATION 
  security-admin/db/mysql/init/backup_mysql_db.sh PRE-CREATION 
  security-admin/db/mysql/init/create_dev_backup_mysql.sh PRE-CREATION 
  security-admin/db/mysql/init/create_dev_backup_mysql_loaded.sh PRE-CREATION 
  security-admin/db/mysql/init/create_xa_core_db.sh PRE-CREATION 
  security-admin/db/mysql/init/mysql_seed_data.sql PRE-CREATION 
  security-admin/db/mysql/init/reset_db.sh PRE-CREATION 
  security-admin/db/mysql/init/reset_db_with_seed.sh PRE-CREATION 
  security-admin/db/mysql/init/schema_mysql.sql PRE-CREATION 
  security-admin/db/mysql/patches/001-groupsource.sql PRE-CREATION 
  security-admin/db/mysql/patches/002-policyname.sql PRE-CREATION 
  security-admin/db/mysql/patches/003-knoxrepo.sql PRE-CREATION 
  security-admin/db/mysql/patches/004-assetconfigsize.sql PRE-CREATION 
  security-admin/db/mysql/patches/005-xtrxlogcolumnsize.sql PRE-CREATION 
  security-admin/db/mysql/patches/006-createdefaultpublicgroup.sql PRE-CREATION 
  security-admin/db/mysql/patches/007-updateBlankPolicyName.sql PRE-CREATION 
  security-admin/db/mysql/patches/008-removeTrailingSlash.sql PRE-CREATION 
  security-admin/db/mysql/patches/009-updated_schema.sql PRE-CREATION 
  security-admin/db/mysql/reset_asset.sql PRE-CREATION 
  security-admin/db/mysql/reset_audit_mysql.sh PRE-CREATION 
  security-admin/db/mysql/reset_core_mysql.sh PRE-CREATION 
  security-admin/db/mysql/resetdb_dev_mysql.sh PRE-CREATION 
  security-admin/db/mysql/xa_audit_db.sql PRE-CREATION 
  security-admin/db/mysql/xa_core_db.sql PRE-CREATION 
  security-admin/db/mysql/xa_db.sql PRE-CREATION 
  security-admin/db/mysql/xa_db_bare.sql PRE-CREATION 
  security-admin/db/oracle/patches/001-groupsource.sql cda2d15 
  security-admin/db/oracle/patches/002-policyname.sql be20751 
  security-admin/db/oracle/patches/003-knoxrepo.sql 422649c 
  security-admin/db/oracle/patches/006-createdefaultpublicgroup.sql 55c0cd5 
  security-admin/db/oracle/patches/009-updated_schema.sql PRE-CREATION 
  security-admin/db/oracle/reset_audit_db_oracle.sql PRE-CREATION 
  security-admin/db/oracle/reset_core_db_oracle.sql PRE-CREATION 
  security-admin/db/oracle/xa_audit_db_oracle.sql 4e1a184 
  security-admin/db/oracle/xa_core_db_oracle.sql 449c461 
  security-admin/db/patches/001-groupsource.sql c49d8cb 
  security-admin/db/patches/002-policyname.sql 35927f5 
  security-admin/db/patches/003-knoxrepo.sql 04c050a 
  security-admin/db/patches/004-assetconfigsize.sql bec992b 
  security-admin/db/patches/005-xtrxlogcolumnsize.sql 4ec9a6d 
  security-admin/db/patches/006-createdefaultpublicgroup.sql ddb211e 
  security-admin/db/patches/007-updateBlankPolicyName.sql d251bc2 
  security-admin/db/patches/008-removeTrailingSlash.sql 2e00f5f 
  security-admin/db/patches/009-updated_schema.sql 401a1dc 
  security-admin/db/reset_asset.sql 1d53819 
  security-admin/db/reset_audit_mysql.sh 51a5359 
  security-admin/db/reset_core_mysql.sh 26f7d46 
  security-admin/db/resetdb_dev_mysql.sh c2bf5fb 
  security-admin/db/xa_audit_db.sql dba98ce 
  security-admin/db/xa_core_db.sql 9d889a0 
  security-admin/db/xa_db.sql 4b2919f 
  security-admin/db/xa_db_bare.sql 8204f1d 
  security-admin/pom.xml 97606b6 
  security-admin/scripts/db_setup.py PRE-CREATION 
  security-admin/scripts/install.properties b835bba 
  security-admin/scripts/setup.sh e9b69a6 
  security-admin/src/main/java/org/apache/ranger/entity/XXEnumElementDef.java f2522f3 
  security-admin/src/main/java/org/apache/ranger/entity/XXResourceDef.java 7d5df92 
  src/main/assembly/admin-web.xml 8696252 

Diff: https://reviews.apache.org/r/30760/diff/


Testing
-------

Following testing was done to validate :
1] Create a tar with the attached patch
2] Copy tar to the host machine and perform install as per current design
3] Make sure the clients 'mysql' tool is not used in 2] above
4] After installation open localhost:6080 and login with admin/admin
5] Create a user/group and check if its persisted in db.


Thanks,

Gautam Borad