You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by Damien Carol <da...@gmail.com> on 2014/08/12 15:06:50 UTC

Review Request 24602: HIVE-7689 : Enable Postgres as METASTORE back-end

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24602/
-----------------------------------------------------------

Review request for hive.


Bugs: HIVE-7689
    https://issues.apache.org/jira/browse/HIVE-7689


Repository: hive-git


Description
-------

I maintain few patches to make Metastore works with Postgres back end in our production environment.
The main goal of this JIRA is to push upstream these patches.

This first patch enable LOCKS on metastore.


Diffs
-----

  metastore/scripts/upgrade/postgres/hive-txn-schema-0.13.0.postgres.sql 2ebd3b0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java 524a7a4 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnDbUtil.java 30cf814 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java 063dee6 

Diff: https://reviews.apache.org/r/24602/diff/


Testing
-------

Using patched version in production. Enable concurrency with DbTxnManager.


Thanks,

Damien Carol


Re: Review Request 24602: HIVE-7689 : Enable Postgres as METASTORE back-end

Posted by Damien Carol <da...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24602/
-----------------------------------------------------------

(Updated sep. 11, 2014, 3:58 après-midi)


Review request for hive.


Changes
-------

Updated the last version of the patch


Bugs: HIVE-7689
    https://issues.apache.org/jira/browse/HIVE-7689


Repository: hive-git


Description
-------

I maintain few patches to make Metastore works with Postgres back end in our production environment.
The main goal of this JIRA is to push upstream these patches.

This patch enable these features :
* LOCKS on postgres metastore
* COMPACTION on postgres metastore
* TRANSACTION on postgres metastore
* fix metastore update script for postgres


Diffs (updated)
-----

  metastore/scripts/upgrade/postgres/hive-txn-schema-0.13.0.postgres.sql 2ebd3b0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java d3aa66f 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnDbUtil.java df183a0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java f1697bb 
  ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java 264052f 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsAggregator.java b074ca9 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java 5e317ab 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java 4625d27 

Diff: https://reviews.apache.org/r/24602/diff/


Testing
-------

Using patched version in production. Enable concurrency with DbTxnManager.


Thanks,

Damien Carol


Re: Review Request 24602: HIVE-7689 : Enable Postgres as METASTORE back-end

Posted by Damien Carol <da...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24602/
-----------------------------------------------------------

(Updated sep. 9, 2014, 8:55 matin)


Review request for hive.


Changes
-------

Rebased on last trunk and fixed a test failure.


Bugs: HIVE-7689
    https://issues.apache.org/jira/browse/HIVE-7689


Repository: hive-git


Description
-------

I maintain few patches to make Metastore works with Postgres back end in our production environment.
The main goal of this JIRA is to push upstream these patches.

This patch enable these features :
* LOCKS on postgres metastore
* COMPACTION on postgres metastore
* TRANSACTION on postgres metastore
* fix metastore update script for postgres


Diffs (updated)
-----

  metastore/scripts/upgrade/postgres/hive-txn-schema-0.13.0.postgres.sql 2ebd3b0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java d3aa66f 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnDbUtil.java df183a0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java f1697bb 
  ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java 264052f 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsAggregator.java b074ca9 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java 5e317ab 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java 4625d27 

Diff: https://reviews.apache.org/r/24602/diff/


Testing
-------

Using patched version in production. Enable concurrency with DbTxnManager.


Thanks,

Damien Carol


Re: Review Request 24602: HIVE-7689 : Enable Postgres as METASTORE back-end

Posted by Damien Carol <da...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24602/
-----------------------------------------------------------

(Updated sep. 8, 2014, 10:27 matin)


Review request for hive.


Changes
-------

Rebased on last trunk


Bugs: HIVE-7689
    https://issues.apache.org/jira/browse/HIVE-7689


Repository: hive-git


Description
-------

I maintain few patches to make Metastore works with Postgres back end in our production environment.
The main goal of this JIRA is to push upstream these patches.

This patch enable these features :
* LOCKS on postgres metastore
* COMPACTION on postgres metastore
* TRANSACTION on postgres metastore
* fix metastore update script for postgres


Diffs (updated)
-----

  metastore/scripts/upgrade/postgres/hive-txn-schema-0.13.0.postgres.sql 2ebd3b0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java d3aa66f 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnDbUtil.java 06d8ac0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java f1697bb 
  ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java 264052f 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsAggregator.java b074ca9 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java 5e317ab 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java 4625d27 

Diff: https://reviews.apache.org/r/24602/diff/


Testing
-------

Using patched version in production. Enable concurrency with DbTxnManager.


Thanks,

Damien Carol


Re: Review Request 24602: HIVE-7689 : Enable Postgres as METASTORE back-end

Posted by Damien Carol <da...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24602/
-----------------------------------------------------------

(Updated août 22, 2014, 3:50 après-midi)


Review request for hive.


Bugs: HIVE-7689
    https://issues.apache.org/jira/browse/HIVE-7689


Repository: hive-git


Description
-------

I maintain few patches to make Metastore works with Postgres back end in our production environment.
The main goal of this JIRA is to push upstream these patches.

This patch enable these features :
* LOCKS on postgres metastore
* COMPACTION on postgres metastore
* TRANSACTION on postgres metastore
* fix metastore update script for postgres


Diffs (updated)
-----

  metastore/scripts/upgrade/postgres/hive-txn-schema-0.13.0.postgres.sql 2ebd3b0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java 524a7a4 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnDbUtil.java 06d8ac0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java 063dee6 
  ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java 264052f 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsAggregator.java f636cff 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java db62721 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java 4625d27 

Diff: https://reviews.apache.org/r/24602/diff/


Testing
-------

Using patched version in production. Enable concurrency with DbTxnManager.


Thanks,

Damien Carol


Re: Review Request 24602: HIVE-7689 : Enable Postgres as METASTORE back-end

Posted by Damien Carol <da...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24602/
-----------------------------------------------------------

(Updated août 21, 2014, 8:40 matin)


Review request for hive.


Bugs: HIVE-7689
    https://issues.apache.org/jira/browse/HIVE-7689


Repository: hive-git


Description (updated)
-------

I maintain few patches to make Metastore works with Postgres back end in our production environment.
The main goal of this JIRA is to push upstream these patches.

This patch enable these features :
* LOCKS on postgres metastore
* COMPACTION on postgres metastore
* TRANSACTION on postgres metastore
* fix metastore update script for postgres


Diffs
-----

  metastore/scripts/upgrade/postgres/hive-txn-schema-0.13.0.postgres.sql 2ebd3b0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java 524a7a4 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnDbUtil.java 30cf814 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java 063dee6 
  ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java f74f683 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsAggregator.java f636cff 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java db62721 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java 4625d27 

Diff: https://reviews.apache.org/r/24602/diff/


Testing
-------

Using patched version in production. Enable concurrency with DbTxnManager.


Thanks,

Damien Carol


Re: Review Request 24602: HIVE-7689 : Enable Postgres as METASTORE back-end

Posted by Damien Carol <da...@gmail.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/24602/
-----------------------------------------------------------

(Updated août 20, 2014, 10:53 matin)


Review request for hive.


Changes
-------

Updated with patch V2 that enable ALL feature of a Metastore Backend


Bugs: HIVE-7689
    https://issues.apache.org/jira/browse/HIVE-7689


Repository: hive-git


Description
-------

I maintain few patches to make Metastore works with Postgres back end in our production environment.
The main goal of this JIRA is to push upstream these patches.

This first patch enable LOCKS on metastore.


Diffs (updated)
-----

  metastore/scripts/upgrade/postgres/hive-txn-schema-0.13.0.postgres.sql 2ebd3b0 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/CompactionTxnHandler.java 524a7a4 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnDbUtil.java 30cf814 
  metastore/src/java/org/apache/hadoop/hive/metastore/txn/TxnHandler.java 063dee6 
  ql/src/java/org/apache/hadoop/hive/ql/lockmgr/DbTxnManager.java f74f683 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsAggregator.java f636cff 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsPublisher.java db62721 
  ql/src/java/org/apache/hadoop/hive/ql/stats/jdbc/JDBCStatsUtils.java 4625d27 

Diff: https://reviews.apache.org/r/24602/diff/


Testing
-------

Using patched version in production. Enable concurrency with DbTxnManager.


Thanks,

Damien Carol