You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@tajo.apache.org by David Chen <dc...@linkedin.com> on 2014/03/28 17:26:53 UTC

Review Request 19786: TAJO-714: Enable setting Parquet tuning parameters

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19786/
-----------------------------------------------------------

Review request for Tajo.


Bugs: TAJO-714
    https://issues.apache.org/jira/browse/TAJO-714


Repository: tajo


Description
-------

Enable setting Parquet parameters such as row group size, page size, compression, and dictionary encoding.

For example:

create table table1_parquet (
    id int,
    name text,
    score float,
    type text)
  using parquet with (
    'parquet.page.size'='65536',
    'parquet.block.size'='536870912',
    'parquet.compression'='snappy')
  as select * from table1;


Diffs
-----

  tajo-storage/src/main/java/org/apache/tajo/storage/parquet/ParquetAppender.java cb2f2436be19eac56e53a155bbcdb78ceb7de580 

Diff: https://reviews.apache.org/r/19786/diff/


Testing
-------

Manual testing using above query.


Thanks,

David Chen

Re: Review Request 19786: TAJO-714: Enable setting Parquet tuning parameters

Posted by David Chen <dc...@linkedin.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19786/
-----------------------------------------------------------

(Updated April 1, 2014, 4:06 a.m.)


Review request for Tajo.


Bugs: TAJO-714
    https://issues.apache.org/jira/browse/TAJO-714


Repository: tajo


Description
-------

Enable setting Parquet parameters such as row group size, page size, compression, and dictionary encoding.

For example:

create table table1_parquet (
    id int,
    name text,
    score float,
    type text)
  using parquet with (
    'parquet.page.size'='65536',
    'parquet.block.size'='536870912',
    'parquet.compression'='snappy')
  as select * from table1;


Diffs (updated)
-----

  pom.xml 042111984c41de3b56d26ec00969dd3e59a064cb 
  tajo-catalog/tajo-catalog-common/pom.xml a4db647f4b642cbe11c466974eeec23c553e583e 
  tajo-catalog/tajo-catalog-common/src/main/java/org/apache/tajo/catalog/CatalogConstants.java c7116f6989a189d5330ae4f0e08296d3b2e62932 
  tajo-catalog/tajo-catalog-common/src/main/java/org/apache/tajo/catalog/CatalogUtil.java 22f54ca651cd02b5913034ea07fd8512b7ff88b4 
  tajo-storage/pom.xml 9f144bb206820d23238532f158b511974f518592 
  tajo-storage/src/main/java/org/apache/tajo/storage/parquet/ParquetAppender.java cb2f2436be19eac56e53a155bbcdb78ceb7de580 
  tajo-storage/src/main/java/org/apache/tajo/storage/parquet/ParquetScanner.java 086f490eaf91c433eb46d6443bf5fe111b6b0f81 
  tajo-storage/src/test/java/org/apache/tajo/storage/TestMergeScanner.java ad12c06ec50f95bdb166f4764914790f31d48a26 
  tajo-storage/src/test/java/org/apache/tajo/storage/TestStorages.java b5338ff1e2066cf4bf6bb5f0a4fd6bbbf8e7633b 
  tajo-storage/src/test/java/org/apache/tajo/storage/v2/TestStorages.java ad49b363c1f647357ee4ace0a59c34e64aeb9f0b 

Diff: https://reviews.apache.org/r/19786/diff/


Testing
-------

Manual testing using above query.


Thanks,

David Chen

Re: Review Request 19786: TAJO-714: Enable setting Parquet tuning parameters

Posted by David Chen <dc...@linkedin.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/19786/
-----------------------------------------------------------

(Updated April 1, 2014, 2:21 a.m.)


Review request for Tajo.


Bugs: TAJO-714
    https://issues.apache.org/jira/browse/TAJO-714


Repository: tajo


Description
-------

Enable setting Parquet parameters such as row group size, page size, compression, and dictionary encoding.

For example:

create table table1_parquet (
    id int,
    name text,
    score float,
    type text)
  using parquet with (
    'parquet.page.size'='65536',
    'parquet.block.size'='536870912',
    'parquet.compression'='snappy')
  as select * from table1;


Diffs (updated)
-----

  tajo-storage/src/main/java/org/apache/tajo/storage/parquet/ParquetAppender.java cb2f2436be19eac56e53a155bbcdb78ceb7de580 
  tajo-storage/src/main/java/org/apache/tajo/storage/parquet/ParquetScanner.java 086f490eaf91c433eb46d6443bf5fe111b6b0f81 

Diff: https://reviews.apache.org/r/19786/diff/


Testing
-------

Manual testing using above query.


Thanks,

David Chen