You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by si...@apache.org on 2021/05/07 01:03:26 UTC

[incubator-pinot] branch master updated (fe596b6 -> 73426bc)

This is an automated email from the ASF dual-hosted git repository.

siddteotia pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


    from fe596b6  Make zookeeper, kafka, controller, broker use random port for integration tests (#6872)
     add 73426bc  Add Zstandard compression support with JMH benchmarking(#6804) (#6876)

No new revisions were added by this update.

Summary of changes:
 pinot-common/pom.xml                               |   4 +
 .../common/utils/config/TableConfigSerDeTest.java  |   4 +-
 .../pinot/core/util/TableConfigUtilsTest.java      |  38 ++-
 .../queries/FSTBasedRegexpLikeQueriesTest.java     |   4 +-
 .../apache/pinot/queries/H3IndexQueriesTest.java   |   2 +-
 .../NoDictionaryCompressionQueriesTest.java        | 375 +++++++++++++++++++++
 .../pinot/queries/TextSearchQueriesTest.java       |   4 +-
 .../LuceneRealtimeClusterIntegrationTest.java      |   2 +-
 .../BenchmarkNoDictionaryIntegerCompression.java   | 168 +++++++++
 .../perf/BenchmarkNoDictionaryLongCompression.java | 169 ++++++++++
 .../BenchmarkNoDictionaryStringCompression.java    | 181 ++++++++++
 .../io/compression/ChunkCompressorFactory.java     |   6 +
 ...ughCompressor.java => ZstandardCompressor.java} |  20 +-
 ...ecompressor.java => ZstandardDecompressor.java} |  17 +-
 .../segment/local/utils/TableConfigUtils.java      |   3 +
 .../forward/FixedByteChunkSVForwardIndexTest.java  |  10 +
 .../forward/VarByteChunkSVForwardIndexTest.java    |  14 +
 .../spi/compression/ChunkCompressionType.java      |   2 +-
 .../spi/creator/SegmentGeneratorConfig.java        |  14 +
 .../apache/pinot/spi/config/table/FieldConfig.java |  12 +
 pom.xml                                            |   6 +
 21 files changed, 1023 insertions(+), 32 deletions(-)
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/NoDictionaryCompressionQueriesTest.java
 create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkNoDictionaryIntegerCompression.java
 create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkNoDictionaryLongCompression.java
 create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkNoDictionaryStringCompression.java
 copy pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/compression/{PassThroughCompressor.java => ZstandardCompressor.java} (63%)
 copy pinot-segment-local/src/main/java/org/apache/pinot/segment/local/io/compression/{SnappyDecompressor.java => ZstandardDecompressor.java} (58%)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org