You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by gi...@apache.org on 2019/11/22 18:49:31 UTC
[incubator-druid] branch master updated (9955107 -> 7250010)
This is an automated email from the ASF dual-hosted git repository.
gian pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-druid.git.
from 9955107 RandomLocationSelectorStrategy to Choose an available disk(location) to store a segment. With unit tests. (#8461)
add 7250010 add parquet support to native batch (#8883)
No new revisions were added by this update.
Summary of changes:
.../java/org/apache/druid/data/input/Firehose.java | 4 +-
.../org/apache/druid/data/input/InputFormat.java | 7 +-
.../apache/druid/data/input/impl/FileEntity.java | 2 +-
.../input/impl/InputEntityIteratingReader.java | 4 +-
.../util/common/parsers/JSONFlattenerMaker.java | 11 +-
.../java/util/common/parsers/ObjectFlattener.java | 2 +
.../java/util/common/parsers/ObjectFlatteners.java | 75 ++++
docs/development/extensions-core/parquet.md | 45 ++-
.../druid/data/input/avro/AvroFlattenerMaker.java | 10 +-
.../data/input/orc/OrcStructFlattenerMaker.java | 11 +-
extensions-core/parquet-extensions/pom.xml | 253 +++++++++++-
.../input/parquet/ParquetExtensionsModule.java | 54 ++-
.../data/input/parquet/ParquetInputFormat.java | 43 +-
.../druid/data/input/parquet/ParquetReader.java | 136 +++++++
.../parquet/simple/ParquetGroupFlattenerMaker.java | 22 +-
.../parquet/simple/ParquetGroupJsonProvider.java | 2 +-
.../data/input/parquet/BaseParquetInputTest.java | 14 +-
.../data/input/parquet/BaseParquetReaderTest.java | 75 ++++
.../data/input/parquet/CompatParquetInputTest.java | 2 +-
.../input/parquet/CompatParquetReaderTest.java | 440 +++++++++++++++++++++
.../input/parquet/DecimalParquetReaderTest.java | 155 ++++++++
.../input/parquet/FlattenSpecParquetInputTest.java | 2 +-
.../parquet/FlattenSpecParquetReaderTest.java | 365 +++++++++++++++++
.../input/parquet/TimestampsParquetReaderTest.java | 155 ++++++++
.../data/input/parquet/WikiParquetReaderTest.java | 82 ++++
website/.spelling | 1 +
26 files changed, 1905 insertions(+), 67 deletions(-)
copy core/src/main/java/org/apache/druid/data/input/impl/JsonInputFormat.java => extensions-core/parquet-extensions/src/main/java/org/apache/druid/data/input/parquet/ParquetInputFormat.java (58%)
create mode 100644 extensions-core/parquet-extensions/src/main/java/org/apache/druid/data/input/parquet/ParquetReader.java
create mode 100644 extensions-core/parquet-extensions/src/test/java/org/apache/druid/data/input/parquet/BaseParquetReaderTest.java
create mode 100644 extensions-core/parquet-extensions/src/test/java/org/apache/druid/data/input/parquet/CompatParquetReaderTest.java
create mode 100644 extensions-core/parquet-extensions/src/test/java/org/apache/druid/data/input/parquet/DecimalParquetReaderTest.java
create mode 100644 extensions-core/parquet-extensions/src/test/java/org/apache/druid/data/input/parquet/FlattenSpecParquetReaderTest.java
create mode 100644 extensions-core/parquet-extensions/src/test/java/org/apache/druid/data/input/parquet/TimestampsParquetReaderTest.java
create mode 100644 extensions-core/parquet-extensions/src/test/java/org/apache/druid/data/input/parquet/WikiParquetReaderTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org