You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by jl...@apache.org on 2021/05/25 01:45:59 UTC

[incubator-pinot] branch detect-invalid-columns updated (8794600 -> 78c0766)

This is an automated email from the ASF dual-hosted git repository.

jlli pushed a change to branch detect-invalid-columns
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


 discard 8794600  Detect invalid column names from BrokerRequestHandler
     add d63d6c5  Fix NPE issue when consumed kafka message is null or the record value is null. (#6950)
     add 16f94a1  Rename some complex type configs (#6953)
     add 5188d4e  Add NETTY_CONNECTION_SEND_REQUEST_LATENCY to broker timer metrics (#6936)
     add c5bca8a  fixed Pinot ui can't show all the pinot servers (#6956)
     add 08b909c  Move TableDataManager to segment-local to unblock partial upsert feature (#6947)
     add 4d834ea  Update JSON datatype test cases + minor JSON index bug fix. (#6951)
     add 0d6ca90  fixed UI crashing when server or brokers are offline (#6935)
     add f15225f  fixed showing all pinot servers in tenant details (#6934)
     add 71e156c  Make Pinot Broker/Server/Minion can start by just passing a config file (#5446)
     add 1209bcc  Use stored types instead of derived types in Forward Indices. (#6960)
     add 958b4d4  Enabling compatibility tests in the script (#6959)
     add 9adbe55  Include complex-type-handling quickstarts in the assembler (#6961)
     add 8878df5  Update LICENSE & NOTICE (#6944)
     add 78c0766  Detect invalid column names from BrokerRequestHandler

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (8794600)
            \
             N -- N -- N   refs/heads/detect-invalid-columns (78c0766)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .github/workflows/scripts/.pinot_quickstart.sh     | 100 ++++++++--
 LICENSE                                            |  73 -------
 LICENSE-binary                                     | 109 ++++------
 NOTICE-binary                                      | 115 ++++++-----
 compatibility-verifier/checkoutAndBuild.sh         |   4 +-
 compatibility-verifier/compCheck.sh                | 220 +++++++++++++++------
 licenses-binary/LICENSE-angular.txt                |  21 --
 licenses-binary/LICENSE-aopalliance.txt            |   2 -
 .../LICENSE-azure.txt                              |  12 +-
 ...ars.txt => LICENSE-codehaus-animal-sniffer.txt} |   4 +-
 licenses-binary/LICENSE-codemirror.txt             |  21 --
 licenses-binary/LICENSE-cpl-1.0.txt                |  88 ---------
 .../{LICENSE-antlr.txt => LICENSE-edl-1.0.txt}     |  15 +-
 licenses-binary/LICENSE-esotericsoftware.txt       |  11 --
 licenses-binary/LICENSE-foundation.txt             |  22 ---
 ...ENSE-fusesource.txt => LICENSE-google-auth.txt} |   5 +-
 ...SE-protobuf.txt => LICENSE-google-protobuf.txt} |   0
 licenses-binary/LICENSE-jcabi.txt                  |   2 +-
 licenses-binary/LICENSE-jcraft.txt                 |  32 ---
 licenses-binary/LICENSE-jline.txt                  |  32 ---
 licenses-binary/LICENSE-jquery-datatables.txt      |  12 --
 .../LICENSE-jquery-requestAnimationFrame.txt       |  22 ---
 licenses-binary/LICENSE-jquery-sizzle.txt          |  36 ----
 licenses-binary/LICENSE-jquery.txt                 |  20 --
 licenses-binary/LICENSE-js-beautify.txt            |   9 -
 licenses-binary/LICENSE-mimepull.txt               |  28 ---
 licenses-binary/LICENSE-normalize.txt              |  21 --
 licenses-binary/LICENSE-paranamer.txt              |  28 ---
 licenses-binary/LICENSE-py4j.txt                   |  26 ---
 .../LICENSE-reactive-streams.txt                   |   8 +-
 licenses-binary/LICENSE-reflections.txt            |  13 ++
 .../{LICENSE-scala.txt => LICENSE-scala-lang.txt}  |   0
 .../LICENSE-stax2.txt                              |   4 +-
 licenses-binary/LICENSE-underscore.txt             |  23 ---
 licenses-binary/LICENSE-xmlenc.txt                 |  27 ---
 licenses-binary/LICENSE-zstd-jni.txt               |  26 +++
 licenses/LICENSE-angular.txt                       |  21 --
 licenses/LICENSE-codemirror.txt                    |  21 --
 licenses/LICENSE-foundation.txt                    |  22 ---
 licenses/LICENSE-jquery-requestAnimationFrame.txt  |  22 ---
 licenses/LICENSE-jquery-sizzle.txt                 |  36 ----
 licenses/LICENSE-jquery.txt                        |  20 --
 licenses/LICENSE-normalize.txt                     |  21 --
 licenses/LICENSE-underscore.txt                    |  23 ---
 .../broker/broker/BrokerAdminApiApplication.java   |   6 +-
 .../broker/broker/helix/HelixBrokerStarter.java    |  34 +++-
 .../broker/broker/HelixBrokerStarterTest.java      |   7 +-
 .../apache/pinot/common/metrics/BrokerTimer.java   |   4 +
 .../apache/pinot/common/metrics/ServerTimer.java   |   4 +-
 .../common/utils/config/TableConfigSerDeTest.java  |   4 +-
 .../apache/pinot/controller/ControllerConf.java    |  24 ++-
 .../api/ControllerAdminApiApplication.java         |   6 +-
 .../app/components/Homepage/ClusterConfig.tsx      |   1 +
 .../app/components/Homepage/InstanceTable.tsx      |   1 +
 .../src/main/resources/app/pages/HomePage.tsx      |  10 +-
 .../src/main/resources/app/pages/Tenants.tsx       |   5 +-
 .../core/data/manager/BaseTableDataManager.java    |   4 +-
 .../core/data/manager/InstanceDataManager.java     |   1 +
 .../manager/offline/DimensionTableDataManager.java |   9 +-
 .../offline/ImmutableSegmentDataManager.java       |   2 +-
 .../manager/offline/TableDataManagerProvider.java  |  13 +-
 .../realtime/RealtimeSegmentDataManager.java       |   2 +-
 .../manager/realtime/RealtimeTableDataManager.java |   4 +-
 .../query/executor/ServerQueryExecutorV1Impl.java  |   4 +-
 .../pinot/core/transport/AsyncQueryResponse.java   |   6 +-
 .../core/transport/InstanceRequestHandler.java     |  27 +--
 .../apache/pinot/core/transport/QueryRouter.java   |   2 +-
 .../pinot/core/transport/ServerChannels.java       |  18 +-
 .../pinot/core/transport/ServerResponse.java       |  17 +-
 .../data/manager/BaseTableDataManagerTest.java     |   4 +-
 .../offline/DimensionTableDataManagerTest.java     |   4 +-
 .../realtime/LLRealtimeSegmentDataManagerTest.java |   4 +-
 .../core/query/executor/QueryExecutorTest.java     |   4 +-
 .../pinot/queries/JsonDataTypeQueriesTest.java     |  77 ++++++--
 .../queries/SegmentWithNullValueVectorTest.java    |   4 +-
 .../data/test_null_value_vector_data.json          |  12 --
 .../data/test_null_value_vector_pinot_schema.json  |  26 ---
 .../test/resources/data/test_upsert_schema.json    |  21 --
 .../org/apache/pinot/compat/tests/SegmentOp.java   |   4 +-
 .../pinot/integration/tests/ClusterTest.java       |  16 +-
 .../tests/ServerStarterIntegrationTest.java        |   5 +-
 .../pinot/minion/MinionAdminApiApplication.java    |   6 +-
 .../org/apache/pinot/minion/MinionStarter.java     |  19 +-
 .../pinot/plugin/inputformat/avro/AvroUtils.java   |  50 ++---
 .../plugin/inputformat/avro/AvroUtilsTest.java     |   8 +-
 .../kafka20/KafkaPartitionLevelConsumer.java       |   7 +-
 .../local}/data/manager/SegmentDataManager.java    |   2 +-
 .../local}/data/manager/TableDataManager.java      |   4 +-
 .../data/manager}/TableDataManagerConfig.java      |   9 +-
 .../recordtransformer/ComplexTypeTransformer.java  |  56 +++---
 .../index/column/PhysicalColumnIndexContainer.java |   7 +-
 .../local}/upsert/TableUpsertMetadataManager.java  |   7 +-
 .../mutable}/IntermediateSegmentTest.java          |   3 +-
 .../MutableSegmentImplAggregateMetricsTest.java    |   3 +-
 .../MutableSegmentImplNullValueVectorTest.java     |   3 +-
 .../mutable/MutableSegmentImplTest.java            |   3 +-
 .../mutable/MutableSegmentImplTestUtils.java       |   3 +-
 .../mutable/MutableSegmentImplUpsertTest.java      |   5 +-
 .../ComplexTypeTransformerTest.java                |   4 +-
 .../src/test/resources/data/test_upsert_data.json  |   0
 .../api/resources/SegmentMetadataFetcher.java      |   2 +-
 .../server/api/resources/TableSizeResource.java    |   4 +-
 .../pinot/server/api/resources/TablesResource.java |   4 +-
 .../server/starter/helix/AdminApiApplication.java  |   5 +-
 .../starter/helix/HelixInstanceDataManager.java    |   6 +-
 .../server/starter/helix/HelixServerStarter.java   |  21 +-
 .../SegmentOnlineOfflineStateModelFactory.java     |   4 +-
 .../apache/pinot/server/api/AccessControlTest.java |   2 +-
 .../apache/pinot/server/api/BaseResourceTest.java  |   4 +-
 .../config/table/ingestion/ComplexTypeConfig.java  |  22 +--
 .../apache/pinot/spi/env/PinotConfiguration.java   |  14 +-
 .../apache/pinot/spi/utils/CommonConstants.java    |   4 +-
 .../java/org/apache/pinot/spi/utils/JsonUtils.java |  40 ++--
 .../pinot/spi/utils/PinotReflectionUtils.java      |  20 +-
 .../org/apache/pinot/spi/utils/JsonUtilsTest.java  |   8 +-
 pinot-tools/pom.xml                                |  20 ++
 .../admin/command/AbstractBaseAdminCommand.java    |   3 -
 .../pinot/tools/admin/command/AddTableCommand.java |   2 +-
 .../admin/command/AvroSchemaToPinotSchema.java     |  32 +--
 .../tools/admin/command/JsonToPinotSchema.java     |  34 ++--
 .../command/LaunchDataIngestionJobCommand.java     |   2 +-
 .../tools/admin/command/StartBrokerCommand.java    |  14 +-
 .../admin/command/StartControllerCommand.java      |  15 +-
 .../tools/admin/command/StartMinionCommand.java    |   2 +-
 .../tools/admin/command/StartServerCommand.java    |  19 +-
 .../admin/command/StartServiceManagerCommand.java  |  16 +-
 .../tools/admin/command/StartZookeeperCommand.java |   2 +
 .../pinot/tools/perf/PerfBenchmarkDriver.java      |   9 +-
 .../pinot/tools/service/PinotServiceManager.java   |  28 ++-
 .../PinotServiceManagerAdminApiApplication.java    |   5 +-
 .../apache/pinot/tools/utils/PinotConfigUtils.java |  19 +-
 .../src/main/resources/conf/pinot-broker.conf      |  24 ++-
 .../src/main/resources/conf/pinot-controller.conf  |  32 ++-
 .../src/main/resources/conf/pinot-minion.conf      |  27 ++-
 .../src/main/resources/conf/pinot-server.conf      |  32 ++-
 ...s_offline_complexTypeHandling_table_config.json |   2 +-
 ...eHandling_meetupRsvp_realtime_table_config.json |   2 +-
 137 files changed, 1098 insertions(+), 1375 deletions(-)
 mode change 100644 => 100755 compatibility-verifier/checkoutAndBuild.sh
 delete mode 100644 licenses-binary/LICENSE-angular.txt
 delete mode 100644 licenses-binary/LICENSE-aopalliance.txt
 rename licenses/LICENSE-handlebars.txt => licenses-binary/LICENSE-azure.txt (87%)
 rename licenses-binary/{LICENSE-handlebars.txt => LICENSE-codehaus-animal-sniffer.txt} (95%)
 delete mode 100644 licenses-binary/LICENSE-codemirror.txt
 delete mode 100644 licenses-binary/LICENSE-cpl-1.0.txt
 copy licenses-binary/{LICENSE-antlr.txt => LICENSE-edl-1.0.txt} (58%)
 delete mode 100644 licenses-binary/LICENSE-esotericsoftware.txt
 delete mode 100644 licenses-binary/LICENSE-foundation.txt
 rename licenses-binary/{LICENSE-fusesource.txt => LICENSE-google-auth.txt} (91%)
 rename licenses-binary/{LICENSE-protobuf.txt => LICENSE-google-protobuf.txt} (100%)
 delete mode 100644 licenses-binary/LICENSE-jcraft.txt
 delete mode 100644 licenses-binary/LICENSE-jline.txt
 delete mode 100644 licenses-binary/LICENSE-jquery-datatables.txt
 delete mode 100644 licenses-binary/LICENSE-jquery-requestAnimationFrame.txt
 delete mode 100644 licenses-binary/LICENSE-jquery-sizzle.txt
 delete mode 100644 licenses-binary/LICENSE-jquery.txt
 delete mode 100644 licenses-binary/LICENSE-js-beautify.txt
 delete mode 100644 licenses-binary/LICENSE-mimepull.txt
 delete mode 100644 licenses-binary/LICENSE-normalize.txt
 delete mode 100644 licenses-binary/LICENSE-paranamer.txt
 delete mode 100644 licenses-binary/LICENSE-py4j.txt
 rename licenses/LICENSE-js-beautify.txt => licenses-binary/LICENSE-reactive-streams.txt (75%)
 create mode 100644 licenses-binary/LICENSE-reflections.txt
 rename licenses-binary/{LICENSE-scala.txt => LICENSE-scala-lang.txt} (100%)
 rename licenses/LICENSE-jquery-datatables.txt => licenses-binary/LICENSE-stax2.txt (83%)
 delete mode 100644 licenses-binary/LICENSE-underscore.txt
 delete mode 100644 licenses-binary/LICENSE-xmlenc.txt
 create mode 100644 licenses-binary/LICENSE-zstd-jni.txt
 delete mode 100644 licenses/LICENSE-angular.txt
 delete mode 100644 licenses/LICENSE-codemirror.txt
 delete mode 100644 licenses/LICENSE-foundation.txt
 delete mode 100644 licenses/LICENSE-jquery-requestAnimationFrame.txt
 delete mode 100644 licenses/LICENSE-jquery-sizzle.txt
 delete mode 100644 licenses/LICENSE-jquery.txt
 delete mode 100644 licenses/LICENSE-normalize.txt
 delete mode 100644 licenses/LICENSE-underscore.txt
 delete mode 100644 pinot-core/src/test/resources/data/test_null_value_vector_data.json
 delete mode 100644 pinot-core/src/test/resources/data/test_null_value_vector_pinot_schema.json
 delete mode 100644 pinot-core/src/test/resources/data/test_upsert_schema.json
 rename {pinot-core/src/main/java/org/apache/pinot/core => pinot-segment-local/src/main/java/org/apache/pinot/segment/local}/data/manager/SegmentDataManager.java (97%)
 rename {pinot-core/src/main/java/org/apache/pinot/core => pinot-segment-local/src/main/java/org/apache/pinot/segment/local}/data/manager/TableDataManager.java (97%)
 rename {pinot-core/src/main/java/org/apache/pinot/core/data/manager/config => pinot-segment-local/src/main/java/org/apache/pinot/segment/local/data/manager}/TableDataManagerConfig.java (91%)
 rename {pinot-core/src/main/java/org/apache/pinot/core => pinot-segment-local/src/main/java/org/apache/pinot/segment/local}/upsert/TableUpsertMetadataManager.java (85%)
 rename {pinot-core/src/test/java/org/apache/pinot/core/indexsegment => pinot-segment-local/src/test/java/org/apache/pinot/segment/local/indexsegment/mutable}/IntermediateSegmentTest.java (98%)
 rename {pinot-core/src/test/java/org/apache/pinot/core => pinot-segment-local/src/test/java/org/apache/pinot/segment/local}/indexsegment/mutable/MutableSegmentImplAggregateMetricsTest.java (98%)
 rename {pinot-core/src/test/java/org/apache/pinot/core => pinot-segment-local/src/test/java/org/apache/pinot/segment/local}/indexsegment/mutable/MutableSegmentImplNullValueVectorTest.java (97%)
 rename {pinot-core/src/test/java/org/apache/pinot/core => pinot-segment-local/src/test/java/org/apache/pinot/segment/local}/indexsegment/mutable/MutableSegmentImplTest.java (98%)
 rename {pinot-core/src/test/java/org/apache/pinot/core => pinot-segment-local/src/test/java/org/apache/pinot/segment/local}/indexsegment/mutable/MutableSegmentImplTestUtils.java (96%)
 rename {pinot-core/src/test/java/org/apache/pinot/core => pinot-segment-local/src/test/java/org/apache/pinot/segment/local}/indexsegment/mutable/MutableSegmentImplUpsertTest.java (95%)
 rename {pinot-core => pinot-segment-local}/src/test/resources/data/test_upsert_data.json (100%)
 copy pinot-plugins/pinot-input-format/pinot-protobuf/src/test/resources/sample.proto => pinot-tools/src/main/resources/conf/pinot-broker.conf (67%)
 copy pinot-plugins/pinot-input-format/pinot-protobuf/src/test/resources/sample.proto => pinot-tools/src/main/resources/conf/pinot-controller.conf (61%)
 copy pinot-plugins/pinot-input-format/pinot-protobuf/src/test/resources/sample.proto => pinot-tools/src/main/resources/conf/pinot-minion.conf (66%)
 copy pinot-plugins/pinot-input-format/pinot-protobuf/src/test/resources/sample.proto => pinot-tools/src/main/resources/conf/pinot-server.conf (58%)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org