You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by je...@apache.org on 2019/07/29 23:21:22 UTC

[incubator-pinot] branch inputPathCompat updated (5e8b4fc -> 32ccef2)

This is an automated email from the ASF dual-hosted git repository.

jenniferdai pushed a change to branch inputPathCompat
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


 discard 5e8b4fc  Addressing comments
    omit 587a244  Addressing comments
    omit 4a0d4b1  Time-aware resizing
     add b1d28fd  Fix potential resource leak in the way we close a collection of closeables (#4418)
     add d2b2981  add download excel (#4403)
     add 7b1715c  3891: Check for validity of segment start/end time during segment generation (#4368)
     add 625482a  [TE] Renamed some classes to making it accurate and consistent (#4439)
     add 31d916f  [TE] Adding Entity GroupKey Anomalies Email Reporter (#4433)
     add db5923c  Clean up the ServerInstance class and remove the un-necessary ip address stored (#4438)
     add 5492217  Fix the potential resource leak from NettyServer (#4440)
     add e897271  [TE] add ml auto config into YAML template (#4423)
     add 16f028e  Fix ServerInstanceTest (#4442)
     add 2e07b0b  [TE] Improvements to the Entity GroupKey Template (#4444)
     add cd579b1  Add comments and fix typo for the SegmentCompletionTest. (#4447)
     add 85b07f3  [TE] frontend - harleyjj/preview - provide custom time range before previewing (#4437)
     add 365ee85  [TE] Detection and alert config formatters (#4443)
     add 9232bb5  Moving handling of NULL values from RecordReaders to NullValueTransfo… (#4399)
     add eaecd64  Refactor pinot-connectors to break the dependencies from kafka 0.9 (#4445)
     add 024da51  Enable SegmentCompleteionIntegrationTest (#4451)
     add 25e7be1  [TE] Bug Fix - Parsing of multiple alert schemes (#4456)
     add d18fab9  [TE] anomaly filters potential inconsistency issue fix (#4448)
     add 2d0b247  [TE] Update Swagger Resource Package (#4458)
     add 6dc820a  Issue #4450: Support parsing of `Order By` clause in PQL compiler. (#4453)
     add 0fded63  [TE] Inject Sub Entity Name into the anomaly properties (#4452)
     add 523f697  Add resource config for lead controller resource (#4449)
     add a1fff55  Ensuring partition config is valid during Hadoop preprocess (#4463)
     add 14ef543  Remove the usage of guava deprecated methods (#4457)
     add 1642f00  [TE] logs and precondition checks for pipeline re-tuning (#4465)
     add eca1d2e  [TE] frontend - set analysis range using alertDetailsDefaultWindowSize from endpoint (#4460)
     add 1d45f87  Enable periodic rebalance as a temporary work-around for the Helix issue (#4459)
     add cac4f24  Allow customized metrics prefix in pinot controller/broker/server (#4392)
     add c01b852  Add table name parameter for segment push (#4454)
     add c81adda  [TE] Include alert description in entity email alert (#4471)
     add 29bc069  [TE] Include admin recipients in every email alert (cc address) (#4470)
     add 9d64d8a  Refactor HelixBrokerStarterTest (#4473)
     add 8717e35  Adding Support for Kafka 2.0 Consumer (#4397)
     add d790b2b  Time-aware resizing
     add a77dd02  Addressing comments
     add 32ccef2  Addressing comments

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (5e8b4fc)
            \
             N -- N -- N   refs/heads/inputPathCompat (32ccef2)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .travis.yml                                        |    6 +
 .travis_install.sh                                 |    7 +-
 .travis_test.sh                                    |   15 +-
 docs/pluggable_streams.rst                         |   48 +
 .../pinot/broker/broker/BrokerServerBuilder.java   |    3 +-
 .../broker/helix/LiveInstanceChangeHandler.java    |    6 +-
 .../pinot/broker/routing/CfgBasedRouting.java      |   64 -
 .../EmptyBrokerOnlineOfflineStateModelFactory.java |   70 -
 ...EmptySegmentOnlineOfflineStateModelFactory.java |   71 -
 .../broker/broker/HelixBrokerStarterTest.java      |  354 ++---
 pinot-common/pom.xml                               |    4 -
 .../apache/pinot/common/metrics/BrokerMetrics.java |   12 +-
 .../pinot/common/metrics/ControllerMetrics.java    |    9 +-
 .../apache/pinot/common/metrics/ServerMetrics.java |   24 +-
 .../pinot/common/request/AggregationInfo.java      |  384 +++--
 .../apache/pinot/common/request/BrokerRequest.java | 1533 ++++++++++----------
 .../apache/pinot/common/request/DataSource.java    |  216 ++-
 .../apache/pinot/common/request/Expression.java    |  421 +++---
 .../pinot/common/request/ExpressionType.java       |   11 +-
 .../pinot/common/request/FilterOperator.java       |   18 +-
 .../apache/pinot/common/request/FilterQuery.java   |  561 ++++---
 .../pinot/common/request/FilterQueryMap.java       |  260 ++--
 .../org/apache/pinot/common/request/Function.java  |  339 ++---
 .../org/apache/pinot/common/request/GroupBy.java   |  420 +++---
 .../pinot/common/request/HavingFilterQuery.java    |  562 ++++---
 .../pinot/common/request/HavingFilterQueryMap.java |  259 ++--
 .../apache/pinot/common/request/Identifier.java    |  220 ++-
 .../pinot/common/request/InstanceRequest.java      |  542 ++++---
 .../org/apache/pinot/common/request/Literal.java   |  364 ++---
 .../apache/pinot/common/request/PinotQuery.java    | 1048 ++++++-------
 .../apache/pinot/common/request/QuerySource.java   |  218 ++-
 .../org/apache/pinot/common/request/QueryType.java |  485 +++----
 .../org/apache/pinot/common/request/Selection.java |  486 +++----
 .../apache/pinot/common/request/SelectionSort.java |  285 ++--
 .../pinot/common/response/ServerInstance.java      |  180 +--
 .../apache/pinot/common/utils/CommonConstants.java |   15 +-
 .../common/utils/FileUploadDownloadClient.java     |   43 +-
 .../org/apache/pinot/common/utils/FileUtils.java   |   59 +-
 .../org/apache/pinot/common/utils/JsonUtils.java   |    6 +-
 .../apache/pinot/common/utils/time/TimeUtils.java  |   15 +
 .../pinot/pql/parsers/pql2/ast/OrderByAstNode.java |   11 +-
 .../apache/pinot/pql/parsers/Pql2CompilerTest.java |   54 +-
 pinot-common/src/thrift/request.thrift             |    1 +
 pinot-connectors/pinot-connector-kafka-0.9/pom.xml |   14 +-
 .../realtime/impl/kafka/KafkaStarterUtils.java     |  171 ---
 .../impl/kafka/server/KafkaDataProducer.java       |   57 +
 .../kafka/server/KafkaDataServerStartable.java     |  109 ++
 ...inot.core.realtime.stream.StreamConsumerFactory |   19 +
 .../kafka/KafkaPartitionLevelConsumerTest.java     |    2 +-
 .../pinot-connector-kafka-2.0/README.md            |   57 +
 .../pom.xml                                        |   48 +-
 .../realtime/impl/kafka2/KafkaConsumerFactory.java |   51 +
 .../realtime/impl/kafka2/KafkaMessageBatch.java    |   63 +
 .../KafkaPartitionLevelConnectionHandler.java      |   73 +
 .../impl/kafka2/KafkaPartitionLevelConsumer.java   |   66 +
 .../kafka2/KafkaPartitionLevelStreamConfig.java    |  147 ++
 .../impl/kafka2/KafkaStreamLevelConsumer.java      |  179 +++
 .../kafka2/KafkaStreamLevelConsumerManager.java    |  194 +++
 .../impl/kafka2/KafkaStreamLevelStreamConfig.java  |  136 ++
 .../impl/kafka2/KafkaStreamMetadataProvider.java   |   67 +
 .../impl/kafka2/server/KafkaDataProducer.java      |   77 +
 .../kafka2/server/KafkaDataServerStartable.java    |   98 ++
 ...inot.core.realtime.stream.StreamConsumerFactory |   19 +
 .../kafka2/KafkaPartitionLevelConsumerTest.java    |  293 ++++
 .../KafkaPartitionLevelStreamConfigTest.java       |  162 +++
 .../impl/kafka2/utils/EmbeddedZooKeeper.java       |   60 +
 .../impl/kafka2/utils/MiniKafkaCluster.java        |  175 +++
 .../pinot-connector-kafka-base/README.md           |   23 +
 .../{ => pinot-connector-kafka-base}/pom.xml       |   43 +-
 .../impl/kafka/KafkaAvroMessageDecoder.java        |    0
 .../impl/kafka/KafkaJSONMessageDecoder.java        |    0
 .../realtime/impl/kafka/KafkaStarterUtils.java     |  118 ++
 .../impl/kafka/KafkaStreamConfigProperties.java    |   19 +-
 .../core/realtime/impl/kafka/MessageAndOffset.java |   41 +-
 pinot-connectors/pom.xml                           |   15 +
 .../apache/pinot/controller/ControllerConf.java    |    7 +
 .../apache/pinot/controller/ControllerStarter.java |    2 +-
 .../PinotSegmentUploadRestletResource.java         |   28 +-
 .../controller/api/upload/SegmentValidator.java    |    2 +-
 .../helix/core/util/HelixSetupUtils.java           |   18 +-
 .../src/main/resources/static/css/pinot.css        |   16 +-
 .../src/main/resources/static/js/init.js           |   10 +
 .../src/main/resources/static/query/index.html     |    8 +-
 .../api/PinotInstanceRestletResourceTest.java      |    4 +-
 .../pinot/controller/helix/ControllerTest.java     |   11 +
 .../helix/core/realtime/SegmentCompletionTest.java |   34 +-
 pinot-core/pom.xml                                 |    4 -
 .../realtime/HLRealtimeSegmentDataManager.java     |    4 +-
 .../realtime/LLRealtimeSegmentDataManager.java     |    4 +-
 .../pinot/core/data/readers/RecordReaderUtils.java |   14 +-
 ...dTransformer.java => CompositeTransformer.java} |   20 +-
 .../recordtransformer/NullValueTransformer.java    |   53 +
 ...ansformer.java => SanitizationTransformer.java} |    6 +-
 .../generator/SegmentGeneratorConfig.java          |   10 +
 .../impl/FixedByteSingleValueMultiColReader.java   |   16 +-
 .../core/io/util/FixedBitIntReaderWriter.java      |   16 +-
 .../core/io/util/FixedByteValueReaderWriter.java   |   16 +-
 .../impl/FixedByteSingleValueMultiColWriter.java   |   23 +-
 .../pinot/core/minion/BackfillDateTimeColumn.java  |    4 +-
 .../apache/pinot/core/minion/SegmentConverter.java |   18 +-
 .../converter/RealtimeSegmentConverter.java        |   10 +-
 .../core/realtime/stream/StreamDataProducer.java   |   27 +-
 .../core/realtime/stream/StreamDataProvider.java   |   46 +
 .../realtime/stream/StreamDataServerStartable.java |   48 +-
 .../RecordReaderSegmentCreationDataSource.java     |    4 +-
 .../creator/impl/SegmentColumnarIndexCreator.java  |  148 +-
 .../impl/SegmentIndexCreationDriverImpl.java       |    4 +-
 .../fwd/SingleValueSortedForwardIndexCreator.java  |   10 +-
 .../inv/OffHeapBitmapInvertedIndexCreator.java     |   26 +-
 .../function/FunctionExpressionEvaluatorTest.java  |    1 -
 .../pinot/core/data/readers/PinotSegmentUtil.java  |   74 +-
 .../data/readers/RecordReaderSampleDataTest.java   |    8 +-
 .../pinot/core/data/readers/RecordReaderTest.java  |    8 +-
 .../recordtransformer/RecordTransformerTest.java   |    6 +-
 .../pinot/core/minion/SegmentConverterTest.java    |   16 +-
 ...adataAndDictionaryAggregationPlanMakerTest.java |   12 +
 .../core/segment/index/ColumnMetadataTest.java     |    6 +
 .../segment/index/SegmentMetadataImplTest.java     |    6 +
 .../SegmentV1V2ToV3FormatConverterTest.java        |    6 +
 .../SegmentGenerationWithTimeColumnTest.java       |   36 +-
 .../index/loader/SegmentPreProcessorTest.java      |    6 +
 .../startree/StarTreeIndexTestSegmentHelper.java   |    6 +
 .../pinot/core/startree/TestStarTreeMetadata.java  |    6 +
 .../hll/SegmentWithHllIndexCreateHelper.java       |    6 +
 .../org/apache/pinot/core/util/CrcUtilsTest.java   |    6 +
 .../pinot/queries/BaseMultiValueQueriesTest.java   |    6 +
 .../pinot/queries/BaseSingleValueQueriesTest.java  |    6 +
 .../apache/pinot/queries/FastHllQueriesTest.java   |    6 +
 .../segments/v1/creator/DictionariesTest.java      |    6 +
 .../pinot/segments/v1/creator/IntArraysTest.java   |    6 +
 .../test/java/org/apache/pinot/util/TestUtils.java |   64 +-
 pinot-distribution/pinot-assembly.xml              |    5 +
 .../pinot/hadoop/job/DefaultControllerRestApi.java |    4 +-
 .../pinot/hadoop/job/SegmentPreprocessingJob.java  |    7 +
 .../apache/pinot/hadoop/job/SegmentTarPushJob.java |    4 +-
 .../apache/pinot/hadoop/job/SegmentUriPushJob.java |    4 +-
 .../hadoop/job/mappers/SegmentCreationMapper.java  |    2 +-
 pinot-integration-tests/pom.xml                    |    1 +
 .../tests/BaseClusterIntegrationTest.java          |   59 +-
 .../tests/BaseClusterIntegrationTestSet.java       |   11 -
 .../tests/ClusterIntegrationTestUtils.java         |   43 +-
 .../pinot/integration/tests/ClusterTest.java       |    7 +-
 .../ControllerPeriodicTasksIntegrationTests.java   |    2 +-
 .../DeleteAPIHybridClusterIntegrationTest.java     |    2 +-
 ...lakyConsumerRealtimeClusterIntegrationTest.java |   14 +-
 .../tests/HybridClusterIntegrationTest.java        |    2 +-
 ...ridClusterIntegrationTestCommandLineRunner.java |   12 +-
 ...onaryAggregationPlanClusterIntegrationTest.java |    2 +-
 .../tests/OfflineClusterIntegrationTest.java       |    4 +-
 .../tests/PinotURIUploadIntegrationTest.java       |    7 +-
 .../tests/RealtimeClusterIntegrationTest.java      |   24 +-
 ....java => SegmentCompletionIntegrationTest.java} |   67 +-
 .../tests/StarTreeClusterIntegrationTest.java      |    2 +-
 .../tests/StarTreeV2ClusterIntegrationTest.java    |    2 +-
 .../tests/UploadRefreshDeleteIntegrationTest.java  |    2 +-
 .../org/apache/pinot/minion/MinionStarter.java     |    4 +-
 .../BaseMultipleSegmentsConversionExecutor.java    |   17 +-
 .../BaseSingleSegmentConversionExecutor.java       |   13 +-
 .../apache/pinot/minion/metrics/MinionMetrics.java |    6 +-
 pinot-perf/pom.xml                                 |    1 +
 .../apache/pinot/perf/BenchmarkQueryEngine.java    |    1 -
 .../perf/BenchmarkRealtimeConsumptionSpeed.java    |    8 +-
 .../org/apache/pinot/perf/RealtimeStressTest.java  |    8 +-
 .../org/apache/pinot/server/conf/ServerConf.java   |    7 +
 .../server/request/ScheduledRequestHandler.java    |   18 +-
 .../apache/pinot/server/starter/ServerBuilder.java |    4 +-
 .../request/ScheduledRequestHandlerTest.java       |   42 +-
 pinot-tools/pom.xml                                |   31 +
 .../org/apache/pinot/tools/HybridQuickstart.java   |   39 +-
 .../org/apache/pinot/tools/RealtimeQuickStart.java |   29 +-
 .../command/BackfillDateTimeColumnCommand.java     |    2 +-
 .../tools/admin/command/StartKafkaCommand.java     |   11 +-
 .../admin/command/StreamAvroIntoKafkaCommand.java  |   20 +-
 .../tools/admin/command/UploadSegmentCommand.java  |    6 +-
 .../pinot/tools/backfill/BackfillSegmentUtils.java |    7 +-
 .../pinot/tools/perf/PerfBenchmarkDriver.java      |   19 -
 .../pinot/tools/perf/PerfBenchmarkDriverConf.java  |   63 -
 .../pinot/tools/streams/AirlineDataStream.java     |   17 +-
 .../pinot/tools/streams/MeetupRsvpStream.java      |   28 +-
 .../airlineStats_realtime_table_config.json        |    0
 .../meetupRsvp_realtime_table_config.json          |    2 +-
 .../airlineStats_realtime_table_config.json        |   38 +
 .../meetupRsvp_realtime_table_config.json          |    5 +-
 .../meetupRsvp_realtime_table_config.json          |    2 +-
 .../apache/pinot/transport/netty/NettyServer.java  |   59 +-
 .../pinot/transport/common/ServerInstanceTest.java |   62 +-
 .../pinot/transport/netty/NettyTestUtils.java      |    8 +-
 .../transport/perf/ScatterGatherPerfClient.java    |    5 +-
 .../transport/perf/ScatterGatherPerfServer.java    |    8 +-
 .../pool/AsyncPoolResourceManagerAdapterTest.java  |   14 +-
 .../pinot/transport/pool/KeyedPoolImplTest.java    |   25 +-
 .../transport/scattergather/ScatterGatherTest.java |   24 +-
 pom.xml                                            |   25 +-
 .../app/pods/components/alert-details/component.js |   16 +-
 .../app/pods/components/alert-details/template.hbs |   21 +
 .../app/pods/manage/explore/route.js               |   10 +-
 .../app/pods/manage/explore/template.hbs           |    1 +
 .../app/pods/manage/yaml/route.js                  |    6 +-
 .../app/pods/manage/yaml/template.hbs              |    1 +
 thirdeye/thirdeye-frontend/app/utils/constants.js  |    1 +
 .../pods/components/yaml-editor/component-test.js  |    2 +-
 thirdeye/thirdeye-pinot/config/dashboard.yml       |    3 +-
 .../alert/content/BaseEmailContentFormatter.java   |   95 +-
 .../content/EntityGroupKeyContentFormatter.java    |  151 ++
 ...HierarchicalAnomaliesEmailContentFormatter.java |    5 +-
 ...a => MetricAnomaliesEmailContentFormatter.java} |   17 +-
 ...nboardingNotificationEmailContentFormatter.java |    1 +
 .../anomaly/alert/util/AnomalyReportGenerator.java |    2 +-
 .../anomaly/alert/v2/AlertTaskRunnerV2.java        |    2 +-
 .../anomaly/utils/ThirdeyeMetricsUtil.java         |    3 +
 .../dashboard/resources/v2/AnomaliesResource.java  |   24 +-
 .../dashboard/resources/v2/pojo/SearchFilters.java |    2 -
 .../thirdeye/detection/DefaultDataProvider.java    |    2 +-
 .../detection/DetectionPipelineTaskRunner.java     |   11 +-
 .../thirdeye/detection/DetectionResource.java      |   15 +-
 .../pinot/thirdeye/detection/DetectionUtils.java   |    9 -
 .../pinot/thirdeye/detection/ModelRetuneFlow.java  |   13 +-
 .../alert/scheme/DetectionEmailAlerter.java        |   43 +-
 .../AbsoluteChangeRuleAnomalyFilter.java           |    3 +-
 .../PercentageChangeRuleAnomalyFilter.java         |   10 +-
 .../SitewideImpactRuleAnomalyFilter.java           |    5 +-
 .../components/ThresholdRuleAnomalyFilter.java     |   14 +-
 .../components/TriggerConditionGrouper.java        |    9 +-
 .../detection/wrapper/AnomalyDetectorWrapper.java  |    6 +
 .../wrapper/ChildKeepingMergeWrapper.java          |   16 +-
 .../thirdeye/detection/wrapper/GrouperWrapper.java |   14 +-
 .../yaml/translator/DetectionConfigTranslator.java |   24 +-
 .../translator/SubscriptionConfigTranslator.java   |    3 +-
 .../pinot/thirdeye/formatter/DTOFormatter.java     |   38 +
 .../formatter/DetectionAlertConfigFormatter.java   |   46 +
 .../formatter/DetectionConfigFormatter.java        |  189 +++
 .../apache/pinot/thirdeye/util/ThirdEyeUtils.java  |    5 +-
 .../detector/entity-groupkey-anomaly-report.ftl    |   99 ++
 ...ly-report.ftl => metric-anomalies-template.ftl} |    0
 .../commons/TestEmailContentFormatterFactory.java  |    6 +-
 .../alert/content/ContentFormatterUtils.java       |   48 +
 ...> TestEntityGroupKeyEmailContentFormatter.java} |  138 +-
 ...HierarchicalAnomaliesEmailContentFormatter.java |   22 +-
 ... TestMetricAnomaliesEmailContentFormatter.java} |   26 +-
 ...TestOnboardingNotificationContentFormatter.java |   20 +-
 .../pinot/thirdeye/datalayer/DaoTestUtils.java     |   13 +
 .../thirdeye/detection/DetectionTestUtils.java     |    9 +
 .../AbsoluteChangeRuleAnomalyFilterTest.java       |   25 +-
 .../PercentageChangeRuleAnomalyFilterTest.java     |   60 +-
 .../SitewideImpactRuleAnomalyFilterTest.java       |   20 +-
 .../components/ThresholdRuleAnomalyFilterTest.java |   56 +-
 .../components/TriggerConditionGrouperTest.java    |    3 +-
 .../wrapper/AnomalyDetectorWrapperTest.java        |    4 +-
 .../thirdeye/detection/yaml/YamlResourceTest.java  |    2 +-
 .../formatter/DetectionConfigFormatterTest.java    |   82 ++
 .../tools/RunAdhocDatabaseQueriesTool.java         |   31 +-
 .../detection/yaml/alertconfig/alert-config-5.yaml |    2 +-
 .../compositePipelineTranslatorTestResult-1.json   |    4 +-
 .../compositePipelineTranslatorTestResult-2.json   |    1 +
 .../compositePipelineTranslatorTestResult-4.json   |    1 +
 .../compositePipelineTranslatorTestResult-5.json   |    4 +
 ...st-entity-groupby-email-content-formatter.html} |   84 +-
 ...st-hierarchical-metric-anomalies-template.html} |    0
 ...er.html => test-metric-anomalies-template.html} |    0
 259 files changed, 9209 insertions(+), 6635 deletions(-)
 delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/CfgBasedRouting.java
 delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/broker/EmptyBrokerOnlineOfflineStateModelFactory.java
 delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/broker/EmptySegmentOnlineOfflineStateModelFactory.java
 delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStarterUtils.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/server/KafkaDataProducer.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/server/KafkaDataServerStartable.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/resources/META-INF/services/org.apache.pinot.core.realtime.stream.StreamConsumerFactory
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/README.md
 copy pinot-connectors/{pinot-connector-kafka-0.9 => pinot-connector-kafka-2.0}/pom.xml (61%)
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaConsumerFactory.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaMessageBatch.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelConnectionHandler.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelConsumer.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelStreamConfig.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaStreamLevelConsumer.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaStreamLevelConsumerManager.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaStreamLevelStreamConfig.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaStreamMetadataProvider.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/server/KafkaDataProducer.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/server/KafkaDataServerStartable.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/resources/META-INF/services/org.apache.pinot.core.realtime.stream.StreamConsumerFactory
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/test/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelConsumerTest.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/test/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelStreamConfigTest.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/test/java/org/apache/pinot/core/realtime/impl/kafka2/utils/EmbeddedZooKeeper.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/test/java/org/apache/pinot/core/realtime/impl/kafka2/utils/MiniKafkaCluster.java
 create mode 100644 pinot-connectors/pinot-connector-kafka-base/README.md
 copy pinot-connectors/{ => pinot-connector-kafka-base}/pom.xml (60%)
 rename pinot-connectors/{pinot-connector-kafka-0.9 => pinot-connector-kafka-base}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaAvroMessageDecoder.java (100%)
 rename pinot-connectors/{pinot-connector-kafka-0.9 => pinot-connector-kafka-base}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaJSONMessageDecoder.java (100%)
 create mode 100644 pinot-connectors/pinot-connector-kafka-base/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStarterUtils.java
 rename pinot-connectors/{pinot-connector-kafka-0.9 => pinot-connector-kafka-base}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamConfigProperties.java (96%)
 copy pinot-common/src/main/java/org/apache/pinot/common/metrics/ControllerMetrics.java => pinot-connectors/pinot-connector-kafka-base/src/main/java/org/apache/pinot/core/realtime/impl/kafka/MessageAndOffset.java (55%)
 rename pinot-core/src/main/java/org/apache/pinot/core/data/recordtransformer/{CompoundTransformer.java => CompositeTransformer.java} (70%)
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/recordtransformer/NullValueTransformer.java
 rename pinot-core/src/main/java/org/apache/pinot/core/data/recordtransformer/{SanitationTransformer.java => SanitizationTransformer.java} (92%)
 copy pinot-common/src/main/java/org/apache/pinot/common/metrics/ControllerMetrics.java => pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamDataProducer.java (54%)
 create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamDataProvider.java
 copy pinot-common/src/main/java/org/apache/pinot/common/metrics/ControllerMetrics.java => pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamDataServerStartable.java (53%)
 rename pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/{SegmentCompletionIntegrationTests.java => SegmentCompletionIntegrationTest.java} (89%)
 copy pinot-tools/src/main/resources/sample_data/{ => kafka_0.9}/airlineStats_realtime_table_config.json (100%)
 copy pinot-tools/src/main/resources/sample_data/{ => kafka_0.9}/meetupRsvp_realtime_table_config.json (94%)
 create mode 100644 pinot-tools/src/main/resources/sample_data/kafka_2.0/airlineStats_realtime_table_config.json
 copy pinot-tools/src/main/resources/sample_data/{ => kafka_2.0}/meetupRsvp_realtime_table_config.json (82%)
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/EntityGroupKeyContentFormatter.java
 rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/{MultipleAnomaliesEmailContentFormatter.java => MetricAnomaliesEmailContentFormatter.java} (92%)
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/formatter/DTOFormatter.java
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/formatter/DetectionAlertConfigFormatter.java
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/formatter/DetectionConfigFormatter.java
 create mode 100644 thirdeye/thirdeye-pinot/src/main/resources/org/apache/pinot/thirdeye/detector/entity-groupkey-anomaly-report.ftl
 rename thirdeye/thirdeye-pinot/src/main/resources/org/apache/pinot/thirdeye/detector/{holiday-anomaly-report.ftl => metric-anomalies-template.ftl} (100%)
 create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/content/ContentFormatterUtils.java
 copy thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/content/{TestMultipleAnomaliesEmailContentFormatter.java => TestEntityGroupKeyEmailContentFormatter.java} (58%)
 rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/content/{TestMultipleAnomaliesEmailContentFormatter.java => TestMetricAnomaliesEmailContentFormatter.java} (86%)
 create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/formatter/DetectionConfigFormatterTest.java
 copy thirdeye/thirdeye-pinot/src/test/resources/{test-multiple-anomalies-email-content-formatter.html => test-entity-groupby-email-content-formatter.html} (58%)
 rename thirdeye/thirdeye-pinot/src/test/resources/{test-hierarchical-anomalies-email-content-formatter.html => test-hierarchical-metric-anomalies-template.html} (100%)
 rename thirdeye/thirdeye-pinot/src/test/resources/{test-multiple-anomalies-email-content-formatter.html => test-metric-anomalies-template.html} (100%)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org