You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by jl...@apache.org on 2019/06/04 18:29:49 UTC
[incubator-pinot] branch helix_084_release_branch updated (1ebcfd9
-> dcb261e)
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch helix_084_release_branch
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 1ebcfd9 Release branch only:Upgrade helix to 0.8.4 for release
add 8c8c0ae Add config to disable HLC realtime segment completion (#4235)
add be62932 [TE] Change process timeout to 2 minutes (#4255)
add 3ce335a [TE] frontend - harleyjj/application - redirect http to https (#4238)
add 951a781 Unify controller base url in integration test (#4257)
add 7abfb12 SoC - Separate out Tuning from Translator (#4250)
add 62ce57f Add RealtimeConsumptionCatchupServiceCallback (#4218)
add 3b9ebea [TE] add padding to baseline endpoints (#4260)
add e768195 [TE] add current time series if it's unavailable in predicted baseline endpoint (#4262)
add 27b61a1 [TE] add padding to graphs in email and Anomalies route (#4263)
add d540d95 Change ControllerTest default prot to 18998 (#4259)
add f5c19f6 [TE] frontend - remove unnecessary flag for noExistingSubscriptionGroup (#4256)
add 0c7a20f [TE] frontend - harleyjj/preview - ensure zoom buttons are over shaded region (#4254)
add 22b56ed Update the documentation for FASTHLL (#4251)
add 00c2204 pinot-connector-kafka-0.9 module (#4252)
add 55a20b2 [TE] detection config semantic validation fix (#4267)
add 69f29c3 [TE] Cube algorithm for ratio metrics (#4246)
add ccab9a1 Fix controller metric (#4274)
add 3ecdc5c Avoid negative sleep time in startupServiceStatusCheck (#4276)
add 4e3c7d9 [TE] Change default auto onboard frequency to 6 hours (#4258)
add 4c9ac58 [TE] pass alertId to preview in Edit Alert (#4275)
add f026f45 Fix the potentail negative sleep time in HelixServerStarter (#4277)
new dcb261e Release branch only:Upgrade helix to 0.8.4 for release
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (1ebcfd9)
\
N -- N -- N refs/heads/helix_084_release_branch (dcb261e)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.gitignore | 6 -
docs/pql_examples.rst | 6 +-
.../broker/broker/helix/HelixBrokerStarter.java | 34 ++-
pinot-common/pom.xml | 18 --
.../pinot/common/config/TableNameBuilder.java | 7 +
.../apache/pinot/common/utils/CommonConstants.java | 3 +
.../apache/pinot/common/utils/ServiceStatus.java | 107 ++++----
{docs => pinot-connectors}/README.md | 9 +-
.../pinot-connector-kafka-0.9}/README.md | 10 +-
.../pinot-connector-kafka-0.9}/pom.xml | 58 ++---
.../realtime/impl/kafka/ConsumerAndIterator.java | 0
.../impl/kafka/KafkaAvroMessageDecoder.java | 0
.../realtime/impl/kafka/KafkaBrokerWrapper.java | 0
.../impl/kafka/KafkaConnectionHandler.java | 0
.../realtime/impl/kafka/KafkaConsumerFactory.java | 0
.../realtime/impl/kafka/KafkaConsumerManager.java | 0
.../impl/kafka/KafkaHighLevelStreamConfig.java | 0
.../impl/kafka/KafkaJSONMessageDecoder.java | 0
.../impl/kafka/KafkaLowLevelStreamConfig.java | 0
.../impl/kafka/KafkaPartitionLevelConsumer.java | 0
.../impl/kafka/KafkaSimpleConsumerFactory.java | 0
.../impl/kafka/KafkaSimpleConsumerFactoryImpl.java | 0
.../realtime/impl/kafka}/KafkaStarterUtils.java | 3 +-
.../impl/kafka/KafkaStreamConfigProperties.java | 0
.../impl/kafka/KafkaStreamLevelConsumer.java | 0
.../impl/kafka/KafkaStreamMetadataProvider.java | 0
.../realtime/impl/kafka/SimpleConsumerFactory.java | 0
.../impl/kafka/SimpleConsumerMessageBatch.java | 0
.../impl/kafka/KafkaLowLevelStreamConfigTest.java | 0
.../kafka/KafkaPartitionLevelConsumerTest.java | 0
.../pom.xml | 41 +--
.../apache/pinot/controller/ControllerConf.java | 15 +-
.../apache/pinot/controller/ControllerStarter.java | 18 +-
.../helix/core/PinotHelixResourceManager.java | 25 +-
.../pinot/controller/helix/ControllerTest.java | 2 +-
pinot-core/pom.xml | 16 --
.../AvroRecordToPinotRowGenerator.java | 0
.../kafka => stream}/SimpleAvroMessageDecoder.java | 0
.../pinot/core/realtime/stream/StreamConfig.java | 4 +-
.../AvroRecordToPinotRowGeneratorTest.java | 0
pinot-integration-tests/pom.xml | 6 +
.../tests/BaseClusterIntegrationTest.java | 2 +-
.../ControllerPeriodicTasksIntegrationTests.java | 2 +-
.../tests/HybridClusterIntegrationTest.java | 3 +-
...ridClusterIntegrationTestCommandLineRunner.java | 2 +-
.../tests/LLCRealtimeClusterIntegrationTest.java | 40 +++
.../tests/NewConfigApplyIntegrationTest.java | 12 +-
.../tests/OfflineClusterIntegrationTest.java | 38 ++-
.../tests/PinotURIUploadIntegrationTest.java | 2 +-
.../tests/RealtimeClusterIntegrationTest.java | 3 +-
pinot-perf/pom.xml | 6 +
.../perf/BenchmarkRealtimeConsumptionSpeed.java | 2 +-
.../org/apache/pinot/perf/RealtimeStressTest.java | 2 +-
.../server/starter/helix/HelixServerStarter.java | 104 ++++++--
.../request/ScheduledRequestHandlerTest.java | 10 +-
pinot-tools/pom.xml | 6 +
.../org/apache/pinot/tools/HybridQuickstart.java | 2 +-
.../org/apache/pinot/tools/RealtimeQuickStart.java | 2 +-
.../tools/admin/command/StartKafkaCommand.java | 2 +-
.../admin/command/StreamAvroIntoKafkaCommand.java | 2 +-
.../pinot/tools/streams/AirlineDataStream.java | 2 +-
.../pinot/tools/streams/MeetupRsvpStream.java | 2 +-
pom.xml | 16 +-
.../app/pods/application/route.js | 8 +-
.../app/pods/components/alert-details/component.js | 59 ++---
.../app/pods/components/alert-details/template.hbs | 5 +-
.../pods/components/anomaly-summary/component.js | 28 +-
.../pods/components/timeseries-chart/component.js | 57 ++++-
.../app/pods/manage/yaml/controller.js | 31 +--
.../app/pods/manage/yaml/template.hbs | 1 +
.../app/pods/screenshot/controller.js | 21 +-
.../thirdeye-frontend/app/pods/screenshot/route.js | 7 +-
.../anomaly/alert/util/EmailScreenshotHelper.java | 2 +-
.../api/application/ApplicationResource.java | 2 +-
.../auto/onboard/AutoOnboardConfiguration.java | 2 +-
.../thirdeye/cube/additive/AdditiveCubeNode.java | 53 ++--
.../thirdeye/cube/additive/AdditiveDBClient.java | 12 +-
.../pinot/thirdeye/cube/additive/AdditiveRow.java | 7 +-
.../pinot/thirdeye/cube/cost/CostFunction.java | 1 +
.../thirdeye/cube/cost/RatioCostFunction.java | 136 ++++++++++
.../apache/pinot/thirdeye/cube/data/cube/Cube.java | 3 +-
.../pinot/thirdeye/cube/data/cube/CubeUtils.java | 25 ++
.../cube/data/cube/DimNameValueCostEntry.java | 54 ++--
.../cube/data/dbclient/BaseCubePinotClient.java | 12 +
.../pinot/thirdeye/cube/data/dbrow/BaseRow.java | 25 ++
.../thirdeye/cube/data/node/BaseCubeNode.java | 49 +++-
.../pinot/thirdeye/cube/data/node/CubeNode.java | 12 +-
.../thirdeye/cube/data/node/CubeNodeUtils.java | 7 +-
.../MultiDimensionalRatioSummary.java} | 76 ++----
.../MultiDimensionalSummary.java | 38 ++-
.../MultiDimensionalSummaryCLITool.java | 6 +-
.../pinot/thirdeye/cube/entry/SummaryUtils.java | 43 ++++
.../pinot/thirdeye/cube/ratio/RatioCubeNode.java | 285 +++++++++++++++++++++
.../pinot/thirdeye/cube/ratio/RatioDBClient.java | 113 ++++++++
.../apache/pinot/thirdeye/cube/ratio/RatioRow.java | 190 ++++++++++++++
.../thirdeye/cube/summary/BaseResponseRow.java | 7 +-
.../pinot/thirdeye/cube/summary/Summary.java | 43 ++--
.../thirdeye/cube/summary/SummaryResponse.java | 33 +--
.../dashboard/resources/SummaryResource.java | 78 +++++-
.../thirdeye/detection/DetectionPipeline.java | 17 +-
.../thirdeye/detection/DetectionResource.java | 41 ++-
.../pinot/thirdeye/detection/DetectionUtils.java | 18 +-
.../annotation/registry/DetectionRegistry.java | 4 +-
.../components/AbsoluteChangeRuleDetector.java | 5 +-
.../components/PercentageChangeRuleDetector.java | 5 +-
.../detection/components/RuleBaselineProvider.java | 13 +-
.../components/ThresholdRuleDetector.java | 1 -
.../onboard/YamlOnboardingTaskRunner.java | 18 +-
.../detection/validators/ConfigValidator.java | 2 +-
.../validators/SubscriptionConfigValidator.java | 2 +-
.../detection/wrapper/AnomalyDetectorWrapper.java | 2 +-
.../detection/wrapper/AnomalyFilterWrapper.java | 2 +-
.../wrapper/BaselineFillingMergeWrapper.java | 12 +-
.../thirdeye/detection/wrapper/GrouperWrapper.java | 2 +-
.../detection/yaml/DetectionConfigTuner.java | 180 +++++++++++++
.../thirdeye/detection/yaml/YamlResource.java | 36 ++-
.../detection/yaml/YamlTranslationResult.java | 87 -------
.../CompositePipelineConfigTranslator.java | 113 +++-----
.../translator/ConfigTranslator.java} | 42 +--
.../YamlDetectionAlertConfigTranslator.java | 48 ++--
.../YamlDetectionConfigTranslator.java | 57 +----
.../YamlDetectionTranslatorLoader.java | 2 +-
.../thirdeye/rootcause/impl/MetricEntity.java | 13 +
.../MultiDimensionalSummaryCLIToolTest.java | 1 +
.../pinot/thirdeye/cube/data/cube/CubeTest.java | 14 +-
.../cube/data/cube/DimNameValueCostEntryTest.java | 7 +-
.../cube/data/dbrow/DimensionValuesTest.java | 1 -
.../thirdeye/cube/data/dbrow/DimensionsTest.java | 1 -
.../cube/data/node/AdditiveCubeNodeTest.java | 61 +++++
.../thirdeye/cube/data/node/CubeNodeTest.java | 49 ++--
.../thirdeye/cube/data/node/RatioCubeNodeTest.java | 112 ++++++++
.../thirdeye/detection/DetectionUtilsTest.java | 43 ++--
.../components/RuleBaselineProviderTest.java | 6 +-
.../yaml/MockYamlDetectionConfigTranslator.java | 21 --
.../yaml/YamlDetectionConfigTranslatorTest.java | 60 -----
.../CompositePipelineConfigTranslatorTest.java | 38 ++-
.../YamlDetectionAlertConfigTranslatorTest.java | 13 +-
.../yaml/translator/YamlTranslationResult.java} | 36 ++-
.../compositePipelineTranslatorTestResult-1.json | 6 +-
.../compositePipelineTranslatorTestResult-2.json | 0
.../yaml/{ => translator}/pipeline-config-1.yaml | 2 +-
.../yaml/{ => translator}/pipeline-config-2.yaml | 0
.../yaml/{ => translator}/pipeline-config-3.yaml | 0
143 files changed, 2316 insertions(+), 1058 deletions(-)
copy {docs => pinot-connectors}/README.md (67%)
copy {docs => pinot-connectors/pinot-connector-kafka-0.9}/README.md (60%)
copy {pinot-orc => pinot-connectors/pinot-connector-kafka-0.9}/pom.xml (59%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/ConsumerAndIterator.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaAvroMessageDecoder.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaBrokerWrapper.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConnectionHandler.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerFactory.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerManager.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaHighLevelStreamConfig.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaJSONMessageDecoder.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfig.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaPartitionLevelConsumer.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactory.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactoryImpl.java (100%)
rename {pinot-common/src/main/java/org/apache/pinot/common/utils => pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka}/KafkaStarterUtils.java (98%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamConfigProperties.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamLevelConsumer.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamMetadataProvider.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerFactory.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerMessageBatch.java (100%)
rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/test/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfigTest.java (100%)
rename {pinot-core/src/test/java/org/apache/pinot/core/realtime => pinot-connectors/pinot-connector-kafka-0.9/src/test/java/org/apache/pinot/core/realtime/impl}/kafka/KafkaPartitionLevelConsumerTest.java (100%)
copy {pinot-azure-filesystem => pinot-connectors}/pom.xml (74%)
rename pinot-core/src/main/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/AvroRecordToPinotRowGenerator.java (100%)
rename pinot-core/src/main/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/SimpleAvroMessageDecoder.java (100%)
rename pinot-core/src/test/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/AvroRecordToPinotRowGeneratorTest.java (100%)
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/cost/RatioCostFunction.java
copy thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/{additive/MultiDimensionalSummary.java => entry/MultiDimensionalRatioSummary.java} (56%)
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/{additive => entry}/MultiDimensionalSummary.java (80%)
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/{additive => entry}/MultiDimensionalSummaryCLITool.java (97%)
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/entry/SummaryUtils.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/ratio/RatioCubeNode.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/ratio/RatioDBClient.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/cube/ratio/RatioRow.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/DetectionConfigTuner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/YamlTranslationResult.java
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/CompositePipelineConfigTranslator.java (79%)
copy thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/{validators/ConfigValidator.java => yaml/translator/ConfigTranslator.java} (50%)
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionAlertConfigTranslator.java (83%)
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionConfigTranslator.java (54%)
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionTranslatorLoader.java (96%)
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/cube/data/node/AdditiveCubeNodeTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/cube/data/node/RatioCubeNodeTest.java
copy pinot-common/src/test/java/org/apache/pinot/common/utils/DataSizeTest.java => thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/DetectionUtilsTest.java (55%)
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/MockYamlDetectionConfigTranslator.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/YamlDetectionConfigTranslatorTest.java
rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/CompositePipelineConfigTranslatorTest.java (78%)
rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionAlertConfigTranslatorTest.java (88%)
copy thirdeye/thirdeye-pinot/src/{main/java/org/apache/pinot/thirdeye/anomaly/onboard/ReplayTaskInfo.java => test/java/org/apache/pinot/thirdeye/detection/yaml/translator/YamlTranslationResult.java} (60%)
rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/compositePipelineTranslatorTestResult-1.json (96%)
rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/compositePipelineTranslatorTestResult-2.json (100%)
rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-1.yaml (97%)
rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-2.yaml (100%)
rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-3.yaml (100%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org
[incubator-pinot] 01/01: Release branch only:Upgrade helix to 0.8.4
for release
Posted by jl...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a commit to branch helix_084_release_branch
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git
commit dcb261e43a5057fd546906a533cdeabbda3395a7
Author: Neha Pawar <np...@linkedin.com>
AuthorDate: Tue May 28 16:02:18 2019 -0700
Release branch only:Upgrade helix to 0.8.4 for release
---
pom.xml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/pom.xml b/pom.xml
index 930fb6b..bfdcdac 100644
--- a/pom.xml
+++ b/pom.xml
@@ -118,7 +118,7 @@
<!-- Configuration for unit/integration tests section 1 of 3 (properties) ENDS HERE.-->
<avro.version>1.7.6</avro.version>
<parquet.version>1.8.0</parquet.version>
- <helix.version>0.8.2</helix.version>
+ <helix.version>0.8.4</helix.version>
<zkclient.version>0.7</zkclient.version>
<jackson.version>2.9.8</jackson.version>
<async-http-client.version>1.9.21</async-http-client.version>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org