You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by jl...@apache.org on 2019/06/01 02:37:39 UTC

[incubator-pinot] branch create-lead-controller-resource updated (e091ac6 -> eb9ec2c)

This is an automated email from the ASF dual-hosted git repository.

jlli pushed a change to branch create-lead-controller-resource
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


 discard e091ac6  Separate Helix cluster creation logic
    omit 02cd55b  Create leadControllerResource in Helix cluster
     add 447f7fc  [TE] frontend - harleyjj/edit-alert - use new yaml components in edit-alert (#4237)
     add a22bf9c  [TE] Destroy PhantomJS process after 3 minutes timeout (#4247)
     add 1ca1436  [TE] make holter winters rule to return the current timeseries (#4249)
     add 106c5a0  Make ControllerLeadershipManager thread-safe and register it to PARTICIPANT HelixManager (#4245)
     add 8c8c0ae  Add config to disable HLC realtime segment completion (#4235)
     add be62932  [TE] Change process timeout to 2 minutes (#4255)
     add 3ce335a  [TE] frontend - harleyjj/application - redirect http to https (#4238)
     add 951a781  Unify controller base url in integration test (#4257)
     add 7abfb12  SoC - Separate out Tuning from Translator (#4250)
     add 62ce57f  Add RealtimeConsumptionCatchupServiceCallback (#4218)
     add 3b9ebea  [TE] add padding to baseline endpoints (#4260)
     add e768195  [TE] add current time series if it's unavailable  in predicted baseline endpoint (#4262)
     add 27b61a1  [TE] add padding to graphs in email and Anomalies route (#4263)
     add d540d95  Change ControllerTest default prot to 18998 (#4259)
     add f5c19f6  [TE] frontend - remove unnecessary flag for noExistingSubscriptionGroup (#4256)
     add 0c7a20f  [TE] frontend - harleyjj/preview - ensure zoom buttons are over shaded region (#4254)
     add 22b56ed  Update the documentation for FASTHLL (#4251)
     add 00c2204  pinot-connector-kafka-0.9 module (#4252)
     add 5b4454b  Create leadControllerResource in Helix cluster
     add eb9ec2c  Separate Helix cluster creation logic

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (e091ac6)
            \
             N -- N -- N   refs/heads/create-lead-controller-resource (eb9ec2c)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:
 .gitignore                                         |   6 -
 docs/pql_examples.rst                              |   6 +-
 .../broker/broker/helix/HelixBrokerStarter.java    |  34 +-
 pinot-common/pom.xml                               |  18 -
 .../pinot/common/config/TableNameBuilder.java      |   7 +
 .../apache/pinot/common/utils/CommonConstants.java |   3 +
 .../apache/pinot/common/utils/ServiceStatus.java   | 107 ++--
 {docs => pinot-connectors}/README.md               |   9 +-
 .../pinot-connector-kafka-0.9}/README.md           |  10 +-
 .../pinot-connector-kafka-0.9}/pom.xml             |  58 +--
 .../realtime/impl/kafka/ConsumerAndIterator.java   |   0
 .../impl/kafka/KafkaAvroMessageDecoder.java        |   0
 .../realtime/impl/kafka/KafkaBrokerWrapper.java    |   0
 .../impl/kafka/KafkaConnectionHandler.java         |   0
 .../realtime/impl/kafka/KafkaConsumerFactory.java  |   0
 .../realtime/impl/kafka/KafkaConsumerManager.java  |   0
 .../impl/kafka/KafkaHighLevelStreamConfig.java     |   0
 .../impl/kafka/KafkaJSONMessageDecoder.java        |   0
 .../impl/kafka/KafkaLowLevelStreamConfig.java      |   0
 .../impl/kafka/KafkaPartitionLevelConsumer.java    |   0
 .../impl/kafka/KafkaSimpleConsumerFactory.java     |   0
 .../impl/kafka/KafkaSimpleConsumerFactoryImpl.java |   0
 .../realtime/impl/kafka}/KafkaStarterUtils.java    |   3 +-
 .../impl/kafka/KafkaStreamConfigProperties.java    |   0
 .../impl/kafka/KafkaStreamLevelConsumer.java       |   0
 .../impl/kafka/KafkaStreamMetadataProvider.java    |   0
 .../realtime/impl/kafka/SimpleConsumerFactory.java |   0
 .../impl/kafka/SimpleConsumerMessageBatch.java     |   0
 .../impl/kafka/KafkaLowLevelStreamConfigTest.java  |   0
 .../kafka/KafkaPartitionLevelConsumerTest.java     |   0
 .../pom.xml                                        |  41 +-
 .../apache/pinot/controller/ControllerConf.java    |  14 +-
 .../controller/ControllerLeadershipManager.java    |  83 ++-
 .../apache/pinot/controller/ControllerStarter.java |  33 +-
 .../helix/core/PinotHelixResourceManager.java      |  25 +-
 .../pinot/controller/helix/ControllerTest.java     |   2 +-
 .../controller/helix/PinotControllerModeTest.java  |   5 +-
 pinot-core/pom.xml                                 |  16 -
 .../AvroRecordToPinotRowGenerator.java             |   0
 .../kafka => stream}/SimpleAvroMessageDecoder.java |   0
 .../pinot/core/realtime/stream/StreamConfig.java   |   4 +-
 .../AvroRecordToPinotRowGeneratorTest.java         |   0
 pinot-integration-tests/pom.xml                    |   6 +
 .../tests/BaseClusterIntegrationTest.java          |   2 +-
 .../ControllerPeriodicTasksIntegrationTests.java   |   2 +-
 .../tests/HybridClusterIntegrationTest.java        |   3 +-
 ...ridClusterIntegrationTestCommandLineRunner.java |   2 +-
 .../tests/LLCRealtimeClusterIntegrationTest.java   |  40 ++
 .../tests/NewConfigApplyIntegrationTest.java       |  12 +-
 .../tests/OfflineClusterIntegrationTest.java       |  38 +-
 .../tests/PinotURIUploadIntegrationTest.java       |   2 +-
 .../tests/RealtimeClusterIntegrationTest.java      |   3 +-
 pinot-perf/pom.xml                                 |   6 +
 .../perf/BenchmarkRealtimeConsumptionSpeed.java    |   2 +-
 .../org/apache/pinot/perf/RealtimeStressTest.java  |   2 +-
 .../server/starter/helix/HelixServerStarter.java   |  73 ++-
 pinot-tools/pom.xml                                |   6 +
 .../org/apache/pinot/tools/HybridQuickstart.java   |   2 +-
 .../org/apache/pinot/tools/RealtimeQuickStart.java |   2 +-
 .../tools/admin/command/StartKafkaCommand.java     |   2 +-
 .../admin/command/StreamAvroIntoKafkaCommand.java  |   2 +-
 .../pinot/tools/streams/AirlineDataStream.java     |   2 +-
 .../pinot/tools/streams/MeetupRsvpStream.java      |   2 +-
 pom.xml                                            |  16 +-
 .../app/pods/application/route.js                  |   8 +-
 .../app/pods/components/alert-details/component.js |  59 +--
 .../app/pods/components/alert-details/template.hbs | 576 +++++++++++----------
 .../pods/components/anomaly-summary/component.js   |  28 +-
 .../pods/components/detection-yaml/component.js    |  24 +-
 .../pods/components/detection-yaml/template.hbs    |   2 +-
 .../pods/components/subscription-yaml/component.js | 205 +-------
 .../pods/components/subscription-yaml/template.hbs |  15 +-
 .../pods/components/timeseries-chart/component.js  |  57 +-
 .../app/pods/manage/yaml/controller.js             | 135 ++++-
 .../app/pods/manage/yaml/route.js                  |  51 +-
 .../app/pods/manage/yaml/template.hbs              |  66 ++-
 .../app/pods/screenshot/controller.js              |  21 +-
 .../thirdeye-frontend/app/pods/screenshot/route.js |   7 +-
 .../app/pods/self-serve/create-alert/controller.js |  12 +
 .../app/pods/self-serve/create-alert/route.js      |  52 +-
 .../app/pods/self-serve/create-alert/template.hbs  |   4 +
 .../anomaly/alert/util/EmailScreenshotHelper.java  |   7 +-
 .../api/application/ApplicationResource.java       |   2 +-
 .../thirdeye/detection/DetectionPipeline.java      |  17 +-
 .../thirdeye/detection/DetectionResource.java      |  41 +-
 .../pinot/thirdeye/detection/DetectionUtils.java   |  18 +-
 .../annotation/registry/DetectionRegistry.java     |   4 +-
 .../components/AbsoluteChangeRuleDetector.java     |   5 +-
 .../detection/components/HoltWintersDetector.java  |   2 +-
 .../components/PercentageChangeRuleDetector.java   |   5 +-
 .../detection/components/RuleBaselineProvider.java |  13 +-
 .../components/ThresholdRuleDetector.java          |   1 -
 .../onboard/YamlOnboardingTaskRunner.java          |  18 +-
 .../detection/validators/ConfigValidator.java      |   2 +-
 .../validators/SubscriptionConfigValidator.java    |   2 +-
 .../detection/wrapper/AnomalyDetectorWrapper.java  |   2 +-
 .../detection/wrapper/AnomalyFilterWrapper.java    |   2 +-
 .../wrapper/BaselineFillingMergeWrapper.java       |  12 +-
 .../thirdeye/detection/wrapper/GrouperWrapper.java |   2 +-
 .../detection/yaml/DetectionConfigTuner.java       | 178 +++++++
 .../thirdeye/detection/yaml/YamlResource.java      |  36 +-
 .../detection/yaml/YamlTranslationResult.java      |  87 ----
 .../CompositePipelineConfigTranslator.java         | 113 ++--
 .../yaml/translator/ConfigTranslator.java          |  55 ++
 .../YamlDetectionAlertConfigTranslator.java        |  48 +-
 .../YamlDetectionConfigTranslator.java             |  57 +-
 .../YamlDetectionTranslatorLoader.java             |   2 +-
 .../thirdeye/rootcause/impl/MetricEntity.java      |  13 +
 .../thirdeye/detection/DetectionUtilsTest.java     |  43 +-
 .../components/RuleBaselineProviderTest.java       |   6 +-
 .../yaml/MockYamlDetectionConfigTranslator.java    |  21 -
 .../yaml/YamlDetectionConfigTranslatorTest.java    |  60 ---
 .../CompositePipelineConfigTranslatorTest.java     |  38 +-
 .../YamlDetectionAlertConfigTranslatorTest.java    |  13 +-
 .../yaml/translator/YamlTranslationResult.java}    |  36 +-
 .../compositePipelineTranslatorTestResult-1.json   |   6 +-
 .../compositePipelineTranslatorTestResult-2.json   |   0
 .../yaml/{ => translator}/pipeline-config-1.yaml   |   2 +-
 .../yaml/{ => translator}/pipeline-config-2.yaml   |   0
 .../yaml/{ => translator}/pipeline-config-3.yaml   |   0
 120 files changed, 1684 insertions(+), 1318 deletions(-)
 copy {docs => pinot-connectors}/README.md (67%)
 copy {docs => pinot-connectors/pinot-connector-kafka-0.9}/README.md (60%)
 copy {pinot-orc => pinot-connectors/pinot-connector-kafka-0.9}/pom.xml (59%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/ConsumerAndIterator.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaAvroMessageDecoder.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaBrokerWrapper.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConnectionHandler.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerFactory.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerManager.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaHighLevelStreamConfig.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaJSONMessageDecoder.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfig.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaPartitionLevelConsumer.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactory.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactoryImpl.java (100%)
 rename {pinot-common/src/main/java/org/apache/pinot/common/utils => pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka}/KafkaStarterUtils.java (98%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamConfigProperties.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamLevelConsumer.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamMetadataProvider.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerFactory.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerMessageBatch.java (100%)
 rename {pinot-core => pinot-connectors/pinot-connector-kafka-0.9}/src/test/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfigTest.java (100%)
 rename {pinot-core/src/test/java/org/apache/pinot/core/realtime => pinot-connectors/pinot-connector-kafka-0.9/src/test/java/org/apache/pinot/core/realtime/impl}/kafka/KafkaPartitionLevelConsumerTest.java (100%)
 copy {pinot-azure-filesystem => pinot-connectors}/pom.xml (74%)
 rename pinot-core/src/main/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/AvroRecordToPinotRowGenerator.java (100%)
 rename pinot-core/src/main/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/SimpleAvroMessageDecoder.java (100%)
 rename pinot-core/src/test/java/org/apache/pinot/core/realtime/{impl/kafka => stream}/AvroRecordToPinotRowGeneratorTest.java (100%)
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/DetectionConfigTuner.java
 delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/YamlTranslationResult.java
 rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/CompositePipelineConfigTranslator.java (79%)
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/translator/ConfigTranslator.java
 rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionAlertConfigTranslator.java (84%)
 rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionConfigTranslator.java (54%)
 rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionTranslatorLoader.java (96%)
 copy pinot-common/src/test/java/org/apache/pinot/common/utils/DataSizeTest.java => thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/DetectionUtilsTest.java (55%)
 delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/MockYamlDetectionConfigTranslator.java
 delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/YamlDetectionConfigTranslatorTest.java
 rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/CompositePipelineConfigTranslatorTest.java (78%)
 rename thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/YamlDetectionAlertConfigTranslatorTest.java (88%)
 copy thirdeye/thirdeye-pinot/src/{main/java/org/apache/pinot/thirdeye/anomaly/onboard/ReplayTaskInfo.java => test/java/org/apache/pinot/thirdeye/detection/yaml/translator/YamlTranslationResult.java} (60%)
 rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/compositePipelineTranslatorTestResult-1.json (96%)
 rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/compositePipelineTranslatorTestResult-2.json (100%)
 rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-1.yaml (97%)
 rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-2.yaml (100%)
 rename thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/{ => translator}/pipeline-config-3.yaml (100%)


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org