You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by jl...@apache.org on 2019/01/25 19:45:12 UTC
[incubator-pinot] branch cache-table-schemas-in-broker updated
(11bdffa -> cfd43e8)
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch cache-table-schemas-in-broker
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 11bdffa Reduce the time of generating filterQueryTree
discard f48296b Add guava cache to cache table schema in pinot broker; Check non-exsitence columns in broker; Cache table schema when state of table becomes online in broker; Emit a metric if column mismatched; Create RequestParams class to extra fields from JsonObject.
new fd09b02 [TE] Annotate and update the registry with alert filter types (#3692)
new 3755e83 Add touch method in PinotFS; Call touch when moving deleted segments. (#3684)
new e6dd1ec Cleaning up the pom.xml file (#3695)
new 53923bc Fix the TableConfig toJSONConfig() method (#3694)
new 148f992 [TE] - frontend harleyjj/yaml - reset and view documentation buttons (#3699)
new c48a38b [TE] Translate Alert Config to Yaml (#3702)
new 42002f3 Fix the json deserialization issue in ColumnPartitionMetadata (#3703)
new 25d21cc Cleaning up the license-maven-plugin (#3706)
new d0d5434 Fix SegmentStatusChecker exception (#3704)
new 9cc609d [TE] Remove new pipeline prefix and inject yaml in Detection Config (#3708)
new 17c85c5 [TE] aaronucsd/fix for the live alerts not showing bug (#3710)
new 29a8e54 [TE] detection - change last time stamp to handle data incompleteness (#3712)
new c6131cb Fix the issue of realtime data manager calling wrong API to load segment (#3707)
new a658f19 Add Pinot code style (#3705)
new 3c4c1c8 Add pinot.root property into pom file to make file location package independent (#3716)
new f9ced25 [TE] aaronucsd/remove true in alert list (#3719)
new b132159 [TE] yaml - subscribed detection names in notification yaml (#3714)
new 4716f74 [TE] - Fix true anomaly definition to include expected anomaly (#3709)
new e6dfe31 Move instantiation of objects which depend on _helixResourceManager to after invocation of PinotHelixResourceManager::start (#3713)
new f09db48 [TE] alerter - do not send replay anomalies (#3720)
new 8a231a6 Fix SegmentConverter to handle virtual column (#3711)
new 8daad94 [TE] Migration endpoints for anomaly function and application (#3724)
new 79ef7f9 Minor fix for star-tree v2 metadata (#3733)
new d052296 Add guava cache to cache table schema in pinot broker; Check non-exsitence columns in broker; Cache table schema when state of table becomes online in broker; Emit a metric if column mismatched; Create RequestParams class to extra fields from JsonObject.
new cfd43e8 Reduce the time of generating filterQueryTree
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (11bdffa)
\
N -- N -- N refs/heads/cache-table-schemas-in-broker (cfd43e8)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 5649 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
license.header => HEADER | 0
config/checkstyle.xml | 211 +++++++++
pinot-style.xml => config/codestyle-eclipse.xml | 54 ++-
config/codestyle-intellij.xml | 505 +++++++++++++++++++++
pinot-core/testng.xml => config/suppressions.xml | 25 +-
.../config/druid_broker_runtime.properties | 19 +
pinot-api/pom.xml | 10 +-
pinot-azure-filesystem/pom.xml | 15 +-
.../org/apache/pinot/filesystem/AzurePinotFS.java | 11 +
pinot-broker/pom.xml | 11 +-
.../builder/RoutingTableBuilderTestUtil.java | 18 +-
pinot-common/pom.xml | 11 +-
.../apache/pinot/common/config/TableConfig.java | 39 +-
.../metadata/segment/ColumnPartitionMetadata.java | 16 +-
.../src/main/resources/log4j-fatal-only.properties | 19 +
.../main/resources/logging-severe-only.properties | 19 +
.../src/main/resources/swagger-ui/index.html | 22 +
.../pinot/common/config/TableConfigTest.java | 14 +-
pinot-controller/pom.xml | 12 +-
.../apache/pinot/controller/ControllerStarter.java | 71 +--
.../controller/helix/SegmentStatusChecker.java | 19 +-
.../helix/core/PinotHelixResourceManager.java | 18 +
.../helix/core/SegmentDeletionManager.java | 5 +-
pinot-controller/src/main/resources/api/index.html | 21 +
.../src/main/resources/landing/index.html | 20 +
.../src/main/resources/static/css/pinot.css | 18 +
.../src/main/resources/static/index.html | 21 +
.../src/main/resources/static/js/init.js | 18 +
.../src/main/resources/static/query/index.html | 21 +
.../src/main/resources/webapp/css/pinot.css | 18 +
.../src/main/resources/webapp/index.html | 25 +-
.../src/main/resources/webapp/js/init.js | 18 +
.../helix/ControllerPeriodicTaskStarterTest.java | 97 ++++
.../pinot/controller/helix/ControllerTest.java | 18 +-
.../controller/helix/SegmentStatusCheckerTest.java | 118 ++---
pinot-core/pom.xml | 21 +-
.../realtime/LLRealtimeSegmentDataManager.java | 6 +-
.../manager/realtime/RealtimeTableDataManager.java | 36 +-
.../data/readers/PinotSegmentRecordReader.java | 5 +-
.../immutable/ImmutableSegmentLoader.java | 4 +
.../core/segment/index/SegmentMetadataImpl.java | 187 +++-----
.../startree/v2/builder/BaseSingleTreeBuilder.java | 10 +-
pinot-distribution/pom.xml | 12 +-
pinot-filesystem/pom.xml | 16 +-
.../org/apache/pinot/filesystem/LocalPinotFS.java | 9 +
.../java/org/apache/pinot/filesystem/PinotFS.java | 10 +-
.../apache/pinot/filesystem/LocalPinotFSTest.java | 23 +
.../pinot/filesystem/PinotFSFactoryTest.java | 5 +
pinot-hadoop-filesystem/pom.xml | 13 +-
.../org/apache/pinot/filesystem/HadoopPinotFS.java | 28 +-
pinot-hadoop/pom.xml | 11 +-
pinot-integration-tests/pom.xml | 10 +-
pinot-minion/pom.xml | 12 +-
pinot-perf/pom.xml | 12 +-
pinot-perf/src/main/resources/log4j.properties | 19 +
pinot-server/pom.xml | 11 +-
.../pinot/server/api/resources/TablesResource.java | 2 +-
pinot-server/src/main/resources/api/index.html | 21 +
pinot-tools/pom.xml | 11 +-
.../src/main/resources/appAssemblerScriptTemplate | 21 +-
.../main/resources/conf/default_broker.properties | 19 +
.../resources/conf/default_controller.properties | 19 +
.../main/resources/conf/default_server.properties | 19 +
.../resources/conf/pinot-admin-log4j.properties | 19 +
.../resources/conf/pinot-broker-log4j.properties | 19 +
.../conf/pinot-controller-log4j.properties | 19 +
.../resources/conf/pinot-server-log4j.properties | 19 +
.../resources/conf/pinot-tools-log4j.properties | 19 +
.../resources/conf/quickstart-log4j.properties | 19 +
.../conf/quickstart-offline-log4j.properties | 19 +
.../conf/quickstart-realtime-log4j.properties | 19 +
.../main/resources/conf/sample_perf_benchmark.yaml | 19 +
pinot-tools/src/main/resources/log4j.properties | 19 +
pinot-tools/src/main/resources/star-tree.html | 21 +
pinot-transport/pom.xml | 21 +-
pom.xml | 159 ++++---
.../modals/yaml-documentation/component.js | 36 ++
.../modals/yaml-documentation/template.hbs | 12 +
.../self-serve-alert-details/template.hbs | 1 -
.../app/pods/components/yaml-editor/component.js | 80 ++--
.../app/pods/components/yaml-editor/template.hbs | 50 ++
.../app/styles/components/yaml-editor.scss | 4 +
thirdeye/thirdeye-frontend/app/utils/constants.js | 25 +-
.../app/utils/manage-alert-utils.js | 2 +-
.../anomaly/ThirdEyeAnomalyApplication.java | 4 -
.../dashboard/ThirdEyeDashboardApplication.java | 9 +-
.../detection/DetectionMigrationResource.java | 271 ++++++++---
.../pinot/thirdeye/detection/DetectionUtils.java | 12 +
.../detection/LegacyAnomalyFunctionTranslator.java | 1 +
.../alert/StatefulDetectionAlertFilter.java | 4 +-
.../filter/DimensionDetectionAlertFilter.java | 2 +
.../detection/alert/filter/LegacyAlertFilter.java | 2 +
.../ToAllRecipientsDetectionAlertFilter.java | 2 +
.../detection/algorithm/DimensionWrapper.java | 11 +-
.../thirdeye/detection/algorithm/MergeWrapper.java | 5 +-
.../{AlertScheme.java => AlertFilter.java} | 2 +-
.../registry/DetectionAlertRegistry.java | 50 +-
.../annotation/registry/DetectionRegistry.java | 28 +-
.../validators/DetectionAlertConfigValidator.java | 13 +-
.../detection/wrapper/AnomalyDetectorWrapper.java | 36 +-
.../detection/wrapper/AnomalyFilterWrapper.java | 6 +-
.../yaml/YamlDetectionAlertConfigTranslator.java | 110 +++--
.../yaml/YamlDetectionConfigTranslator.java | 8 +
.../yaml/YamlDetectionTranslatorLoader.java | 1 +
.../thirdeye/detection/yaml/YamlResource.java | 23 +-
.../email/filter/PrecisionRecallEvaluator.java | 4 +-
.../detection/DetectionMigrationResourceTest.java | 285 ++++++++++++
.../detection/algorithm/MergeWrapperTest.java | 10 +-
.../components/ThresholdRuleAnomalyFilterTest.java | 4 +-
.../MergeDimensionThresholdIntegrationTest.java | 1 -
.../wrapper/AnomalyDetectorWrapperTest.java | 31 ++
.../wrapper/ChildKeepingMergeWrapperTest.java | 10 +-
.../YamlDetectionAlertConfigTranslatorTest.java | 87 ++--
.../thirdeye/detection/yaml/YamlResourceTest.java | 8 +-
.../detection/legacy-anomaly-function-1.json | 27 ++
.../detection/legacy-anomaly-function-2.json | 26 ++
.../detection/migrated-detection-config-1.json | 47 ++
.../detection/migrated-detection-config-2.json | 43 ++
.../detection/yaml/alertconfig/alert-config-2.yaml | 6 +-
.../detection/yaml/alertconfig/alert-config-3.yaml | 3 +-
.../detection/yaml/alertconfig/alert-config-4.yaml | 3 +-
121 files changed, 3082 insertions(+), 843 deletions(-)
rename license.header => HEADER (100%)
create mode 100644 config/checkstyle.xml
rename pinot-style.xml => config/codestyle-eclipse.xml (94%)
create mode 100644 config/codestyle-intellij.xml
copy pinot-core/testng.xml => config/suppressions.xml (53%)
create mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/helix/ControllerPeriodicTaskStarterTest.java
create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/modals/yaml-documentation/component.js
create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/modals/yaml-documentation/template.hbs
copy thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/annotation/{AlertScheme.java => AlertFilter.java} (97%)
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/DetectionMigrationResourceTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/legacy-anomaly-function-1.json
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/legacy-anomaly-function-2.json
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/migrated-detection-config-1.json
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/migrated-detection-config-2.json
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org