You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by jl...@apache.org on 2019/03/05 23:39:40 UTC
[incubator-pinot] branch add-participant-role-in-controller updated
(26ad99b -> 9c830c5)
This is an automated email from the ASF dual-hosted git repository.
jlli pushed a change to branch add-participant-role-in-controller
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 26ad99b Remove PowerMock; move controller mode out of resource manager
discard 6dbeb72 Add controller mode logic
new 4f96cba [TE] frontend - harleyjj/alert-details - multiple alert overview improvements for MVP (#3863)
new 23cda0b only show inconsistent alert when it is daily metrics (#3865)
new 1f9d096 [TE] detection - task scheduler backoff fix (#3866)
new b3f7fee Fix reporting/logging of numEntriesScannedPostFilter (#3870)
new f70935e Disable realtime aggregate metrics if multi value columns present (#3868)
new e3a9184 Fix listFiles method in HadoopPinotFS (#3838)
new de950ff [TE] Update label and detection description (#3878)
new 126b022 [TE] Include alert description in the email (#3879)
new e6cdea0 [TE] frontend - harleyjj/manage-alerts - fix display bugs in alerts list (#3882)
new 209c966 [TE] detection - threshold-based filter (#3881)
new 4e7ffb3 [TE] Migration - fill in metric urn for old anomalies (#3880)
new 2da1157 Doc coding guidelines (#3884)
new 47be0f0 [TE] Enable description after migration (#3883)
new 9269f5e Check assigned instances for uploading new segment (#3856)
new 1f2c2d7 Move images files to img directory for docs (#3886)
new 8f647cf Unify move method in PinotFS (#3834)
new 52a9559 [TE] frontend - fix some bugs with alert details graph on range change (#3876)
new 3b09d27 [TE] Endpoint to delete a complete application (#3888)
new 3b92bee [TE] Minor fix in template (#3889)
new 6fc48ce [TE] frontend - harleyjj/alert-details - limit number of anomalies displayed in graph (#3890)
new caef8f6 Replace deprecated ZkClient APIs (#3894)
new 9791a3d [TE] frondend - hide anomaly legend if the anomalies is too much. (#3896)
new 4964f91 Actively check cluster changes if there is no callback for a long time (#3885)
new 97f0a86 hadern DateTimeFormatSpecTest with locale (#3785)
new 9dda23f In ClusterChangeMediator, remove sleep and make it notify based (#3898)
new 4dc59ff Reduce MAX_SEGMENT_COMPLETION_TIME_MILLIS to 5 minutes (#3893)
new ca72055 [TE] migration - bucket period conversion (#3902)
new 8bf4011 [TE] Hide Linkedin URLs and add an inlab wiki reference for creating an alert in UI (#3901)
new ce551eb [TE] Add cron validator and make detection cron configurable (#3903)
new bab7926 [TE] frontend - explore dimensions in new alert overview (#3897)
new 3b95a64 [TE] frontend harleyjj/create-alert turn form off for create-alert (#3905)
new ec22501 Update read-the-docs high level organization. More changes to follow (#3906)
new 0e111e6 Remove references that we don't need (#3907)
new 91237aa [TE] pinot -harleyjj/email-content update view/edit linke to edit-new route (#3909)
new dbf02c8 [TE] frontend - harleyjj/alert-overview - handle empty responses better (#3908)
new a7a8bb6 Fix the RecordReader to pick incoming time column (#3895)
new dc5d2ec Add controller mode logic
new f3e2ce5 Remove PowerMock; move controller mode out of resource manager
new 9c830c5 Address PR comments
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (26ad99b)
\
N -- N -- N refs/heads/add-participant-role-in-controller (9c830c5)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 5796 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
docs/{reference.rst => README} | 14 +-
docs/{reference.rst => admin_guide.rst} | 9 +-
docs/architecture.rst | 2 +-
docs/{reference.rst => code_modues.rst} | 12 +-
docs/{reference.rst => coding_guidelines.rst} | 17 +-
docs/{reference.rst => customizations.rst} | 11 +-
docs/{reference.rst => dev_env.rst} | 26 +-
docs/{reference.rst => dev_guide.rst} | 11 +-
docs/{reference.rst => extensions.rst} | 12 +-
docs/{reference.rst => getting_involved.rst} | 8 -
docs/{trying_pinot.rst => getting_started.rst} | 4 +-
docs/{ => img}/Pinot - Hybrid flow.png | Bin
docs/{ => img}/Pinot-Offline-only-flow.png | Bin
docs/{ => img}/hlc-arch.png | Bin
docs/{ => img}/image2014-11-12-1-54-56.png | Bin
docs/{ => img}/image2014-11-12-19-54-12.png | Bin
docs/{ => img}/image2014-11-12-20-59-50.png | Bin
docs/{ => img}/image2014-11-13-11-21-7.png | Bin
docs/{ => img}/image2014-11-13-11-22-57.png | Bin
docs/{ => img}/image2015-4-14-194451.png | Bin
docs/{ => img}/image2015-5-12-7-24-58.png | Bin
docs/{ => img}/image2015-5-13 15-2-9.png | Bin
docs/{ => img}/image2015-5-17 13-32-28.png | Bin
docs/{ => img}/image2015-5-17 17-59-10.png | Bin
docs/{ => img}/image2015-5-19 0-29-34.png | Bin
docs/{ => img}/image2015-5-19 0-58-54.png | Bin
docs/{ => img}/image2015-5-19 1-28-35.png | Bin
docs/{ => img}/image2015-5-19 1-47-44.png | Bin
docs/{ => img}/image2015-5-19 1-59-51.png | Bin
docs/{ => img}/llc-arch.png | Bin
docs/{ => img}/pinot-architecture.png | Bin
docs/{ => img}/pluggable_streams.png | Bin
docs/{ => img}/znode_layout.png | Bin
docs/index.rst | 24 +-
docs/index_techniques.rst | 1 +
docs/multitenancy.rst | 4 +-
docs/pinot_hadoop.rst | 2 +-
docs/{reference.rst => tuning_pinot.rst} | 8 +-
docs/{reference.rst => user_guide.rst} | 6 +-
.../org/apache/pinot/filesystem/AzurePinotFS.java | 6 +-
.../pinot/broker/broker/BrokerServerBuilder.java | 10 +-
.../broker/broker/helix/ClusterChangeHandler.java | 11 +-
.../broker/broker/helix/ClusterChangeMediator.java | 218 +-
.../broker/helix/ExternalViewChangeHandler.java | 43 +
.../broker/broker/helix/HelixBrokerStarter.java | 32 +-
.../broker/helix/InstanceConfigChangeHandler.java | 28 +-
...nerImpl.java => LiveInstanceChangeHandler.java} | 56 +-
.../ConnectionPoolBrokerRequestHandler.java | 11 +-
.../broker/broker/HelixBrokerStarterTest.java | 61 +-
.../queryquota/TableQueryQuotaManagerTest.java | 2 +-
.../broker/routing/TimeBoundaryServiceTest.java | 2 +-
.../common/data/DateTimeFormatPatternSpec.java | 4 +-
.../apache/pinot/common/metrics/BrokerMeter.java | 4 +-
.../apache/pinot/common/metrics/BrokerTimer.java | 4 +-
.../pinot/common/utils/helix/HelixHelper.java | 17 +
.../pinot/common/data/DateTimeFormatSpecTest.java | 5 +-
.../common/partition/IdealStateBuilderUtil.java | 6 +
.../apache/pinot/controller/ControllerConf.java | 18 +-
.../apache/pinot/controller/ControllerStarter.java | 36 +-
.../resources/LLCSegmentCompletionHandlers.java | 3 +
.../PinotSegmentUploadRestletResource.java | 13 +-
.../controller/api/upload/SegmentValidator.java | 19 +-
.../api/upload/SegmentValidatorResponse.java | 55 +
.../pinot/controller/api/upload/ZKOperator.java | 12 +-
.../helix/core/PinotHelixResourceManager.java | 74 +-
.../helix/core/SegmentDeletionManager.java | 16 +-
.../realtime/PinotLLCRealtimeSegmentManager.java | 71 +-
.../pinot/controller/helix/HelixHelperTest.java | 43 +-
.../controller/helix/PinotResourceManagerTest.java | 34 +-
.../PinotLLCRealtimeSegmentManagerTest.java | 65 +
.../sharding/SegmentAssignmentStrategyTest.java | 41 +-
.../validation/ValidationManagerTest.java | 32 +-
.../realtime/LLRealtimeSegmentDataManager.java | 2 +-
.../pinot/core/data/readers/AvroRecordReader.java | 16 +-
.../pinot/core/data/readers/CSVRecordReader.java | 26 +-
.../pinot/core/data/readers/JSONRecordReader.java | 26 +-
.../pinot/core/data/readers/RecordReader.java | 2 +
.../core/data/readers/RecordReaderFactory.java | 5 +-
.../pinot/core/data/readers/RecordReaderUtils.java | 215 +-
.../core/data/readers/ThriftRecordReader.java | 145 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 19 +
.../pinot/core/query/scheduler/QueryScheduler.java | 2 +-
.../impl/kafka/AvroRecordToPinotRowGenerator.java | 17 +-
.../java/org/apache/pinot/core/util/AvroUtils.java | 57 -
.../data/readers/RecordReaderSampleDataTest.java | 233 +
.../core/data/readers/RecordReaderUtilsTest.java | 60 +
.../core/data/readers/ThriftRecordReaderTest.java | 1 -
.../pinot/index/persist/AvroDataPublisherTest.java | 167 -
.../src/test/resources/data/test_sample_data.csv | 10002 +++++++++++++++++++
.../org/apache/pinot/filesystem/LocalPinotFS.java | 17 +-
.../java/org/apache/pinot/filesystem/PinotFS.java | 62 +-
.../apache/pinot/filesystem/LocalPinotFSTest.java | 13 +-
.../pinot/filesystem/PinotFSFactoryTest.java | 2 +-
.../org/apache/pinot/filesystem/HadoopPinotFS.java | 27 +-
.../tests/PinotURIUploadIntegrationTest.java | 47 +-
.../pinot/tools/perf/PerfBenchmarkDriver.java | 15 +-
.../app/pods/components/alert-details/component.js | 334 +-
.../app/pods/components/alert-details/template.hbs | 138 +-
.../pods/components/rootcause-anomaly/component.js | 2 +-
.../self-serve-alert-details/template.hbs | 2 +-
.../self-serve-alert-yaml-details/template.hbs | 2 +-
.../pods/components/timeseries-chart/component.js | 2 +
.../app/pods/components/yaml-editor/component.js | 23 +-
.../app/pods/components/yaml-editor/template.hbs | 10 +-
.../custom/anomalies-table/dimensions/template.hbs | 2 +-
.../app/pods/manage/alert/explore/controller.js | 12 +-
.../app/pods/manage/alerts/index/controller.js | 14 +-
.../app/pods/manage/alerts/index/route.js | 10 +-
.../app/pods/manage/explore-new/route.js | 8 +-
.../app/pods/manage/explore-new/template.hbs | 1 +
.../app/pods/manage/yaml/route.js | 2 +-
.../app/pods/manage/yaml/template.hbs | 2 +-
.../app/pods/self-serve/create-alert/controller.js | 3 +-
.../app/pods/self-serve/create-alert/template.hbs | 2 +-
thirdeye/thirdeye-frontend/app/utils/anomaly.js | 33 +
thirdeye/thirdeye-frontend/app/utils/constants.js | 2 +-
.../app/utils/manage-alert-utils.js | 20 +-
thirdeye/thirdeye-frontend/config/environment.js | 6 +
.../acceptance/self-serve-import-metric-test.js | 4 +-
.../tests/acceptance/self-serve-onboarding-test.js | 187 -
.../alert/content/BaseEmailContentFormatter.java | 13 +-
...HierarchicalAnomaliesEmailContentFormatter.java | 2 +
.../MultipleAnomaliesEmailContentFormatter.java | 4 +-
.../api/application/ApplicationResource.java | 117 +
.../dashboard/ThirdEyeDashboardApplication.java | 4 +
.../detection/DetectionMigrationResource.java | 27 +-
.../thirdeye/detection/DetectionPipelineJob.java | 25 +-
.../detection/LegacyAnomalyFunctionTranslator.java | 2 +-
.../detection/alert/DetectionAlertJob.java | 19 +-
.../components/ThresholdRuleAnomalyFilter.java | 32 +-
.../detection/spec/ThresholdRuleFilterSpec.java | 40 +-
.../validators/DetectionConfigValidator.java | 7 +
.../validators/SubscriptionConfigValidator.java | 8 +-
.../yaml/CompositePipelineConfigTranslator.java | 4 +-
.../thirdeye/detector/holiday-anomaly-report.ftl | 8 +-
.../api/application/ApplicationResourceTest.java | 160 +
.../detection/DetectionMigrationResourceTest.java | 4 +
.../components/ThresholdRuleAnomalyFilterTest.java | 66 +-
.../detection/migrated-detection-config-1.json | 4 +-
.../detection/migrated-detection-config-2.json | 4 +-
...multiple-anomalies-email-content-formatter.html | 5 +-
141 files changed, 12388 insertions(+), 1389 deletions(-)
copy docs/{reference.rst => README} (82%)
copy docs/{reference.rst => admin_guide.rst} (91%)
copy docs/{reference.rst => code_modues.rst} (86%)
copy docs/{reference.rst => coding_guidelines.rst} (80%)
copy docs/{reference.rst => customizations.rst} (86%)
copy docs/{reference.rst => dev_env.rst} (63%)
copy docs/{reference.rst => dev_guide.rst} (89%)
copy docs/{reference.rst => extensions.rst} (79%)
copy docs/{reference.rst => getting_involved.rst} (89%)
rename docs/{trying_pinot.rst => getting_started.rst} (99%)
rename docs/{ => img}/Pinot - Hybrid flow.png (100%)
rename docs/{ => img}/Pinot-Offline-only-flow.png (100%)
rename docs/{ => img}/hlc-arch.png (100%)
rename docs/{ => img}/image2014-11-12-1-54-56.png (100%)
rename docs/{ => img}/image2014-11-12-19-54-12.png (100%)
rename docs/{ => img}/image2014-11-12-20-59-50.png (100%)
rename docs/{ => img}/image2014-11-13-11-21-7.png (100%)
rename docs/{ => img}/image2014-11-13-11-22-57.png (100%)
rename docs/{ => img}/image2015-4-14-194451.png (100%)
rename docs/{ => img}/image2015-5-12-7-24-58.png (100%)
rename docs/{ => img}/image2015-5-13 15-2-9.png (100%)
rename docs/{ => img}/image2015-5-17 13-32-28.png (100%)
rename docs/{ => img}/image2015-5-17 17-59-10.png (100%)
rename docs/{ => img}/image2015-5-19 0-29-34.png (100%)
rename docs/{ => img}/image2015-5-19 0-58-54.png (100%)
rename docs/{ => img}/image2015-5-19 1-28-35.png (100%)
rename docs/{ => img}/image2015-5-19 1-47-44.png (100%)
rename docs/{ => img}/image2015-5-19 1-59-51.png (100%)
rename docs/{ => img}/llc-arch.png (100%)
rename docs/{ => img}/pinot-architecture.png (100%)
rename docs/{ => img}/pluggable_streams.png (100%)
rename docs/{ => img}/znode_layout.png (100%)
copy docs/{reference.rst => tuning_pinot.rst} (86%)
rename docs/{reference.rst => user_guide.rst} (92%)
copy pinot-core/src/main/java/org/apache/pinot/core/io/writer/DataFileWriter.java => pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/ClusterChangeHandler.java (78%)
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/ExternalViewChangeHandler.java
copy pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/IntegerLiteralAstNode.java => pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/InstanceConfigChangeHandler.java (58%)
rename pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/{LiveInstancesChangeListenerImpl.java => LiveInstanceChangeHandler.java} (66%)
create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/upload/SegmentValidatorResponse.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/RecordReaderSampleDataTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/RecordReaderUtilsTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/index/persist/AvroDataPublisherTest.java
create mode 100644 pinot-core/src/test/resources/data/test_sample_data.csv
delete mode 100644 thirdeye/thirdeye-frontend/tests/acceptance/self-serve-onboarding-test.js
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/api/application/ApplicationResource.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/api/application/ApplicationResourceTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org