You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by jl...@apache.org on 2019/04/08 23:21:56 UTC

[incubator-pinot] branch create-lead-controller-resource updated (4495688 -> cf08af7)

This is an automated email from the ASF dual-hosted git repository.

jlli pushed a change to branch create-lead-controller-resource
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.


 discard 4495688  Create leadControllerResource in Helix cluster
     new 2b25dd9  [TE] revert early termination in detection loop (#4056)
     new dad8773  skip .swp files for vim users (#4052)
     new e9a49ec  Fix the race condition for real-time inverted index reader (#4051)
     new 7b61bfc  [TE] disable anomalies endpoint padding for minute level alerts (#4058)
     new 35f5e15  Add wait_time flag for Travis config (#4057)
     new 69db491  add support for parquet reader (#3852)
     new 402e5ad  In ServiceStatus, replace Apache math Pair with inner StatusDescriptionPair class (#4062)
     new c8d2f7f  Fix minute speedup (#4060)
     new 8121927  [TE] frontend - harleyjj/alert-overview - display dash and n/a when value is undefined (#4046)
     new 8c3edbb  [TE] Clean up logging messages; remove default ref links (#4059)
     new fdd9b92  [TE] Disable thirdeye-hadoop (#4064)
     new f66c342  [TE] frontend - harleyjj/yaml-editor - surface error message in put (#4068)
     new 8036bff  Move Parquet related classes to the new package (#4073)
     new a102ee0  [TE] frontend - harleyjj/yaml-editor - if there is no existing subscription group, the user can create one on edit-alert (#4071)
     new 0655993  [TE] frontend - harleyjj/anomalies - prototype anomalies route replacement (#4066)
     new 3a9625b  Introduce interface stability and audience annotations (#4063)
     new 08ad552  [TE] SQL connector, with support for Presto, MySQL, H2. With a front end for onboarding dataset (#3830)
     new 972472e  Fix travis-wait (#4077)
     new b08eccc  [TE] detection - handle day light savings time in moving windows (#4072)
     new 641e401  Exit 1 when caught exception in Pinot Admin command. (#4065)
     new 6cb2ffa  Remove stale test RealtimeTableDataManagerTest (#4075)
     new 2d860d2  Always enable default column feature, remove the configuration (#4074)
     new 78bfe3e  Fix 500 issue with 'GET /tenants' API call (#4061)
     new 23adfcd  [TE] Email template - Truncate long names; Make links more intuitive to click
     new 58a926e  Reduce logging in controller (#4078)
     new a2c8d37  Support legacy time type in SegmentValidationAndRetentionConfig (#4081)
     new af62e20  Revert travis-wait config (#4084)
     new e115bc9  In TimeUtils.timeUnitFromString(), return null if input is null or empty (#4088)
     new 0ee5a1d  [TE] Minor correction to #4079 (#4083)
     new 4003155  [TE] frontend - harleyjj/rca - override date-picker component to maintain 0:00 as end stamp (#4080)
     new 435e8be  Update doc for "Creating Pinot segments" to reflect the current code base (#4086)
     new cf08af7  Create leadControllerResource in Helix cluster

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (4495688)
            \
             N -- N -- N   refs/heads/create-lead-controller-resource (cf08af7)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 5938 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 .gitignore                                         |     1 +
 docs/pinot_hadoop.rst                              |   262 +-
 .../HelixExternalViewBasedTimeBoundaryService.java |    42 +-
 .../pinot/annotations/InterfaceAudience.java       |    73 +
 .../pinot/annotations/InterfaceStability.java      |    70 +
 .../SegmentsValidationAndRetentionConfig.java      |    16 +-
 .../apache/pinot/common/config/TagNameUtils.java   |     5 +-
 .../apache/pinot/common/utils/ServiceStatus.java   |    62 +-
 .../apache/pinot/common/utils/time/TimeUtils.java  |    61 +-
 .../org/apache/pinot/common/utils/UtilsTest.java   |    69 +-
 .../api/resources/PinotTableRestletResource.java   |     7 +-
 .../helix/core/PinotHelixResourceManager.java      |    22 +-
 .../helix/core/retention/RetentionManager.java     |     4 +-
 .../pinot/controller/util/TableSizeReader.java     |     9 +-
 .../validation/OfflineSegmentIntervalChecker.java  |     9 +-
 .../helix/core/PinotHelixResourceManagerTest.java  |    54 +-
 pinot-core/pom.xml                                 |    33 +-
 .../manager/config/InstanceDataManagerConfig.java  |     2 -
 .../pinot/core/data/readers/AvroRecordReader.java  |    35 +-
 .../pinot/core/data/readers/RecordReader.java      |     3 +-
 .../core/data/readers/RecordReaderFactory.java     |     8 +-
 .../pinot/core/indexsegment/IndexSegment.java      |     3 +-
 .../operator/filter/BitmapBasedFilterOperator.java |    26 +-
 .../invertedindex/RealtimeInvertedIndexReader.java |    13 +-
 .../pinot/core/realtime/stream/MessageBatch.java   |     6 +
 .../realtime/stream/PartitionLevelConsumer.java    |     4 +
 .../core/realtime/stream/StreamLevelConsumer.java  |     4 +
 .../core/realtime/stream/StreamMessageDecoder.java |     4 +
 .../realtime/stream/StreamMetadataProvider.java    |     4 +
 .../core/segment/index/SegmentMetadataImpl.java    |     1 +
 .../segment/index/loader/IndexLoadingConfig.java   |    12 +-
 .../segment/index/loader/SegmentPreProcessor.java  |     2 +-
 .../name/NormalizedDateSegmentNameGenerator.java   |    18 +-
 .../java/org/apache/pinot/core/util/AvroUtils.java |    42 +-
 .../realtime/LLRealtimeSegmentDataManagerTest.java |     1 -
 .../RealtimeInvertedIndexReaderTest.java           |   106 +
 .../NormalizedDateSegmentNameGeneratorTest.java    |    33 +-
 .../pinot/hadoop/job/SegmentCreationJob.java       |     2 +-
 .../hadoop/job/mapper/SegmentCreationMapper.java   |    10 +-
 .../tests/ChaosMonkeyIntegrationTest.java          |     1 +
 .../tests/OfflineClusterIntegrationTest.java       |   103 +-
 pinot-orc/pom.xml                                  |     2 +-
 .../pinot/orc/data/readers/ORCRecordReader.java    |    48 +-
 {pinot-hadoop-filesystem => pinot-parquet}/pom.xml |    37 +-
 .../parquet/data/readers/ParquetRecordReader.java  |    78 +-
 .../pinot/parquet/data/readers/ParquetUtils.java   |    87 +
 .../data/readers/ParquetRecordReaderTest.java      |   101 +
 .../helix/HelixInstanceDataManagerConfig.java      |     8 -
 .../realtime/RealtimeTableDataManagerTest.java     |   320 -
 .../pinot/tools/admin/PinotAdministrator.java      |     9 +-
 .../pinot/tools/admin/command/AddTableCommand.java |     5 +
 .../segment/converter/SegmentMergeCommand.java     |    11 +-
 pom.xml                                            |     7 +
 thirdeye/pom.xml                                   |     1 -
 .../app/pods/anomalies/controller.js               |   407 +
 .../thirdeye-frontend/app/pods/anomalies/route.js  |   134 +
 .../app/pods/anomalies/template.hbs                |    98 +
 .../app/pods/components/alert-details/component.js |     8 +-
 .../pods/components/anomaly-summary/component.js   |   276 +
 .../pods/components/anomaly-summary/template.hbs   |   111 +
 .../app/pods/components/entity-filter/component.js |     7 +-
 .../rootcause-chart-toolbar/component.js           |     4 +-
 .../app/pods/components/yaml-editor/component.js   |    88 +-
 .../app/pods/components/yaml-editor/template.hbs   |    12 +-
 .../app/pods/self-serve/create-alert/template.hbs  |     6 +-
 .../self-serve/import-sql-metric/controller.js     |   137 +
 .../pods/self-serve/import-sql-metric/template.hbs |   166 +
 thirdeye/thirdeye-frontend/app/router.js           |     2 +
 .../styles/components/range-pill-selectors.scss    |     1 -
 thirdeye/thirdeye-frontend/app/utils/anomaly.js    |    15 +-
 .../thirdeye-frontend/app/utils/api/anomaly.js     |    13 +-
 thirdeye/thirdeye-frontend/app/utils/constants.js  |     4 +-
 .../config/data-sources/data-sources-config.yml    |    25 +-
 thirdeye/thirdeye-pinot/config/data/README.md      |     7 +
 thirdeye/thirdeye-pinot/config/data/daily.csv      |   732 +
 thirdeye/thirdeye-pinot/config/data/hourly.csv     | 66498 +++++++++++++++++++
 thirdeye/thirdeye-pinot/config/h2db.mv.db          |   Bin 2330624 -> 0 bytes
 thirdeye/thirdeye-pinot/pom.xml                    |     5 +
 .../pinot/thirdeye/anomaly/task/TaskDriver.java    |     6 +-
 .../MultiDimensionalSummaryCLITool.java            |     2 +-
 ...mmaryClient.java => ThirdEyeSummaryClient.java} |     8 +-
 .../dashboard/ThirdEyeDashboardApplication.java    |     2 +
 .../dashboard/resources/SummaryResource.java       |     6 +-
 .../resources/v2/RootCauseMetricResource.java      |     2 +-
 .../thirdeye/datalayer/util/DaoProviderUtil.java   |     3 -
 .../pinot/thirdeye/datasource/RelationalQuery.java |    35 +-
 ...sponse.java => RelationalThirdEyeResponse.java} |     7 +-
 .../loader/DefaultAggregationLoader.java           |     2 +-
 .../datasource/mock/AutoOnboardMockDataSource.java |    58 +-
 .../datasource/mock/MockThirdEyeDataSource.java    |     2 +-
 .../pinot/PinotControllerResponseCacheLoader.java  |    10 +-
 .../datasource/pinot/PinotDataSourceMaxTime.java   |     2 +-
 .../thirdeye/datasource/pinot/PinotQuery.java      |    28 +-
 .../datasource/pinot/PinotThirdEyeDataSource.java  |   252 +-
 .../resultset/ThirdEyeDataFrameResultSet.java      |    82 +-
 .../pinot/resultset/ThirdEyeResultSetUtils.java    |   190 +
 .../pinot/thirdeye/datasource/sql/SqlDataset.java  |    88 +
 .../pinot/thirdeye/datasource/sql/SqlQuery.java    |   113 +
 .../datasource/sql/SqlResponseCacheLoader.java     |   330 +
 .../datasource/sql/SqlThirdEyeDataSource.java      |   140 +
 .../{pinot/PqlUtils.java => sql/SqlUtils.java}     |   451 +-
 .../sql/resources/SqlDataSourceResource.java       |    54 +
 .../detection/DetectionPipelineScheduler.java      |     2 +-
 .../pinot/thirdeye/detection/DetectionUtils.java   |    18 +
 .../detection/alert/DetectionAlertJob.java         |    10 +-
 .../detection/alert/DetectionAlertScheduler.java   |     8 +-
 .../detection/alert/DetectionAlertTaskRunner.java  |     2 +-
 .../thirdeye/detection/algorithm/MergeWrapper.java |     1 -
 .../detection/wrapper/AnomalyDetectorWrapper.java  |    57 +-
 .../yaml/CompositePipelineConfigTranslator.java    |    48 +-
 .../yaml/YamlDetectionAlertConfigTranslator.java   |     6 +-
 .../detector/function/BaseAnomalyFunction.java     |     4 -
 .../rootcause/impl/MetricAnalysisPipeline.java     |     2 +-
 .../apache/pinot/thirdeye/util/ThirdEyeUtils.java  |   116 +
 .../thirdeye/detector/holiday-anomaly-report.ftl   |    92 +-
 .../src/main/resources/schema/create-schema.sql    |     4 +-
 .../pinot/PinotThirdEyeDataSourceTest.java         |    18 +-
 .../wrapper/AnomalyDetectorWrapperTest.java        |    25 +
 .../YamlDetectionAlertConfigTranslatorTest.java    |     2 +-
 .../AnomalyApplicationEndToEndTest.java            |     4 +-
 ...multiple-anomalies-email-content-formatter.html |    74 +-
 121 files changed, 71432 insertions(+), 1646 deletions(-)
 create mode 100644 pinot-common/src/main/java/org/apache/pinot/annotations/InterfaceAudience.java
 create mode 100644 pinot-common/src/main/java/org/apache/pinot/annotations/InterfaceStability.java
 create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeInvertedIndexReaderTest.java
 copy {pinot-hadoop-filesystem => pinot-parquet}/pom.xml (85%)
 copy pinot-core/src/main/java/org/apache/pinot/core/data/readers/JSONRecordReader.java => pinot-parquet/src/main/java/org/apache/pinot/parquet/data/readers/ParquetRecordReader.java (59%)
 create mode 100644 pinot-parquet/src/main/java/org/apache/pinot/parquet/data/readers/ParquetUtils.java
 create mode 100644 pinot-parquet/src/test/java/org/apache/pinot/parquet/data/readers/ParquetRecordReaderTest.java
 delete mode 100644 pinot-server/src/test/java/org/apache/pinot/server/integration/realtime/RealtimeTableDataManagerTest.java
 create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/controller.js
 create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/route.js
 create mode 100644 thirdeye/thirdeye-frontend/app/pods/anomalies/template.hbs
 create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-summary/component.js
 create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-summary/template.hbs
 create mode 100644 thirdeye/thirdeye-frontend/app/pods/self-serve/import-sql-metric/controller.js
 create mode 100644 thirdeye/thirdeye-frontend/app/pods/self-serve/import-sql-metric/template.hbs
 create mode 100644 thirdeye/thirdeye-pinot/config/data/README.md
 create mode 100644 thirdeye/thirdeye-pinot/config/data/daily.csv
 create mode 100755 thirdeye/thirdeye-pinot/config/data/hourly.csv
 delete mode 100644 thirdeye/thirdeye-pinot/config/h2db.mv.db
 rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/client/diffsummary/{PinotThirdEyeSummaryClient.java => ThirdEyeSummaryClient.java} (97%)
 copy pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/FloatingPointLiteralAstNode.java => thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/RelationalQuery.java (63%)
 rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/{pinot/PinotThirdEyeResponse.java => RelationalThirdEyeResponse.java} (93%)
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/pinot/resultset/ThirdEyeResultSetUtils.java
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlDataset.java
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlQuery.java
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlResponseCacheLoader.java
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/SqlThirdEyeDataSource.java
 copy thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/{pinot/PqlUtils.java => sql/SqlUtils.java} (54%)
 create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datasource/sql/resources/SqlDataSourceResource.java


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org