You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by xi...@apache.org on 2020/06/12 21:41:34 UTC
[incubator-pinot] branch
default_pinot_startable_to_use_config_files updated (84ff2ff -> 538955c)
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch default_pinot_startable_to_use_config_files
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 84ff2ff Adding more config alias
discard 41e4604 Make Pinot Broker/Server can start by just passing a config file
add 7310ffb Remove master branch restriction (#5467)
add 6bfcacb [Cleanup] Merge RealtimeSegmentOnlineOfflineStateModel and SegmentOnlineOfflineStateModel in CommonConstants (#5459)
add 71ce427 [TE] frontend - harleyjj/packages - remove bower from frontend (#5460)
add 2807584 [TE] frontend - harleyjj/components - remove dead components (#5466)
add 79260b3 [TE] frontend - harleyjj/rca - update frontend for new AC event format (#5447)
add b40dd99 Faster bit unpacking (Part 1) (#5409)
add fb5b75f Adding files generated by running quickstart to gitignore (#5441)
add 44a1e2e Refactor DistinctTable to use PriorityQueue based algorithm (#5451)
add de97edc Fixing mobile site image responsiveness (#5469)
add ee21e79 Two changes: (#5470)
add 01a316e Support distinctCountRawThetaSketch aggregation that returns serialized sketch. (#5465)
add 563d289 Update Superset image build (#5471)
add a314d42 Initialize _aggregateMetric in constructor (#5472)
add ed26e85 [TE] fix document for adding new application (#5473)
add aae985f Adding more information into jar manifest (#5480)
add 8a3eb43 Add a new table config field for peer segment download. (#5478)
add 056c930 Changed the segment commit protocol to send/receive streamPartitionMs… (#5486)
add 295300c Remove bintray target to mvn deploy command (#5488)
add 572c750 Extract all fields if fieldsToRead is null/empty (#5484)
add 8a8baed Upgrade pinotdb version to 0.3.1 to use new pinot sql api (#5489)
add f7417ff Add GenericTransformFunction wrapper for simple ScalarFunctions (#5440)
add 5ebcacf Enhance GenerateData to produce deterministic time-series (#5491)
add 5474c42 Add multi-value support to SegmentDumpTool (#5487)
add 7ac4cd2 [TE] clean up decprecated/unused code (#5435)
add 72b5dce [TE] Fix the run-backend and run-frontend scripts (#5481)
add 9f0f95c [TE] frontend - harleyjj/rca - D3 v4 updates and revise RCA Algorithm Table (#5493)
add df18e0e Fix bug in distinctCountRawHLL on SQL path (#5494)
add 3545a89 Upgrade pinot docker packaging and adding jmx agent (#5477)
add 4517bc4 Revert "Enhance GenerateData to produce deterministic time-series (#5491)" (#5496)
add c152f18 Fix travis_quickstart.sh to handle delayed cluster setup. (#5498)
add d54b04a Deep extraction in Avro and Json RecordExtractor (#5492)
add 3443593 Enhance and simplify the filtering (#5444)
add d72493e Update SegmentDumpTool to use PinotSegmentRecordReader. (#5505)
add 04e12bd Config for raw index writer version (#5503)
add bea55a0 [TE] Add data quality/sla rule to the detection template (#5515)
add 2e834cf Support escaping single quote for SQL literal (#5501)
add c139488 Support expression as the left-hand side for BETWEEN and IN clause (#5502)
add 957b28d Moved StreamPartitionMsgOffset to be an interface (#5506)
add 2b09676 One to many records from record reader/decoder (#5430)
add 15fda7f Update Pinot quickstart to use sql mode (#5530)
add 5b3837c Adding github actions for pinot tests (#5512)
add a1a2434 Remove BlockValIterator and directly read values from BlockValSet with docId (#5510)
add 5390698 Fix the failure caused by Reflections in FunctionRegistry (#5531)
add 2d28c0f Enhance quickstart script for CI tests (#5508)
add bbc3228 Update license and notice for 0.4.0 release (#5529)
add b383373 Adding Support for SQL CASE Statement (#5461)
add 4f4c587 Fixing grep thirdeye changes in github action scripts (#5532)
add 427a6fa Enhance GenerateData to produce deterministic time-series (#5497)
add db20a2e [TE] Pushdown topk filter (#5495)
add 17caad3 Cleanup the console output in OfflineClusterIntegrationTest (#5536)
add 7b41f5a Clean up the usage of BrokerRequest in metrics (#5535)
add bd1f2c0 Add the header to TestRecordReader.java (#5537)
add 3c42e5e Remove '/docker', '/kubernetes', '/website' for src release (#5541)
add 55b4ddc Change default segment load mode to MMAP. (#5539)
add f1f1c41 Changed the stream and metadata interface (#5542)
add 2692d9f Update year in NOTICE-binary (#5547)
add 7326d4a Fixed backward incompatibility for existing stream implementations (#5549)
add cd774c7 Return Select only Literal Expression at Broker (#5513)
add 91f8844 [TE][subscription] Bug fix to fix the notification pipeline when detections are disabled (#5545)
add fcc3144 Add SCALAR type into TransformFunctionType (#5544)
add ed265c0 Make Pinot Broker/Server can start by just passing a config file
add 538955c Adding more config alias
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (84ff2ff)
\
N -- N -- N refs/heads/default_pinot_startable_to_use_config_files (538955c)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/pinot_tests.yml | 78 +
.github/workflows/scripts/.pinot_quickstart.sh | 172 +
.../workflows/scripts/.pinot_test.sh | 36 +-
.gitignore | 4 +
.travis.yml | 11 +-
.travis/.travis_nightly_build.sh | 2 +-
.travis/.travis_quickstart.sh | 96 +-
LICENSE-binary | 155 +-
NOTICE-binary | 55 +-
docker/images/pinot-superset/Dockerfile | 3 +-
docker/images/pinot-superset/bin/superset-init | 13 +
docker/images/pinot-superset/requirements-db.txt | 2 +-
docker/images/pinot/Dockerfile | 4 +-
docker/images/pinot/bin/generator.sh | 43 +-
.../etc/jmx_prometheus_javaagent/configs/pinot.yml | 208 +
.../jmx_prometheus_javaagent-0.12.0.jar | Bin 0 -> 370075 bytes
.../docker}/ingestion-job-specs/airlineStats.yaml | 0
.../docker}/ingestion-job-specs/baseballStats.yaml | 0
.../airlineStats_realtime_table_config.json | 0
.../meetupRsvp_realtime_table_config.json | 0
licenses-binary/LICENSE-gpl-2.0.txt | 125 +
.../broker/broker/helix/HelixBrokerStarter.java | 8 +-
.../HelixExternalViewBasedQueryQuotaManager.java | 4 +-
.../requesthandler/BaseBrokerRequestHandler.java | 136 +
.../pinot/broker/routing/RoutingManager.java | 6 +-
.../instanceselector/BaseInstanceSelector.java | 6 +-
.../segmentselector/RealtimeSegmentSelector.java | 4 +-
.../LiteralOnlyBrokerRequestTest.java | 145 +
.../instanceselector/InstanceSelectorTest.java | 8 +-
.../segmentselector/SegmentSelectorTest.java | 4 +-
pinot-common/pom.xml | 4 +
.../common/function/AggregationFunctionType.java | 1 +
.../pinot/common/function/DateTimeFunctions.java | 24 +
.../pinot/common/function/FunctionRegistry.java | 111 +-
.../pinot/common/function/JsonFunctions.java | 11 +
.../pinot/common/function/StringFunctions.java | 200 +-
.../common/function/TransformFunctionType.java | 16 +-
.../function/annotations/ScalarFunction.java | 26 +-
.../segment/LLCRealtimeSegmentZKMetadata.java | 29 +-
.../pinot/common/metrics/AbstractMetrics.java | 74 -
.../protocols/SegmentCompletionProtocol.java | 79 +-
.../org/apache/pinot/common/segment/ReadMode.java | 9 +
.../apache/pinot/common/utils/CommonConstants.java | 12 +-
.../common/utils/config/TableConfigUtils.java | 18 +
.../pinot/common/utils/request/RequestUtils.java | 7 +-
.../parsers/PinotQuery2BrokerRequestConverter.java | 2 +-
.../parsers/pql2/ast/BetweenPredicateAstNode.java | 8 +-
.../pql/parsers/pql2/ast/InPredicateAstNode.java | 2 +
.../apache/pinot/sql/parsers/CalciteSqlParser.java | 81 +-
.../function/FunctionDefinitionRegistryTest.java | 21 +-
.../common/function/TransformFunctionTypeTest.java | 14 +-
.../common/utils/config/TableConfigSerDeTest.java | 11 +
.../pinot/sql/parsers/CalciteSqlCompilerTest.java | 83 +-
.../apache/pinot/controller/ControllerStarter.java | 4 +
.../resources/LLCSegmentCompletionHandlers.java | 94 +-
.../helix/core/PinotHelixResourceManager.java | 20 +-
.../segment/OfflineSegmentAssignment.java | 6 +-
.../segment/RealtimeSegmentAssignment.java | 14 +-
.../assignment/segment/SegmentAssignmentUtils.java | 13 +-
.../realtime/PinotLLCRealtimeSegmentManager.java | 67 +-
.../core/realtime/SegmentCompletionManager.java | 84 +-
.../segment/CommittingSegmentDescriptor.java | 10 +-
.../helix/core/rebalance/TableRebalancer.java | 6 +-
.../helix/core/retention/RetentionManager.java | 3 +-
.../api/SegmentCompletionProtocolDeserTest.java | 21 +-
...fflineNonReplicaGroupSegmentAssignmentTest.java | 14 +-
.../OfflineReplicaGroupSegmentAssignmentTest.java | 26 +-
...altimeNonReplicaGroupSegmentAssignmentTest.java | 19 +-
.../RealtimeReplicaGroupSegmentAssignmentTest.java | 19 +-
.../segment/SegmentAssignmentUtilsTest.java | 8 +-
.../PinotLLCRealtimeSegmentManagerTest.java | 92 +-
.../helix/core/realtime/SegmentCompletionTest.java | 378 +-
.../segment/FlushThresholdUpdaterTest.java | 3 +-
.../core/rebalance/TableRebalancerClusterTest.java | 2 +-
.../helix/core/rebalance/TableRebalancerTest.java | 8 +-
.../helix/core/retention/RetentionManagerTest.java | 5 +-
.../apache/pinot/core/common/BaseBlockValSet.java | 67 +-
.../pinot/core/common/BlockDocIdIterator.java | 22 +-
.../apache/pinot/core/common/BlockDocIdSet.java | 10 +-
.../pinot/core/common/BlockSingleValIterator.java | 54 -
.../apache/pinot/core/common/BlockValIterator.java | 28 -
.../org/apache/pinot/core/common/BlockValSet.java | 160 +-
.../org/apache/pinot/core/common/DataFetcher.java | 60 +-
.../apache/pinot/core/common/ObjectSerDeUtils.java | 2 +-
.../data/function/InbuiltFunctionEvaluator.java | 8 +-
.../realtime/HLRealtimeSegmentDataManager.java | 3 +-
.../realtime/LLRealtimeSegmentDataManager.java | 91 +-
.../realtime/SegmentBuildTimeLeaseExtender.java | 2 +-
.../apache/pinot/core/data/table/TableResizer.java | 191 +-
.../generator/SegmentGeneratorConfig.java | 15 +
.../immutable/ImmutableSegmentLoader.java | 5 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 32 +-
.../core/io/util/FixedBitIntReaderWriterV2.java | 149 +
.../pinot/core/io/util/PinotDataBitSetV2.java | 729 +++
.../writer/impl/v1/BaseChunkSingleValueWriter.java | 8 +-
.../impl/v1/FixedByteChunkSingleValueWriter.java | 10 +-
.../impl/v1/VarByteChunkSingleValueWriter.java | 9 +-
.../pinot/core/minion/RawIndexConverter.java | 14 +-
.../core/operator/blocks/EmptyFilterBlock.java | 4 +-
.../core/operator/blocks/MultiValueBlock.java | 5 +-
.../core/operator/blocks/SingleValueBlock.java | 5 +-
.../operator/dociditerators/AndDocIdIterator.java | 123 +-
.../dociditerators/ArrayBasedDocIdIterator.java | 37 +-
...Iterator.java => BitmapBasedDocIdIterator.java} | 9 +-
.../dociditerators/BitmapDocIdIterator.java | 79 +-
...kDocIdIterator.java => EmptyDocIdIterator.java} | 16 +-
.../ExpressionScanDocIdIterator.java | 72 +-
.../dociditerators/MVScanDocIdIterator.java | 142 +-
...cIdIterator.java => MatchAllDocIdIterator.java} | 33 +-
.../operator/dociditerators/OrDocIdIterator.java | 102 +-
.../RangelessBitmapDocIdIterator.java | 53 +-
.../dociditerators/SVScanDocIdIterator.java | 207 +-
.../dociditerators/ScanBasedDocIdIterator.java | 22 +-
.../dociditerators/SortedDocIdIterator.java | 99 +-
.../core/operator/docidsets/AndBlockDocIdSet.java | 181 -
.../pinot/core/operator/docidsets/AndDocIdSet.java | 156 +
.../operator/docidsets/ArrayBasedDocIdSet.java | 21 +-
.../core/operator/docidsets/BitmapDocIdSet.java | 70 +-
...FilterBlockDocIdSet.java => EmptyDocIdSet.java} | 38 +-
.../docidsets/ExpressionFilterDocIdSet.java | 51 +-
.../operator/docidsets/FilterBlockDocIdSet.java | 49 +-
...{SizeBasedDocIdSet.java => MVScanDocIdSet.java} | 44 +-
.../core/operator/docidsets/MatchAllDocIdSet.java | 24 +-
.../core/operator/docidsets/OrBlockDocIdSet.java | 126 -
.../pinot/core/operator/docidsets/OrDocIdSet.java | 120 +
...ArrayBasedDocIdSet.java => SVScanDocIdSet.java} | 29 +-
.../docidsets/ScanBasedMultiValueDocIdSet.java | 85 -
.../docidsets/ScanBasedSingleValueDocIdSet.java | 88 -
.../core/operator/docidsets/SortedDocIdSet.java | 74 +-
.../DictionaryBasedMultiValueIterator.java | 108 -
.../DictionaryBasedSingleValueIterator.java | 88 -
.../docvaliterators/MultiValueIterator.java | 84 -
.../docvaliterators/SingleValueIterator.java | 84 -
.../core/operator/docvalsets/MultiValueSet.java | 22 +-
.../core/operator/docvalsets/SingleValueSet.java | 142 +-
.../core/operator/filter/AndFilterOperator.java | 19 +-
.../operator/filter/BitmapBasedFilterOperator.java | 79 +-
.../core/operator/filter/FilterOperatorUtils.java | 45 +-
.../pinot/core/operator/filter/IntRanges.java | 84 -
.../operator/filter/MatchAllFilterOperator.java | 10 +-
.../core/operator/filter/OrFilterOperator.java | 23 +-
.../filter/RangeIndexBasedFilterOperator.java | 63 +-
.../operator/filter/ScanBasedFilterOperator.java | 53 +-
.../filter/SortedIndexBasedFilterOperator.java | 138 +
.../SortedInvertedIndexBasedFilterOperator.java | 179 -
.../operator/filter/TextMatchFilterOperator.java | 40 +-
.../BaseDictionaryBasedPredicateEvaluator.java | 8 +
.../predicate/EqualsPredicateEvaluatorFactory.java | 38 +-
.../predicate/InPredicateEvaluatorFactory.java | 38 +-
.../NotEqualsPredicateEvaluatorFactory.java | 38 +-
.../predicate/NotInPredicateEvaluatorFactory.java | 38 +-
.../filter/predicate/PredicateEvaluator.java | 8 +-
.../predicate/PredicateEvaluatorProvider.java | 6 -
.../predicate/RangePredicateEvaluatorFactory.java | 30 +
.../RegexpLikePredicateEvaluatorFactory.java | 11 +-
.../TextMatchPredicateEvaluatorFactory.java | 58 -
.../function/BinaryOperatorTransformFunction.java | 334 ++
.../transform/function/CaseTransformFunction.java | 450 ++
.../function/EqualsTransformFunction.java | 53 +
.../GreaterThanOrEqualTransformFunction.java | 61 +
.../function/GreaterThanTransformFunction.java | 61 +
.../function/LessThanOrEqualTransformFunction.java | 61 +
.../function/LessThanTransformFunction.java | 61 +
.../function/LiteralTransformFunction.java | 59 +-
.../function/NotEqualsTransformFunction.java | 53 +
.../function/ScalarTransformFunctionWrapper.java | 300 ++
.../function/TransformFunctionFactory.java | 46 +-
.../org/apache/pinot/core/plan/FilterPlanNode.java | 51 +-
.../core/query/aggregation/DistinctTable.java | 249 -
.../function/AggregationFunctionFactory.java | 2 +
.../function/DistinctAggregationFunction.java | 59 +-
...inctCountRawThetaSketchAggregationFunction.java | 140 +
...istinctCountThetaSketchAggregationFunction.java | 16 +-
.../function/customobject/DistinctTable.java | 334 ++
.../query/executor/ServerQueryExecutorV1Impl.java | 6 +-
.../query/reduce/AggregationDataTableReducer.java | 2 +-
.../query/reduce/DistinctDataTableReducer.java | 91 +-
.../core/query/reduce/GroupByDataTableReducer.java | 5 +-
.../core/query/reduce/ResultReducerFactory.java | 2 +-
.../RecordReaderSegmentCreationDataSource.java | 22 +-
.../creator/impl/SegmentColumnarIndexCreator.java | 47 +-
.../impl/SegmentIndexCreationDriverImpl.java | 38 +-
.../fwd/SingleValueFixedByteRawIndexCreator.java | 20 +-
.../fwd/SingleValueVarByteRawIndexCreator.java | 33 +-
.../defaultcolumn/BaseDefaultColumnHandler.java | 4 +-
.../startree/operator/StarTreeFilterOperator.java | 9 +-
.../org/apache/pinot/core/util/ArrayCopyUtils.java | 5 +-
.../core/common/RealtimeNoDictionaryTest.java | 26 +-
.../core/common/docidsets/BitmapDocIdSetTest.java | 78 -
.../core/common/docidsets/SortedDocIdSetTest.java | 136 -
.../function/InbuiltFunctionEvaluatorTest.java | 42 +-
...valuatorTest.java => InbuiltFunctionsTest.java} | 56 +-
.../realtime/LLRealtimeSegmentDataManagerTest.java | 139 +-
.../pinot/core/data/table/TableResizerTest.java | 158 -
.../mutable/MutableSegmentImplTest.java | 76 +-
.../pinot/core/io/util/PinotDataBitSetV2Test.java | 438 ++
.../dociditerators/AndDocIdIteratorTest.java | 55 +
.../dociditerators/BitmapDocIdIteratorTest.java | 61 +-
.../dociditerators/OrDocIdIteratorTest.java | 58 +
.../dociditerators/SortedDocIdIteratorTest.java | 85 +
.../RealtimeSingleValueIteratorTest.java | 167 -
.../operator/filter/AndFilterOperatorTest.java | 2 +-
.../pinot/core/operator/filter/IntRangesTest.java | 103 -
.../core/operator/filter/OrFilterOperatorTest.java | 8 +-
.../core/operator/filter/TestFilterOperator.java | 57 +-
.../function/BaseTransformFunctionTest.java | 21 +
.../BinaryOperatorTransformFunctionTest.java | 109 +
.../function/CaseTransformFunctionTest.java | 522 ++
.../function/EqualsTransformFunctionTest.java} | 36 +-
.../GreaterThanOrEqualTransformFunctionTest.java} | 36 +-
.../GreaterThanTransformFunctionTest.java} | 36 +-
.../LessThanOrEqualTransformFunctionTest.java} | 36 +-
.../function/LessThanTransformFunctionTest.java} | 36 +-
.../function/LiteralTransformFunctionTest.java | 41 +
.../function/NotEqualsTransformFunctionTest.java} | 36 +-
.../ScalarTransformFunctionWrapperTest.java | 173 +
.../fakestream/FakePartitionLevelConsumer.java | 22 +-
.../impl/fakestream/FakeStreamConfigUtils.java | 10 +-
.../impl/fakestream/FakeStreamConsumerFactory.java | 10 +-
.../impl/fakestream/FakeStreamMessageBatch.java | 8 +-
.../fakestream/FakeStreamMetadataProvider.java | 7 +-
.../core/realtime/stream/StreamConfigTest.java | 2 +
.../SegmentGenerationWithMultipleRecordsKey.java | 111 +
.../pinot/core/startree/v2/BaseStarTreeV2Test.java | 100 +-
.../FixedByteChunkSingleValueReaderWriteTest.java | 225 +-
.../VarByteChunkSingleValueReaderWriteTest.java | 49 +-
.../queries/DistinctCountThetaSketchTest.java | 115 +-
.../apache/pinot/queries/DistinctQueriesTest.java | 57 +-
...erSegmentAggregationSingleValueQueriesTest.java | 10 +-
...erSegmentResultTableSingleValueQueriesTest.java | 183 +-
.../src/test/resources/data/rawhllresults.txt | 8 +
.../src/test/resources/data/test_data-mv.avro | Bin 9583323 -> 7700192 bytes
pinot-distribution/pinot-source-assembly.xml | 5 +
.../ControllerPeriodicTasksIntegrationTest.java | 8 +-
.../tests/OfflineClusterIntegrationTest.java | 176 +-
.../tests/SegmentCompletionIntegrationTest.java | 6 +-
.../pinot/perf/BenchmarkOrDocIdIterator.java | 44 +-
.../pinot/perf/BenchmarkPinotDataBitSet.java | 546 +++
.../inputformat/avro/AvroRecordExtractor.java | 19 +-
.../pinot/plugin/inputformat/avro/AvroUtils.java | 67 +-
.../avro/AvroRecordExtractorComplexTypesTest.java | 209 +
.../avro/AvroRecordExtractorMapTypeTest.java | 123 -
.../inputformat/avro/AvroRecordExtractorTest.java | 10 +-
.../inputformat/csv/CSVRecordExtractorTest.java | 7 +-
.../inputformat/json/JSONRecordExtractor.java | 63 +-
...xtractor.java => JSONRecordExtractorUtils.java} | 79 +-
.../inputformat/json/JSONRecordExtractorTest.java | 12 +-
.../json/JSONRecordExtractorUtilsTest.java | 120 +
.../inputformat/orc/ORCRecordExtractorTest.java | 5 +-
.../parquet/ParquetRecordExtractorTest.java | 5 +-
.../kafka09/KafkaPartitionLevelConsumer.java | 12 +-
.../kafka09/KafkaStreamMetadataProvider.java | 11 +-
.../stream/kafka09/SimpleConsumerMessageBatch.java | 9 +-
.../kafka09/KafkaPartitionLevelConsumerTest.java | 9 +-
.../plugin/stream/kafka20/KafkaMessageBatch.java | 9 +-
.../kafka20/KafkaPartitionLevelConsumer.java | 10 +
.../kafka20/KafkaStreamMetadataProvider.java | 15 +-
.../kafka20/KafkaPartitionLevelConsumerTest.java | 28 +-
.../pinot/server/starter/ServerInstance.java | 3 +
.../server/starter/helix/HelixServerStarter.java | 5 +-
.../src/test/resources/data/test_data-mv.avro | Bin 9583323 -> 7700192 bytes
pinot-spi/pom.xml | 4 +
.../apache/pinot/spi/config/table/FieldConfig.java | 12 +-
.../SegmentsValidationAndRetentionConfig.java | 11 +
.../apache/pinot/spi/data/readers/GenericRow.java | 3 +
.../pinot/spi/data/readers/RecordExtractor.java | 5 +-
.../pinot/spi/data/readers/RecordReader.java | 2 +-
.../org/apache/pinot/spi/stream/LongMsgOffset.java | 41 +-
.../pinot/spi/stream/LongMsgOffsetFactory.java | 21 +-
.../org/apache/pinot/spi/stream/MessageBatch.java | 10 +
.../pinot/spi/stream/PartitionCountFetcher.java | 2 +-
.../pinot/spi/stream/PartitionLevelConsumer.java | 22 +
.../pinot/spi/stream/PartitionOffsetFetcher.java | 8 +-
.../org/apache/pinot/spi/stream/StreamConfig.java | 12 +
.../pinot/spi/stream/StreamConfigProperties.java | 1 +
.../spi/stream/StreamConsumerFactoryProvider.java | 19 +-
.../pinot/spi/stream/StreamMessageDecoder.java | 2 +-
.../pinot/spi/stream/StreamMetadataProvider.java | 11 +-
.../pinot/spi/stream/StreamPartitionMsgOffset.java | 57 +-
...r.java => StreamPartitionMsgOffsetFactory.java} | 32 +-
.../java/org/apache/pinot/spi/utils/JsonUtils.java | 15 +
.../spi/utils/builder/TableConfigBuilder.java | 7 +
.../data/readers/AbstractRecordExtractorTest.java | 80 +-
pinot-spi/src/test/resources/TestRecordReader.java | 18 +
.../groovy_map_transform_functions_schema.json | 27 -
.../groovy_transform_functions_schema.json | 44 -
.../org/apache/pinot/tools/HybridQuickstart.java | 65 +-
.../org/apache/pinot/tools/PinotToolLauncher.java | 3 +-
.../java/org/apache/pinot/tools/Quickstart.java | 51 +-
.../org/apache/pinot/tools/RealtimeQuickStart.java | 43 +-
.../org/apache/pinot/tools/SegmentDumpTool.java | 148 +-
.../apache/pinot/tools/StarTreeIndexViewer.java | 9 -
.../tools/admin/command/QuickstartRunner.java | 4 +-
.../data/generator/PatternSeasonalGenerator.java | 6 +-
.../data/generator/PatternSpikeGenerator.java | 42 +-
.../apache/pinot/tools/scan/query/Projection.java | 19 +-
.../tools/scan/query/SegmentQueryProcessor.java | 57 +-
.../converter/DictionaryToRawIndexConverter.java | 48 +-
.../generator/complexWebsite_generator.json | 108 +-
.../src/main/resources/generator/generator.sh | 76 -
pom.xml | 16 +-
thirdeye/docs/configuration.rst | 2 +-
thirdeye/run-backend.sh | 2 +-
thirdeye/run-frontend.sh | 2 +-
thirdeye/thirdeye-frontend/.bowerrc | 4 -
thirdeye/thirdeye-frontend/.gitignore | 2 -
.../app/mirage/endpoints/rootcause.js | 11 +
.../app/pods/components/alert-details/template.hbs | 1 +
.../components/alert-report-modal/template.hbs | 6 +
.../app/pods/components/anomaly-graph/component.js | 764 ---
.../app/pods/components/anomaly-graph/template.hbs | 120 -
.../app/pods/components/anomaly-id/component.js | 37 -
.../app/pods/components/anomaly-id/template.hbs | 15 -
.../components/anomaly-stats-block/component.js | 21 -
.../components/anomaly-stats-block/template.hbs | 53 -
.../pods/components/dimension-heatmap/component.js | 199 -
.../pods/components/dimension-heatmap/template.hbs | 16 -
.../pods/components/dimension-summary/component.js | 5 -
.../pods/components/dimension-summary/template.hbs | 16 -
.../app/pods/components/events-header/component.js | 86 -
.../app/pods/components/events-header/template.hbs | 26 -
.../app/pods/components/events-table/component.js | 134 -
.../app/pods/components/events-table/template.hbs | 16 -
.../app/pods/components/heatmap-chart/component.js | 47 +-
.../modals/manage-groups-modal/component.js | 716 ---
.../modals/manage-groups-modal/template.hbs | 239 -
.../components/performance-tooltip/component.js | 5 -
.../components/performance-tooltip/template.hbs | 17 -
.../rootcause-dimensions-algorithm/component.js | 20 +-
.../rootcause-dimensions-algorithm/template.hbs | 3 +-
.../self-serve-alert-yaml-details/component.js | 2 +-
.../pods/components/self-serve-graph/component.js | 114 -
.../pods/components/self-serve-graph/template.hbs | 38 -
.../pods/components/thirdeye-chart/component.js | 8 -
.../pods/components/thirdeye-chart/template.hbs | 1 -
.../pods/components/timeseries-chart/component.js | 8 +-
.../pods/custom/anomalies-table/rule/template.hbs | 2 +-
.../dimensions-table/change-bars/component.js | 7 +-
.../custom/dimensions-table/dimension/component.js | 3 +-
.../app/pods/example/controller.js | 10 -
.../thirdeye-frontend/app/pods/example/route.js | 32 -
.../app/pods/example/template.hbs | 23 -
.../pods/manage/alerts/performance/controller.js | 101 -
.../app/pods/manage/alerts/performance/route.js | 348 --
.../pods/manage/alerts/performance/template.hbs | 140 -
.../partials/rootcause/dimensions/template.hbs | 36 +-
.../app/pods/rootcause/controller.js | 4 +-
.../app/pods/rootcause/template.hbs | 10 +-
.../app/pods/self-serve/create-alert/template.hbs | 15 -
thirdeye/thirdeye-frontend/app/router.js | 2 +-
.../app/shared/dimensionAnalysisTableConfig.js | 19 +-
.../app/shared/filterBarConfig.js | 21 +-
thirdeye/thirdeye-frontend/app/styles/app.scss | 4 -
.../app/styles/components/anomaly-graph.scss | 151 -
.../app/styles/components/anomaly-id.scss | 32 -
.../app/styles/components/dimension-heatmap.scss | 69 -
.../app/styles/components/dimension-summary.scss | 30 -
.../app/styles/pods/manage/alerts-performance.scss | 20 -
.../app/styles/pods/rootcause.scss | 100 +
thirdeye/thirdeye-frontend/app/utils/yaml-tools.js | 38 +-
thirdeye/thirdeye-frontend/bower.json | 8 -
thirdeye/thirdeye-frontend/config/environment.js | 4 +
thirdeye/thirdeye-frontend/ember-cli-build.js | 4 +-
thirdeye/thirdeye-frontend/jsconfig.json | 2 +-
thirdeye/thirdeye-frontend/package.json | 7 +-
thirdeye/thirdeye-frontend/pom.xml | 9 -
.../tests/acceptance/rootcause-test.js | 16 +-
.../components/anomaly-graph/component-test.js | 23 -
.../pods/components/anomaly-id/component-test.js | 55 -
.../components/thirdeye-chart/component-test.js | 26 -
.../thirdeye-frontend/tests/utils/constants.js | 1 +
thirdeye/thirdeye-frontend/yarn.lock | 5146 +++++++++++---------
.../anomaly/ThirdEyeAnomalyApplication.java | 85 +-
.../thirdeye/anomaly/alert/AlertJobContext.java | 49 -
.../thirdeye/anomaly/alert/AlertJobResource.java | 86 -
.../thirdeye/anomaly/alert/AlertTaskInfo.java | 114 -
.../anomaly/alert/util/AnomalyReportGenerator.java | 599 ---
.../thirdeye/anomaly/alert/util/EmailHelper.java | 51 -
.../anomaly/alert/v2/AlertJobRunnerV2.java | 158 -
.../anomaly/alert/v2/AlertJobSchedulerV2.java | 250 -
.../anomaly/alert/v2/AlertTaskRunnerV2.java | 293 --
.../classification/ClassificationJobConfig.java | 47 -
.../classification/ClassificationJobContext.java | 70 -
.../classification/ClassificationJobResource.java | 23 -
.../classification/ClassificationJobRunner.java | 126 -
.../classification/ClassificationJobScheduler.java | 186 -
.../classification/ClassificationTaskInfo.java | 73 -
.../classification/ClassificationTaskRunner.java | 437 --
.../classifier/AnomalyClassifier.java | 45 -
.../classifier/AnomalyClassifierFactory.java | 152 -
.../detection/AnomalyDetectionOutputContext.java | 37 -
.../anomaly/detection/DetectionJobContext.java | 80 -
.../anomaly/detection/DetectionJobRunner.java | 182 -
.../anomaly/detection/DetectionJobScheduler.java | 614 ---
.../detection/DetectionJobSchedulerUtils.java | 30 -
.../anomaly/detection/DetectionTaskInfo.java | 138 -
.../anomaly/detection/DetectionTaskRunner.java | 467 --
.../anomaly/detection/lib/AutotuneMethodType.java | 24 -
.../anomaly/merge/TimeBasedAnomalyMerger.java | 311 --
.../anomaly/monitor/MonitorJobScheduler.java | 8 -
.../pinot/thirdeye/anomaly/task/TaskConstants.java | 18 +-
.../pinot/thirdeye/anomaly/task/TaskContext.java | 28 -
.../pinot/thirdeye/anomaly/task/TaskDriver.java | 9 +-
.../pinot/thirdeye/anomaly/task/TaskGenerator.java | 69 -
.../thirdeye/anomaly/task/TaskInfoFactory.java | 22 +-
.../thirdeye/anomaly/task/TaskRunnerFactory.java | 20 -
.../AlertFilterAutotuneFactory.java | 95 -
.../BaseAlertFilterAutoTune.java | 78 -
.../thirdeye/common/BaseThirdEyeApplication.java | 13 -
.../checker/DataCompletenessAlgorithm.java | 94 -
.../checker/DataCompletenessAlgorithmFactory.java | 39 -
.../checker/DataCompletenessConstants.java | 41 -
.../checker/DataCompletenessJobContext.java | 55 -
.../checker/DataCompletenessJobRunner.java | 170 -
.../checker/DataCompletenessScheduler.java | 53 -
.../checker/DataCompletenessTaskInfo.java | 101 -
.../checker/DataCompletenessTaskRunner.java | 348 --
.../checker/DataCompletenessUtils.java | 273 --
.../checker/PercentCompletenessFunctionInput.java | 88 -
.../checker/Wo4WAvgDataCompletenessAlgorithm.java | 164 -
.../dashboard/ThirdEyeDashboardApplication.java | 22 +-
.../dashboard/resources/AnomalyResource.java | 552 +--
.../dashboard/resources/DatasetConfigResource.java | 7 -
.../dashboard/resources/DetectionJobResource.java | 859 ----
.../dashboard/resources/EmailResource.java | 598 ---
.../dashboard/resources/v2/AnomaliesResource.java | 428 +-
.../dashboard/resources/v2/DataResource.java | 4 +-
.../dashboard/resources/v2/TimeSeriesResource.java | 435 --
.../resources/v2/pojo/AnomalyDataCompare.java | 97 -
.../dashboard/resources/v2/pojo/SearchFilters.java | 9 +-
.../datalayer/bao/AutotuneConfigManager.java | 36 -
.../datalayer/bao/DatasetConfigManager.java | 2 -
.../pinot/thirdeye/datalayer/bao/JobManager.java | 2 -
.../bao/jdbc/AutotuneConfigManagerImpl.java | 76 -
.../bao/jdbc/DatasetConfigManagerImpl.java | 8 -
.../datalayer/bao/jdbc/JobManagerImpl.java | 32 -
.../thirdeye/datalayer/dao/GenericPojoDao.java | 4 -
.../thirdeye/datalayer/dto/AutotuneConfigDTO.java | 78 -
.../datalayer/dto/MergedAnomalyResultDTO.java | 1 +
.../datalayer/entity/AutotuneConfigIndex.java | 77 -
.../datalayer/pojo/AutotuneConfigBean.java | 174 -
.../thirdeye/datalayer/pojo/DatasetConfigBean.java | 54 +-
.../thirdeye/datalayer/util/DaoProviderUtil.java | 3 -
.../pinot/thirdeye/datasource/DAORegistry.java | 6 -
.../pinot/thirdeye/datasource/sql/SqlUtils.java | 22 +-
.../pinot/thirdeye/detection/DataProvider.java | 4 +-
.../thirdeye/detection/DefaultDataProvider.java | 10 +-
.../detection/DefaultInputDataFetcher.java | 2 +-
.../thirdeye/detection/DetectionResource.java | 76 -
.../detection/LegacyAnomalyFunctionTranslator.java | 96 -
.../detection/StaticDetectionPipeline.java | 2 +-
.../detection/alert/DetectionAlertJob.java | 1 -
.../alert/StatefulDetectionAlertFilter.java | 2 +-
.../algorithm/BaselineRuleFilterWrapper.java | 4 +-
.../detection/algorithm/DimensionWrapper.java | 8 +-
.../detection/algorithm/LegacyMergeWrapper.java | 2 +-
.../algorithm/ThresholdRuleFilterWrapper.java | 2 +-
.../content/BaseNotificationContent.java | 5 +-
.../anomaly/detection/DetectionTaskRunnerTest.java | 113 -
.../checker/DataCompletenessUtilsTest.java | 232 -
.../dashboard/resource/AnomalyResourceTest.java | 30 -
.../pinot/thirdeye/datalayer/DaoTestUtils.java | 21 +-
.../datalayer/bao/TestAnomalyTaskManager.java | 13 +-
.../datalayer/bao/TestAutotuneConfigManager.java | 91 -
.../datalayer/bao/TestDatasetConfigManager.java | 6 -
.../thirdeye/datasource/sql/TestSqlUtils.java | 124 +
.../pinot/thirdeye/detection/DataProviderTest.java | 64 +-
.../pinot/thirdeye/detection/MockDataProvider.java | 12 +-
.../rootcause/MockDatasetConfigManager.java | 5 -
.../thirdeye/tools/AutoTuneAlertFilterTool.java | 224 -
.../pinot/thirdeye/tools/FetchAutoTuneResult.java | 166 -
.../tools/RunAdhocDatabaseQueriesTool.java | 2 +-
.../tools/anomaly/report/AnomalyReportConfig.java | 86 -
.../tools/anomaly/report/AnomalyReportDriver.java | 118 -
.../anomaly/report/GenerateAnomalyReport.java | 349 --
.../test/resources/sample-classifier.properties | 1 -
website/package.json | 32 +-
website/src/pages/index.css | 7 +-
website/src/pages/index.js | 5 +-
479 files changed, 14712 insertions(+), 24224 deletions(-)
create mode 100644 .github/workflows/pinot_tests.yml
create mode 100755 .github/workflows/scripts/.pinot_quickstart.sh
copy .travis/.travis_nightly_build.sh => .github/workflows/scripts/.pinot_test.sh (51%)
create mode 100644 docker/images/pinot-superset/bin/superset-init
create mode 100644 docker/images/pinot/etc/jmx_prometheus_javaagent/configs/pinot.yml
create mode 100644 docker/images/pinot/etc/jmx_prometheus_javaagent/jmx_prometheus_javaagent-0.12.0.jar
rename docker/images/pinot/{ => examples/docker}/ingestion-job-specs/airlineStats.yaml (100%)
rename docker/images/pinot/{ => examples/docker}/ingestion-job-specs/baseballStats.yaml (100%)
rename docker/images/pinot/{ => examples/docker}/table-configs/airlineStats_realtime_table_config.json (100%)
rename docker/images/pinot/{ => examples/docker}/table-configs/meetupRsvp_realtime_table_config.json (100%)
create mode 100644 licenses-binary/LICENSE-gpl-2.0.txt
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/requesthandler/LiteralOnlyBrokerRequestTest.java
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/alertFilterAutotune/AlertFilterAutoTune.java => pinot-common/src/main/java/org/apache/pinot/common/function/annotations/ScalarFunction.java (59%)
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/alertFilterAutotune/DummyAlertFilterAutoTune.java => pinot-common/src/test/java/org/apache/pinot/common/function/FunctionDefinitionRegistryTest.java (66%)
rename pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/ScanBasedDocIdSet.java => pinot-common/src/test/java/org/apache/pinot/common/function/TransformFunctionTypeTest.java (71%)
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/common/BlockSingleValIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/common/BlockValIterator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/util/FixedBitIntReaderWriterV2.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/util/PinotDataBitSetV2.java
rename pinot-core/src/main/java/org/apache/pinot/core/operator/dociditerators/{IndexBasedDocIdIterator.java => BitmapBasedDocIdIterator.java} (73%)
copy pinot-core/src/main/java/org/apache/pinot/core/operator/dociditerators/{EmptyBlockDocIdIterator.java => EmptyDocIdIterator.java} (72%)
rename pinot-core/src/main/java/org/apache/pinot/core/operator/dociditerators/{SizeBasedDocIdIterator.java => MatchAllDocIdIterator.java} (69%)
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/AndBlockDocIdSet.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/AndDocIdSet.java
rename pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/{EmptyFilterBlockDocIdSet.java => EmptyDocIdSet.java} (57%)
rename pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/{SizeBasedDocIdSet.java => MVScanDocIdSet.java} (52%)
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/classifier/DummyAnomalyClassifier.java => pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/MatchAllDocIdSet.java (64%)
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/OrBlockDocIdSet.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/OrDocIdSet.java
copy pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/{ArrayBasedDocIdSet.java => SVScanDocIdSet.java} (56%)
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/ScanBasedMultiValueDocIdSet.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/ScanBasedSingleValueDocIdSet.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docvaliterators/DictionaryBasedMultiValueIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docvaliterators/DictionaryBasedSingleValueIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docvaliterators/MultiValueIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docvaliterators/SingleValueIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/filter/IntRanges.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/filter/SortedIndexBasedFilterOperator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/filter/SortedInvertedIndexBasedFilterOperator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/filter/predicate/TextMatchPredicateEvaluatorFactory.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/BinaryOperatorTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/CaseTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/EqualsTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/GreaterThanOrEqualTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/GreaterThanTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/LessThanOrEqualTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/LessThanTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/NotEqualsTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/ScalarTransformFunctionWrapper.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/DistinctTable.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/DistinctCountRawThetaSketchAggregationFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/customobject/DistinctTable.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/common/docidsets/BitmapDocIdSetTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/common/docidsets/SortedDocIdSetTest.java
rename pinot-core/src/test/java/org/apache/pinot/core/data/function/{DateTimeFunctionEvaluatorTest.java => InbuiltFunctionsTest.java} (77%)
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/io/util/PinotDataBitSetV2Test.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/dociditerators/AndDocIdIteratorTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/dociditerators/OrDocIdIteratorTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/dociditerators/SortedDocIdIteratorTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/docvaliterators/RealtimeSingleValueIteratorTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/filter/IntRangesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/transform/function/BinaryOperatorTransformFunctionTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/transform/function/CaseTransformFunctionTest.java
copy pinot-core/src/{main/java/org/apache/pinot/core/operator/dociditerators/EmptyBlockDocIdIterator.java => test/java/org/apache/pinot/core/operator/transform/function/EqualsTransformFunctionTest.java} (53%)
copy pinot-core/src/{main/java/org/apache/pinot/core/operator/dociditerators/EmptyBlockDocIdIterator.java => test/java/org/apache/pinot/core/operator/transform/function/GreaterThanOrEqualTransformFunctionTest.java} (52%)
copy pinot-core/src/{main/java/org/apache/pinot/core/operator/dociditerators/EmptyBlockDocIdIterator.java => test/java/org/apache/pinot/core/operator/transform/function/GreaterThanTransformFunctionTest.java} (53%)
copy pinot-core/src/{main/java/org/apache/pinot/core/operator/dociditerators/EmptyBlockDocIdIterator.java => test/java/org/apache/pinot/core/operator/transform/function/LessThanOrEqualTransformFunctionTest.java} (53%)
copy pinot-core/src/{main/java/org/apache/pinot/core/operator/dociditerators/EmptyBlockDocIdIterator.java => test/java/org/apache/pinot/core/operator/transform/function/LessThanTransformFunctionTest.java} (53%)
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/transform/function/LiteralTransformFunctionTest.java
rename pinot-core/src/{main/java/org/apache/pinot/core/operator/dociditerators/EmptyBlockDocIdIterator.java => test/java/org/apache/pinot/core/operator/transform/function/NotEqualsTransformFunctionTest.java} (53%)
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/transform/function/ScalarTransformFunctionWrapperTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/creator/SegmentGenerationWithMultipleRecordsKey.java
create mode 100644 pinot-core/src/test/resources/data/rawhllresults.txt
create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkPinotDataBitSet.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractorComplexTypesTest.java
delete mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractorMapTypeTest.java
copy pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/{JSONRecordExtractor.java => JSONRecordExtractorUtils.java} (52%)
create mode 100644 pinot-plugins/pinot-input-format/pinot-json/src/test/java/org/apache/pinot/plugin/inputformat/json/JSONRecordExtractorUtilsTest.java
rename pinot-core/src/main/java/org/apache/pinot/core/common/BlockMultiValIterator.java => pinot-spi/src/main/java/org/apache/pinot/spi/stream/LongMsgOffset.java (54%)
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/classifier/BaseAnomalyClassifier.java => pinot-spi/src/main/java/org/apache/pinot/spi/stream/LongMsgOffsetFactory.java (66%)
copy pinot-spi/src/main/java/org/apache/pinot/spi/stream/{PartitionLevelConsumer.java => StreamPartitionMsgOffsetFactory.java} (59%)
delete mode 100644 pinot-spi/src/test/resources/groovy_map_transform_functions_schema.json
delete mode 100644 pinot-spi/src/test/resources/groovy_transform_functions_schema.json
delete mode 100755 pinot-tools/src/main/resources/generator/generator.sh
delete mode 100644 thirdeye/thirdeye-frontend/.bowerrc
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-graph/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-graph/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-id/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-id/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-stats-block/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/anomaly-stats-block/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/dimension-heatmap/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/dimension-heatmap/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/dimension-summary/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/dimension-summary/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/events-header/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/events-header/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/events-table/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/events-table/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/modals/manage-groups-modal/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/modals/manage-groups-modal/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/performance-tooltip/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/performance-tooltip/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/self-serve-graph/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/self-serve-graph/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/thirdeye-chart/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/thirdeye-chart/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/example/controller.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/example/route.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/example/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/manage/alerts/performance/controller.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/manage/alerts/performance/route.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/manage/alerts/performance/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/styles/components/anomaly-graph.scss
delete mode 100644 thirdeye/thirdeye-frontend/app/styles/components/anomaly-id.scss
delete mode 100644 thirdeye/thirdeye-frontend/app/styles/components/dimension-heatmap.scss
delete mode 100644 thirdeye/thirdeye-frontend/app/styles/components/dimension-summary.scss
delete mode 100644 thirdeye/thirdeye-frontend/bower.json
delete mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/anomaly-graph/component-test.js
delete mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/anomaly-id/component-test.js
delete mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/thirdeye-chart/component-test.js
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/AlertJobContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/AlertJobResource.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/AlertTaskInfo.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/util/AnomalyReportGenerator.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/v2/AlertJobRunnerV2.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/v2/AlertJobSchedulerV2.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/v2/AlertTaskRunnerV2.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/ClassificationJobConfig.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/ClassificationJobContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/ClassificationJobResource.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/ClassificationJobRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/ClassificationJobScheduler.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/ClassificationTaskInfo.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/ClassificationTaskRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/classifier/AnomalyClassifier.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/classification/classifier/AnomalyClassifierFactory.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/AnomalyDetectionOutputContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/DetectionJobContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/DetectionJobRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/DetectionJobScheduler.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/DetectionTaskInfo.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/DetectionTaskRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/lib/AutotuneMethodType.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/merge/TimeBasedAnomalyMerger.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/alertFilterAutotune/AlertFilterAutotuneFactory.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/alertFilterAutotune/BaseAlertFilterAutoTune.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessAlgorithm.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessAlgorithmFactory.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessConstants.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessJobContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessJobRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessScheduler.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessTaskInfo.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessTaskRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/PercentCompletenessFunctionInput.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/completeness/checker/Wo4WAvgDataCompletenessAlgorithm.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/dashboard/resources/DetectionJobResource.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/dashboard/resources/EmailResource.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/dashboard/resources/v2/TimeSeriesResource.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/dashboard/resources/v2/pojo/AnomalyDataCompare.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datalayer/bao/AutotuneConfigManager.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datalayer/bao/jdbc/AutotuneConfigManagerImpl.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datalayer/dto/AutotuneConfigDTO.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datalayer/entity/AutotuneConfigIndex.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datalayer/pojo/AutotuneConfigBean.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/LegacyAnomalyFunctionTranslator.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/detection/DetectionTaskRunnerTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/completeness/checker/DataCompletenessUtilsTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/datalayer/bao/TestAutotuneConfigManager.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/datasource/sql/TestSqlUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/tools/AutoTuneAlertFilterTool.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/tools/FetchAutoTuneResult.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/tools/anomaly/report/AnomalyReportConfig.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/tools/anomaly/report/AnomalyReportDriver.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/tools/anomaly/report/GenerateAnomalyReport.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/resources/sample-classifier.properties
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org