You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by ja...@apache.org on 2019/10/23 01:48:23 UTC
[incubator-pinot] branch offheap_var_length_store updated (5ee259e
-> e4c5be2)
This is an automated email from the ASF dual-hosted git repository.
jackie pushed a change to branch offheap_var_length_store
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 5ee259e Implement OffHeapMutableBytesStore for real-time var-length bytes store
add a0c84fe Implement DISTINCT (#4535)
add 761ce2f Add APIs to get leader for all tables or a given table (#4545)
add 31594da Replace Hashmap to Object2IntOpenHashMap in OnHeapStringDictionary (#4568)
add 283a495 Revert "Set processingException when all queried segments cannot be acquired (#3942)" (#4632)
add 49a65a3 Support default value for Byte column (#4583)
add e447117 Remove import of sun.misc.Cleaner to make code compatible with jdk11 (#4634)
add ffa66bf Refactor ControllerLeaderLocator (#4553)
add f30d83b Adding documentation for Pinot Schema. (#4637)
add 07c74b1 User doc for Star-Tree index (#4640)
add c563b82 Add license header for star-tree document (#4641)
add bd1af57 Adding section describing defaultNullValue in Schema page. (#4642)
add 4c4800b Support HTTP POST/PUT JSON schema (#4639)
add 09d3735 Remove sun.misc.Cleaner import (#4643)
add a734931 Add metrics for the number of partitions for which controller becomes leader (#4633)
add c44d371 [TE] fix email alerter throw exception (#4647)
add 0b4fc0c Documentation for completionConfig (#4636)
add ca01c86 [TE] frontend - harleyjj/rca - make first column scrollable in dimensions-algorithm table (#4631)
add 577f1cf Do not update download URL and crypter when segment is not refreshed (#4593)
add d30dfb0 Standardize the Dictionary interface, ensure the BYTES support (#4622)
add 4b5c5ac Misc fixes for aggregation functions (#4579)
add b0fe681 Support ORC files as data source in segment creation (#4635)
add bfb518e Add integration test for ControllerLeaderLocator (#4567)
add b24816a Adding sample ADL settings to documentation (#4645)
add dd4e69e Use timed wait around get() calls in PinotInstance (#4649)
add 9cfcd30 Simplify the logic of List handling in DataTypeTransformer (#4651)
add d6f9655 Implement all transform function APIs for MapValueTransformFunction (#4595)
add ad391dd Enable distinct and throw exceptions for not-supported cases (#4648)
add bb5913f Enabling alternative controller rest API classes in preprocess (#4646)
add 7eccc99 Revert the binary-search change for MapValue transform function (#4654)
add 8b24ec4 Fix the DistinctCountHLL with serialized HyperLogLog of non-default log2m (#4655)
add 8193e52 Refactor TransformBlockDataFetcher into RowBasedBlockValueFetcher (#4658)
add 8a80760 Refactor toggleInstanceState API (#4560)
add 7662937 Make TransformFunction.getDictionary() API consistent with DataSource.getDictionary() (#4661)
add 26a0696 Added documentation for split commit (#4660)
add 0b69aab [TE] Clean up legacy group id and name logic (#4656)
add 639f94e [TE] frontend - harleyjj/alert-details - update Alert Overview to align with new API (#4659)
add 97f8ef3 [TE] frontend - harleyjj/alert-details - add comparison to preview (#4638)
add 9746e82 [TE] Clean up legacy detection related classes; update ADContentFormatterContext (#4657)
add b07436f Support other filesystems for Pinot Hadoop job (#4664)
add 48edd8d Support serialized BYTES data with non-default factor (#4666)
add df183d5 [TE] Accelerate yaml listing (#4670)
add b75876c Fix flakiness in BoundedAccountingExecutorTest (#4674)
add af48abc Mocking out the LeadControllerManager in test (#4677)
add bed6efe [TE] Improve logging - log the job name with every log line (#4675)
add 8273f66 Update Getting Started documentation. (#4615)
add 849ebcb [TE] frontend - harleyjj/comparison - fix bugs from mini bugbash (#4672)
add 492d780 Apply several fixes in realtime segment manager (#4669)
add 8249b6b Make GenericRow support null value fields and default null values (#4671)
add 73eb06d Ensure segment converter not fail for schemas without time fieldSpec (#4680)
add aa04c57 Remove validation for config controller.host (#4681)
add 18a9f2f Use guava cache for instance admin endpoints (#4678)
add 2d20c64 Possible fix for NPE seen in this test. (#4684)
add ce298ba Unit tests and bug fixes for DeleteTable rest API for controller. (#4608)
add 51c7a0f Modify get tenant names APIs (#4688)
add 9362ba4 First pass of GROUP BY with ORDER BY support (#4602)
add cf627b2 Add groupByMode=sql and responseFormat=sql options to query console (#4694)
add bcc74f8 Fetch new schema when loading committed real-time segments (#4693)
add b824b48 Remove "refresh" usecase check in RoutingTableBuilderFactory (#4687)
add 2a3fcde [#4667] Fix auto-tuning algorithm to update when parameters are changed (#4679)
add c37dc02 Remove the temporary code for the selection fix (#4696)
add 4d68dd1 [TE] frontend - harleyjj/comparison - set getAnomaliesError in any error catch (#4697)
add f58ba2d [TE] [notification] JIRA alerting framework (#4682)
add c17827f Fix simple date time column segment generation test (#4698)
add cf954ae [TE] remove erroneous import (#4691)
add 144cd98 [TE] handle data insufficient exceptions in the detection pipeline (#4685)
add 7540702 Enhance Selection Comparator (#4702)
add 4f997af Add documenation for queryOptions groupByMode and responseFormat (#4708)
add f81e07a [TE] changed retention and Pinot metadata sync frequency (#4700)
add 1ddbd6e Clean up metrics (#4710)
add 13ebf49 [TE] frontend - harleyjj/alert-details - add flags for tracking state of anomalies (#4709)
add f8b8f27 Adding option to load a Pinot segment as post creation verification (#4706)
add 0ebd321 [TE] check start time in range when deciding if needs notification (#4699)
add eed7c1a [TE] [notification] Multi-dimension based conditional alerting (#4703)
add 770381f correct detection name for holt winters (#4650)
add 4f386bc [TE] frontend - harleyjj/packages - update node and front end packages (#4683)
add 5f01357 fix small typo in log message (#4707)
add 6ee6a41 [TE] Add unit test for DetectionEmailAlerter - fix casting bug (#4717)
add 3579aae Remove the segment missing error message when acquiring segments (#4714)
add a78ac5c [TE][RCA] Fix the broken RCA algorithm tab (#4720)
add dc17239 Package parquet and orc record reader into shaded jar (#4716)
add f245b5e [TE] support row count metric for Pinot (#4718)
add e9e6a33 [TE] frontend - harleyjj/alert-details - handle concurrency errors in alert details component (#4721)
add a6f8f1e [Resource Assignment] Plug in resource assignment to LLC REALTIME table (#4695)
add 860cb92 Enable full stack trace when there is an exception during tests (#4727)
add 6bc6e55 Optimize MutableOffHeapByteArrayStore by directly calling the PinotDataBuffer API (#4362)
add c1a0944 [TE] Fix ignored timeout by checking Thread.interrupted (#4690)
add 15bde95 [TE] web - harleyjj/rca-session - save dimension-algorithm table settings with session and load them (#4712)
add 2f3cd43 [TE] put default settings for subscription YAML (#4723)
add f015c68 Add sql query command (#4726)
add e4c5be2 Implement OffHeapMutableBytesStore for real-time var-length bytes store
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (5ee259e)
\
N -- N -- N refs/heads/offheap_var_length_store (e4c5be2)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
docs/admin_guide.rst | 1 +
docs/architecture.rst | 29 +-
docs/getting_started.rst | 123 +-
docs/index.rst | 2 +-
docs/pluggable_storage.rst | 42 +-
docs/pql_examples.rst | 38 +
docs/schema.rst | 138 +
docs/segment_fetcher.rst | 2 +
docs/star-tree/example.png | Bin 0 -> 29005 bytes
docs/star-tree/space-time.png | Bin 0 -> 25225 bytes
docs/star-tree/star-tree.rst | 349 +
docs/star-tree/structure.png | Bin 0 -> 25841 bytes
docs/tableconfig_schema.rst | 23 +
docs/tuning_pinot.rst | 13 +-
docs/tuning_realtime_performance.rst | 38 +-
kubernetes/examples/gke/skaffold/pinot-broker.yml | 2 +-
.../examples/gke/skaffold/pinot-controller.yml | 3 +-
kubernetes/examples/gke/skaffold/pinot-server.yml | 2 +-
.../broker/api/resources/PinotClientRequest.java | 6 +-
.../requesthandler/BaseBrokerRequestHandler.java | 164 +-
.../broker/routing/RoutingTableBuilderFactory.java | 8 +-
.../PartitionAwareOfflineRoutingTableBuilder.java | 23 +-
.../broker/broker/HelixBrokerStarterTest.java | 2 +-
.../broker/requesthandler/QueryValidationTest.java | 60 +
...rtitionAwareOfflineRoutingTableBuilderTest.java | 44 +-
.../common/assignment/InstancePartitionsUtils.java | 32 +-
.../apache/pinot/common/config/IndexingConfig.java | 11 -
.../common/config/StreamConsumptionConfig.java | 35 -
.../apache/pinot/common/config/TableConfig.java | 10 -
.../apache/pinot/common/config/TagNameUtils.java | 15 -
.../org/apache/pinot/common/data/RowEvent.java | 36 -
.../pinot/common/exception/QueryException.java | 2 -
.../common/function/AggregationFunctionType.java | 58 +-
.../function/FunctionDefinitionRegistry.java | 6 +-
.../apache/pinot/common/metrics/BrokerMeter.java | 4 -
.../pinot/common/metrics/ControllerGauge.java | 10 +-
.../pinot/common/metrics/ControllerMeter.java | 16 +-
.../apache/pinot/common/metrics/ServerGauge.java | 5 -
.../common/partition/PartitionAssignment.java | 109 -
...roupBasedStreamPartitionAssignmentStrategy.java | 83 -
.../partition/ReplicaGroupPartitionAssignment.java | 124 -
.../ReplicaGroupPartitionAssignmentGenerator.java | 128 -
.../StreamPartitionAssignmentGenerator.java | 139 -
.../StreamPartitionAssignmentStrategy.java | 40 -
.../StreamPartitionAssignmentStrategyFactory.java | 45 -
.../UniformStreamPartitionAssignmentStrategy.java | 66 -
.../protocols/SegmentCompletionProtocol.java | 2 +-
.../apache/pinot/common/request/BrokerRequest.java | 199 +-
.../response/broker/BrokerResponseNative.java | 14 +-
.../pinot/common/response/broker/ResultTable.java | 53 +-
.../org/apache/pinot/common/utils/BytesUtils.java | 31 +-
.../apache/pinot/common/utils/CommonConstants.java | 3 +
.../common/utils/helix/LeadControllerUtils.java | 49 +
.../parsers/PinotQuery2BrokerRequestConverter.java | 77 +-
.../org/apache/pinot/pql/parsers/Pql2Compiler.java | 3 +-
.../pql/parsers/pql2/ast/FunctionCallAstNode.java | 59 +-
.../pinot/pql/parsers/pql2/ast/SelectAstNode.java | 25 +-
.../apache/pinot/sql/parsers/CalciteSqlParser.java | 67 +-
.../pinot/common/config/TableConfigTest.java | 23 -
.../apache/pinot/common/data/FieldSpecTest.java | 11 +
.../function/AggregationFunctionTypeTest.java | 3 +-
.../common/partition/IdealStateBuilderUtil.java | 179 -
...icaGroupBasedStreamPartitionAssignmentTest.java | 136 -
.../StreamPartitionAssignmentGeneratorTest.java | 364 -
.../UniformStreamPartitionAssignmentTest.java | 93 -
.../pinot/sql/parsers/CalciteSqlCompilerTest.java | 347 +
pinot-common/src/thrift/request.thrift | 1 +
.../apache/pinot/controller/ControllerStarter.java | 2 +-
.../pinot/controller/LeadControllerManager.java | 41 +-
.../pinot/controller/api/resources/Constants.java | 1 +
.../resources/PinotInstanceRestletResource.java | 12 +-
.../PinotLeadControllerRestletResource.java | 202 +
.../api/resources/PinotSchemaRestletResource.java | 51 +-
.../api/resources/PinotTableRestletResource.java | 39 +-
.../controller/api/resources/PqlQueryResource.java | 19 +-
.../pinot/controller/api/upload/ZKOperator.java | 18 +-
.../helix/core/PinotHelixResourceManager.java | 265 +-
.../helix/core/PinotTableIdealStateBuilder.java | 7 +-
.../instance/InstanceTagPoolSelector.java | 4 +-
.../assignment/segment/SegmentAssignmentUtils.java | 3 +-
.../realtime/PinotLLCRealtimeSegmentManager.java | 1394 +-
.../core/realtime/SegmentCompletionManager.java | 67 +-
.../helix/core/realtime/TableConfigCache.java | 12 +-
.../segment/DefaultFlushThresholdUpdater.java | 45 +-
.../segment/FlushThresholdUpdateManager.java | 35 +-
.../realtime/segment/FlushThresholdUpdater.java | 20 +-
.../SegmentSizeBasedFlushThresholdUpdater.java | 121 +-
.../RealtimeSegmentValidationManager.java | 6 +-
.../src/main/resources/static/js/init.js | 20 +-
.../src/main/resources/static/query/index.html | 14 +-
.../src/main/resources/webapp/index.html | 14 +-
.../src/main/resources/webapp/js/init.js | 20 +-
.../controller/LeadControllerManagerTest.java | 17 +-
.../api/PinotInstanceRestletResourceTest.java | 141 +-
.../api/PinotSchemaRestletResourceTest.java | 30 +
.../api/PinotTableRestletResourceTest.java | 98 +
.../controller/api/upload/ZKOperatorTest.java | 141 +
.../helix/ControllerInstanceToggleTest.java | 26 +-
.../pinot/controller/helix/ControllerTest.java | 14 +
.../controller/helix/PinotControllerModeTest.java | 23 +-
.../helix/core/PinotHelixResourceManagerTest.java | 60 +-
.../PinotLLCRealtimeSegmentManagerTest.java | 2115 +-
.../helix/core/realtime/SegmentCompletionTest.java | 32 +-
.../segment/FlushThresholdUpdaterTest.java | 768 +-
.../helix/core/retention/RetentionManagerTest.java | 7 +-
.../validation/ValidationManagerTest.java | 5 +-
.../apache/pinot/core/common/BaseBlockValSet.java | 9 +-
.../org/apache/pinot/core/common/BlockValSet.java | 2 +
.../org/apache/pinot/core/common/DataFetcher.java | 22 +-
.../org/apache/pinot/core/common/DataSource.java | 16 +-
.../apache/pinot/core/common/ObjectSerDeUtils.java | 54 +-
.../core/common/RowBasedBlockValueFetcher.java | 217 +
.../core/common/datatable/DataTableBuilder.java | 3 +-
.../org/apache/pinot/core/data/GenericRow.java | 166 +-
.../core/data/aggregator/AvgValueAggregator.java | 2 +-
.../DistinctCountHLLValueAggregator.java | 2 +-
.../aggregator/MinMaxRangeValueAggregator.java | 2 +-
.../aggregator/PercentileEstValueAggregator.java | 2 +-
.../PercentileTDigestValueAggregator.java | 2 +-
.../core/data/manager/BaseTableDataManager.java | 66 +-
.../core/data/manager/InstanceDataManager.java | 14 -
.../pinot/core/data/manager/TableDataManager.java | 40 +-
.../manager/offline/OfflineTableDataManager.java | 3 +-
.../realtime/HLRealtimeSegmentDataManager.java | 74 +-
.../realtime/LLRealtimeSegmentDataManager.java | 41 +-
.../manager/realtime/RealtimeTableDataManager.java | 75 +-
.../apache/pinot/core/data/order/OrderByUtils.java | 123 +-
.../pinot/core/data/readers/AvroRecordReader.java | 1 -
.../apache/pinot/core/data/readers/FileFormat.java | 2 +-
.../core/data/readers/GenericRowRecordReader.java | 5 +-
.../readers/MultiplePinotSegmentRecordReader.java | 7 +-
.../pinot/core/data/readers/RecordReaderUtils.java | 12 +-
.../recordtransformer/CompositeTransformer.java | 7 +-
.../recordtransformer/DataTypeTransformer.java | 63 +-
.../recordtransformer/ExpressionTransformer.java | 22 +-
.../recordtransformer/NullValueTransformer.java | 34 +-
.../core/data/recordtransformer/PinotDataType.java | 221 +-
.../recordtransformer/SanitizationTransformer.java | 12 +-
.../data/recordtransformer/TimeTransformer.java | 10 +-
.../core/data/table/ConcurrentIndexedTable.java | 169 +-
.../apache/pinot/core/data/table/IndexedTable.java | 40 +-
.../java/org/apache/pinot/core/data/table/Key.java | 9 +-
.../org/apache/pinot/core/data/table/Record.java | 8 +
.../pinot/core/data/table/SimpleIndexedTable.java | 102 +-
.../org/apache/pinot/core/data/table/Table.java | 10 +-
.../immutable/ImmutableSegmentLoader.java | 16 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 58 +-
.../io/util/DictionaryDelegatingValueReader.java | 79 -
.../core/io/util/FixedByteValueReaderWriter.java | 11 +-
.../org/apache/pinot/core/io/util/ValueReader.java | 15 +-
.../io/util/VarLengthBytesValueReaderWriter.java | 53 +-
.../writer/impl/MutableOffHeapByteArrayStore.java | 81 +-
.../core/io/writer/impl/OffHeapStringStore.java | 222 -
.../apache/pinot/core/minion/SegmentPurger.java | 5 +-
.../core/minion/segment/MapperRecordReader.java | 3 +-
.../core/minion/segment/ReducerRecordReader.java | 3 +-
.../core/operator/CombineGroupByOperator.java | 2 +-
...tor.java => CombineGroupByOrderByOperator.java} | 163 +-
.../operator/blocks/IntermediateResultsBlock.java | 102 +-
.../core/operator/blocks/ProjectionBlock.java | 9 +-
.../core/operator/docvalsets/MultiValueSet.java | 5 +
.../operator/docvalsets/ProjectionBlockValSet.java | 75 +-
.../core/operator/docvalsets/SingleValueSet.java | 5 +
.../operator/docvalsets/TransformBlockValSet.java | 10 +
.../operator/filter/ExpressionFilterOperator.java | 32 +-
.../predicate/InPredicateEvaluatorFactory.java | 2 +-
.../predicate/NotInPredicateEvaluatorFactory.java | 3 +-
.../predicate/RangePredicateEvaluatorFactory.java | 47 +-
.../query/AggregationGroupByOrderByOperator.java | 133 +
.../query/DictionaryBasedAggregationOperator.java | 2 +-
.../query/MetadataBasedAggregationOperator.java | 2 +-
.../core/operator/query/SelectionOnlyOperator.java | 16 +-
.../operator/query/SelectionOrderByOperator.java | 105 +-
.../transform/TransformBlockDataFetcher.java | 337 -
.../core/operator/transform/TransformOperator.java | 5 +-
.../function/AdditionTransformFunction.java | 41 +-
.../transform/function/BaseTransformFunction.java | 749 +-
.../DateTimeConversionTransformFunction.java | 19 +-
.../function/DivisionTransformFunction.java | 69 +-
.../function/IdentifierTransformFunction.java | 34 +-
.../function/LiteralTransformFunction.java | 34 +-
.../function/MapValueTransformFunction.java | 93 +-
.../function/MultiplicationTransformFunction.java | 41 +-
.../function/SingleParamMathTransformFunction.java | 51 +-
.../function/SubtractionTransformFunction.java | 68 +-
.../function/TimeConversionTransformFunction.java | 5 +-
.../transform/function/TransformFunction.java | 38 +-
.../function/TransformFunctionFactory.java | 21 +-
.../function/ValueInTransformFunction.java | 40 +-
...java => AggregationGroupByOrderByPlanNode.java} | 17 +-
.../core/plan/AggregationGroupByPlanNode.java | 2 +-
.../pinot/core/plan/AggregationPlanNode.java | 2 +-
.../apache/pinot/core/plan/CombinePlanNode.java | 9 +
.../plan/DictionaryBasedAggregationPlanNode.java | 9 +-
.../plan/MetadataBasedAggregationPlanNode.java | 13 +-
.../apache/pinot/core/plan/TransformPlanNode.java | 74 +-
.../core/plan/maker/InstancePlanMakerImplV2.java | 17 +-
.../query/aggregation/AggregationExecutor.java | 3 +-
.../aggregation/DefaultAggregationExecutor.java | 61 +-
.../core/query/aggregation/DistinctTable.java | 235 +
.../aggregation/function/AggregationFunction.java | 79 +-
.../function/AggregationFunctionFactory.java | 16 +-
.../function/AggregationFunctionUtils.java | 61 +-
.../function/AggregationFunctionVisitorBase.java | 53 +-
.../function/AvgAggregationFunction.java | 168 +-
.../function/AvgMVAggregationFunction.java | 23 +-
.../function/CountAggregationFunction.java | 39 +-
.../function/CountMVAggregationFunction.java | 21 +-
.../function/DistinctAggregationFunction.java | 157 +
.../function/DistinctCountAggregationFunction.java | 48 +-
.../DistinctCountHLLAggregationFunction.java | 283 +-
.../DistinctCountHLLMVAggregationFunction.java | 114 +-
.../DistinctCountMVAggregationFunction.java | 21 +-
.../DistinctCountRawHLLAggregationFunction.java | 48 +-
.../DistinctCountRawHLLMVAggregationFunction.java | 30 +-
.../function/FastHLLAggregationFunction.java | 43 +-
.../function/MaxAggregationFunction.java | 39 +-
.../function/MaxMVAggregationFunction.java | 21 +-
.../function/MinAggregationFunction.java | 39 +-
.../function/MinMVAggregationFunction.java | 21 +-
.../function/MinMaxRangeAggregationFunction.java | 186 +-
.../function/MinMaxRangeMVAggregationFunction.java | 23 +-
.../function/PercentileAggregationFunction.java | 44 +-
.../function/PercentileEstAggregationFunction.java | 173 +-
.../PercentileEstMVAggregationFunction.java | 47 +-
.../function/PercentileMVAggregationFunction.java | 21 +-
.../PercentileTDigestAggregationFunction.java | 188 +-
.../PercentileTDigestMVAggregationFunction.java | 27 +-
.../function/SumAggregationFunction.java | 39 +-
.../function/SumMVAggregationFunction.java | 21 +-
.../groupby/AggregationGroupByTrimmingService.java | 3 +-
.../groupby/DefaultGroupByExecutor.java | 2 +-
.../groupby/DictionaryBasedGroupKeyGenerator.java | 6 +-
.../aggregation/groupby/GroupKeyGenerator.java | 1 +
.../NoDictionaryMultiColumnGroupKeyGenerator.java | 2 +-
.../query/executor/ServerQueryExecutorV1Impl.java | 53 +-
.../core/query/pruner/AbstractSegmentPruner.java | 3 +-
.../core/query/reduce/BrokerReduceService.java | 516 +-
.../pinot/core/query/reduce/CombineService.java | 6 +-
.../core/query/request/ServerQueryRequest.java | 2 +-
.../core/query/selection/SelectionFetcher.java | 125 -
.../query/selection/SelectionOperatorService.java | 49 +-
.../query/selection/SelectionOperatorUtils.java | 61 +-
.../comparator/CompositeDocIdValComparator.java | 85 -
.../comparator/DocIdDoubleValComparator.java | 44 -
.../comparator/DocIdFloatValComparator.java | 44 -
.../comparator/DocIdIntValComparator.java | 44 -
.../comparator/DocIdLongValComparator.java | 44 -
.../selection/comparator/IDocIdValComparator.java | 24 -
.../iterator/BytesSelectionColumnIterator.java | 50 -
.../DoubleArraySelectionColumnIterator.java | 45 -
.../iterator/DoubleSelectionColumnIterator.java | 42 -
.../FloatArraySelectionColumnIterator.java | 45 -
.../iterator/FloatSelectionColumnIterator.java | 42 -
.../iterator/IntArraySelectionColumnIterator.java | 45 -
.../iterator/IntSelectionColumnIterator.java | 42 -
.../iterator/LongArraySelectionColumnIterator.java | 45 -
.../iterator/LongSelectionColumnIterator.java | 42 -
.../iterator/SelectionColumnIterator.java | 31 -
.../SelectionMultiValueColumnIterator.java | 44 -
...SelectionSingleValueColumnWithDictIterator.java | 49 -
.../StringArraySelectionColumnIterator.java | 45 -
.../iterator/StringSelectionColumnIterator.java | 50 -
.../converter/RealtimeSegmentConverter.java | 17 +-
.../converter/stats/RealtimeColumnStatistics.java | 6 +-
.../impl/dictionary/BaseMutableDictionary.java | 72 +
.../dictionary/BaseOffHeapMutableDictionary.java | 86 +-
.../dictionary/BaseOnHeapMutableDictionary.java | 35 +-
.../dictionary/BytesOffHeapMutableDictionary.java | 180 +-
.../dictionary/BytesOnHeapMutableDictionary.java | 143 +-
.../dictionary/DoubleOffHeapMutableDictionary.java | 222 +-
.../dictionary/DoubleOnHeapMutableDictionary.java | 160 +-
.../dictionary/FloatOffHeapMutableDictionary.java | 223 +-
.../dictionary/FloatOnHeapMutableDictionary.java | 160 +-
.../dictionary/IntOffHeapMutableDictionary.java | 223 +-
.../dictionary/IntOnHeapMutableDictionary.java | 160 +-
.../dictionary/LongOffHeapMutableDictionary.java | 224 +-
.../dictionary/LongOnHeapMutableDictionary.java | 160 +-
.../impl/dictionary/MutableDictionary.java | 92 -
.../impl/dictionary/MutableDictionaryFactory.java | 2 +-
.../impl/dictionary/OffHeapMutableBytesStore.java | 165 +-
.../dictionary/StringOffHeapMutableDictionary.java | 176 +-
.../dictionary/StringOnHeapMutableDictionary.java | 119 +-
.../ConsumingSegmentAssignmentStrategy.java | 61 -
.../segment/RealtimeSegmentAssignmentStrategy.java | 41 -
.../stream/AvroRecordToPinotRowGenerator.java | 1 -
.../stream/PartitionLevelStreamConfig.java | 66 +-
.../pinot/core/realtime/stream/StreamConfig.java | 155 +-
.../RecordReaderSegmentCreationDataSource.java | 9 +-
.../creator/impl/SegmentColumnarIndexCreator.java | 13 +-
.../creator/impl/SegmentDictionaryCreator.java | 3 +-
.../impl/SegmentIndexCreationDriverImpl.java | 12 +-
.../core/segment/creator/impl/V1Constants.java | 39 +-
.../stats/AbstractColumnStatisticsCollector.java | 23 -
.../stats/SegmentPreIndexStatsCollectorImpl.java | 8 +-
.../stats/StringColumnPreIndexStatsCollector.java | 5 +-
.../index/column/PhysicalColumnIndexContainer.java | 8 +-
.../converter/SegmentV1V2ToV3FormatConverter.java | 5 +-
.../index/data/source/ColumnDataSource.java | 12 +-
.../loader/bloomfilter/BloomFilterHandler.java | 8 +-
.../defaultcolumn/BaseDefaultColumnHandler.java | 5 +
.../core/segment/index/readers/BaseDictionary.java | 75 +-
...aryReader.java => BaseImmutableDictionary.java} | 68 +-
.../segment/index/readers/BytesDictionary.java | 42 +-
.../core/segment/index/readers/Dictionary.java | 50 +-
.../segment/index/readers/DoubleDictionary.java | 18 +-
.../segment/index/readers/FloatDictionary.java | 18 +-
.../core/segment/index/readers/IntDictionary.java | 23 +-
.../core/segment/index/readers/LongDictionary.java | 18 +-
.../segment/index/readers/OnHeapDictionary.java | 5 +-
.../index/readers/OnHeapDoubleDictionary.java | 43 +-
.../index/readers/OnHeapFloatDictionary.java | 38 +-
.../segment/index/readers/OnHeapIntDictionary.java | 28 +-
.../index/readers/OnHeapLongDictionary.java | 43 +-
.../index/readers/OnHeapStringDictionary.java | 73 +-
.../segment/index/readers/StringDictionary.java | 84 +-
.../pinot/core/segment/memory/PinotByteBuffer.java | 6 +-
.../pinot/core/segment/memory/PinotDataBuffer.java | 2 +-
.../virtualcolumn/DocIdVirtualColumnProvider.java | 56 +-
.../SingleStringVirtualColumnProvider.java | 76 +-
.../executor/StarTreeAggregationExecutor.java | 7 +-
.../startree/executor/StarTreeGroupByExecutor.java | 2 +-
.../startree/v2/builder/BaseSingleTreeBuilder.java | 2 +-
.../v2/store/StarTreeDimensionDataSource.java | 10 +-
.../startree/v2/store/StarTreeLoaderUtils.java | 2 +-
.../v2/store/StarTreeMetricDataSource.java | 4 +-
.../org/apache/pinot/core/util/ArrayCopyUtils.java | 15 +
.../java/org/apache/pinot/core/util/AvroUtils.java | 54 +-
.../java/org/apache/pinot/core/util/CrcUtils.java | 18 +-
.../pinot/core/util/FixedIntArrayOffHeapIdMap.java | 96 +-
.../org/apache/pinot/core/util/GroupByUtils.java | 56 +
.../server/realtime/ControllerLeaderLocator.java | 226 +-
.../data/manager/BaseTableDataManagerTest.java | 5 -
.../pinot/core/data/order/OrderByUtilsTest.java | 2 +-
.../data/recordtransformer/PinotDataTypeTest.java | 150 +-
.../recordtransformer/RecordTransformerTest.java | 151 +-
.../pinot/core/data/table/IndexedTableTest.java | 150 +-
.../util/VarLengthBytesValueReaderWriterTest.java | 8 +-
.../io/writer/impl/OffHeapStringStoreTest.java | 119 -
.../function/ValueInTransformFunctionTest.java | 3 +-
...ngeOfflineDictionaryPredicateEvaluatorTest.java | 26 +-
.../function/AggregationFunctionFactoryTest.java | 107 +-
.../resources/BoundedAccountingExecutorTest.java | 31 +-
.../impl/dictionary/DictionaryPerfRunner.java | 140 -
.../impl/dictionary/MultiValueDictionaryTest.java | 71 +-
.../impl/dictionary/MutableDictionaryTest.java | 94 +-
.../dictionary/OffHeapMutableBytesStoreTest.java | 70 +-
.../ConsumingSegmentAssignmentStrategyTest.java | 285 -
.../core/realtime/stream/StreamConfigTest.java | 242 +-
.../SegmentGenerationWithBytesTypeTest.java | 24 +-
.../SegmentGenerationWithTimeColumnTest.java | 30 +-
.../index/loader/SegmentPreProcessorTest.java | 12 +
...eaderTest.java => ImmutableDictionaryTest.java} | 199 +-
.../ImmutableDictionaryTypeConversionTest.java | 385 +
.../pinot/core/startree/v2/BaseStarTreeV2Test.java | 2 +-
.../org/apache/pinot/queries/BaseQueriesTest.java | 27 +
.../apache/pinot/queries/DistinctQueriesTest.java | 703 +
...erSegmentAggregationSingleValueQueriesTest.java | 73 +
...InnerSegmentSelectionMultiValueQueriesTest.java | 16 +-
...nnerSegmentSelectionSingleValueQueriesTest.java | 20 +-
...terSegmentAggregationMultiValueQueriesTest.java | 32 +-
...erSegmentAggregationSingleValueQueriesTest.java | 68 +-
.../InterSegmentOrderByMultiValueQueriesTest.java | 120 +
.../InterSegmentOrderBySingleValueQueriesTest.java | 346 +
.../queries/PercentileTDigestQueriesTest.java | 4 +-
.../org/apache/pinot/queries/QueriesTestUtils.java | 21 +
.../pinot/queries/SerializedBytesQueriesTest.java | 794 +
.../AggregationGroupByTrimmingServiceTest.java | 15 +-
.../groupby/NoDictionaryGroupKeyGeneratorTest.java | 2 +-
.../pinot/query/executor/QueryExecutorTest.java | 50 +-
.../converter/RealtimeSegmentConverterTest.java | 16 +
.../v1/creator/BitmapInvertedIndexTest.java | 9 +-
.../segments/v1/creator/DictionariesTest.java | 99 +-
.../realtime/ControllerLeaderLocatorTest.java | 174 +-
.../src/test/resources/data/newColumnsSchema3.json | 10 +
pinot-hadoop/pom.xml | 40 +
.../apache/pinot/hadoop/job/BaseSegmentJob.java | 56 +-
.../pinot/hadoop/job/SegmentCreationJob.java | 42 +-
.../pinot/hadoop/job/SegmentPreprocessingJob.java | 53 +-
.../apache/pinot/hadoop/job/SegmentTarPushJob.java | 2 +-
.../hadoop/job/mappers/SegmentCreationMapper.java | 12 +-
pinot-integration-tests/pom.xml | 10 +
.../tests/ClusterIntegrationTestUtils.java | 15 +-
.../tests/MapTypeClusterIntegrationTest.java | 304 +-
.../tests/OfflineClusterIntegrationTest.java | 29 +
.../tests/PinotURIUploadIntegrationTest.java | 32 -
.../ControllerLeaderLocatorIntegrationTest.java | 168 +
.../pinot/orc/data/readers/ORCRecordReader.java | 3 +
...exedTable.java => BenchmarkCombineGroupBy.java} | 144 +-
.../org/apache/pinot/perf/BenchmarkDictionary.java | 117 +-
.../apache/pinot/perf/BenchmarkIndexedTable.java | 64 +-
.../perf/BenchmarkOffHeapDictionaryMemory.java | 10 +-
.../pinot/perf/BenchmarkOfflineIndexReader.java | 10 +-
.../pinot/perf/BenchmarkPinotDataBuffer.java | 139 +
.../pinot/perf/BenchmarkStringDictionary.java | 10 +-
.../pinot/perf/StringDictionaryPerfTest.java | 83 +-
.../starter/helix/HelixInstanceDataManager.java | 16 -
.../SegmentOnlineOfflineStateModelFactory.java | 5 -
pinot-tools/pom.xml | 5 +
.../tools/admin/command/CreateSegmentCommand.java | 132 +-
.../tools/admin/command/PostQueryCommand.java | 19 +-
.../admin/command/StartControllerCommand.java | 5 -
.../resources/sample_data/airlineStats_data.json | 19492 +++++++++++++++++++
.../resources/sample_data/airlineStats_data.orc | Bin 0 -> 584802 bytes
pom.xml | 1 +
thirdeye/docs/templates.rst | 4 +-
thirdeye/pom.xml | 7 +
thirdeye/thirdeye-frontend/.travis.yml | 2 +-
.../app/mirage/factories/anomaly.js | 3 +-
.../app/pods/anomalies/controller.js | 31 +-
.../app/pods/components/alert-details/component.js | 851 +-
.../app/pods/components/alert-details/template.hbs | 199 +-
.../pods/components/anomaly-summary/component.js | 12 +-
.../pods/components/rootcause-anomaly/component.js | 52 +-
.../pods/components/rootcause-anomaly/template.hbs | 4 +-
.../rootcause-dimensions-algorithm/component.js | 23 +-
.../rootcause-dimensions-settings/template.hbs | 2 +
.../pods/components/timeseries-chart/component.js | 4 +-
.../anomalies-table/dimensions-only/template.hbs | 7 +
.../custom/anomalies-table/resolution/component.js | 10 +-
.../app/pods/home/index/controller.js | 2 +-
.../app/pods/manage/explore/route.js | 6 +-
.../app/pods/manage/yaml/template.hbs | 2 +
.../partials/rootcause/dimensions/template.hbs | 3 +
.../app/pods/rootcause/controller.js | 21 +-
.../thirdeye-frontend/app/pods/rootcause/route.js | 9 +-
.../app/pods/self-serve/create-alert/template.hbs | 1 +
.../app/pods/services/api/anomalies/service.js | 8 +-
.../app/styles/components/timeseries-chart.scss | 30 +-
.../app/styles/pods/custom/dimensions-table.scss | 13 +-
.../thirdeye-frontend/app/templates/dropdown.hbs | 29 +
thirdeye/thirdeye-frontend/app/utils/rca-utils.js | 2 +-
thirdeye/thirdeye-frontend/package.json | 63 +-
thirdeye/thirdeye-frontend/pom.xml | 2 +-
.../component-test.js | 4 +-
thirdeye/thirdeye-frontend/yarn.lock | 8849 ++++++++-
thirdeye/thirdeye-pinot/config/detector.yml | 6 +
thirdeye/thirdeye-pinot/pom.xml | 33 +
.../anomaly/alert/util/AnomalyReportGenerator.java | 4 +-
.../thirdeye/anomaly/alert/util/EmailHelper.java | 4 +-
.../anomaly/alert/v2/AlertTaskRunnerV2.java | 367 +-
.../detection/lib/FunctionReplayRunnable.java | 295 -
.../thirdeye/anomaly/monitor/MonitorConstants.java | 6 +-
.../anomaly/monitor/MonitorTaskRunner.java | 12 +-
.../anomaly/onboard/DetectionOnboardResource.java | 185 -
.../thirdeye/anomaly/onboard/ReplayTaskInfo.java | 46 -
.../thirdeye/anomaly/onboard/ReplayTaskRunner.java | 147 -
.../onboard/framework/BaseDetectionOnboardJob.java | 43 -
.../framework/BaseDetectionOnboardTask.java | 50 -
.../framework/DetectionOnBoardJobRunner.java | 184 -
.../DetectionOnboardExecutionContext.java | 54 -
.../onboard/framework/DetectionOnboardJob.java | 50 -
.../framework/DetectionOnboardJobContext.java | 113 -
.../framework/DetectionOnboardJobStatus.java | 93 -
.../onboard/framework/DetectionOnboardTask.java | 50 -
.../framework/DetectionOnboardTaskContext.java | 52 -
.../framework/DetectionOnboardTaskRunner.java | 55 -
.../framework/DetectionOnboardTaskStatus.java | 69 -
.../tasks/AlertFilterAutoTuneOnboardingTask.java | 127 -
.../tasks/DataPreparationOnboardingTask.java | 79 -
.../onboard/tasks/DefaultDetectionOnboardJob.java | 319 -
.../tasks/FunctionCreationOnboardingTask.java | 366 -
.../tasks/FunctionReplayOnboardingTask.java | 129 -
.../onboard/tasks/NotificationOnboardingTask.java | 160 -
.../onboard/utils/FunctionCreationUtils.java | 52 -
.../anomaly/onboard/utils/PropertyCheckUtils.java | 50 -
.../pinot/thirdeye/anomaly/task/TaskDriver.java | 9 +-
.../thirdeye/anomaly/task/TaskInfoFactory.java | 4 -
.../thirdeye/anomaly/task/TaskRunnerFactory.java | 3 -
.../onboard/AutoOnboardPinotMetadataSource.java | 6 +-
.../thirdeye/common/dimension/DimensionMap.java | 16 +
.../thirdeye/cube/summary/SummaryResponse.java | 18 +
.../dashboard/ThirdEyeDashboardApplication.java | 5 -
.../dashboard/resources/AnomalyResource.java | 214 -
.../dashboard/resources/DetectionJobResource.java | 439 -
.../dashboard/resources/EmailResource.java | 4 +-
.../dashboard/resources/OnboardResource.java | 681 -
.../dashboard/resources/SummaryResource.java | 60 +-
.../resources/v2/RootCauseSessionResource.java | 6 +
.../datalayer/bao/MergedAnomalyResultManager.java | 2 +
.../bao/jdbc/MergedAnomalyResultManagerImpl.java | 14 +-
.../datalayer/dto/MergedAnomalyResultDTO.java | 1 +
.../datalayer/pojo/AnomalyFunctionBean.java | 15 +-
.../datalayer/pojo/MergedAnomalyResultBean.java | 7 +
.../datalayer/pojo/RootcauseSessionBean.java | 17 +-
.../pinot/resultset/ThirdEyeResultSetUtils.java | 4 +-
.../thirdeye/detection/DefaultDataProvider.java | 2 +-
.../detection/DetectionPipelineTaskRunner.java | 9 +-
.../detection/alert/DetectionAlertJob.java | 8 +-
.../detection/alert/DetectionAlertTaskFactory.java | 8 +-
.../alert/StatefulDetectionAlertFilter.java | 15 +-
.../filter/DimensionsRecipientAlertFilter.java | 134 +
.../ToAllRecipientsDetectionAlertFilter.java | 8 +-
.../alert/scheme/DetectionAlertScheme.java | 53 +-
.../alert/scheme/DetectionEmailAlerter.java | 201 +-
.../alert/scheme/DetectionJiraAlerter.java | 133 +
.../detection/algorithm/DimensionWrapper.java | 114 +-
.../detection/health/DetectionTaskStatus.java | 1 -
.../validators/SubscriptionConfigValidator.java | 6 -
.../thirdeye/detection/yaml/YamlResource.java | 5 +-
.../translator/SubscriptionConfigTranslator.java | 2 +
.../formatter/DetectionConfigFormatter.java | 6 +-
.../notification/commons/JiraConfiguration.java | 119 +
.../commons}/SmtpConfiguration.java | 18 +-
.../content/BaseNotificationContent.java | 32 +-
.../notification/content/NotificationContent.java | 2 +-
.../content/templates/EntityGroupKeyContent.java | 11 +-
.../templates/HierarchicalAnomaliesContent.java | 7 +-
.../content/templates/MetricAnomaliesContent.java | 15 +-
.../templates/OnboardingNotificationContent.java | 113 -
.../formatter/ADContentFormatterContext.java | 24 +-
.../formatter/channels/AlertContentFormatter.java | 44 +
.../formatter/channels/EmailContentFormatter.java | 58 +-
.../formatter/channels/JiraContentFormatter.java | 150 +
.../pinot/thirdeye/rootcause/util/EntityUtils.java | 2 +-
.../detector/jira-metric-anomalies-template.ftl | 48 +
.../thirdeye/alert/feed/TestUnionAnomalyFeed.java | 104 -
.../alert/fetcher/TestContinuumAnomalyFetcher.java | 85 -
.../fetcher/TestUnnotifiedAnomalyFetcher.java | 81 -
.../onboard/DetectionOnBoardJobRunnerTest.java | 344 -
.../onboard/DetectionOnboardResourceTest.java | 97 -
.../anomaly/onboard/OnboardingTaskTestUtils.java | 72 -
.../anomaly/onboard/tasks/TestOnboardingTasks.java | 128 -
.../dashboard/resource/OnboardResourceTest.java | 100 -
.../pinot/thirdeye/datalayer/DaoTestUtils.java | 26 +
.../bao/TestMergedAnomalyResultManager.java | 30 +-
.../pinot/PinotThirdEyeDataSourceTest.java | 2 +-
.../pinot/thirdeye/detection/DataProviderTest.java | 32 +-
.../thirdeye/detection/DetectionTestUtils.java | 9 +
.../alert/DetectionAlertTaskFactoryTest.java | 17 +-
.../thirdeye/detection/alert/SendAlertTest.java | 8 -
.../detection/alert/filter/AlertFilterUtils.java | 23 +-
.../filter/DimensionsDetectionAlertFilterTest.java | 274 +
.../ToAllRecipientsDetectionAlertFilterTest.java | 2 -
.../alert/scheme/AnotherRandomAlerter.java | 6 +-
.../DetectionEmailAlerterTest.java} | 150 +-
.../detection/alert/scheme/RandomAlerter.java | 6 +-
.../templates/TestEntityGroupKeyContent.java | 24 +-
.../TestHierarchicalAnomaliesContent.java | 21 +-
.../templates/TestMetricAnomaliesContent.java | 75 +-
.../TestOnboardingNotificationContent.java | 138 -
.../channels/TestJiraContentFormatter.java} | 161 +-
.../tools/CleanupAndRegenerateAnomaliesTool.java | 262 -
.../tools/anomaly/report/AnomalyReportDriver.java | 4 +-
.../anomaly/report/GenerateAnomalyReport.java | 4 +-
.../src/test/resources/sample-alert-config.yml | 10 -
.../src/test/resources/sample-detection-config.yml | 4 +-
.../resources/test-jira-anomalies-template.ftl | 20 +
.../resources/test-metric-anomalies-template.html | 12 +-
549 files changed, 45686 insertions(+), 21826 deletions(-)
create mode 100644 docs/schema.rst
create mode 100755 docs/star-tree/example.png
create mode 100755 docs/star-tree/space-time.png
create mode 100644 docs/star-tree/star-tree.rst
create mode 100755 docs/star-tree/structure.png
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/requesthandler/QueryValidationTest.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/StreamConsumptionConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/RowEvent.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/PartitionAssignment.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/ReplicaGroupBasedStreamPartitionAssignmentStrategy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/ReplicaGroupPartitionAssignment.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/ReplicaGroupPartitionAssignmentGenerator.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/StreamPartitionAssignmentGenerator.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/StreamPartitionAssignmentStrategy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/StreamPartitionAssignmentStrategyFactory.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/UniformStreamPartitionAssignmentStrategy.java
copy pinot-core/src/main/java/org/apache/pinot/core/data/table/Key.java => pinot-common/src/main/java/org/apache/pinot/common/response/broker/ResultTable.java (50%)
rename {pinot-core/src/test/java/org/apache/pinot/core/query/aggregation => pinot-common/src/test/java/org/apache/pinot/common}/function/AggregationFunctionTypeTest.java (97%)
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/partition/IdealStateBuilderUtil.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/partition/ReplicaGroupBasedStreamPartitionAssignmentTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/partition/StreamPartitionAssignmentGeneratorTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/partition/UniformStreamPartitionAssignmentTest.java
create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotLeadControllerRestletResource.java
create mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/api/upload/ZKOperatorTest.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/common/RowBasedBlockValueFetcher.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/util/DictionaryDelegatingValueReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/writer/impl/OffHeapStringStore.java
copy pinot-core/src/main/java/org/apache/pinot/core/operator/{CombineGroupByOperator.java => CombineGroupByOrderByOperator.java} (58%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/query/AggregationGroupByOrderByOperator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/TransformBlockDataFetcher.java
copy pinot-core/src/main/java/org/apache/pinot/core/plan/{AggregationGroupByPlanNode.java => AggregationGroupByOrderByPlanNode.java} (87%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/DistinctTable.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/DistinctAggregationFunction.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/SelectionFetcher.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/CompositeDocIdValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/DocIdDoubleValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/DocIdFloatValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/DocIdIntValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/DocIdLongValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/IDocIdValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/BytesSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/DoubleArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/DoubleSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/FloatArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/FloatSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/IntArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/IntSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/LongArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/LongSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/SelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/SelectionMultiValueColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/SelectionSingleValueColumnWithDictIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/StringArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/StringSelectionColumnIterator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/dictionary/BaseMutableDictionary.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/dictionary/MutableDictionary.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/segment/ConsumingSegmentAssignmentStrategy.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/segment/RealtimeSegmentAssignmentStrategy.java
rename pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/{ImmutableDictionaryReader.java => BaseImmutableDictionary.java} (78%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/util/GroupByUtils.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/io/writer/impl/OffHeapStringStoreTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/impl/dictionary/DictionaryPerfRunner.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/segment/ConsumingSegmentAssignmentStrategyTest.java
rename pinot-core/src/test/java/org/apache/pinot/core/segment/index/readers/{ImmutableDictionaryReaderTest.java => ImmutableDictionaryTest.java} (59%)
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/readers/ImmutableDictionaryTypeConversionTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/DistinctQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/InterSegmentOrderByMultiValueQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/InterSegmentOrderBySingleValueQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/SerializedBytesQueriesTest.java
create mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/server/realtime/ControllerLeaderLocatorIntegrationTest.java
copy pinot-perf/src/main/java/org/apache/pinot/perf/{BenchmarkIndexedTable.java => BenchmarkCombineGroupBy.java} (56%)
create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkPinotDataBuffer.java
create mode 100644 pinot-tools/src/main/resources/sample_data/airlineStats_data.json
create mode 100644 pinot-tools/src/main/resources/sample_data/airlineStats_data.orc
create mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/anomalies-table/dimensions-only/template.hbs
create mode 100644 thirdeye/thirdeye-frontend/app/templates/dropdown.hbs
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/lib/FunctionReplayRunnable.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/DetectionOnboardResource.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/ReplayTaskInfo.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/ReplayTaskRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/BaseDetectionOnboardJob.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/BaseDetectionOnboardTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnBoardJobRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardExecutionContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardJob.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardJobContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardJobStatus.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardTaskContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardTaskRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardTaskStatus.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/AlertFilterAutoTuneOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/DataPreparationOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/DefaultDetectionOnboardJob.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/FunctionCreationOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/FunctionReplayOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/NotificationOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/utils/FunctionCreationUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/utils/PropertyCheckUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/dashboard/resources/OnboardResource.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/filter/DimensionsRecipientAlertFilter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/scheme/DetectionJiraAlerter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/commons/JiraConfiguration.java
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/{anomaly => notification/commons}/SmtpConfiguration.java (83%)
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/content/templates/OnboardingNotificationContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/formatter/channels/AlertContentFormatter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/formatter/channels/JiraContentFormatter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/resources/org/apache/pinot/thirdeye/detector/jira-metric-anomalies-template.ftl
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/feed/TestUnionAnomalyFeed.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/fetcher/TestContinuumAnomalyFetcher.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/fetcher/TestUnnotifiedAnomalyFetcher.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/onboard/DetectionOnBoardJobRunnerTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/onboard/DetectionOnboardResourceTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/onboard/OnboardingTaskTestUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/TestOnboardingTasks.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/dashboard/resource/OnboardResourceTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/filter/DimensionsDetectionAlertFilterTest.java
copy thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/{SendAlertTest.java => scheme/DetectionEmailAlerterTest.java} (57%)
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/content/templates/TestOnboardingNotificationContent.java
copy thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/{detection/alert/SendAlertTest.java => notification/formatter/channels/TestJiraContentFormatter.java} (51%)
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/tools/CleanupAndRegenerateAnomaliesTool.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/test-jira-anomalies-template.ftl
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org