You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by xi...@apache.org on 2020/04/08 19:37:03 UTC
[incubator-pinot] branch remove_MaxDirectMemorySize_in_scripts
updated (428b219 -> 1a86786)
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch remove_MaxDirectMemorySize_in_scripts
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
from 428b219 Remove MaxDirectMemorySize settings
add a6c903d Bump jackson.version from 2.9.9 to 2.10.2 in /thirdeye (#5094)
add 83215f0 Fix a NullPointerException that can occur if an Exception is raised when reading a JSON Record file. (#5128)
add 43db343 pinot-quickstart companion container for thirdeye (#5125)
add a91ffd6 Fix an NPE that is encountered when the offline table config does not specify a time column but the realtime table config does. (#5131)
add 76f9c53 Support schema evolution for consuming segments (#4954)
add a5fb1bd docker - generator script for synthetic time series in pinot (#5134)
add 3e451e7 Refactor the data source to include all information needed for query execution (#5115)
add 330f37f Fix the NPE when no segment exists in RealtimeSegmentSelector (#5138)
add 5c7ece2 Add test for RealtimeSegmentSelector for no segment scenario (#5139)
add d8fabec [TE] database - add missing schema fields and index to application_index (#5124)
add 6d8c60a [TE] Minor corrections to the default yaml template (#5140)
add 46698d8 Update links in README to latest docs (#5141)
add 6daeb59 Fix the default value provider classes (#5137)
add f7f9f4a Fix hybrid quickstart (#5143)
add 6b6fa56a Update license and notice (#5145)
add 888700d [TE] Remove validation to make recipients backwards compatible (#5149)
add 82cfbdd Fix a formatting bug in AggregationFunctionUtils (#5148)
add d15a91a update pinot assembly scripts (#5146)
add d989427 Fix the SQL group-by for empty data table (#5151)
add 494874d [TE] Detection creation endpoints should trigger Replay & Tuning (#5142)
add be37b56 Refactor value based segment pruner to work on DataSource instead of ColumnMetadata (#5144)
add 9933870 Move SegmentMetadata from pinot-common to pinot-core (#5156)
add 4be032a [TE] frontend - harleyjj/alert-details - stop showing bounds for minutely granularity on Alert Overview (#5157)
add 1376331 [TE] Setup a test Github workflow for ThirdEye (#5158)
add c81a656 Add Azure Data Lake Gen2 connector for PinotFS (#5116)
add bbaa1d9 [TE] anomaly detection model downloader (#5155)
add 8eb5933 Updated Readme with Pinot clients and replace gitter badge with slack (#5164)
add e442bb9 Updating readme (#5133)
add 917493f Optimization for selection only queries: Allow early termination (#5163)
add 32a54ae Fixing the missing fields in k8s helm template and reduce hardware & jvm requirements to start up pinot stack (#5161)
add 2e800e0 Fix the NPE for DISTINCT aggregation function when no record is selected (#5154)
add d289db8 Add QueryConfig to TableConfig with the query timeout setting (#5162)
add 56f3e97 Fix the bug of broker not able to handle json format rest api response (#5170)
add b8a4a1e [TE] frontend - harleyjj/rca - add Alert Correlation events to RCA event table (#5136)
add 977c79c [TE] frontend - harleyjj/rca - cube table updates (#5159)
add 2cfbe7e [TE][subscription] update subscription watermarks to use anomaly create time instead of end time (#5152)
add 562180d [TE] Remove hard-coded server data datetimeformatter (#5171)
add 20b1da9 Add Confluent Schema Registry Avro Message Decoder (#4973)
add ef32b27 Fix selection early termination test (#5173)
add 385c0d3 [TE] Fix issue of displaying latests data in the speed-up case (#5165)
add ae484e5 Table level timeout implementation (#5169)
add b8ed426 Add EarlyTerminationException to prevent logging too many invalid error messages (#5174)
add 28f2643 Fix the numEntriesScannedPostFilter field test in SelectionOnlyEarlyTerminationTest (#5179)
add 4a6b21d Fix docker compose & quick start (#5178)
add b274d02 Prepare for pinot release 0.4.0 (#5186)
add ed235d2 Add a simple PinotFS benchmark driver (#5160)
add 8ff155a Change the name for azure data lake gen2 implementation (#5188)
add 48fb505 Change readme link to gitbook for kafka plugins readme. (#5191)
add f1e2086 [TE] frontend - harleyjj/validation - surface errors in dom for create and edit alert (#5187)
add 8f0ed55 Update travis scripts to test quickstart over jdk 10-15 (#5182)
add 772f51e [TE] frontend - harleyjj/alert-details - show bounds for minute granularity again (#5192)
add 1f1baf8 Adding missing license files for jquery-requestAnimationFrame and jquery-sizzle, requested in Issue #5183 (#5195)
add 00fcb1d Move table config into pinot-spi (#5194)
add 8dfa51a Lucene DocId to PinotDocId cache to improve performance (#5177)
add 9cb716f Nightly publish to bintray (#5190)
add 67c30ed Move docs link from apache-pinot.gitbook.io/apache-pinot-cookbook to docs.pinot.apache.org (#5193)
add 95e0f1d Shuffle the segments when rebalancing the table to avoid creating hotspot servers (#5197)
add 1474344 Remove the construction of second bitmap in text index reader to improve performance (#5199)
add 08e92ab Fix the flakiness of case-insensitivity test (#5201)
add 189f3b8 Refactor DistinctQueriesTest to cover more scenarios (#5168)
add 3a0ad72 Add override option to be 1 to force publishing the jars to bintray (#5202)
add fedd1ae [TE] fix the merger issue that it can't merge historical anomaly generated by multiple rules (#5196)
add f20c3d6 Pinot website (#5185)
add e09d245 Fixing license checks for website directory (#5203)
add 221e73a adding a banner to old docs for new doc link (#5205)
add 3bbaa03 Fix the capacity of the DistinctTable (#5204)
add ac327bb Optimize ExpressionFilterOperator (#5132)
add 8278cbc Add gcs nio support (#5106)
add 20afda5 fixing presto-coordinator k8s yaml file (#5210)
add 610350a [TE] Retain the original last success task execution time if we can't… (#5207)
add 0d5b5e2 Make text index query cache a configurable option (#5176)
add 4ee35c3 Change the logo for navbar on the website (#5214)
add 1baede8 Stream github events demo (#5189)
add fc9f2a0 [TE] Show error messages to the new UI (#5211)
add 6b1c10d Add tests for VALUEIN (#5217)
add aaacf8d Minor changes to enable setup of github events demo via Docker
add e84a3af Support order-by on BYTES column (#5213)
add df3b904 Fix travis cache (#5225)
add 1a86786 Merge branch 'master' into remove_MaxDirectMemorySize_in_scripts
No new revisions were added by this update.
Summary of changes:
.github/workflows/maven.yml | 43 +
.gitignore | 23 +
.travis.yml | 54 +-
.../log4j2.xml => .travis/.ci.settings.xml | 24 +-
.travis_install.sh => .travis/.travis_install.sh | 9 +-
.travis/.travis_nightly_build.sh | 31 +
.travis/.travis_quickstart.sh | 132 ++
.travis/.travis_quickstart_openjdk.sh | 32 +
.travis/.travis_set_deploy_build_opts.sh | 26 +
.travis_test.sh => .travis/.travis_test.sh | 15 +-
.travis_quickstart.sh | 125 --
LICENSE-binary | 131 +-
NOTICE | 2 +-
NOTICE-binary | 448 +++--
README.md | 28 +-
docker/images/pinot-thirdeye/Dockerfile | 74 +
docker/images/pinot-thirdeye/README.md | 102 ++
docker/images/pinot-thirdeye/bin/start-thirdeye.sh | 49 +
.../pinot-thirdeye/config/ephemeral/dashboard.yml | 36 +
.../ephemeral}/data-sources/cache-config.yml | 0
.../data-sources/data-sources-config-backend.yml | 189 ++
.../data-sources/data-sources-config-frontend.yml | 189 ++
.../config/ephemeral}/data/README.md | 0
.../config/ephemeral}/data/daily.csv | 0
.../config/ephemeral}/data/hourly.csv | 0
.../config/ephemeral}/data/pageviews.csv | 0
.../anomaly-functions/alertFilter.properties | 0
.../alertFilterAutotune.properties | 0
.../anomaly-functions/anomalyClassifier.properties | 0
.../anomaly-functions/functions.properties | 0
.../pinot-thirdeye/config/ephemeral/detector.yml | 84 +
.../config/ephemeral/persistence.yml | 5 +
.../pinot-thirdeye/config/ephemeral}/rca.yml | 0
.../config/pinot-quickstart/bootstrap.sql | 4 +
.../config/pinot-quickstart}/dashboard.yml | 0
.../data-sources/cache-config.yml | 0
.../data-sources/data-sources-config.yml | 14 +
.../config/pinot-quickstart}/data/README.md | 0
.../config/pinot-quickstart}/data/daily.csv | 0
.../config/pinot-quickstart}/data/hourly.csv | 0
.../config/pinot-quickstart}/data/pageviews.csv | 0
.../anomaly-functions/alertFilter.properties | 0
.../alertFilterAutotune.properties | 0
.../anomaly-functions/anomalyClassifier.properties | 0
.../anomaly-functions/functions.properties | 0
.../config/pinot-quickstart/detector.yml | 84 +
.../config/pinot-quickstart/persistence.yml | 5 +
.../config/pinot-quickstart}/rca.yml | 0
.../images/pinot-thirdeye/docker-build-and-push.sh | 30 +
docker/images/pinot-thirdeye/docker-build.sh | 47 +
docker/images/pinot-thirdeye/docker-push.sh | 29 +
docker/images/pinot/Dockerfile | 1 +
docker/images/pinot/README.md | 4 +-
docker/images/pinot/bin/generator.sh | 77 +
docker/images/pinot/docker-compose.yml | 2 +-
docs/admin_guide.rst | 2 +
docs/architecture.rst | 2 +
docs/batch_data_ingestion.rst | 207 +--
docs/client_api.rst | 2 +
docs/code_modules.rst | 2 +
docs/contribution_guidelines.rst | 2 +
docs/customizations.rst | 2 +
docs/dev_env.rst | 2 +
docs/dev_guide.rst | 2 +
docs/extensions.rst | 2 +
docs/getting_started.rst | 4 +-
docs/in_production.rst | 2 +
docs/index.rst | 2 +
docs/index_techniques.rst | 2 +
docs/intro.rst | 2 +
docs/introduction.rst | 2 +
docs/pinot_hadoop.rst | 2 +
docs/pluggable_storage.rst | 6 +-
docs/pluggable_streams.rst | 38 +
docs/pql_examples.rst | 2 +
docs/record_reader.rst | 2 +
docs/schema.rst | 2 +
docs/segment_fetcher.rst | 2 +
docs/star-tree/star-tree.rst | 2 +
docs/tableconfig_schema.rst | 2 +
docs/tuning_pinot.rst | 2 +
docs/tuning_realtime_performance.rst | 2 +
docs/tuning_scatter_and_gather.rst | 2 +
docs/user_guide.rst | 2 +
kubernetes/helm/README.md | 18 +-
kubernetes/helm/pinot-github-events-setup.yml | 279 +++
kubernetes/helm/presto-coordinator.yaml | 1 +
kubernetes/helm/templates/broker/statefulset.yml | 2 +-
kubernetes/helm/templates/server/statefulset.yml | 10 +-
kubernetes/helm/values.yaml | 21 +-
licenses-binary/LICENSE-fusesource.txt | 27 +
.../LICENSE-jquery-requestAnimationFrame.txt | 22 +
licenses-binary/LICENSE-jquery-sizzle.txt | 36 +
licenses-binary/LICENSE-py4j.txt | 26 +
licenses-binary/LICENSE-threeten.txt | 29 +
licenses/LICENSE-jquery-requestAnimationFrame.txt | 22 +
licenses/LICENSE-jquery-sizzle.txt | 36 +
pinot-broker/pom.xml | 78 +-
.../broker/api/resources/PinotBrokerDebug.java | 4 +-
.../broker/broker/BrokerAdminApiApplication.java | 2 +
...okerResourceOnlineOfflineStateModelFactory.java | 2 +-
.../BrokerUserDefinedMessageHandlerFactory.java | 54 +-
.../broker/broker/helix/HelixBrokerStarter.java | 2 +-
.../HelixExternalViewBasedQueryQuotaManager.java | 54 +-
.../requesthandler/BaseBrokerRequestHandler.java | 73 +-
.../SingleConnectionBrokerRequestHandler.java | 2 +-
.../pinot/broker/routing/RoutingManager.java | 47 +-
.../instanceselector/InstanceSelectorFactory.java | 6 +-
.../segmentpruner/SegmentPrunerFactory.java | 10 +-
.../segmentselector/RealtimeSegmentSelector.java | 3 +
.../segmentselector/SegmentSelectorFactory.java | 5 +-
.../routing/timeboundary/TimeBoundaryManager.java | 4 +-
.../broker/broker/HelixBrokerStarterTest.java | 15 +-
...elixExternalViewBasedQueryQuotaManagerTest.java | 107 +-
.../request/PqlAndCalciteSqlCompatibilityTest.java | 50 +
.../instanceselector/InstanceSelectorTest.java | 10 +-
.../routing/segmentpruner/SegmentPrunerTest.java | 12 +-
.../segmentselector/SegmentSelectorTest.java | 16 +-
.../timeboundary/TimeBoundaryManagerTest.java | 9 +-
pinot-clients/pinot-java-client/pom.xml | 3 +-
pinot-clients/pom.xml | 3 +-
pinot-common/pom.xml | 39 +-
.../InstanceAssignmentConfigUtils.java | 17 +-
.../common/assignment/InstancePartitionsUtils.java | 9 +-
.../apache/pinot/common/config/TableConfig.java | 701 --------
.../common/config/TextIndexConfigValidator.java | 46 -
.../common/messages/QueryQuotaUpdateMessage.java | 46 -
.../common/messages/TableConfigRefreshMessage.java | 64 +
.../pinot/common/metadata/ZKMetadataProvider.java | 19 +-
.../metadata/instance/InstanceZKMetadata.java | 2 +-
.../apache/pinot/common/metrics/BrokerMeter.java | 1 +
.../apache/pinot/common/utils/CommonConstants.java | 21 +-
.../org/apache/pinot/common/utils/DataSchema.java | 37 +-
.../org/apache/pinot/common/utils/DataTable.java | 3 +
.../pinot/common/utils/config/InstanceUtils.java | 80 +
.../common/utils/config/TableConfigUtils.java | 192 +++
.../common/{ => utils}/config/TagNameUtils.java | 12 +-
.../pinot/common/utils/helix/HelixHelper.java | 2 +-
.../pinot/common/utils/helix/TableCache.java | 9 +-
.../utils/BrokerRequestComparisonUtils.java | 24 +-
.../pinot/common/config/QuotaConfigTest.java | 120 --
.../pinot/common/config/TableConfigTest.java | 387 -----
.../apache/pinot/common/utils/DataSizeTest.java | 45 -
.../pinot/common/utils/DataSizeUtilsTest.java | 92 +
.../common/utils/config/TableConfigSerDeTest.java | 370 ++++
.../common/utils/config/TableConfigUtilsTest.java | 66 +
.../config/TagNameUtilsTest.java} | 6 +-
pinot-common/src/test/resources/pql_queries.list | 8 +
pinot-common/src/test/resources/sql_queries.list | 8 +
pinot-controller/pom.xml | 3 +-
.../pinot/controller/LeadControllerManager.java | 2 +-
.../api/events/DefaultMetadataEventNotifier.java | 3 +-
.../api/events/MetadataEventNotifier.java | 3 +-
.../pinot/controller/api/resources/Constants.java | 6 +-
.../resources/LLCSegmentCompletionHandlers.java | 2 +-
.../PinotInstanceAssignmentRestletResource.java | 12 +-
.../resources/PinotInstanceRestletResource.java | 9 +-
.../PinotLeadControllerRestletResource.java | 2 +-
.../api/resources/PinotQueryResource.java | 2 +-
.../api/resources/PinotSchemaRestletResource.java | 2 +-
.../api/resources/PinotSegmentRestletResource.java | 4 +-
.../PinotSegmentUploadDownloadRestletResource.java | 4 +-
.../api/resources/PinotTableIndexingConfigs.java | 18 +-
.../api/resources/PinotTableInstances.java | 4 +-
.../api/resources/PinotTableMetadataConfigs.java | 14 +-
.../api/resources/PinotTableRestletResource.java | 53 +-
.../api/resources/PinotTableSegmentConfigs.java | 22 +-
.../api/resources/PinotTaskRestletResource.java | 2 +-
.../api/resources/PinotTenantRestletResource.java | 6 +-
.../pinot/controller/api/resources/TableViews.java | 49 +-
.../controller/api/upload/SegmentValidator.java | 9 +-
.../pinot/controller/api/upload/ZKOperator.java | 4 +-
.../helix/ControllerRequestURLBuilder.java | 2 +-
.../controller/helix/SegmentStatusChecker.java | 4 +-
.../helix/core/PinotHelixResourceManager.java | 101 +-
.../helix/core/PinotTableIdealStateBuilder.java | 6 +-
.../helix/core/SegmentDeletionManager.java | 2 +-
.../instance/InstanceAssignmentDriver.java | 12 +-
.../InstanceReplicaGroupPartitionSelector.java | 2 +-
.../instance/InstanceTagPoolSelector.java | 6 +-
.../segment/OfflineSegmentAssignment.java | 31 +-
.../segment/RealtimeSegmentAssignment.java | 21 +-
.../core/assignment/segment/SegmentAssignment.java | 4 +-
.../segment/SegmentAssignmentFactory.java | 4 +-
.../assignment/segment/SegmentAssignmentUtils.java | 19 +-
.../helix/core/minion/ClusterInfoProvider.java | 6 +-
.../core/minion/PinotHelixTaskResourceManager.java | 2 +-
.../helix/core/minion/PinotTaskManager.java | 6 +-
.../generator/ConvertToRawIndexTaskGenerator.java | 10 +-
.../core/minion/generator/PinotTaskGenerator.java | 4 +-
.../core/minion/generator/TaskGeneratorUtils.java | 2 +-
.../realtime/PinotLLCRealtimeSegmentManager.java | 18 +-
.../core/realtime/PinotRealtimeSegmentManager.java | 11 +-
.../core/realtime/SegmentCompletionManager.java | 2 +-
.../helix/core/realtime/TableConfigCache.java | 2 +-
.../segment/CommittingSegmentDescriptor.java | 2 +-
.../helix/core/rebalance/RebalanceResult.java | 2 +-
.../helix/core/rebalance/TableRebalancer.java | 8 +-
.../core/relocation/RealtimeSegmentRelocator.java | 6 +-
.../helix/core/retention/RetentionManager.java | 6 +-
.../helix/core/util/ZKMetadataUtils.java | 6 +-
.../controller/util/AutoAddInvertedIndex.java | 12 +-
.../controller/util/SegmentIntervalUtils.java | 2 +-
.../controller/util/TableRetentionValidator.java | 9 +-
.../pinot/controller/util/TableSizeReader.java | 10 +-
.../BrokerResourceValidationManager.java | 2 +-
.../validation/OfflineSegmentIntervalChecker.java | 14 +-
.../RealtimeSegmentValidationManager.java | 10 +-
.../controller/validation/StorageQuotaChecker.java | 70 +-
.../pinot/controller/api/PinotFileUploadTest.java | 7 +-
...PinotInstanceAssignmentRestletResourceTest.java | 25 +-
.../api/PinotInstanceRestletResourceTest.java | 11 +-
.../api/PinotSegmentRestletResourceTest.java | 14 +-
.../api/PinotTableRestletResourceTest.java | 110 +-
.../api/PinotTenantRestletResourceTest.java | 10 +-
.../pinot/controller/api/TableSizeReaderTest.java | 4 +-
.../pinot/controller/api/TableViewsTest.java | 18 +-
.../controller/api/upload/ZKOperatorTest.java | 10 +-
.../helix/ControllerInstanceToggleTest.java | 15 +-
.../controller/helix/ControllerSentinelTestV2.java | 13 +-
.../controller/helix/ControllerTenantTest.java | 2 +-
.../pinot/controller/helix/ControllerTest.java | 14 +-
.../controller/helix/PinotResourceManagerTest.java | 10 +-
.../controller/helix/SegmentStatusCheckerTest.java | 2 +-
.../helix/core/PinotHelixResourceManagerTest.java | 28 +-
.../instance/InstanceAssignmentTest.java | 39 +-
...fflineNonReplicaGroupSegmentAssignmentTest.java | 9 +-
.../OfflineReplicaGroupSegmentAssignmentTest.java | 15 +-
...altimeNonReplicaGroupSegmentAssignmentTest.java | 11 +-
.../RealtimeReplicaGroupSegmentAssignmentTest.java | 9 +-
.../segment/SegmentAssignmentUtilsTest.java | 4 +-
.../PinotLLCRealtimeSegmentManagerTest.java | 13 +-
.../segment/FlushThresholdUpdaterTest.java | 2 +-
.../core/rebalance/TableRebalancerClusterTest.java | 19 +-
.../helix/core/retention/RetentionManagerTest.java | 19 +-
.../controller/utils/SegmentMetadataMockUtils.java | 6 +-
.../validation/StorageQuotaCheckerTest.java | 183 +-
.../validation/ValidationManagerTest.java | 17 +-
pinot-core/pom.xml | 3 +-
.../org/apache/pinot/core/common/DataFetcher.java | 14 +-
.../org/apache/pinot/core/common/DataSource.java | 25 +-
.../pinot/core/common/DataSourceMetadata.java | 69 +-
.../org/apache/pinot/core/common/Operator.java | 6 +-
.../core/common/RowBasedBlockValueFetcher.java | 34 +-
.../core/common/datatable/DataTableBuilder.java | 151 +-
.../core/common/datatable/DataTableImplV2.java | 8 +
.../core/common/datatable/DataTableUtils.java | 117 +-
.../core/data/manager/BaseTableDataManager.java | 2 +-
.../core/data/manager/InstanceDataManager.java | 2 +-
.../pinot/core/data/manager/TableDataManager.java | 2 +-
.../manager/config/TableDataManagerConfig.java | 6 +-
.../manager/offline/TableDataManagerProvider.java | 4 +-
.../realtime/HLRealtimeSegmentDataManager.java | 10 +-
.../realtime/LLRealtimeSegmentDataManager.java | 44 +-
.../manager/realtime/RealtimeTableDataManager.java | 7 +-
.../data/readers/PinotSegmentColumnReader.java | 6 +-
.../data/readers/PinotSegmentRecordReader.java | 10 +-
.../java/org/apache/pinot/core/data/table/Key.java | 37 +-
.../org/apache/pinot/core/data/table/Record.java | 37 +-
.../pinot/core/indexsegment/IndexSegment.java | 7 +-
.../generator/SegmentGeneratorConfig.java | 11 +-
.../immutable/ImmutableSegmentImpl.java | 15 +-
.../immutable/ImmutableSegmentLoader.java | 7 +-
.../core/indexsegment/mutable/MutableSegment.java | 6 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 131 +-
.../io/reader/impl/ConstantMVForwardIndex.java | 26 +-
.../reader/impl/ConstantMVInvertedIndex.java} | 35 +-
.../reader/impl/ConstantSVSortedIndex.java} | 45 +-
.../io/reader/impl/v1/SortedIndexReaderImpl.java | 1 -
.../core/metadata/DefaultMetadataExtractor.java | 4 +-
.../pinot/core/metadata/MetadataExtractor.java | 2 +-
.../pinot/core/minion/BackfillDateTimeColumn.java | 4 +-
.../apache/pinot/core/minion}/PinotTaskConfig.java | 4 +-
.../pinot/core/minion/RawIndexConverter.java | 10 +-
.../apache/pinot/core/minion/SegmentConverter.java | 5 +-
.../apache/pinot/core/minion/SegmentPurger.java | 2 +-
.../minion/rollup/MergeRollupSegmentConverter.java | 8 +-
.../apache/pinot/core/operator/BaseOperator.java | 3 +-
.../core/operator/CombineGroupByOperator.java | 10 +-
.../operator/CombineGroupByOrderByOperator.java | 33 +-
.../pinot/core/operator/CombineOperator.java | 33 +-
.../pinot/core/operator/DocIdSetOperator.java | 25 +-
.../pinot/core/operator/ProjectionOperator.java | 15 +-
.../operator/blocks/IntermediateResultsBlock.java | 41 +-
.../operator/dociditerators/AndDocIdIterator.java | 16 +-
.../ExpressionScanDocIdIterator.java | 342 ++++
.../dociditerators/MVScanDocIdIterator.java | 21 +-
.../dociditerators/SVScanDocIdIterator.java | 10 -
.../dociditerators/ScanBasedDocIdIterator.java | 5 -
.../core/operator/docidsets/AndBlockDocIdSet.java | 218 +--
.../docidsets/ExpressionFilterDocIdSet.java | 84 +
.../operator/docidsets/FilterBlockDocIdSet.java | 4 +
.../core/operator/docidsets/ScanBasedDocIdSet.java | 11 +-
.../docidsets/ScanBasedMultiValueDocIdSet.java | 2 +-
.../docidsets/ScanBasedSingleValueDocIdSet.java | 2 +-
.../core/operator/docidsets/StarTreeDocIdSet.java | 104 --
.../operator/filter/ExpressionFilterOperator.java | 309 +---
.../core/operator/filter/FilterOperatorUtils.java | 20 +-
.../SortedInvertedIndexBasedFilterOperator.java | 1 -
.../BaseDictionaryBasedPredicateEvaluator.java | 6 +-
.../BaseRawValueBasedPredicateEvaluator.java | 6 +-
.../filter/predicate/PredicateEvaluator.java | 3 +-
.../operator/query/AggregationGroupByOperator.java | 21 +-
.../query/AggregationGroupByOrderByOperator.java | 23 +-
.../core/operator/query/AggregationOperator.java | 21 +-
.../query/DictionaryBasedAggregationOperator.java | 9 +-
.../query/MetadataBasedAggregationOperator.java | 12 +-
.../core/operator/query/SelectionOnlyOperator.java | 22 +-
.../operator/query/SelectionOrderByOperator.java | 33 +-
.../function/IdentifierTransformFunction.java | 8 +-
.../plan/AggregationGroupByOrderByPlanNode.java | 6 +-
.../core/plan/AggregationGroupByPlanNode.java | 5 +-
.../pinot/core/plan/AggregationPlanNode.java | 5 +-
.../plan/DictionaryBasedAggregationPlanNode.java | 3 +-
.../plan/MetadataBasedAggregationPlanNode.java | 4 +-
.../core/query/aggregation/DistinctTable.java | 52 +-
.../function/AggregationFunctionFactory.java | 5 +-
.../function/AggregationFunctionUtils.java | 22 +-
.../function/DistinctAggregationFunction.java | 101 +-
.../core/query/config/SegmentPrunerConfig.java | 53 +-
.../exception/EarlyTerminationException.java} | 14 +-
.../pinot/core/query/executor/QueryExecutor.java | 5 -
.../query/executor/ServerQueryExecutorV1Impl.java | 26 +-
.../core/query/pruner/AbstractSegmentPruner.java | 105 --
.../query/pruner/ColumnValueSegmentPruner.java | 312 ++--
.../core/query/pruner/DataSchemaSegmentPruner.java | 4 +-
.../core/query/pruner/PartitionSegmentPruner.java | 117 --
.../core/query/pruner/SegmentPrunerProvider.java | 1 -
.../core/query/pruner/SegmentPrunerService.java | 4 +-
.../core/query/pruner/ValidSegmentPruner.java | 2 +-
.../query/reduce/AggregationDataTableReducer.java | 9 +-
.../core/query/reduce/BrokerReduceService.java | 8 +-
.../pinot/core/query/reduce/CombineService.java | 12 +-
.../query/reduce/DistinctDataTableReducer.java | 43 +-
.../core/query/reduce/GroupByDataTableReducer.java | 21 +-
.../query/reduce/SelectionDataTableReducer.java | 40 +-
.../query/selection/SelectionOperatorService.java | 69 +-
.../query/selection/SelectionOperatorUtils.java | 201 ++-
.../converter/RealtimeSegmentConverter.java | 4 +-
.../converter/stats/RealtimeColumnStatistics.java | 99 +-
.../stats/RealtimeNoDictionaryColStatistics.java | 41 +-
.../stats/RealtimeSegmentStatsContainer.java | 14 +-
.../core/realtime/impl/RealtimeSegmentConfig.java | 54 +-
.../impl/dictionary/BaseMutableDictionary.java | 4 +-
.../RealtimeLuceneDocIdCollector.java} | 31 +-
.../RealtimeLuceneTextIndexReader.java | 5 +-
.../core/segment/creator/StatsCollectorConfig.java | 6 +-
.../column}/BaseVirtualColumnProvider.java | 13 +-
.../DefaultNullValueVirtualColumnProvider.java | 87 +
.../index/column/PhysicalColumnIndexContainer.java | 12 +-
.../converter/SegmentV1V2ToV3FormatConverter.java | 20 +-
.../index/data/source/ColumnDataSource.java | 201 ---
.../index/datasource/BaseDataSource.java} | 109 +-
.../index/datasource/ImmutableDataSource.java | 119 ++
.../index/datasource/MutableDataSource.java | 123 ++
.../segment/index/loader/IndexLoadingConfig.java | 25 +-
.../segment/index/loader/SegmentPreProcessor.java | 6 +-
.../loader/bloomfilter/BloomFilterHandler.java | 6 +-
.../ColumnMinMaxValueGenerator.java | 8 +-
.../defaultcolumn/BaseDefaultColumnHandler.java | 6 +-
.../defaultcolumn/DefaultColumnHandlerFactory.java | 4 +-
.../defaultcolumn/V1DefaultColumnHandler.java | 2 +-
.../defaultcolumn/V3DefaultColumnHandler.java | 8 +-
.../loader/invertedindex/InvertedIndexHandler.java | 4 +-
.../loader/invertedindex/TextIndexHandler.java | 64 +-
.../index/{ => metadata}/ColumnMetadata.java | 29 +-
.../segment/index/metadata}/SegmentMetadata.java | 4 +-
.../index/{ => metadata}/SegmentMetadataImpl.java | 3 +-
.../readers/ConstantValueBytesDictionary.java | 82 +
.../readers/ConstantValueDoubleDictionary.java} | 53 +-
.../readers/ConstantValueFloatDictionary.java} | 53 +-
.../readers/ConstantValueIntDictionary.java} | 51 +-
.../readers/ConstantValueLongDictionary.java} | 51 +-
.../readers/ConstantValueStringDictionary.java | 81 +
.../segment/index/readers/DocIdDictionary.java | 73 +
.../index/readers/text/LuceneDocIdCollector.java | 11 +-
.../index/readers/text/LuceneTextIndexReader.java | 125 +-
.../core/segment/store/ColumnIndexDirectory.java | 3 +-
.../core/segment/store/FilePerIndexDirectory.java | 2 +-
.../pinot/core/segment/store/SegmentDirectory.java | 2 +-
.../core/segment/store/SegmentDirectoryPaths.java | 9 +
.../segment/store/SegmentLocalFSDirectory.java | 2 +-
.../segment/store/SingleFileIndexDirectory.java | 2 +-
.../virtualcolumn/DocIdVirtualColumnProvider.java | 59 +-
.../SingleStringVirtualColumnProvider.java | 160 --
.../virtualcolumn/VirtualColumnContext.java | 2 +-
.../virtualcolumn/VirtualColumnProvider.java | 2 +-
.../VirtualColumnProviderFactory.java | 19 +-
.../v2/builder/StarTreeV2BuilderConfig.java | 2 +-
.../core/startree/v2/store/StarTreeDataSource.java | 98 ++
.../startree/v2/store/StarTreeIndexContainer.java | 2 +-
.../startree/v2/store/StarTreeLoaderUtils.java | 33 +-
.../v2/store/StarTreeMetricDataSource.java | 136 --
.../apache/pinot/core/transport/QueryRouter.java | 2 +-
.../pinot/core/transport/ServerInstance.java | 3 +-
.../core/transport/ServerRoutingInstance.java | 2 +-
.../pinot/core/util/FixedIntArrayOffHeapIdMap.java | 4 +-
.../org/apache/pinot/core/util/QueryOptions.java | 47 +-
.../apache/pinot/core/util/ReplicationUtils.java | 10 +-
.../ServerSegmentCompletionProtocolHandler.java | 2 +-
.../core/common/RealtimeNoDictionaryTest.java | 33 +-
.../core/common/datatable/DataTableUtilsTest.java | 86 +
.../data/manager/BaseTableDataManagerTest.java | 2 +-
.../realtime/LLRealtimeSegmentDataManagerTest.java | 16 +-
.../MutableSegmentImplNullValueVectorTest.java | 6 +-
.../mutable/MutableSegmentImplTest.java | 12 +-
.../pinot/core/minion/SegmentPurgerTest.java | 10 +-
.../core/operator/CombineSlowOperatorsTest.java | 13 +-
.../NoDictionaryEqualsPredicateEvaluatorsTest.java | 14 +-
.../NoDictionaryInPredicateEvaluatorTest.java | 10 +-
...ngeOfflineDictionaryPredicateEvaluatorTest.java | 29 +-
.../function/AggregationFunctionUtilsTest.java | 66 +
.../query/pruner/ColumnValueSegmentPrunerTest.java | 127 ++
.../query/scheduler/PrioritySchedulerTest.java | 7 +-
.../core/realtime/stream/StreamConfigTest.java | 8 +-
.../core/segment/index/ColumnMetadataTest.java | 2 +
.../segment/index/SegmentMetadataImplTest.java | 2 +
.../DefaultNullValueVirtualColumnProviderTest.java | 177 ++
.../SegmentV1V2ToV3FormatConverterTest.java | 2 +-
.../SegmentGenerationWithBytesTypeTest.java | 20 +-
.../SegmentGenerationWithTimeColumnTest.java | 12 +-
.../index/creator/SegmentPartitionTest.java | 85 +-
.../core/segment/index/loader/LoaderTest.java | 76 +-
.../index/loader/SegmentPreProcessorTest.java | 4 +-
.../BaseDefaultColumnHandlerTest.java | 208 +++
.../store/ColumnIndexDirectoryTestHelper.java | 2 +-
.../segment/store/FilePerIndexDirectoryTest.java | 2 +-
.../segment/store/SegmentLocalFSDirectoryTest.java | 4 +-
.../store/SingleFileIndexDirectoryTest.java | 2 +-
.../pinot/core/transport/QueryRoutingTest.java | 2 +-
.../org/apache/pinot/core/util/CrcUtilsTest.java | 2 +-
.../org/apache/pinot/queries/BaseQueriesTest.java | 10 +-
.../pinot/queries/BaseSingleValueQueriesTest.java | 17 +-
.../apache/pinot/queries/DistinctQueriesTest.java | 1339 ++++++---------
...nerSegmentAggregationMultiValueQueriesTest.java | 24 +-
...InnerSegmentSelectionMultiValueQueriesTest.java | 23 +-
...nnerSegmentSelectionSingleValueQueriesTest.java | 27 +-
...terSegmentAggregationMultiValueQueriesTest.java | 115 +-
.../InterSegmentOrderBySingleValueQueriesTest.java | 68 +-
...terSegmentResultTableMultiValueQueriesTest.java | 34 +-
.../org/apache/pinot/queries/QueriesTestUtils.java | 38 +
.../RangePredicateWithSortedInvertedIndexTest.java | 6 +-
.../queries/SelectionOnlyEarlyTerminationTest.java | 123 ++
...archQueries.java => TextSearchQueriesTest.java} | 13 +-
.../query/pruner/ColumnValueSegmentPrunerTest.java | 100 --
.../selection/SelectionOperatorServiceTest.java | 103 +-
.../pinot/segments/v1/creator/IntArraysTest.java | 6 +-
.../test/resources/conf/query-executor.properties | 6 +-
pinot-distribution/pinot-assembly.xml | 88 +-
pinot-distribution/pinot-source-assembly.xml | 2 +-
pinot-distribution/pom.xml | 3 +-
pinot-integration-tests/pom.xml | 3 +-
.../tests/BaseClusterIntegrationTest.java | 10 +-
.../tests/BaseClusterIntegrationTestSet.java | 113 +-
.../pinot/integration/tests/ClusterTest.java | 39 +-
.../ControllerPeriodicTasksIntegrationTests.java | 20 +-
...vertToRawIndexMinionClusterIntegrationTest.java | 8 +-
.../DefaultCommitterRealtimeIntegrationTest.java | 41 +-
.../tests/HybridClusterIntegrationTest.java | 19 +-
.../tests/LLCRealtimeClusterIntegrationTest.java | 18 +-
.../LuceneRealtimeClusterIntegrationTest.java | 5 +-
.../MultiNodesOfflineClusterIntegrationTest.java | 21 +
.../tests/OfflineClusterIntegrationTest.java | 99 +-
.../tests/SegmentCompletionIntegrationTest.java | 4 +-
.../tests/SimpleMinionClusterIntegrationTest.java | 10 +-
.../src/test/resources/log4j2.xml | 2 +-
pinot-minion/pom.xml | 3 +-
.../minion/events/DefaultMinionEventObserver.java | 2 +-
.../pinot/minion/events/MinionEventObserver.java | 2 +-
.../BaseMultipleSegmentsConversionExecutor.java | 4 +-
.../BaseSingleSegmentConversionExecutor.java | 4 +-
.../executor/ConvertToRawIndexTaskExecutor.java | 4 +-
.../pinot/minion/executor/PinotTaskExecutor.java | 2 +-
.../pinot/minion/executor/PurgeTaskExecutor.java | 4 +-
.../minion/executor/SegmentConversionResult.java | 2 +-
.../minion/taskfactory/TaskFactoryRegistry.java | 2 +-
.../minion/executor/PurgeTaskExecutorTest.java | 12 +-
pinot-perf/pom.xml | 3 +-
.../pinot/perf/BenchmarkOfflineIndexReader.java | 4 +-
.../apache/pinot/perf/BenchmarkQueryEngine.java | 4 +-
.../pinot-batch-ingestion-common/pom.xml | 5 +-
.../batch/common/SegmentGenerationTaskRunner.java | 8 +-
.../batch/common/SegmentGenerationUtils.java | 6 +-
.../pinot-batch-ingestion-hadoop/pom.xml | 5 +-
.../batch/hadoop/HadoopSegmentCreationMapper.java | 6 +-
.../pinot-batch-ingestion-spark/pom.xml | 5 +-
.../spark/SparkSegmentGenerationJobRunner.java | 4 +-
.../pinot-batch-ingestion-standalone/pom.xml | 5 +-
.../standalone/SegmentGenerationJobRunner.java | 6 +-
pinot-plugins/pinot-batch-ingestion/pom.xml | 3 +-
.../v0_deprecated/pinot-hadoop/pom.xml | 3 +-
.../pinot/hadoop/job/HadoopSegmentCreationJob.java | 9 +-
.../hadoop/job/HadoopSegmentPreprocessingJob.java | 20 +-
.../hadoop/job/mappers/SegmentCreationMapper.java | 24 +-
...mentBuildPushOfflineClusterIntegrationTest.java | 6 +-
.../v0_deprecated/pinot-ingestion-common/pom.xml | 5 +-
.../pinot/ingestion/common/ControllerRestApi.java | 2 +-
.../ingestion/common/DefaultControllerRestApi.java | 10 +-
.../pinot/ingestion/jobs/BaseSegmentJob.java | 6 +-
.../v0_deprecated/pinot-spark/pom.xml | 3 +-
.../spark/jobs/SparkSegmentCreationFunction.java | 17 +-
.../pinot/spark/jobs/SparkSegmentCreationJob.java | 6 +-
.../pinot-batch-ingestion/v0_deprecated/pom.xml | 3 +-
pinot-plugins/pinot-file-system/pinot-adls/pom.xml | 9 +-
.../pinot/plugin/filesystem/ADLSGen2PinotFS.java | 462 +++++
.../pinot/plugin/filesystem/AzurePinotFSUtil.java | 89 +
.../filesystem/test/AzurePinotFSUtilTest.java | 101 ++
pinot-plugins/pinot-file-system/pinot-gcs/pom.xml | 10 +-
.../apache/pinot/plugin/filesystem/GcsPinotFS.java | 4 +-
pinot-plugins/pinot-file-system/pinot-hdfs/pom.xml | 3 +-
pinot-plugins/pinot-file-system/pom.xml | 3 +-
.../{pinot-avro => pinot-avro-base}/pom.xml | 9 +-
.../inputformat/avro/AvroRecordExtractor.java | 0
.../plugin/inputformat/avro/AvroRecordReader.java | 0
.../plugin/inputformat/avro/AvroSchemaUtil.java | 0
.../pinot/plugin/inputformat/avro/AvroUtils.java | 0
.../inputformat/avro/AvroRecordReaderTest.java | 0
.../avro/AvroRecordToPinotRowGeneratorTest.java | 0
.../pinot-input-format/pinot-avro/pom.xml | 20 +-
.../pinot-confluent-avro}/pom.xml | 67 +-
...aConfluentSchemaRegistryAvroMessageDecoder.java | 70 +
pinot-plugins/pinot-input-format/pinot-csv/pom.xml | 5 +-
.../pinot-input-format/pinot-json/pom.xml | 5 +-
.../plugin/inputformat/json/JSONRecordReader.java | 4 +-
pinot-plugins/pinot-input-format/pinot-orc/pom.xml | 5 +-
.../pinot-input-format/pinot-parquet/pom.xml | 5 +-
.../pinot-input-format/pinot-thrift/pom.xml | 5 +-
pinot-plugins/pinot-input-format/pom.xml | 5 +-
.../pinot-kafka-0.9/README.md | 2 +-
.../pinot-stream-ingestion/pinot-kafka-0.9/pom.xml | 6 +-
.../pinot-kafka-2.0/README.md | 2 +-
.../pinot-stream-ingestion/pinot-kafka-2.0/pom.xml | 6 +-
.../pinot-kafka-base/pom.xml | 6 +-
pinot-plugins/pinot-stream-ingestion/pom.xml | 3 +-
pinot-plugins/pom.xml | 6 +-
pinot-server/pom.xml | 3 +-
.../pinot/server/api/resources/TablesResource.java | 2 +-
.../helix/DefaultHelixStarterServerConfig.java | 8 +-
.../starter/helix/HelixInstanceDataManager.java | 31 +-
.../helix/HelixInstanceDataManagerConfig.java | 8 +
.../server/starter/helix/HelixServerStarter.java | 4 +-
.../starter/helix/SegmentFetcherAndLoader.java | 4 +-
.../SegmentOnlineOfflineStateModelFactory.java | 4 +-
.../pinot/server/api/TablesResourceTest.java | 4 +-
pinot-spi/pom.xml | 3 +-
.../apache/pinot/spi}/config/BaseJsonConfig.java | 11 +-
.../pinot/spi}/config/ColumnPartitionConfig.java | 15 +-
.../apache/pinot/spi}/config/CompletionConfig.java | 3 +-
.../org/apache/pinot/spi}/config/FieldConfig.java | 27 +-
.../apache/pinot/spi}/config/IndexingConfig.java | 64 +-
.../org/apache/pinot/spi/config/QueryConfig.java | 49 +
.../org/apache/pinot/spi}/config/QuotaConfig.java | 82 +-
.../spi}/config/ReplicaGroupStrategyConfig.java | 2 +-
.../apache/pinot/spi}/config/RoutingConfig.java | 2 +-
.../pinot/spi}/config/SegmentPartitionConfig.java | 22 +-
.../SegmentsValidationAndRetentionConfig.java | 3 +-
.../pinot/spi}/config/StarTreeIndexConfig.java | 2 +-
.../org/apache/pinot/spi/config/TableConfig.java | 220 +++
.../pinot/spi}/config/TableCustomConfig.java | 2 +-
.../apache/pinot/spi}/config/TableTaskConfig.java | 2 +-
.../org/apache/pinot/spi/config/TableType.java | 4 +-
.../pinot/spi}/config/TagOverrideConfig.java | 2 +-
.../org/apache/pinot/spi}/config/TenantConfig.java | 2 +-
.../org/apache/pinot/spi/config/api}/Instance.java | 54 +-
.../apache/pinot/spi/config/api/InstanceType.java | 6 +-
.../org/apache/pinot/spi/config/api}/Tenant.java | 4 +-
.../apache/pinot/spi/config/api}/TenantRole.java | 2 +-
.../assignment}/InstanceAssignmentConfig.java | 4 +-
.../assignment}/InstanceConstraintConfig.java | 4 +-
.../config}/assignment/InstancePartitionsType.java | 2 +-
.../InstanceReplicaGroupPartitionConfig.java | 4 +-
.../config/assignment}/InstanceTagPoolConfig.java | 4 +-
.../java/org/apache/pinot/spi/data/FieldSpec.java | 4 +
.../org/apache/pinot/spi/filesystem/PinotFS.java | 16 +-
.../org/apache/pinot/spi/stream/StreamConfig.java | 21 +-
.../java/org/apache/pinot/spi/utils/DataSize.java | 91 -
.../org/apache/pinot/spi/utils/DataSizeUtils.java | 94 +
.../spi/utils/builder/TableConfigBuilder.java | 312 ++++
.../pinot/spi/utils/builder}/TableNameBuilder.java | 9 +-
.../pinot/spi}/config/IndexingConfigTest.java | 4 +-
.../apache/pinot/spi/config/QuotaConfigTest.java | 129 ++
.../apache/pinot/spi/config/api}/TenantTest.java | 3 +-
.../pinot/spi/filesystem/LocalPinotFSTest.java | 8 +
pinot-tools/pom.xml | 3 +-
.../apache/pinot/tools/ClusterStateVerifier.java | 2 +-
.../apache/pinot/tools/GitHubEventsQuickstart.java | 151 ++
.../org/apache/pinot/tools/HybridQuickstart.java | 11 +-
.../apache/pinot/tools/PinotNumReplicaChanger.java | 4 +-
.../apache/pinot/tools/PinotTableRebalancer.java | 2 +-
.../org/apache/pinot/tools/PinotToolLauncher.java | 10 +-
.../apache/pinot/tools/QuickstartTableRequest.java | 2 +-
.../org/apache/pinot/tools/SegmentDumpTool.java | 6 +-
.../apache/pinot/tools/StarTreeIndexViewer.java | 4 +-
.../org/apache/pinot/tools/UpdateSegmentState.java | 5 +-
.../pinot/tools/admin/PinotAdministrator.java | 8 +-
.../tools/admin/command/AddTenantCommand.java | 4 +-
.../command/BackfillDateTimeColumnCommand.java | 6 +-
.../command/GitHubEventsQuickStartCommand.java | 72 +
.../tools/admin/command/MoveReplicaGroup.java | 14 +-
.../OfflineSegmentIntervalCheckerCommand.java | 6 +-
.../tools/admin/command/QuickstartRunner.java | 4 +-
.../command/RealtimeProvisioningHelperCommand.java | 12 +-
.../admin/command/ShowClusterInfoCommand.java | 2 +-
.../admin/command/StreamGitHubEventsCommand.java | 111 ++
.../tools/admin/command/ValidateConfigCommand.java | 7 +-
.../tools/admin/command/VerifySegmentState.java | 2 +-
.../anonymizer/ArrayBasedGlobalDictionaries.java | 3 +-
.../pinot/tools/anonymizer/GlobalDictionaries.java | 2 +-
.../anonymizer/MapBasedGlobalDictionaries.java | 2 +-
.../anonymizer/PinotDataAndQueryAnonymizer.java | 27 +-
.../config/validator/TableConfigValidator.java | 3 +-
.../tools/filesystem/PinotFSBenchmarkDriver.java | 249 +++
.../tools/filesystem/PinotFSBenchmarkRunner.java | 79 +
.../pinot/tools/perf/PerfBenchmarkDriver.java | 18 +-
.../pinot/tools/perf/PerfBenchmarkRunner.java | 2 +-
.../tools/query/comparison/ClusterStarter.java | 15 +-
.../realtime/provisioning/MemoryEstimator.java | 46 +-
.../apache/pinot/tools/scan/query/Aggregation.java | 2 +-
.../apache/pinot/tools/scan/query/Projection.java | 4 +-
.../tools/scan/query/SegmentQueryProcessor.java | 12 +-
.../apache/pinot/tools/scan/query/Selection.java | 2 +-
.../segment/converter/SegmentMergeCommand.java | 15 +-
.../pinot/tools/streams/AirlineDataStream.java | 12 +-
.../streams/githubevents/GitHubAPICaller.java | 205 +++
.../githubevents/PullRequestMergedEvent.java | 397 +++++
.../PullRequestMergedEventsStream.java | 310 ++++
.../conf/sample_filesystem_benchmark.conf | 5 +
...lRequestMergedEvents_realtime_table_config.json | 36 +
...lRequestMergedEvents_realtime_table_config.json | 37 +
.../pullRequestMergedEvents_schema.json | 151 ++
pom.xml | 78 +-
thirdeye/pom.xml | 2 +-
.../app/pods/components/alert-details/component.js | 35 +-
.../pods/components/detection-yaml/component.js | 31 +-
.../pods/components/detection-yaml/template.hbs | 108 +-
.../components/modals/error-modal/component.js | 19 +
.../components/modals/error-modal/template.hbs | 15 +
.../rootcause-dimensions-algorithm/component.js | 15 +-
.../pods/components/subscription-yaml/component.js | 9 +
.../pods/components/subscription-yaml/template.hbs | 57 +-
.../app/pods/components/te-modal/component.js | 1 +
.../app/pods/components/te-modal/template.hbs | 8 +-
.../dimensions-table/change-bars/component.js | 4 +-
.../dimensions-table/change-bars/template.hbs | 2 +-
.../contribution-change/template.hbs | 1 -
.../{contribution-change => cost}/component.js | 3 +-
.../pods/custom/dimensions-table/cost/template.hbs | 1 +
.../custom/dimensions-table/dimension/template.hbs | 2 +-
.../{percent-change => node-size}/component.js | 0
.../custom/dimensions-table/node-size/template.hbs | 1 +
.../dimensions-table/percent-change/template.hbs | 1 -
.../app/pods/manage/yaml/controller.js | 76 +-
.../app/pods/manage/yaml/template.hbs | 7 +
.../app/pods/self-serve/create-alert/controller.js | 33 +-
.../app/pods/self-serve/create-alert/template.hbs | 13 +-
.../services/rootcause-entities-cache/service.js | 2 +-
.../app/shared/dimensionAnalysisTableConfig.js | 20 +-
.../app/shared/filterBarConfig.js | 33 +
.../app/styles/components/button.scss | 14 +
.../app/styles/components/detection-yaml.scss | 41 +
.../app/styles/components/links.scss | 25 +
.../app/styles/components/subscription-yaml.scss | 14 +
.../app/styles/pods/custom/dimensions-table.scss | 5 +-
.../app/styles/pods/self-serve/create-alert.scss | 4 +
.../app/styles/wrapper/styles.scss | 2 +-
thirdeye/thirdeye-frontend/app/utils/yaml-tools.js | 15 +-
thirdeye/thirdeye-frontend/package.json | 1 +
.../acceptance/self-serve-import-metric-test.js | 4 +-
.../components/detection-yaml/component-test.js | 8 +-
.../components/subscription-yaml/component-test.js | 4 +-
.../thirdeye-frontend/tests/utils/constants.js | 1 +
thirdeye/thirdeye-frontend/yarn.lock | 7 +
.../anomaly/ThirdEyeAnomalyApplication.java | 9 +
.../anomaly/monitor/MonitorTaskRunner.java | 1 +
.../thirdeye/common/ThirdEyeConfiguration.java | 11 +
.../dashboard/ThirdEyeDashboardApplication.java | 10 +
.../datalayer/bao/MergedAnomalyResultManager.java | 2 +-
.../bao/jdbc/MergedAnomalyResultManagerImpl.java | 7 +-
.../datalayer/pojo/DetectionAlertConfigBean.java | 21 +-
.../pinot/resultset/ThirdEyeResultSetUtils.java | 8 -
.../thirdeye/detection/DefaultDataProvider.java | 3 +
.../pinot/thirdeye/detection/alert/AlertUtils.java | 9 +-
.../detection/alert/DetectionAlertJob.java | 17 +-
.../detection/alert/DetectionAlertTaskRunner.java | 24 +-
.../alert/StatefulDetectionAlertFilter.java | 21 +-
.../filter/DimensionsRecipientAlertFilter.java | 17 +-
.../alert/filter/PerUserDimensionAlertFilter.java | 18 +-
.../detection/alert/filter/SubscriptionUtils.java | 1 -
.../ToAllRecipientsDetectionAlertFilter.java | 22 +-
.../alert/scheme/DetectionEmailAlerter.java | 5 +-
.../components/ThresholdRuleDetector.java | 2 +-
.../thirdeye/detection/health/DetectionHealth.java | 19 +-
.../detection/health/DetectionTaskStatus.java | 15 +-
.../validators/SubscriptionConfigValidator.java | 9 -
.../detection/wrapper/AnomalyDetectorWrapper.java | 5 +-
.../wrapper/ChildKeepingMergeWrapper.java | 17 +-
.../thirdeye/detection/yaml/YamlResource.java | 53 +-
.../translator/SubscriptionConfigTranslator.java | 1 -
.../thirdeye/model/download/ModelDownloader.java | 34 +-
.../download/ModelDownloaderConfiguration.java | 65 +
.../model/download/ModelDownloaderManager.java | 88 +
.../apache/pinot/thirdeye/util/ThirdEyeUtils.java | 23 +-
.../src/main/resources/schema/create-schema.sql | 8 +-
.../thirdeye/detection/alert/SendAlertTest.java | 6 +-
.../ToAllRecipientsDetectionAlertFilterTest.java | 19 +-
.../wrapper/ChildKeepingMergeWrapperTest.java | 5 +-
.../thirdeye/detection/yaml/YamlResourceTest.java | 2 +-
website/.gitignore | 28 +
website/README.md | 35 +
website/docs/about.md | 14 +
website/docs/about/features_of_pinot.md | 40 +
website/docs/about/what_is_pinot.md | 35 +
website/docs/about/who_use_pinot.md | 26 +
website/docs/administration.md | 14 +
.../docs/administration/guides/troubleshooting.md | 6 +
.../docs/administration/installation/cloud/aws.md | 150 ++
.../administration/installation/cloud/azure.md | 129 ++
.../docs/administration/installation/cloud/gcp.md | 134 ++
.../installation/cloud/on-premise.md | 287 ++++
.../docs/administration/installation/containers.md | 12 +
.../installation/containers/docker.md | 136 ++
.../installation/operating-systems/macos.md | 11 +
.../installation/operating-systems/ubuntu.md | 14 +
website/docs/administration/running_locally.md | 60 +
website/docs/components.md | 14 +
website/docs/components/broker.md | 13 +
website/docs/components/cluster.md | 137 ++
website/docs/components/controller.md | 7 +
.../docs/components/minion.md | 0
.../docs/components/schema.md | 0
.../docs/components/segments.md | 0
.../docs/components/server.md | 0
.../docs/components/tables.md | 0
.../docs/components/tenants.md | 0
website/docs/concepts.md | 14 +
website/docs/concepts/pinot-architecture.md | 17 +
website/docs/how-to.md | 14 +
website/docs/misc.md | 14 +
website/docs/misc/build-docker.md | 183 ++
website/docs/user-guide.md | 14 +
website/docs/user-guide/clients/golang.md | 166 ++
website/docs/user-guide/clients/java.md | 132 ++
website/docs/user-guide/pql.md | 254 +++
website/docs/user-guide/query-pinot.md | 77 +
website/docs/user-guide/response-format.md | 381 ++++
website/docs/user-guide/rest-admin-interface.md | 7 +
website/docusaurus.config.js | 180 ++
website/package.json | 50 +
website/scripts/build-site.sh | 36 +
website/scripts/publish_site.sh | 51 +
website/sidebars.js | 73 +
.../src/components/Alert/index.js | 54 +-
website/src/components/Alert/styles.css | 66 +
.../src/components/BlogPostTags/index.js | 28 +-
.../src/components/BlogPostTags/styles.module.css | 3 +
website/src/components/Changelog/index.js | 151 ++
website/src/components/CheckboxList/index.js | 59 +
.../src/components/CheckboxList/styles.css | 0
.../src/components/CodeHeader/index.js | 26 +-
website/src/components/CodeHeader/styles.css | 17 +
website/src/components/Field/index.js | 200 +++
website/src/components/Fields/index.js | 109 ++
website/src/components/Fields/styles.css | 31 +
website/src/components/Jump/index.js | 51 +
website/src/components/Jump/styles.css | 109 ++
.../src/components/Step/index.js | 16 +-
.../src/components/Step/styles.css | 0
.../src/components/Steps/index.js | 16 +-
website/src/components/Steps/styles.css | 15 +
website/src/css/custom.css | 1812 ++++++++++++++++++++
website/src/exports/animatedGraph.js | 82 +
website/src/exports/cloudify.js | 349 ++++
website/src/exports/newPost.js | 49 +
website/src/exports/newRelease.js | 49 +
.../src/exports/repoUrl.js | 13 +-
.../src/pages/download.css | 11 +-
website/src/pages/download.js | 147 ++
website/src/pages/index.css | 131 ++
website/src/pages/index.js | 297 ++++
website/src/pages/index.module.css | 334 ++++
website/static/img/companies/factual.svg | 1 +
website/static/img/companies/linkedin.svg | 1 +
website/static/img/companies/microsoft-teams.svg | 21 +
website/static/img/companies/slack.svg | 1 +
website/static/img/companies/uber.svg | 9 +
website/static/img/companies/weibo.svg | 1 +
website/static/img/components/Broker.png | Bin 0 -> 16477 bytes
website/static/img/components/ClusterLogical.png | Bin 0 -> 10056 bytes
website/static/img/components/TimeBoundary.jpg | Bin 0 -> 34893 bytes
website/static/img/components/components.png | Bin 0 -> 8582 bytes
website/static/img/dynamic-table.png | Bin 0 -> 241500 bytes
website/static/img/favicon-16x16.png | Bin 0 -> 1535 bytes
website/static/img/favicon-32x32.png | Bin 0 -> 2576 bytes
website/static/img/favicon-96x96.png | Bin 0 -> 8369 bytes
website/static/img/favicon.ico | Bin 0 -> 1150 bytes
website/static/img/ingest-query.svg | 321 ++++
website/static/img/logo.svg | 1 +
website/static/img/pinot-320x320.png | Bin 0 -> 32566 bytes
.../static}/img/pinot-architecture.png | Bin
website/static/img/pinot-components.svg | 247 +++
website/static/img/pinot-navbar-logo.svg | 19 +
website/static/img/pinot-overview-dark.png | Bin 0 -> 317730 bytes
website/static/img/pinot-overview-light.png | Bin 0 -> 145510 bytes
website/static/img/pinot-overview.svg | 247 +++
website/static/img/pinot-query.svg | 277 +++
website/static/img/pinot.png | Bin 0 -> 124842 bytes
website/static/img/pql-query.png | Bin 0 -> 138225 bytes
website/static/img/pql/pql-query-console.png | Bin 0 -> 301189 bytes
website/static/img/undraw_docusaurus_mountain.svg | 170 ++
website/static/img/undraw_docusaurus_react.svg | 169 ++
website/static/img/undraw_docusaurus_tree.svg | 1 +
811 files changed, 23242 insertions(+), 8126 deletions(-)
create mode 100644 .github/workflows/maven.yml
copy pinot-integration-tests/src/test/resources/log4j2.xml => .travis/.ci.settings.xml (65%)
rename .travis_install.sh => .travis/.travis_install.sh (90%)
create mode 100755 .travis/.travis_nightly_build.sh
create mode 100755 .travis/.travis_quickstart.sh
create mode 100755 .travis/.travis_quickstart_openjdk.sh
create mode 100755 .travis/.travis_set_deploy_build_opts.sh
rename .travis_test.sh => .travis/.travis_test.sh (71%)
delete mode 100755 .travis_quickstart.sh
create mode 100644 docker/images/pinot-thirdeye/Dockerfile
create mode 100644 docker/images/pinot-thirdeye/README.md
create mode 100755 docker/images/pinot-thirdeye/bin/start-thirdeye.sh
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/dashboard.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/data-sources/cache-config.yml (100%)
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/data-sources/data-sources-config-backend.yml
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/data-sources/data-sources-config-frontend.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/data/README.md (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/data/daily.csv (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/data/hourly.csv (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/data/pageviews.csv (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/detector-config/anomaly-functions/alertFilter.properties (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/detector-config/anomaly-functions/alertFilterAutotune.properties (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => docker/images/pinot-thirdeye/config/ephemeral/detector-config/anomaly-functions/anomalyClassifier.properties (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/detector-config/anomaly-functions/functions.properties (100%)
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/detector.yml
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/persistence.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/rca.yml (100%)
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/bootstrap.sql
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/dashboard.yml (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/data-sources/cache-config.yml (100%)
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/data-sources/data-sources-config.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/data/README.md (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/data/daily.csv (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/data/hourly.csv (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/data/pageviews.csv (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/detector-config/anomaly-functions/alertFilter.properties (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/detector-config/anomaly-functions/alertFilterAutotune.properties (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => docker/images/pinot-thirdeye/config/pinot-quickstart/detector-config/anomaly-functions/anomalyClassifier.properties (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/detector-config/anomaly-functions/functions.properties (100%)
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/detector.yml
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/persistence.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/rca.yml (100%)
create mode 100755 docker/images/pinot-thirdeye/docker-build-and-push.sh
create mode 100755 docker/images/pinot-thirdeye/docker-build.sh
create mode 100755 docker/images/pinot-thirdeye/docker-push.sh
create mode 100755 docker/images/pinot/bin/generator.sh
create mode 100644 kubernetes/helm/pinot-github-events-setup.yml
create mode 100644 licenses-binary/LICENSE-fusesource.txt
create mode 100644 licenses-binary/LICENSE-jquery-requestAnimationFrame.txt
create mode 100644 licenses-binary/LICENSE-jquery-sizzle.txt
create mode 100644 licenses-binary/LICENSE-py4j.txt
create mode 100644 licenses-binary/LICENSE-threeten.txt
create mode 100644 licenses/LICENSE-jquery-requestAnimationFrame.txt
create mode 100644 licenses/LICENSE-jquery-sizzle.txt
rename pinot-common/src/main/java/org/apache/pinot/common/{config/instance => assignment}/InstanceAssignmentConfigUtils.java (90%)
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TableConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TextIndexConfigValidator.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/messages/QueryQuotaUpdateMessage.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/messages/TableConfigRefreshMessage.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/config/InstanceUtils.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/config/TableConfigUtils.java
rename pinot-common/src/main/java/org/apache/pinot/common/{ => utils}/config/TagNameUtils.java (94%)
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/config/QuotaConfigTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/config/TableConfigTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/DataSizeTest.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/DataSizeUtilsTest.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/config/TableConfigSerDeTest.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/config/TableConfigUtilsTest.java
rename pinot-common/src/test/java/org/apache/pinot/common/{config/TagOverrideConfigTest.java => utils/config/TagNameUtilsTest.java} (94%)
copy pinot-minion/src/main/java/org/apache/pinot/minion/events/DefaultMinionEventObserver.java => pinot-core/src/main/java/org/apache/pinot/core/io/reader/impl/ConstantMVForwardIndex.java (57%)
copy pinot-core/src/main/java/org/apache/pinot/core/{data/table/Key.java => io/reader/impl/ConstantMVInvertedIndex.java} (54%)
copy pinot-core/src/main/java/org/apache/pinot/core/{segment/virtualcolumn/IntSingleValueDataFileReader.java => io/reader/impl/ConstantSVSortedIndex.java} (57%)
rename {pinot-common/src/main/java/org/apache/pinot/common/config => pinot-core/src/main/java/org/apache/pinot/core/minion}/PinotTaskConfig.java (95%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/dociditerators/ExpressionScanDocIdIterator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/ExpressionFilterDocIdSet.java
copy pinot-common/src/main/java/org/apache/pinot/common/utils/TenantRole.java => pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/ScanBasedDocIdSet.java (76%)
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/StarTreeDocIdSet.java
rename pinot-core/src/main/java/org/apache/pinot/core/{segment/virtualcolumn/DefaultNullValueSingleStringVirtualColumnProvider.java => query/exception/EarlyTerminationException.java} (69%)
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/pruner/AbstractSegmentPruner.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/pruner/PartitionSegmentPruner.java
copy pinot-core/src/main/java/org/apache/pinot/core/{segment/index/readers/text/LuceneDocIdCollector.java => realtime/impl/invertedindex/RealtimeLuceneDocIdCollector.java} (59%)
rename pinot-core/src/main/java/org/apache/pinot/core/segment/{virtualcolumn => index/column}/BaseVirtualColumnProvider.java (71%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/column/DefaultNullValueVirtualColumnProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/data/source/ColumnDataSource.java
rename pinot-core/src/main/java/org/apache/pinot/core/{startree/v2/store/StarTreeDimensionDataSource.java => segment/index/datasource/BaseDataSource.java} (50%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/datasource/ImmutableDataSource.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/datasource/MutableDataSource.java
rename pinot-core/src/main/java/org/apache/pinot/core/segment/index/{ => metadata}/ColumnMetadata.java (90%)
rename {pinot-common/src/main/java/org/apache/pinot/common/segment => pinot-core/src/main/java/org/apache/pinot/core/segment/index/metadata}/SegmentMetadata.java (95%)
rename pinot-core/src/main/java/org/apache/pinot/core/segment/index/{ => metadata}/SegmentMetadataImpl.java (99%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ConstantValueBytesDictionary.java
copy pinot-core/src/main/java/org/apache/pinot/core/segment/{virtualcolumn/IntSingleValueDataFileReader.java => index/readers/ConstantValueDoubleDictionary.java} (50%)
copy pinot-core/src/main/java/org/apache/pinot/core/segment/{virtualcolumn/IntSingleValueDataFileReader.java => index/readers/ConstantValueFloatDictionary.java} (50%)
copy pinot-core/src/main/java/org/apache/pinot/core/segment/{virtualcolumn/IntSingleValueDataFileReader.java => index/readers/ConstantValueIntDictionary.java} (50%)
rename pinot-core/src/main/java/org/apache/pinot/core/segment/{virtualcolumn/IntSingleValueDataFileReader.java => index/readers/ConstantValueLongDictionary.java} (50%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ConstantValueStringDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/DocIdDictionary.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/virtualcolumn/SingleStringVirtualColumnProvider.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/v2/store/StarTreeDataSource.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/v2/store/StarTreeMetricDataSource.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/common/datatable/DataTableUtilsTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/query/aggregation/function/AggregationFunctionUtilsTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/query/pruner/ColumnValueSegmentPrunerTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/column/DefaultNullValueVirtualColumnProviderTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/loader/defaultcolumn/BaseDefaultColumnHandlerTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/SelectionOnlyEarlyTerminationTest.java
rename pinot-core/src/test/java/org/apache/pinot/queries/{TestTextSearchQueries.java => TextSearchQueriesTest.java} (99%)
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/query/pruner/ColumnValueSegmentPrunerTest.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/AzurePinotFSUtil.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/src/test/java/org/apache/pinot/plugin/filesystem/test/AzurePinotFSUtilTest.java
copy pinot-plugins/pinot-input-format/{pinot-avro => pinot-avro-base}/pom.xml (92%)
rename pinot-plugins/pinot-input-format/{pinot-avro => pinot-avro-base}/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractor.java (100%)
rename pinot-plugins/pinot-input-format/{pinot-avro => pinot-avro-base}/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordReader.java (100%)
rename pinot-plugins/pinot-input-format/{pinot-avro => pinot-avro-base}/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroSchemaUtil.java (100%)
rename pinot-plugins/pinot-input-format/{pinot-avro => pinot-avro-base}/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroUtils.java (100%)
rename pinot-plugins/pinot-input-format/{pinot-avro => pinot-avro-base}/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordReaderTest.java (100%)
rename pinot-plugins/pinot-input-format/{pinot-avro => pinot-avro-base}/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordToPinotRowGeneratorTest.java (100%)
copy pinot-plugins/{pinot-stream-ingestion/pinot-kafka-2.0 => pinot-input-format/pinot-confluent-avro}/pom.xml (61%)
create mode 100644 pinot-plugins/pinot-input-format/pinot-confluent-avro/src/main/java/org/apache/pinot/plugin/inputformat/avro/confluent/KafkaConfluentSchemaRegistryAvroMessageDecoder.java
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/BaseJsonConfig.java (83%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/ColumnPartitionConfig.java (81%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/CompletionConfig.java (96%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/FieldConfig.java (76%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/IndexingConfig.java (90%)
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/QueryConfig.java
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/QuotaConfig.java (50%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/ReplicaGroupStrategyConfig.java (98%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/RoutingConfig.java (98%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/SegmentPartitionConfig.java (78%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/SegmentsValidationAndRetentionConfig.java (97%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/StarTreeIndexConfig.java (98%)
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/TableConfig.java
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/TableCustomConfig.java (97%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/TableTaskConfig.java (97%)
copy pinot-common/src/main/java/org/apache/pinot/common/utils/ServerType.java => pinot-spi/src/main/java/org/apache/pinot/spi/config/TableType.java (92%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/TagOverrideConfig.java (98%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi}/config/TenantConfig.java (97%)
rename {pinot-common/src/main/java/org/apache/pinot/common/config => pinot-spi/src/main/java/org/apache/pinot/spi/config/api}/Instance.java (60%)
copy pinot-common/src/main/java/org/apache/pinot/common/utils/ServerType.java => pinot-spi/src/main/java/org/apache/pinot/spi/config/api/InstanceType.java (88%)
rename {pinot-common/src/main/java/org/apache/pinot/common/config => pinot-spi/src/main/java/org/apache/pinot/spi/config/api}/Tenant.java (96%)
copy {pinot-common/src/main/java/org/apache/pinot/common/utils => pinot-spi/src/main/java/org/apache/pinot/spi/config/api}/TenantRole.java (95%)
rename {pinot-common/src/main/java/org/apache/pinot/common/config/instance => pinot-spi/src/main/java/org/apache/pinot/spi/config/assignment}/InstanceAssignmentConfig.java (96%)
rename {pinot-common/src/main/java/org/apache/pinot/common/config/instance => pinot-spi/src/main/java/org/apache/pinot/spi/config/assignment}/InstanceConstraintConfig.java (93%)
rename {pinot-common/src/main/java/org/apache/pinot/common => pinot-spi/src/main/java/org/apache/pinot/spi/config}/assignment/InstancePartitionsType.java (96%)
rename {pinot-common/src/main/java/org/apache/pinot/common/config/instance => pinot-spi/src/main/java/org/apache/pinot/spi/config/assignment}/InstanceReplicaGroupPartitionConfig.java (96%)
rename {pinot-common/src/main/java/org/apache/pinot/common/config/instance => pinot-spi/src/main/java/org/apache/pinot/spi/config/assignment}/InstanceTagPoolConfig.java (95%)
delete mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/DataSize.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/DataSizeUtils.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/builder/TableConfigBuilder.java
rename {pinot-common/src/main/java/org/apache/pinot/common/config => pinot-spi/src/main/java/org/apache/pinot/spi/utils/builder}/TableNameBuilder.java (91%)
rename {pinot-common/src/test/java/org/apache/pinot/common => pinot-spi/src/test/java/org/apache/pinot/spi}/config/IndexingConfigTest.java (97%)
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/config/QuotaConfigTest.java
rename {pinot-common/src/test/java/org/apache/pinot/common/config => pinot-spi/src/test/java/org/apache/pinot/spi/config/api}/TenantTest.java (94%)
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/GitHubEventsQuickstart.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/GitHubEventsQuickStartCommand.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/StreamGitHubEventsCommand.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkDriver.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkRunner.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/GitHubAPICaller.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/PullRequestMergedEvent.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/PullRequestMergedEventsStream.java
create mode 100644 pinot-tools/src/main/resources/conf/sample_filesystem_benchmark.conf
create mode 100644 pinot-tools/src/main/resources/examples/stream/githubEvents/docker/pullRequestMergedEvents_realtime_table_config.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/githubEvents/pullRequestMergedEvents_realtime_table_config.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/githubEvents/pullRequestMergedEvents_schema.json
create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/modals/error-modal/component.js
create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/modals/error-modal/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/contribution-change/template.hbs
rename thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/{contribution-change => cost}/component.js (91%)
create mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/cost/template.hbs
rename thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/{percent-change => node-size}/component.js (100%)
create mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/node-size/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/percent-change/template.hbs
copy pinot-minion/src/main/java/org/apache/pinot/minion/executor/PinotTaskExecutor.java => thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/model/download/ModelDownloader.java (52%)
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/model/download/ModelDownloaderConfiguration.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/model/download/ModelDownloaderManager.java
create mode 100755 website/.gitignore
create mode 100755 website/README.md
create mode 100644 website/docs/about.md
create mode 100644 website/docs/about/features_of_pinot.md
create mode 100644 website/docs/about/what_is_pinot.md
create mode 100644 website/docs/about/who_use_pinot.md
create mode 100644 website/docs/administration.md
create mode 100644 website/docs/administration/guides/troubleshooting.md
create mode 100644 website/docs/administration/installation/cloud/aws.md
create mode 100644 website/docs/administration/installation/cloud/azure.md
create mode 100644 website/docs/administration/installation/cloud/gcp.md
create mode 100644 website/docs/administration/installation/cloud/on-premise.md
create mode 100644 website/docs/administration/installation/containers.md
create mode 100644 website/docs/administration/installation/containers/docker.md
create mode 100644 website/docs/administration/installation/operating-systems/macos.md
create mode 100644 website/docs/administration/installation/operating-systems/ubuntu.md
create mode 100644 website/docs/administration/running_locally.md
create mode 100644 website/docs/components.md
create mode 100644 website/docs/components/broker.md
create mode 100644 website/docs/components/cluster.md
create mode 100644 website/docs/components/controller.md
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/minion.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/schema.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/segments.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/server.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/tables.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/tenants.md (100%)
create mode 100644 website/docs/concepts.md
create mode 100644 website/docs/concepts/pinot-architecture.md
create mode 100644 website/docs/how-to.md
create mode 100644 website/docs/misc.md
create mode 100644 website/docs/misc/build-docker.md
create mode 100644 website/docs/user-guide.md
create mode 100644 website/docs/user-guide/clients/golang.md
create mode 100644 website/docs/user-guide/clients/java.md
create mode 100644 website/docs/user-guide/pql.md
create mode 100644 website/docs/user-guide/query-pinot.md
create mode 100644 website/docs/user-guide/response-format.md
create mode 100644 website/docs/user-guide/rest-admin-interface.md
create mode 100755 website/docusaurus.config.js
create mode 100755 website/package.json
create mode 100755 website/scripts/build-site.sh
create mode 100644 website/scripts/publish_site.sh
create mode 100755 website/sidebars.js
copy pinot-core/src/main/java/org/apache/pinot/core/data/table/Key.java => website/src/components/Alert/index.js (52%)
create mode 100644 website/src/components/Alert/styles.css
copy pinot-controller/src/main/java/org/apache/pinot/controller/api/events/DefaultMetadataEventNotifier.java => website/src/components/BlogPostTags/index.js (58%)
create mode 100644 website/src/components/BlogPostTags/styles.module.css
create mode 100644 website/src/components/Changelog/index.js
create mode 100644 website/src/components/CheckboxList/index.js
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/src/components/CheckboxList/styles.css (100%)
copy pinot-controller/src/main/java/org/apache/pinot/controller/api/events/DefaultMetadataEventNotifier.java => website/src/components/CodeHeader/index.js (65%)
create mode 100644 website/src/components/CodeHeader/styles.css
create mode 100644 website/src/components/Field/index.js
create mode 100644 website/src/components/Fields/index.js
create mode 100644 website/src/components/Fields/styles.css
create mode 100644 website/src/components/Jump/index.js
create mode 100644 website/src/components/Jump/styles.css
copy pinot-common/src/main/java/org/apache/pinot/common/utils/TenantRole.java => website/src/components/Step/index.js (82%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/src/components/Step/styles.css (100%)
copy pinot-common/src/main/java/org/apache/pinot/common/utils/TenantRole.java => website/src/components/Steps/index.js (81%)
create mode 100644 website/src/components/Steps/styles.css
create mode 100644 website/src/css/custom.css
create mode 100644 website/src/exports/animatedGraph.js
create mode 100644 website/src/exports/cloudify.js
create mode 100644 website/src/exports/newPost.js
create mode 100644 website/src/exports/newRelease.js
rename pinot-common/src/main/java/org/apache/pinot/common/utils/TenantRole.java => website/src/exports/repoUrl.js (72%)
rename pinot-common/src/main/java/org/apache/pinot/common/utils/ServerType.java => website/src/pages/download.css (85%)
create mode 100644 website/src/pages/download.js
create mode 100644 website/src/pages/index.css
create mode 100755 website/src/pages/index.js
create mode 100644 website/src/pages/index.module.css
create mode 100644 website/static/img/companies/factual.svg
create mode 100644 website/static/img/companies/linkedin.svg
create mode 100644 website/static/img/companies/microsoft-teams.svg
create mode 100644 website/static/img/companies/slack.svg
create mode 100644 website/static/img/companies/uber.svg
create mode 100644 website/static/img/companies/weibo.svg
create mode 100644 website/static/img/components/Broker.png
create mode 100644 website/static/img/components/ClusterLogical.png
create mode 100644 website/static/img/components/TimeBoundary.jpg
create mode 100644 website/static/img/components/components.png
create mode 100644 website/static/img/dynamic-table.png
create mode 100644 website/static/img/favicon-16x16.png
create mode 100644 website/static/img/favicon-32x32.png
create mode 100644 website/static/img/favicon-96x96.png
create mode 100644 website/static/img/favicon.ico
create mode 100644 website/static/img/ingest-query.svg
create mode 100644 website/static/img/logo.svg
create mode 100644 website/static/img/pinot-320x320.png
copy {docs => website/static}/img/pinot-architecture.png (100%)
create mode 100644 website/static/img/pinot-components.svg
create mode 100644 website/static/img/pinot-navbar-logo.svg
create mode 100644 website/static/img/pinot-overview-dark.png
create mode 100644 website/static/img/pinot-overview-light.png
create mode 100644 website/static/img/pinot-overview.svg
create mode 100644 website/static/img/pinot-query.svg
create mode 100644 website/static/img/pinot.png
create mode 100644 website/static/img/pql-query.png
create mode 100644 website/static/img/pql/pql-query-console.png
create mode 100755 website/static/img/undraw_docusaurus_mountain.svg
create mode 100755 website/static/img/undraw_docusaurus_react.svg
create mode 100755 website/static/img/undraw_docusaurus_tree.svg
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org