You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by xi...@apache.org on 2020/05/02 04:54:12 UTC
[incubator-pinot] branch jsonpath_function updated (0f94d9f ->
493518d)
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch jsonpath_function
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard 0f94d9f Adding more tests
discard 382d5f6 Adding integration test
discard 21e2810 Adding json_path function to extract field from json object
add dbcbd2e [TE] Empty Entity report bug fix (#4598)
add 5e525d0 [TE] Exclude template/blacklist emails before sending out alert (#4601)
add 0a32309 [TE] fix create alert error message NPE (#4594)
add e70a781 Add ApacheCon Slide to README file (#4604)
add 67ea9bb [TE] Merger fix to consider anomalies generated earlier (#4565)
add f5017be [TE] Redesign to support multiple Alert Content formatters (#4599)
add add0f07 [TE] Update AI Availability table (#4606)
add fe7fff6 [TE] Add anomaly type for merged anomaly result (#4605)
add 8f9bb5d [TE] Remove the logic of reading stderr from phantomjs to avoid zombie processes (#4611)
add 45205e8 [TE] frontend - harleyjj/alert-details - handle reported anomaly for anomaly table (#4587)
add fe29287 [TE] frontend - harleyjj/auth - handle expired token and 401 errors plus redirect after login (#4580)
add 76fcc86 [TE] frontend - harleyjj/ai - fix small bug in AI Availability (#4600)
add 09207f9 [TE] consider anomaly type during merge (#4613)
add 8d593f3 [TE] Bug fix to initialize the configDAO (#4616)
add c7b647a [TE][Composite-Alert] Entity Anomaly Merger (#4609)
add c87b110 [TE] Add data set display name and show it on UI (#4619)
add 239237e [TE] the last time stamp filter out the anomalies (#4621)
add 44d1ce9 Remove import of sun.misc.Cleaner to make code compatible with jdk11 (#4624)
add 04c4dc2 Revert "Remove import of sun.misc.Cleaner to make code compatible with jdk11 (#4624)" (#4625)
add eda4176 [TE] [Notification] Refactor email filters to a generalized alert filter (#4620)
add 3668c79 Documentation update for realtime Pinot (#4630)
add f8c2cf3 Put order-by expressions in front of selection expreesions in selection DataSchema (#4629)
add a0c84fe Implement DISTINCT (#4535)
add 761ce2f Add APIs to get leader for all tables or a given table (#4545)
add 31594da Replace Hashmap to Object2IntOpenHashMap in OnHeapStringDictionary (#4568)
add 283a495 Revert "Set processingException when all queried segments cannot be acquired (#3942)" (#4632)
add 49a65a3 Support default value for Byte column (#4583)
add e447117 Remove import of sun.misc.Cleaner to make code compatible with jdk11 (#4634)
add ffa66bf Refactor ControllerLeaderLocator (#4553)
add f30d83b Adding documentation for Pinot Schema. (#4637)
add 07c74b1 User doc for Star-Tree index (#4640)
add c563b82 Add license header for star-tree document (#4641)
add bd1af57 Adding section describing defaultNullValue in Schema page. (#4642)
add 4c4800b Support HTTP POST/PUT JSON schema (#4639)
add 09d3735 Remove sun.misc.Cleaner import (#4643)
add a734931 Add metrics for the number of partitions for which controller becomes leader (#4633)
add c44d371 [TE] fix email alerter throw exception (#4647)
add 0b4fc0c Documentation for completionConfig (#4636)
add ca01c86 [TE] frontend - harleyjj/rca - make first column scrollable in dimensions-algorithm table (#4631)
add 577f1cf Do not update download URL and crypter when segment is not refreshed (#4593)
add d30dfb0 Standardize the Dictionary interface, ensure the BYTES support (#4622)
add 4b5c5ac Misc fixes for aggregation functions (#4579)
add b0fe681 Support ORC files as data source in segment creation (#4635)
add bfb518e Add integration test for ControllerLeaderLocator (#4567)
add b24816a Adding sample ADL settings to documentation (#4645)
add dd4e69e Use timed wait around get() calls in PinotInstance (#4649)
add 9cfcd30 Simplify the logic of List handling in DataTypeTransformer (#4651)
add d6f9655 Implement all transform function APIs for MapValueTransformFunction (#4595)
add ad391dd Enable distinct and throw exceptions for not-supported cases (#4648)
add bb5913f Enabling alternative controller rest API classes in preprocess (#4646)
add 7eccc99 Revert the binary-search change for MapValue transform function (#4654)
add 8b24ec4 Fix the DistinctCountHLL with serialized HyperLogLog of non-default log2m (#4655)
add 8193e52 Refactor TransformBlockDataFetcher into RowBasedBlockValueFetcher (#4658)
add 8a80760 Refactor toggleInstanceState API (#4560)
add 7662937 Make TransformFunction.getDictionary() API consistent with DataSource.getDictionary() (#4661)
add 26a0696 Added documentation for split commit (#4660)
add 0b69aab [TE] Clean up legacy group id and name logic (#4656)
add 639f94e [TE] frontend - harleyjj/alert-details - update Alert Overview to align with new API (#4659)
add 97f8ef3 [TE] frontend - harleyjj/alert-details - add comparison to preview (#4638)
add 9746e82 [TE] Clean up legacy detection related classes; update ADContentFormatterContext (#4657)
add b07436f Support other filesystems for Pinot Hadoop job (#4664)
add 48edd8d Support serialized BYTES data with non-default factor (#4666)
add df183d5 [TE] Accelerate yaml listing (#4670)
add b75876c Fix flakiness in BoundedAccountingExecutorTest (#4674)
add af48abc Mocking out the LeadControllerManager in test (#4677)
add bed6efe [TE] Improve logging - log the job name with every log line (#4675)
add 8273f66 Update Getting Started documentation. (#4615)
add 849ebcb [TE] frontend - harleyjj/comparison - fix bugs from mini bugbash (#4672)
add 492d780 Apply several fixes in realtime segment manager (#4669)
add 8249b6b Make GenericRow support null value fields and default null values (#4671)
add 73eb06d Ensure segment converter not fail for schemas without time fieldSpec (#4680)
add aa04c57 Remove validation for config controller.host (#4681)
add 18a9f2f Use guava cache for instance admin endpoints (#4678)
add 2d20c64 Possible fix for NPE seen in this test. (#4684)
add ce298ba Unit tests and bug fixes for DeleteTable rest API for controller. (#4608)
add 51c7a0f Modify get tenant names APIs (#4688)
add 9362ba4 First pass of GROUP BY with ORDER BY support (#4602)
add cf627b2 Add groupByMode=sql and responseFormat=sql options to query console (#4694)
add bcc74f8 Fetch new schema when loading committed real-time segments (#4693)
add b824b48 Remove "refresh" usecase check in RoutingTableBuilderFactory (#4687)
add 2a3fcde [#4667] Fix auto-tuning algorithm to update when parameters are changed (#4679)
add c37dc02 Remove the temporary code for the selection fix (#4696)
add 4d68dd1 [TE] frontend - harleyjj/comparison - set getAnomaliesError in any error catch (#4697)
add f58ba2d [TE] [notification] JIRA alerting framework (#4682)
add c17827f Fix simple date time column segment generation test (#4698)
add cf954ae [TE] remove erroneous import (#4691)
add 144cd98 [TE] handle data insufficient exceptions in the detection pipeline (#4685)
add 7540702 Enhance Selection Comparator (#4702)
add 4f997af Add documenation for queryOptions groupByMode and responseFormat (#4708)
add f81e07a [TE] changed retention and Pinot metadata sync frequency (#4700)
add 1ddbd6e Clean up metrics (#4710)
add 13ebf49 [TE] frontend - harleyjj/alert-details - add flags for tracking state of anomalies (#4709)
add f8b8f27 Adding option to load a Pinot segment as post creation verification (#4706)
add 0ebd321 [TE] check start time in range when deciding if needs notification (#4699)
add eed7c1a [TE] [notification] Multi-dimension based conditional alerting (#4703)
add 770381f correct detection name for holt winters (#4650)
add 4f386bc [TE] frontend - harleyjj/packages - update node and front end packages (#4683)
add 5f01357 fix small typo in log message (#4707)
add 6ee6a41 [TE] Add unit test for DetectionEmailAlerter - fix casting bug (#4717)
add 3579aae Remove the segment missing error message when acquiring segments (#4714)
add a78ac5c [TE][RCA] Fix the broken RCA algorithm tab (#4720)
add dc17239 Package parquet and orc record reader into shaded jar (#4716)
add f245b5e [TE] support row count metric for Pinot (#4718)
add e9e6a33 [TE] frontend - harleyjj/alert-details - handle concurrency errors in alert details component (#4721)
add a6f8f1e [Resource Assignment] Plug in resource assignment to LLC REALTIME table (#4695)
add 860cb92 Enable full stack trace when there is an exception during tests (#4727)
add 6bc6e55 Optimize MutableOffHeapByteArrayStore by directly calling the PinotDataBuffer API (#4362)
add c1a0944 [TE] Fix ignored timeout by checking Thread.interrupted (#4690)
add 15bde95 [TE] web - harleyjj/rca-session - save dimension-algorithm table settings with session and load them (#4712)
add 2f3cd43 [TE] put default settings for subscription YAML (#4723)
add f015c68 Add sql query command (#4726)
add 1b8cdd8 Fix comparison to pick the right minimum value for hash-set (#4588)
add 3a77194 Enhance the exception handling in TableRebalancer (#4734)
add ac5ada2 Catch exception when checking lead controller resource is enabled (#4736)
add b00b66c [TE] correct time format before send query to Vertica (#4548)
add 2f72432 Fix state change when consumption is stopped (#4739)
add 9c84de7 Changing error log to warn in SegmentPreprocessingMapper (#4735)
add 7d66875 Implement OffHeapMutableBytesStore for real-time var-length bytes store (#4385)
add 5af88ef [TE] frontend - harleyjj/alert-details - fix more preview comparison bugs (#4738)
add f3b6617 Make Kafka offset out of range as an transient exception. (#4618)
add 494ff8a Optimizations for IndexedTable resize (#4728)
add a8c6f8d Adding bootstrap mode for Pinot-hadoop job to output segments into relative directories. (#4742)
add 3c3c716 Fix a wrong option name for AddSchema in the information log (#4746)
add 1f5bf57 Presence vector (#4585)
add 74aea85 [SegmentGeneratorConfig Cleanup] Replace checkTimeColumnValidityDuringGeneration with skipTimeValueCheck (#4745)
add 04f2b7c AvroSchemaToPinotSchema should return immediately if outputDir doesn't exist (#4751)
add 716a3b2 Clean up duplicate/unused metrics in controller (#4750)
add 4f849ea [New Transformation function] DateTrunc: Identical semantics to presto's date_trunc (#4740)
add 4fc317b First commit, Fixed a typo in ReadMe (#4755)
add 5b97d06 fix issue #4115, change replaceAll() to replace (#4116)
add b30a692 [TE] frontend - harleyjj/alert-details - comparison revisions and facelift based on feedback (#4749)
add 8040b09 [TE][notification] Ability to reopen and reuse existing Jira tickets for alerts (#4748)
add 367f7e4 [TE] Merge anomaly properties (#4744)
add b48c412 [TE] frontend - harleyjj/alert-details - remove duplicate key from component (#4760)
add 07bd379 Bug fixing: Json decoder extracts wrong time field value if schema contains outgoingTimeFieldSpec (#4758)
add 5439e77 Helm chart templates for Pinot deployment and quickstart example (#4725)
add 6d3c7de Introduce a mode in the server to disable queries (#4767)
add 22aa781 [TE] deactivate metrics instead of deleting (#4768)
add 2ce7502 Fix the bug of releasing the segment when there are still threads working on it (#4764)
add 5d30495 [TE] endpoints - harleyjj/alert-activation - make endpoint for toggling alert activation (#4763)
add f0c95dd [TE] Clean up ADContentFormatterContext (#4765)
add 4afabca Show all items in the side menu (#4770)
add a3977b9 [TE] frontend - harleyjj/self-serve-alert-yaml-details - add toggle button for activating/deactivating alert (#4769)
add fa07579 Simplify the constant calculation in CombinePlanNode (#4772)
add 4f3d650 [TE] Configure default alerter before constructing properties (#4771)
add 19ccfe0 [TE] Extending Jira Merge capabilities for supporting dimensional alerter (#4766)
add faa068d [TE] add event trigger listener for scheduling (#4724)
add 1c66672 Adding superset demo example (#4779)
add 6026746 [TE][notification] Minor tweeking of jira alerter (#4776)
add b2b1852 Adding example for azure (#4781)
add 0614310 Prepare License and Notice files for 0.2.0 release (#4782)
add 23303ec [TE] minor naming change on ThirdEyeAnomalyConfiguration (#4785)
add 363d47f [TE] fix the bug that the moving window might span beyound the monitoring end time (#4787)
add 5193287 Enhance CombineOperator (#4773)
add 052b73b Enhance Selection Comparator 2 (#4788)
add 4445fdc Fix the bug of uneven task distribution for threads (#4793)
add 8147714 Adding example for aws (#4789)
add aba5482 Data Anonymizer Tool (#4747)
add 343aadb Disable compression when numPartitions are less than the threshold (#4797)
add 8516fdb [TE] frontend - harleyjj/alert-details - small patch for dimensions column in anomaly table (#4799)
add ea3ef34 Add query options from json to existing query options, instead of overriding (#4786)
add ed4e3ae [TE] Initiate docker for ThirdEye (#4780)
add 7790e15 Fix controller download segment api on non-local PinotFS. (#4757)
add 98140bc Decouple Key from Record (#4798)
add 103f538 [TE] Remove datepartition for presto queries to unblock other usecases (#4802)
add c9f465a Revert "Fix controller download segment api on non-local PinotFS. (#4757)" (#4804)
add 64e1342 Small typo fix (confifurations -> configurations) (#4805)
add a92d88d [TE] revert the default settings; update indexes on task table (#4810)
add 01b1de5 Include dataSchema in the ResultTable to retain column type information (#4807)
add b9fd128 Adding pinot presto docker image (#4812)
add e92f94b [TE] Fail alert task if unable to notify receipients with exception of dimensions alerter (#4811)
add 895c7ee Make default timeout to 15s for all queries in tests (#4813)
add e6624fe [TE] Set non additive dataset for Pinot (#4803)
add 36ef2c3 [TE] frontend - harleyjj/homepage - homepage facelift and default to application tier0-tier1 if none chosen (#4794)
add 5282e11 [TE] frontend - harleyjj/alert-overview - fix report anomaly bugs (#4816)
add a7b4aff [TE] web - harleyjj/rca - add detectionConfigId to anomaly entity attributes (#4821)
add 094fffa [TE] frontend - harleyjj/rca - add link from RCA to Alert Overview whe RCA is exploring an anomaly (#4822)
add 2e221e6 [TE] frontend - harleyjj/preview - disable preview button instead of removing from DOM (#4485)
add 3ffbab9 [TE][notification] Minor cleaning up of the jira related code (#4814)
add 1f79d29 Bug Fix: Fix segment download url in SegmentZkMetadata. (#4825)
add d764ea6 Enhance table rebalance rest API argument check (#4824)
add 648d02a Replace ServerInstance with ServerRoutingInstance for Broker scatter-gather (#4817)
add eb45b43 [TE] add event driven scheduler (#4777)
add 57f67c9 Refactor segments admin rest APIs (#4806)
add 75dbe8c Enhance RoutingTable with ServerInstance (#4823)
add 687ac69 Reorg k8s related scripts structure and update readme (#4827)
add 85c7f5a Add segment batch deletion rest API (#4828)
add c33da6b [TE] change default time zone to pacific time zone (#4830)
add d493707 Add user guide for pluggable storage for realtime table (#4783)
add 54a4991 Misc enhancements to the broker routing (#4831)
add 3c00da7 [TE][notification] Jira Alerting improvements (#4829)
add 12dd36c [TE] fix mismatch in dataset names in data availability listener (#4832)
add a9f6591 Replace NettyTCPServer with QueryServer for server side query handling (#4834)
add 2189c92 Adding example of pinot-quickstart with Avro encoded messages in Kafka (#4836)
add 2f203df Support ORDER BY for DISTINCT queries (#4790)
add 8763494 Fix documentation on LLC configs (#4839)
add e189f5e Refactoring realtime segment committer (#4713)
add 94f687a Handle default value after adding new byte column (#4844)
add 81703be [TE] Centralized cache proof-of-concept for anomaly detection via Couchbase (#4761)
add c720b99 [TE] quick fix for error in retriving legacy anomaly (#4843)
add 5e5b32f Remove the support of Hocon based config (#4841)
add 9403cf1 Remove the redundant testSqlQueriesFromQueryFile() in integration tests (#4848)
add e1b3512 Prepare for pinot release 0.3.0 (#4849)
add e6e7bf9 [TE] Use default centralized cache settings if exception occurs during init (#4845)
add 1cc296b [TE] Fix duplicate entries in entity report (#4840)
add 759eee9 Add getFinalResultColumnType to be used in constructing ResultTable::dataSchema (#4852)
add dada6e2 [TE] Minor fix on DataAvailabilityTaskScheduler (#4853)
add 2f18f65 [TE] add detection health for the alerts list (#4842)
add 0f64e4a Fixing encryption for .tar.gz upload (#4855)
add 98f8c9a [TE] Update AI Availability dashboard to v2 (#4857)
add c0f8b7a Fix the controller rest API for non local FS. (#4808)
add 5c02b14 Split BrokerReduceService code into several DataTableReducers (#4851)
add 54fb020 [TE] Enable local debugging of CSV data (#4826)
add b558e81 [TE] add default constructor for detection health status (#4861)
add a2a27d8 [TE] Refactor the fetch anomalies interface to incorporate config id within the anomaly slice (#4846)
add 9881764 Introduce the base JSON config class and clean up the config classes (#4858)
add 8ba44af Fix the usage of removed guava API (#4864)
add 05c89fc Enhance TagNameUtils to handle the TagOverrideConfig (#4859)
add 03ae23c [TE] Check if snapshot exists before attaching file (#4867)
add fdfe8a2 Misc clean up for PinotHelixResourceManager (#4865)
add 1ba6205 Removing segment generation config from RecordReader interface (#4866)
add 63ceb0c Adding pinot-spi module and moving record reader interface (#4869)
add 3e7cbfa Pinot Ingestion Jobs Refactor with Pinot Spark Support (#4800)
add 3486022 Pushing PinotFS to pinot-spi (#4871)
add 64312f4 Adding pinotFS.open(URI) method to pinotFS (#4873)
add db91339 [TE] clean up some legacy code (#4837)
add 5d0bcca [TE] frontend - harleyjj/bugs - Dont filter zeroes from bounds and display error message on create alert (#4868)
add f3558b6 Capture the exact UPDATE operation in DefaultColumnHandler (#4876)
add 2201a22 [TE] Generify centralized cache DAO and add certificate-based authentication support for Couchbase (#4862)
add 3ec7548 Add getResultColumnName API to AggregationFunction to fetch sql compliant result name (#4870)
add 8d08bcc Clean up the connection-pool based broker routing (#4850)
add 82359d0 Use Files.createDirectories instead of File.mkdirs in (#4878)
add d15b33a [TE] Bug fix in the rca dashboard/summary endpoint (#4880)
add 2552c0f Refactor pinot record reader dependency (#4872)
add a93f129 Simplifying interface related to StreamLevelConsumer (#4883)
add 79407b5 Failure to recover after segment reload failure does not release segment lock (#4882)
add 423692b Pinot ingestion job - Standalone (#4874)
add c37fa7d Moving stream related apis to pinot-spi (#4884)
add c93c523 Fix small typo in README (#4886)
add 1d84514 After pulling in the latest changes, mvn clean install fails. (#4887)
add 3e285e0 Results in ResultTable if responseFormat=sql (#4877)
add bc87b48 Refactor file format based RecordReader constructors (#4888)
add 7b4a4e7 [TE][notification] Support configuring reference links per dimensional recipients (#4893)
add fc12121 [TE][notification] Make alertScheme and alertSuppressor consistently use Map<String, Object> (#4892)
add 23d1437 Adding example of k8s presto-worker deployment (#4895)
add ef42fc4 Moving crypter classes to pinot-spi (#4897)
add 3a3f536 [TE] Handle sql time format yyyy-MM-dd-HH (#4898)
add aca933f Build shaded jar for all record readers (#4896)
add e01ccc2 Initial code dump for dynamically loading pinot plugins (#4899)
add e4c3b56 [TE] Stop producing so many logs -- don't check for holes in the middle of timeseries for complete cache misses (#4890)
add 6bf7f64 [TE] Prefetch based on data granularity in dimension exploration jobs (#4894)
add b934d10 Support multi-value in data anonymizer (#4905)
add 1c582ed Remove deprecated server config keys (#4903)
add 29d88fb Replacing usage of Class.forName with PluginManager.createInstance (#4907)
add 58ff866 [TE] clean up and fix bugs in notification pipeline (#4908)
add d046db1 Removing dependency on Hadoop (#4909)
add fb5556c Cleanup avro dependencies (#4915)
add cb78869 Fix formatting in README (#4918)
add 32b6ff0 Remove the redundant AvroSchemaUtil and fix the build (#4922)
add 7cab902 Support ORDER BY and BYTES in data anonymizer tool (#4910)
add acaa78d Re-implement FileUploadPathProvider and distinguish dataDir and localTempDir (#4913)
add 78bd737 Clean up the un-necessary split for IN/NOT_IN predicates (#4924)
add 08c0c2b Modifying segment fetcher doc to v2 endpoint (#4923)
add a9b7b52 [TE] add documentation for centralized caching in ThirdEye (#4917)
add 06c7e7d Moving dependencies and enabling a shaded jar (#4930)
add a55a13a [TE] frontend - harleyjj/timeseries - no bounded region for threshold (#4931)
add 9a30e0c [TE] frontend - harleyjj/alerts - detection health for alerts page (#4921)
add 6d5ea12 Misc fix for pinot spi (#4932)
add d4e367a Fix infinite loop when fetching anomaly (#4935)
add d196f3f [TE] frontend - harleyjj/rca - pin graph tooltip to fixed position (#4936)
add da9d997 Fix the issue of server not registering state model factory before connecting the Helix manager (#4929)
add 4391b40 changing pinot-avro dependency scope to test from compile (#4937)
add f48370c [TE] web - harleyjj/subscription-groups - add application field to subscription group objects (#4938)
add 7bd5a7e Removing pinot-common dependency from pinot-hadoop-filesystem and pin… (#4939)
add c2e6251 Removing dependency on pinot-common and pinot-core from pinot-connect… (#4940)
add 34351de Refactor virtualColumn (#4774)
add b250439 Update schema API to reload table on schema change when applicable (#4838)
add 0826de5 Implement GcsPinotFS (#4911)
add 8619391 Refactor SegmentFetcher to handle retry for all URIs (#4942)
add 09db4d9 Adding basic null predicate support (#4943)
add b4cd708 Clean up BitmapInvertedIndexReader (#4934)
add 5b5dfe8 Restructuring Pinot Plugin Modules (#4946)
add dec307e Moving pinot-api to pinot-clients/pinot-java-client (#4947)
add cc4a213 Fixing CreateSegment and quickstart (#4948)
add c6d4aaa Cleanup pom files (#4949)
add 2fc5e5d Move gcs filesystem dependencies out of root pom (#4951)
add 0200407 Adding profile goal to generate shaded jars for all plugins automatically (#4950)
add fd75576 Fix the client id to be topic and partition (#4955)
add 499f03f Rename stream plugin pkgs (#4957)
add b9b146d Fixing Stateful sets Provisioning Failure of PVC in GKE (#4945)
add 9edad92 Make plugin manager to load plugins based on environment variables (#4956)
add 247af5d Add schemaFile as option in AddTableCommand (#4959)
add a73e78b Package rename pinot-plugin modules (part of #4941). (#4963)
add 97c7118 adding examples for standalone batch ingestion (#4965)
add 17b2360 Sql query endpoint "/query/sql" (#4964)
add 5503d4d Rewrite single value IN predicate as EQUALITY. (#4847)
add f15a7b0 Add error for empty instance list for tenant API (#4969)
add b5d1f42 Remove Kafka and Stream dependency on avro (#4968)
add 97a3c21 Refactor pinot-batch-ingestion job specs to pinot-spi (#4967)
add 2a9df4e Cleanup plugins dependencies of `pinot-parquet` and `pinot-gcs` (#4971)
add ca0b590 Update quickstart and examples (#4970)
add e81e530 Support STRING and BYTES for no dictionary columns in realtime consuming segments (#4791)
add 37886c4 Make pinot-distribution to build a pinot-all jar and assemble it (#4977)
add 4fa5090 Changing the rebalance strategy from Crush to AutoRebalance for controller (#4972)
add a0fd481 Fix the exception in server instance when Helix starts a new ZK session (#4976)
add 35346c9 Make the rebalance strategy configurable for lead controller resource (#4981)
add 5919af1 QueryServer need not be a runnable (#4980)
add 29c6b39 Adding pinot-batch-ingestion-spark (#4975)
add 6d98cd6 Make quickstart working with IDE (#4986)
add 0eb1c93 [TE] Throttle MySQL write when storing anomalies (#4991)
add 1f4080c Rename pinot quickstart (#4992)
add 71b0b58 [TE] Support weekly anomaly detection (#4988)
add 7ff9dd4 [TE] Fix over-scheduling tasks in data availability scheduler (#4984)
add f990656 Pinot batch ingestion hadoop (#4987)
add e46eec3 Make PQL case insensitive (#4983)
add e29b88a Fixing java 11 runtime issues (#4998)
add 5b031c3 [TE] change anomaly fetching to use intersection (#4996)
add 0f7d8cf Update dockerfile for pinot image and pinot-presto image (#4997)
add 49a56fa Make PQL use LIMIT N if TOP N is not set (#4999)
add e18f1a1 Only set LIMIT N to group by TopN when it's larger than 0 (#5003)
add 696a04a Enhance TableRebalancer to be able to rebalance table under any condition (#4990)
add c6065ae [TE] weekly detection - time zone daily boundary alignment (#5004)
add c3117d0 Handle sun.nio.ch.DirectBuffer cleaner behavior for jdk 8+ (#5002)
add 0819c1e [TE] frontend - harleyjj/alert-details - show bounds for minute and day granularity in Alert Overview (#5000)
add 1f876c6 update docker image location (#5007)
add 4d61045 Supress runtime logging warnings for java 11 (#5001)
add 94c7675 Exclude slf4j from pom (#5010)
add 995ad83 Calcite SQL compiler syntax support for order by expression and set LENIENT SQL conformance (#5005)
add 4ebdb08 fixing converting PinotQuery to BrokerRequest for group by clause with selections (#5014)
add 132009c Make sql as default query format. (#4994)
add 23a4c04 Adding script for local port-forwarding and open PrestoUI console (#5017)
add 14d790f Add documentation to fields of important query execution stats. (#4989)
add 9410dd1 [TE] Use upper and lower bounds as predicted for threshold algorithm (#4960)
add f6d33be For RANGE predicate queries touching offline segments, use sorted inverted index (#5013)
add 96a55cb [TE][detection] Implement anomalies cache to speed up detection (#4900)
add 1d0c936 Enhance TableRebalancer to support reassigning COMPLETED segments when instances changed (#5015)
add daf02ac Make output schema to match selection list for aggregation groupbys (#5019)
add 37618fb Upgrade Helix version to 0.9.4 and re-enable two integration tests for pinot-minion (#5020)
add f1d21b0 Added execution command for prestoUI in the readme (#5021)
add 622e00e Support alias replacement in PinotQuery (#5016)
add a1d8e03 Fix benchmark client (#4933)
add 0e12cb7 Support arithmetic operators like '+','-','*','/','%' (#5018)
add 6a97127 Decouple server instance id with hostname/port config. (#4995)
add 0c1be2f [TE] auto enable data-availaibity trigger for PINOT detections without cron (#5009)
add 01a9187 [TE][bug] Bring back the cleanCode method accidentally removed in #4900 (#5024)
add 73b93da [TE] Allow fallback for out-of-window cases (#5025)
add 76d6934 [TE] frontend - harleyjj/alert-details - fix anomaly chart mapping to be robust against imprecision (#5012)
add 9232f59 [TE] endpoint - harleyjj/yamlresource - add dataset as an optional param for yaml/list (#5011)
add f3b24d6 Use NetUtil.getHostNameOrAddress instead of localhost (#5029)
add 9b5bdbb Enable sql test query file (#5028)
add 8c91911 Support cast as a transform function (#5030)
add bef6fda Do not derive host/port from instance id in HelixServerStarter (#5027)
add 89fec1e Change SqlConformanceLevel from LENIENT to BABEL (#5031)
add 0b3a60d [TE] Add reference link to labelling anomalies in alert notifications (#5037)
add f5fe4af fixing start kafka command (#5042)
add 157f128 Ignore Hadoop Segment Build PushOfflineClusterIntegrationTest (#5049)
add ec0da53 Fix logging in HadoopPinotFS (#5050)
add f515ae4 Set alias name in resultTable schema names (#5033)
add b4b1512 Add forceDelete option for task queue deletion (#5051)
add b9e4d7d [TE] frontend - harleyjj/alert-details - bug fix and consolidation of anomaly filtering to a method (#5048)
add 0a1c17a [TE] weekly detection - holt winter algorithm prediction window alignment (#5052)
add 49f890b Reduce docker image size (#5047)
add da4e3de Remove unnecessary pom in pinot-plugins targets (#5036)
add 935baf7 Adding backward compatible classname mapping from old plugins classname (#5035)
add d6222f5 Fix shutdown method in HelixInstanceDataManager (#5055)
add c6743c0 Enhance the task related rest APIs (#5054)
add 783cb38 Add FieldConfig to encapsulate encoding, indexing info for a field.(#5006)
add c9d88e4 Fix the assumption of 'SERVER_' hostname prefix for admin endpoint cache in PinotHelixResourceManager (#5057)
add 1f4605b Add skipShade option (#5053)
add 2adf39e Update travis tests (#5045)
add 4665d8a Close Kafka consumer before building or downloading immutable segment (#5039)
add 2452961 Improvements to data anonymizer tool (#5061)
add 4af1f61 Minor fix on MapBasedGlobalDictionaries (#5063)
add c39a002 Another minor fix on MapBasedGlobalDictionaries (#5064)
add d7eeb44 Update quota manager to reduce zk access (#4979)
add bfa176c Update Selection Query Limit with pre-configured value (#5040)
add 7cca144 [TE] [data-availability] Scheduling of data availability tasks & some clean up (#5056)
add 7f6afdf [TE] detection health - generate task status in monitoring task (#5065)
add 344bade Re-design the broker routing (#5046)
add 2a79531 Support Text Search (#4993)
add a257935 Support no global-dictionary columns in data anonymizer (#5071)
add 4be7490 Use getResourceAsStream to load test resource file packaged inside (#5072)
add 9c65deb Reduce the non-determinism in lucene integration test (#5077)
add 94122e8 [TE] frontend - harleyjj/alerts - update application filter for many-to-many relationship (#5062)
add 884af43 [TE] Remove fromAddress as a compulsory field from subscription group (#5078)
add 4779341 Disbale text query realtime integration test (#5079)
add 3c78a8c [TE] add initial delay upon receiving events in scheduling (#5060)
add c613f46 [TE] Adjust dectection window using expected delay (#5059)
add 7dfc5c1 Adding quickstart into Pinot admin command (#5080)
add ef69b75 [TE][subscription] Fix duplicate anomaly report issue and clean up subscription pipelines (#5081)
add 35f2117 [TE][subscription] Minor bug fix in the empty email check (#5084)
add 21850ba Support text index load for V1 segment format (#5085)
add d5c8398 Support creation of inverted index on a new column in V1 segment (#5087)
add 4124563 Support segment reload for text index (#5074)
add e44192e Support embedded parsing in PinotDataAndQueryAnonymizer (#5088)
add f247e77 Plug in the new routing introduced in #5046 (#5082)
add ef6509e Minor improvement for RoutingManager (#5092)
add b2608ad [TE] Upgrade mysql version to 5.1.41 to fix compatibility issues connectin with 8.* (#5093)
add 0e56960 Fix a typo in RoutingConfig (#5096)
add 26ead7d [TE] add dependencies for enabling ThirdEye https connections (#5095)
add fdfb97e [TE][subscription] Dimension Recipient Alerter should be agnostic to individual errors; Emit metrics to track emails and jiras (#5091)
add 3126d56 Support non-literal expressions for right-side operand in predicate comparison (#5070)
add 3c91a6d Remove the support of the old Star-Tree (#5086)
add 00fd911 [TE][subscription] destroy jira connections after use (#5097)
add 754532e9 [TE] Change the jetty version to be compatible of loading the certificate for HTTPS (#5099)
add b880c47 Fix the duplicate broker refresh message (#5102)
add 9f33abe [TE] Add additional safeguard around jira description length (#5100)
add 16e6fbf [Cleanup] Remove the old broker routing (#5101)
add 9abf0a4 Adding PinotClusterConfig APIs in controller and corresponding Pinot Admin SubCommand: OperateClusterConfig (#5073)
add 0f514cb Defaulttenant for hybrid quickstart and example queriesDefault tenant and example queries for hybrid quickstart
add 67450de Refactor existing Message Handler to update query quota on broker (Part 1) (#5066)
add 067915b [TE] pinot - harleyjj/yamlresource - skip parse errors and log when returning detection configs (#5109)
add ef75b02 Update rate limiter when table config updated on controller (Part 2) (#5067)
add 72f7775 [ThirdEye] OTHER now show the nodes that are not picked up by the summary (#5090)
add f267c86 [TE] frontend - harleyjj/rca - add tooltip for Dimensions tab to explain Cube Algorithm (#5098)
add f2969b8 [TE][api] create or update subscription config api (#5111)
add dd768ea [TE] frontend - harleyjj/alert-details - put correct tail value in anomaly for graphing (#5110)
add edf1ce6 Bugfixing the issue for ThreadLocal DocIdSet in ExpressionFilterOperator (#5114)
add 565374b Fix the backward-compatible issue for `PartitionAwareRealtime` routing (#5120)
add 8ec8499 [TE] added a couple of validations to check if detection is subscribed & valid; cleaned up other validations (#5113)
add 2ec6ed8 Synthetic Time Series Generator for pinot-tools (#5118)
add 91850cd [TE] Cleaned up default detection & subscription yaml (#5121)
add 3369a9d Fix the ExpressionFilterOperator (#5122)
add e6bff84 Fix default value for dictionary byte column (#5123)
add 5096a37 Always copy test data out from jar file (#5119)
add 155cb3b Fix PostQuery command to accept queryType. Use Request in Connection and PreparedStatement to execute sql (#5112)
add ce3b46e Change console loggers to non-async for pinot-tools (#5126)
add a6c903d Bump jackson.version from 2.9.9 to 2.10.2 in /thirdeye (#5094)
add 83215f0 Fix a NullPointerException that can occur if an Exception is raised when reading a JSON Record file. (#5128)
add 43db343 pinot-quickstart companion container for thirdeye (#5125)
add a91ffd6 Fix an NPE that is encountered when the offline table config does not specify a time column but the realtime table config does. (#5131)
add 76f9c53 Support schema evolution for consuming segments (#4954)
add a5fb1bd docker - generator script for synthetic time series in pinot (#5134)
add 3e451e7 Refactor the data source to include all information needed for query execution (#5115)
add 330f37f Fix the NPE when no segment exists in RealtimeSegmentSelector (#5138)
add 5c7ece2 Add test for RealtimeSegmentSelector for no segment scenario (#5139)
add d8fabec [TE] database - add missing schema fields and index to application_index (#5124)
add 6d8c60a [TE] Minor corrections to the default yaml template (#5140)
add 46698d8 Update links in README to latest docs (#5141)
add 6daeb59 Fix the default value provider classes (#5137)
add f7f9f4a Fix hybrid quickstart (#5143)
add 6b6fa56a Update license and notice (#5145)
add 888700d [TE] Remove validation to make recipients backwards compatible (#5149)
add 82cfbdd Fix a formatting bug in AggregationFunctionUtils (#5148)
add d15a91a update pinot assembly scripts (#5146)
add d989427 Fix the SQL group-by for empty data table (#5151)
add 494874d [TE] Detection creation endpoints should trigger Replay & Tuning (#5142)
add be37b56 Refactor value based segment pruner to work on DataSource instead of ColumnMetadata (#5144)
add 9933870 Move SegmentMetadata from pinot-common to pinot-core (#5156)
add 4be032a [TE] frontend - harleyjj/alert-details - stop showing bounds for minutely granularity on Alert Overview (#5157)
add 1376331 [TE] Setup a test Github workflow for ThirdEye (#5158)
add c81a656 Add Azure Data Lake Gen2 connector for PinotFS (#5116)
add bbaa1d9 [TE] anomaly detection model downloader (#5155)
add 8eb5933 Updated Readme with Pinot clients and replace gitter badge with slack (#5164)
add e442bb9 Updating readme (#5133)
add 917493f Optimization for selection only queries: Allow early termination (#5163)
add 32a54ae Fixing the missing fields in k8s helm template and reduce hardware & jvm requirements to start up pinot stack (#5161)
add 2e800e0 Fix the NPE for DISTINCT aggregation function when no record is selected (#5154)
add d289db8 Add QueryConfig to TableConfig with the query timeout setting (#5162)
add 56f3e97 Fix the bug of broker not able to handle json format rest api response (#5170)
add b8a4a1e [TE] frontend - harleyjj/rca - add Alert Correlation events to RCA event table (#5136)
add 977c79c [TE] frontend - harleyjj/rca - cube table updates (#5159)
add 2cfbe7e [TE][subscription] update subscription watermarks to use anomaly create time instead of end time (#5152)
add 562180d [TE] Remove hard-coded server data datetimeformatter (#5171)
add 20b1da9 Add Confluent Schema Registry Avro Message Decoder (#4973)
add ef32b27 Fix selection early termination test (#5173)
add 385c0d3 [TE] Fix issue of displaying latests data in the speed-up case (#5165)
add ae484e5 Table level timeout implementation (#5169)
add b8ed426 Add EarlyTerminationException to prevent logging too many invalid error messages (#5174)
add 28f2643 Fix the numEntriesScannedPostFilter field test in SelectionOnlyEarlyTerminationTest (#5179)
add 4a6b21d Fix docker compose & quick start (#5178)
add b274d02 Prepare for pinot release 0.4.0 (#5186)
add ed235d2 Add a simple PinotFS benchmark driver (#5160)
add 8ff155a Change the name for azure data lake gen2 implementation (#5188)
add 48fb505 Change readme link to gitbook for kafka plugins readme. (#5191)
add f1e2086 [TE] frontend - harleyjj/validation - surface errors in dom for create and edit alert (#5187)
add 8f0ed55 Update travis scripts to test quickstart over jdk 10-15 (#5182)
add 772f51e [TE] frontend - harleyjj/alert-details - show bounds for minute granularity again (#5192)
add 1f1baf8 Adding missing license files for jquery-requestAnimationFrame and jquery-sizzle, requested in Issue #5183 (#5195)
add 00fcb1d Move table config into pinot-spi (#5194)
add 8dfa51a Lucene DocId to PinotDocId cache to improve performance (#5177)
add 9cb716f Nightly publish to bintray (#5190)
add 67c30ed Move docs link from apache-pinot.gitbook.io/apache-pinot-cookbook to docs.pinot.apache.org (#5193)
add 95e0f1d Shuffle the segments when rebalancing the table to avoid creating hotspot servers (#5197)
add 1474344 Remove the construction of second bitmap in text index reader to improve performance (#5199)
add 08e92ab Fix the flakiness of case-insensitivity test (#5201)
add 189f3b8 Refactor DistinctQueriesTest to cover more scenarios (#5168)
add 3a0ad72 Add override option to be 1 to force publishing the jars to bintray (#5202)
add fedd1ae [TE] fix the merger issue that it can't merge historical anomaly generated by multiple rules (#5196)
add f20c3d6 Pinot website (#5185)
add e09d245 Fixing license checks for website directory (#5203)
add 221e73a adding a banner to old docs for new doc link (#5205)
add 3bbaa03 Fix the capacity of the DistinctTable (#5204)
add ac327bb Optimize ExpressionFilterOperator (#5132)
add 8278cbc Add gcs nio support (#5106)
add 20afda5 fixing presto-coordinator k8s yaml file (#5210)
add 610350a [TE] Retain the original last success task execution time if we can't… (#5207)
add 0d5b5e2 Make text index query cache a configurable option (#5176)
add 4ee35c3 Change the logo for navbar on the website (#5214)
add 1baede8 Stream github events demo (#5189)
add fc9f2a0 [TE] Show error messages to the new UI (#5211)
add 6b1c10d Add tests for VALUEIN (#5217)
add aaacf8d Minor changes to enable setup of github events demo via Docker
add e84a3af Support order-by on BYTES column (#5213)
add df3b904 Fix travis cache (#5225)
add 7ca6f33 [TE] frontend - harleyjj/rca - reformat dimension-algorithm table (#5206)
add a1401de [TE] frontend - harleyjj/home - use duration param to set date range (#5198)
add 06bd2c6 [TE] endpoint - harleyjj/metricBreakdownPipeline - add flag for ignoring score when adding dimensions to response (#5212)
add 60bc83a Revert "[TE][subscription] update subscription watermarks to use anomaly create time instead of end time (#5152)" (#5227)
add 8f0d059 Support bootstrap mode for table rebalance (#5224)
add 6943212 enable async processing in pinot broker query api (#5229)
add 62a3e54 Add inter segment tests for text search and fix bug for Lucene query parser creation (#5226)
add 0a890fe [TE] Remove MIGRATED_ALGORITHM type (#5172)
add 0e0eef4 Update JVM settings for scripts (#5127)
add 535700b Address extra comments in #5224 (#5230)
add 16ac894 Handle queries like count(distinct ) (#5223)
add 33fc485 fixing spark ingestion issue (#5216)
add 08844de Fix logging in AvroUtil and add test (#5232)
add 235b474 Fix the error message in RoutingManager (#5235)
add 409d717 Exclude jsr311 dependency to make pinot-quickstart work under pinot-tools-pkg (#5241)
add 1e3e38c [TE] frontend - harleyjj/alert-details - add basic forecast display capability to Alert Overview (#5236)
add fc2b2b7 [TE] frontend - harleyjj/alert-details - show blob in place of graph when loading and to display error when no time series returned (#5231)
add 8b1cde8 [TE] add rate limiter to batch alert onboarding (#5234)
add 0880f10 fix generator.sh after pinot version bump (#5237)
add 79c0838 [TE] frontend - harleyjj/alert-details - fix buggy flag for showing forecast message (#5243)
add 7f04bdf [TE] Runner to generate SLA based metric data missing alerts (#5200)
add 881469d [TE] script to migrate subscription group watermarks from anomaly endtime to create time. (#5244)
add 159e4bb [TE] Update notificaion template to support Data SLA anomalies; Don't show NA for predicted values (#5242)
add c92d677 Add a new server api for download of segments. (#5221)
add 889889e include pinot-confluent-avro plugin to the distribution (#5248)
add b20ace0 Evaluate schema transform expressions during ingestion (#5238)
add e061317 Remove groupId in pinot-adls pom file (#5255)
add ca900e4 Optimize GroovyExpressionEvaluator (#5257)
add 193fb07 Add twitter icon to README (#5251)
add 2a31111 Support Aggregation functions with multiple arguments. (#5259)
add d68ef7b Fix HDFS copy logic (#5218)
add 142a86f Derive num docs per chunk from max column value length for varbyte raw index creator (#5256)
add e312a93 Pull out all hadoop and spark dependencies into the root pom (#5247)
add a8a0a75 Add icon for the latest release (#5265)
add 0622d2c Re-implement ORCRecordReader (#5267)
add c577088 [TE][subscription] Subscription pipeline should use anomaly create ti… (#5233)
add 713dd1b Use java.io.tmpdir instead of /tmp (#5270)
add 78e753b Fix file not found exception for AvroRecordExtractorMapTypeTest (#5272)
add 7a62166 [TE] Disable alerts if it has no success run within 30 days (#5208)
add bd79861 Issue 5261: Support AggregationFunctions with multiple arguments (contd). (#5275)
add 52472b3 Add access control for Pinot server segment download api. (#5260)
add fb043da Refactor configs in pinot-spi (#5262)
add 79cc2a9 Removing the explicit reference to index types in segmentDirectory/co… (#5276)
add 4ed36ff Remove hadoop dependency in Create Segment Command (#5271)
add d8a2705 Adding allowVolumeExpansion for volume resizing and updating zookeeper chart (#5273)
add f8b6b2b Adding Pinot S3 Filesystem Plugin (#5249)
add b29ad2e [TE] Add validations for the threshold rule anomaly filter (#5278)
add e604468 Add proper closing of S3PinotFS and S3Client in S3PinotFSTest. (#5287)
add 6b62a0a Fix pinot-s3 pom file (#5290)
add 410fd70 Use 8byte offsets in chunk based raw index creator (#5285)
add 62799a3 Improve GroupBy query performance by setting initial size for OpenHashMap used in DictionaryBasedGroupKeyGenerator. (#5291)
add 7fd2110 Disable S3MockListner in S3PinotFSTest. (#5292)
add f2c56a7 [Part 2] Deepstore by-pass in LLC: introduce segment uploader for segment split commit. (#5277)
add 22865e6 add pinot upsert features to pinot common (#5175)
add f566932 Allow user to specify zk data dir and don't do clean up during zk shutdown (#5295)
add 90c9060 Always use local filesystem for ORCRecordReader (#5299)
add 1fe22b5 Implement ARRAYLENGTH UDF for multi-valued columns (#5301)
add 3d9d206 Fixing missing error message from pinot-admin command (#5305)
add bfddb7a Pull the source fields Set out of the RecordReader/Decoder (#5303)
add b9e8d96 Move ExpressionEvaluators and SchemaFieldExtractor from pinot-spi to pinot-core (#5310)
add cb62dfc Prune stop words for text index (#5297)
add 6f384ea Decouple Schema from RecordReader and StreamMessageDecoder (#5309)
add b0ad7ca Support inbuilt transform functions (#5312)
add 4c6050f Move UpsertConfig under package org.apache.pinot.spi.config.table (#5311)
add 6a1565c Allow configuring minion task timeout in the PinotTaskGenerator (#5317)
add 997853d Use time column from table config instead of schema (#5320)
add 26ae5ee Adding missing presto quickstart examples (#5323)
add c87be27 In SegmentPurger, use table config to generate the segment (#5325)
add f52fcd9 Adding json_path function to extract field from json object
add 3ba6e5c Adding integration test
add 493518d Adding more tests
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (0f94d9f)
\
N -- N -- N refs/heads/jsonpath_function (493518d)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/maven.yml | 43 +
.gitignore | 27 +-
.travis.yml | 78 +-
.travis/.ci.settings.xml | 31 +
.travis/.travis_install.sh | 81 +
.travis/.travis_nightly_build.sh | 31 +
.travis/.travis_quickstart.sh | 135 +
.travis/.travis_quickstart_openjdk.sh | 32 +
.travis/.travis_set_deploy_build_opts.sh | 26 +
.travis/.travis_test.sh | 78 +
.travis_install.sh | 67 -
.travis_test.sh | 92 -
LICENSE-binary | 143 +-
NOTICE | 2 +-
NOTICE-binary | 415 +-
README.md | 51 +-
.../pinotdruidbenchmark/PinotThroughput.java | 7 +-
docker/Dockerfile | 63 -
docker/README.md | 147 -
docker/docker-compose.yml | 82 -
docker/images/pinot-presto/Dockerfile | 60 +
docker/images/pinot-presto/README.md | 61 +
docker/images/pinot-presto/docker-build.sh | 47 +
.../pinot-presto/etc/catalog/pinot.properties | 29 +
.../etc/catalog/pinot_quickstart.properties | 28 +
docker/images/pinot-presto/etc/config.properties | 27 +
docker/images/pinot-presto/etc/jvm.config | 8 +
docker/images/pinot-presto/etc/log.properties | 20 +
docker/images/pinot-presto/etc/node.properties | 22 +
docker/images/pinot-superset/.dockerignore | 22 +
docker/images/pinot-superset/.python-version | 20 +
docker/images/pinot-superset/Dockerfile | 112 +
docker/images/pinot-superset/Makefile | 64 +
docker/images/pinot-superset/README.md | 70 +
docker/images/pinot-superset/requirements-db.txt | 35 +
docker/images/pinot-thirdeye/Dockerfile | 74 +
docker/images/pinot-thirdeye/README.md | 102 +
docker/images/pinot-thirdeye/bin/start-thirdeye.sh | 49 +
.../pinot-thirdeye/config/ephemeral/dashboard.yml | 36 +
.../config/ephemeral/data-sources/cache-config.yml | 34 +
.../data-sources/data-sources-config-backend.yml | 189 +
.../data-sources/data-sources-config-frontend.yml | 189 +
.../config/ephemeral}/data/README.md | 0
.../config/ephemeral}/data/daily.csv | 0
.../config/ephemeral}/data/hourly.csv | 0
.../config/ephemeral/data/pageviews.csv | 67 +
.../anomaly-functions/alertFilter.properties | 0
.../alertFilterAutotune.properties | 0
.../anomaly-functions/anomalyClassifier.properties | 0
.../anomaly-functions/functions.properties | 0
.../pinot-thirdeye/config/ephemeral/detector.yml | 84 +
.../config/ephemeral/persistence.yml | 5 +
.../pinot-thirdeye/config/ephemeral}/rca.yml | 0
.../config/pinot-quickstart/bootstrap.sql | 4 +
.../config/pinot-quickstart}/dashboard.yml | 0
.../pinot-quickstart/data-sources/cache-config.yml | 34 +
.../data-sources/data-sources-config.yml | 14 +
.../config/pinot-quickstart}/data/README.md | 0
.../config/pinot-quickstart}/data/daily.csv | 0
.../config/pinot-quickstart}/data/hourly.csv | 0
.../config/pinot-quickstart/data/pageviews.csv | 67 +
.../anomaly-functions/alertFilter.properties | 0
.../alertFilterAutotune.properties | 0
.../anomaly-functions/anomalyClassifier.properties | 0
.../anomaly-functions/functions.properties | 0
.../config/pinot-quickstart/detector.yml | 84 +
.../config/pinot-quickstart/persistence.yml | 5 +
.../config/pinot-quickstart}/rca.yml | 0
.../images/pinot-thirdeye/docker-build-and-push.sh | 30 +
docker/images/pinot-thirdeye/docker-build.sh | 47 +
docker/images/pinot-thirdeye/docker-push.sh | 29 +
docker/images/pinot/Dockerfile | 82 +
docker/images/pinot/README.md | 142 +
docker/images/pinot/bin/generator.sh | 77 +
docker/{ => images/pinot}/docker-build-and-push.sh | 0
docker/{ => images/pinot}/docker-build.sh | 0
docker/images/pinot/docker-compose.yml | 82 +
docker/{ => images/pinot}/docker-push.sh | 0
.../pinot/ingestion-job-specs/airlineStats.yaml | 129 +
.../pinot/ingestion-job-specs/baseballStats.yaml | 139 +
.../airlineStats_realtime_table_config.json | 35 +
.../meetupRsvp_realtime_table_config.json | 29 +
docs/admin_guide.rst | 6 +
docs/architecture.rst | 89 +-
docs/batch_data_ingestion.rst | 223 +
docs/client_api.rst | 2 +
docs/code_modules.rst | 15 +-
docs/contribution_guidelines.rst | 5 +-
docs/customizations.rst | 2 +
docs/dev_env.rst | 4 +-
docs/dev_guide.rst | 4 +
docs/extensions.rst | 2 +
docs/getting_started.rst | 129 +-
docs/in_production.rst | 6 +-
docs/index.rst | 34 +-
docs/index_techniques.rst | 2 +
docs/intro.rst | 2 +
docs/introduction.rst | 4 +
docs/pinot_hadoop.rst | 110 +-
docs/pluggable_storage.rst | 79 +-
docs/pluggable_streams.rst | 75 +-
docs/pql_examples.rst | 69 +-
docs/record_reader.rst | 4 +-
docs/schema.rst | 140 +
docs/segment_fetcher.rst | 30 +
docs/star-tree/example.png | Bin 0 -> 29005 bytes
docs/star-tree/space-time.png | Bin 0 -> 25225 bytes
docs/star-tree/star-tree.rst | 351 +
docs/star-tree/structure.png | Bin 0 -> 25841 bytes
docs/tableconfig_schema.rst | 196 +-
docs/tuning_pinot.rst | 16 +-
docs/tuning_realtime_performance.rst | 115 +
docs/tuning_scatter_and_gather.rst | 2 +
docs/user_guide.rst | 4 +
kubernetes/README.md | 8 +-
kubernetes/examples/gke/skaffold/README.md | 119 -
.../gke/skaffold/gke-storageclass-kafka-pd.yml | 28 -
.../gke-storageclass-pinot-controller-pd.yml | 28 -
.../skaffold/gke-storageclass-pinot-server-pd.yml | 28 -
.../gke/skaffold/gke-storageclass-zk-pd.yml | 28 -
kubernetes/examples/gke/skaffold/pinot-broker.yml | 88 -
.../examples/gke/skaffold/pinot-controller.yml | 106 -
.../examples/gke/skaffold/pinot-example-loader.yml | 43 -
kubernetes/examples/gke/skaffold/pinot-server.yml | 101 -
kubernetes/helm/Chart.yaml | 35 +
kubernetes/helm/README.md | 549 +
kubernetes/helm/charts/zookeeper-2.1.3.tgz | Bin 0 -> 10623 bytes
kubernetes/helm/gke-pd.yaml | 27 +
kubernetes/helm/gke-ssd.yaml | 27 +
kubernetes/helm/helm-rbac.yaml | 37 +
kubernetes/helm/launch-presto-ui.sh | 28 +
kubernetes/helm/open-superset-ui.sh | 28 +
kubernetes/helm/pinot-github-events-setup.yml | 279 +
kubernetes/helm/pinot-presto-cli.sh | 31 +
kubernetes/helm/pinot-realtime-quickstart.yml | 501 +
kubernetes/helm/presto-cli.sh | 28 +
kubernetes/helm/presto-coordinator.yaml | 159 +
kubernetes/helm/presto-worker.yaml | 144 +
.../gke/skaffold => helm}/query-pinot-data.sh | 0
kubernetes/helm/requirements.lock | 25 +
kubernetes/helm/requirements.yaml | 24 +
kubernetes/helm/setup_gke.sh | 42 +
kubernetes/helm/superset.yaml | 2322 ++
kubernetes/helm/templates/_helpers.tpl | 143 +
kubernetes/helm/templates/broker/configmap.yaml | 28 +
.../helm/templates/broker/service-external.yaml | 41 +
.../helm/templates/broker/service-headless.yaml | 38 +
kubernetes/helm/templates/broker/service.yaml | 38 +
kubernetes/helm/templates/broker/statefulset.yml | 91 +
.../helm/templates/controller/configmap.yaml | 32 +
.../templates/controller/service-external.yaml | 41 +
.../templates/controller/service-headless.yaml | 38 +
kubernetes/helm/templates/controller/service.yaml | 38 +
.../helm/templates/controller/statefulset.yaml | 100 +
kubernetes/helm/templates/server/configmap.yaml | 30 +
.../helm/templates/server/service-headless.yaml | 38 +
kubernetes/helm/templates/server/service.yaml | 38 +
kubernetes/helm/templates/server/statefulset.yml | 108 +
kubernetes/helm/values.yaml | 218 +
kubernetes/skaffold/gke/README.md | 119 +
.../gke/skaffold => skaffold/gke}/cleanup.sh | 0
.../skaffold/gke/gke-storageclass-kafka-pd.yml | 29 +
.../gke/gke-storageclass-pinot-controller-pd.yml | 29 +
.../gke/gke-storageclass-pinot-server-pd.yml | 29 +
kubernetes/skaffold/gke/gke-storageclass-zk-pd.yml | 29 +
.../gke/skaffold => skaffold/gke}/kafka.yml | 0
kubernetes/skaffold/gke/pinot-broker.yml | 88 +
kubernetes/skaffold/gke/pinot-controller.yml | 105 +
.../skaffold/gke/pinot-realtime-quickstart.yml | 40 +
kubernetes/skaffold/gke/pinot-server.yml | 101 +
.../skaffold => skaffold/gke}/query-pinot-data.sh | 0
.../gke/skaffold => skaffold/gke}/setup.sh | 0
.../gke/skaffold => skaffold/gke}/skaffold.yaml | 0
.../gke/skaffold => skaffold/gke}/zookeeper.yml | 0
licenses-binary/LICENSE-fusesource.txt | 27 +
.../LICENSE-jquery-requestAnimationFrame.txt | 22 +
licenses-binary/LICENSE-jquery-sizzle.txt | 36 +
licenses-binary/LICENSE-py4j.txt | 26 +
licenses-binary/LICENSE-threeten.txt | 29 +
licenses/LICENSE-jquery-requestAnimationFrame.txt | 22 +
licenses/LICENSE-jquery-sizzle.txt | 36 +
pinot-api/pom.xml | 95 -
.../org/apache/pinot/client/BrokerResponse.java | 72 -
.../java/org/apache/pinot/client/Connection.java | 195 -
.../client/JsonAsyncHttpPinotClientTransport.java | 160 -
.../org/apache/pinot/client/PreparedStatement.java | 121 -
.../org/apache/pinot/client/ResultSetGroup.java | 81 -
.../java/org/apache/pinot/client/package-info.java | 98 -
.../apache/pinot/client/PreparedStatementTest.java | 101 -
pinot-azure-filesystem/pom.xml | 56 -
.../org/apache/pinot/filesystem/AzurePinotFS.java | 252 -
.../pinot/filesystem/test/AzurePinotFSTest.java | 88 -
pinot-broker/pom.xml | 91 +-
.../org/apache/pinot/broker/api/AccessControl.java | 4 +-
.../broker/api/resources/PinotBrokerDebug.java | 113 +-
.../api/resources/PinotBrokerHealthCheck.java | 17 +-
.../broker/api/resources/PinotBrokerRouting.java | 76 +
.../broker/api/resources/PinotClientRequest.java | 98 +-
.../broker/broker/BrokerAdminApiApplication.java | 16 +-
.../pinot/broker/broker/BrokerServerBuilder.java | 154 -
...okerResourceOnlineOfflineStateModelFactory.java | 79 +-
.../BrokerUserDefinedMessageHandlerFactory.java | 147 +
.../broker/broker/helix/ClusterChangeHandler.java | 4 +-
.../broker/broker/helix/HelixBrokerStarter.java | 207 +-
.../broker/helix/LiveInstanceChangeHandler.java | 121 -
.../TimeboundaryRefreshMessageHandlerFactory.java | 145 -
.../HelixExternalViewBasedQueryQuotaManager.java | 216 +-
.../pinot/broker/queryquota/QueryQuotaConfig.java | 42 -
.../pinot/broker/queryquota/QueryQuotaEntity.java | 72 +
.../requesthandler/BaseBrokerRequestHandler.java | 480 +-
.../ConnectionPoolBrokerRequestHandler.java | 404 -
...ualitiesToInClauseFilterQueryTreeOptimizer.java | 373 +-
.../requesthandler/PinotQueryParserFactory.java | 2 +-
.../SingleConnectionBrokerRequestHandler.java | 39 +-
.../routing/HelixExternalViewBasedRouting.java | 618 -
.../HelixExternalViewBasedTimeBoundaryService.java | 148 -
.../pinot/broker/routing/RoutingManager.java | 555 +
.../apache/pinot/broker/routing/RoutingTable.java | 54 -
.../broker/routing/RoutingTableBuilderFactory.java | 149 -
.../broker/routing/RoutingTableLookupRequest.java | 79 -
.../pinot/broker/routing/TimeBoundaryService.java | 65 -
.../builder/BalancedRandomRoutingTableBuilder.java | 64 -
.../BasePartitionAwareRoutingTableBuilder.java | 158 -
.../routing/builder/BaseRoutingTableBuilder.java | 213 -
.../builder/DefaultOfflineRoutingTableBuilder.java | 137 -
.../DefaultRealtimeRoutingTableBuilder.java | 117 -
.../builder/GeneratorBasedRoutingTableBuilder.java | 299 -
.../HighLevelConsumerBasedRoutingTableBuilder.java | 86 -
.../builder/LargeClusterRoutingTableBuilder.java | 63 -
.../LowLevelConsumerRoutingTableBuilder.java | 151 -
.../builder/LowLevelRoutingTableBuilderUtil.java | 81 -
.../PartitionAwareOfflineRoutingTableBuilder.java | 204 -
.../PartitionAwareRealtimeRoutingTableBuilder.java | 154 -
.../routing/builder/RoutingTableBuilder.java | 63 -
.../builder/RoutingTableInstancePruner.java | 73 -
.../instanceselector/BalancedInstanceSelector.java | 55 +
.../instanceselector/BaseInstanceSelector.java | 179 +
.../routing/instanceselector/InstanceSelector.java | 60 +
.../instanceselector/InstanceSelectorFactory.java | 52 +
.../ReplicaGroupInstanceSelector.java | 65 +
.../segmentpruner/PartitionSegmentPruner.java | 191 +
.../routing/segmentpruner/SegmentPruner.java | 57 +
.../segmentpruner/SegmentPrunerFactory.java | 100 +
.../segmentselector/OfflineSegmentSelector.java | 52 +
.../segmentselector/RealtimeSegmentSelector.java | 168 +
.../routing/segmentselector/SegmentSelector.java | 62 +
.../segmentselector/SegmentSelectorFactory.java | 35 +
.../routing/selector/MergedSegmentSelector.java | 95 -
.../broker/routing/selector/SegmentSelector.java | 49 -
.../routing/selector/SegmentSelectorProvider.java | 47 -
.../routing/timeboundary/TimeBoundaryInfo.java | 37 +
.../routing/timeboundary/TimeBoundaryManager.java | 202 +
.../broker/broker/HelixBrokerStarterTest.java | 63 +-
...elixExternalViewBasedQueryQuotaManagerTest.java | 133 +-
.../request/PqlAndCalciteSqlCompatibilityTest.java | 83 +-
.../requesthandler/BrokerRequestOptionsTest.java | 140 +
...tiesToInClauseFilterQueryTreeOptimizerTest.java | 395 +-
.../requesthandler/QueryLimitOverrideTest.java | 76 +
.../broker/requesthandler/QueryValidationTest.java | 105 +
...ixExternalViewBasedTimeBoundaryServiceTest.java | 167 -
.../broker/routing/RandomRoutingTableTest.java | 105 -
.../pinot/broker/routing/RoutingTableTest.java | 302 -
.../BalancedRandomRoutingTableBuilderTest.java | 119 -
.../HighLevelConsumerRoutingTableBuilderTest.java | 118 -
.../LargeClusterRoutingTableBuilderTest.java | 268 -
.../LowLevelConsumerRoutingTableBuilderTest.java | 252 -
...rtitionAwareOfflineRoutingTableBuilderTest.java | 404 -
...titionAwareRealtimeRoutingTableBuilderTest.java | 374 -
.../builder/RoutingTableBuilderTestUtil.java | 44 -
.../instanceselector/InstanceSelectorTest.java | 406 +
.../routing/segmentpruner/SegmentPrunerTest.java | 222 +
.../segmentselector/SegmentSelectorTest.java | 128 +
.../selector/MergedSegmentSelectorTest.java | 149 -
.../timeboundary/TimeBoundaryManagerTest.java | 170 +
pinot-clients/pinot-java-client/pom.xml | 96 +
.../org/apache/pinot/client/AbstractResultSet.java | 0
.../apache/pinot/client/AggregationResultSet.java | 0
.../org/apache/pinot/client/BrokerResponse.java | 78 +
.../org/apache/pinot/client/BrokerSelector.java | 0
.../java/org/apache/pinot/client/Connection.java | 216 +
.../org/apache/pinot/client/ConnectionFactory.java | 0
.../apache/pinot/client/DynamicBrokerSelector.java | 0
.../apache/pinot/client/ExternalViewReader.java | 0
.../org/apache/pinot/client/GroupByResultSet.java | 0
.../client/JsonAsyncHttpPinotClientTransport.java | 167 +
.../JsonAsyncHttpPinotClientTransportFactory.java | 0
.../apache/pinot/client/PinotClientException.java | 0
.../apache/pinot/client/PinotClientTransport.java | 0
.../pinot/client/PinotClientTransportFactory.java | 0
.../org/apache/pinot/client/PreparedStatement.java | 133 +
.../main/java/org/apache/pinot/client/Request.java | 0
.../java/org/apache/pinot/client/ResultSet.java | 0
.../org/apache/pinot/client/ResultSetGroup.java | 86 +
.../apache/pinot/client/ResultTableResultSet.java | 106 +
.../apache/pinot/client/SelectionResultSet.java | 0
.../apache/pinot/client/SimpleBrokerSelector.java | 0
.../java/org/apache/pinot/client/TextTable.java | 0
.../java/org/apache/pinot/client/package-info.java | 98 +
.../apache/pinot/client/ConnectionFactoryTest.java | 0
.../apache/pinot/client/PreparedStatementTest.java | 101 +
.../apache/pinot/client/ResultSetGroupTest.java | 0
.../src/test/resources/log4j2.xml | 0
.../org/apache/pinot/client/aggregation.json | 0
.../apache/pinot/client/aggregationGroupBy.json | 0
.../org/apache/pinot/client/exception.json | 0
.../org/apache/pinot/client/selection.json | 0
pinot-clients/pom.xml | 58 +
pinot-common/pom.xml | 107 +-
.../antlr4/org/apache/pinot/pql/parsers/PQL2.g4 | 5 +
.../pinot/annotations/InterfaceAudience.java | 76 -
.../pinot/annotations/InterfaceStability.java | 75 -
.../assignment/InstanceAssignmentConfigUtils.java | 124 +
.../common/assignment/InstancePartitions.java | 7 +-
.../common/assignment/InstancePartitionsType.java | 37 -
.../common/assignment/InstancePartitionsUtils.java | 55 +-
.../config/AdjustTableNameChildKeyTransformer.java | 70 -
.../pinot/common/config/ChildKeyHandler.java | 45 -
.../pinot/common/config/ChildKeyTransformer.java | 33 -
.../pinot/common/config/ColumnPartitionConfig.java | 103 -
.../config/ColumnPartitionMapChildKeyHandler.java | 28 -
.../apache/pinot/common/config/CombinedConfig.java | 110 -
.../pinot/common/config/CombinedConfigLoader.java | 171 -
...CombinedConfigSeparatorChildKeyTransformer.java | 132 -
.../pinot/common/config/CompletionConfig.java | 63 -
.../org/apache/pinot/common/config/ConfigDoc.java | 37 -
.../org/apache/pinot/common/config/ConfigKey.java | 31 -
.../common/config/ConfigNodeLifecycleAware.java | 34 -
.../apache/pinot/common/config/Deserializer.java | 445 -
.../org/apache/pinot/common/config/Duration.java | 77 -
.../apache/pinot/common/config/DurationDsl.java | 57 -
.../apache/pinot/common/config/IndexingConfig.java | 321 -
.../org/apache/pinot/common/config/Instance.java | 145 -
.../common/config/NamedListChildKeyHandler.java | 75 -
.../apache/pinot/common/config/NestedConfig.java | 31 -
.../pinot/common/config/OfflineTagConfig.java | 39 -
.../pinot/common/config/PinotTaskConfig.java | 91 -
.../apache/pinot/common/config/QuotaConfig.java | 126 -
.../pinot/common/config/RealtimeTagConfig.java | 64 -
.../config/RemapTableTypesChildKeyTransformer.java | 64 -
.../common/config/ReplicaGroupStrategyConfig.java | 108 -
.../apache/pinot/common/config/RoutingConfig.java | 74 -
.../common/config/SegmentPartitionConfig.java | 146 -
.../SegmentsValidationAndRetentionConfig.java | 264 -
.../org/apache/pinot/common/config/Serializer.java | 197 -
.../common/config/SimpleMapChildKeyHandler.java | 50 -
.../apache/pinot/common/config/SingleKeyDsl.java | 30 -
.../pinot/common/config/StarTreeIndexConfig.java | 71 -
.../common/config/StreamConsumptionConfig.java | 35 -
.../apache/pinot/common/config/TableConfig.java | 729 -
.../pinot/common/config/TableCustomConfig.java | 99 -
.../pinot/common/config/TableNameBuilder.java | 139 -
.../pinot/common/config/TableTaskConfig.java | 73 -
.../org/apache/pinot/common/config/TagConfig.java | 43 -
.../apache/pinot/common/config/TagNameUtils.java | 119 -
.../pinot/common/config/TagOverrideConfig.java | 98 -
.../config/TaskConfigMapChildKeyHandler.java | 59 -
.../org/apache/pinot/common/config/Tenant.java | 138 -
.../apache/pinot/common/config/TenantConfig.java | 121 -
.../common/config/TypedMapChildKeyHandler.java | 74 -
.../pinot/common/config/UseChildKeyHandler.java | 31 -
.../common/config/UseChildKeyTransformers.java | 34 -
.../org/apache/pinot/common/config/UseDsl.java | 35 -
.../config/instance/InstanceAssignmentConfig.java | 75 -
...InstanceAssignmentConfigMapChildKeyHandler.java | 28 -
.../instance/InstanceAssignmentConfigUtils.java | 110 -
.../config/instance/InstanceConstraintConfig.java | 44 -
.../InstanceReplicaGroupPartitionConfig.java | 113 -
.../config/instance/InstanceTagPoolConfig.java | 86 -
.../pinot/common/data/DateTimeFieldSpec.java | 152 -
.../data/DateTimeFieldSpecChildKeyHandler.java | 31 -
.../common/data/DateTimeFormatPatternSpec.java | 106 -
.../pinot/common/data/DateTimeFormatSpec.java | 253 -
.../pinot/common/data/DateTimeFormatUnitSpec.java | 152 -
.../pinot/common/data/DateTimeGranularitySpec.java | 140 -
.../pinot/common/data/DimensionFieldSpec.java | 61 -
.../data/DimensionFieldSpecChildKeyHandler.java | 31 -
.../org/apache/pinot/common/data/FieldSpec.java | 458 -
.../apache/pinot/common/data/MetricFieldSpec.java | 184 -
.../data/MetricFieldSpecChildKeyHandler.java | 31 -
.../org/apache/pinot/common/data/RowEvent.java | 36 -
.../java/org/apache/pinot/common/data/Schema.java | 672 -
.../pinot/common/data/StarTreeIndexSpec.java | 182 -
.../apache/pinot/common/data/TimeFieldSpec.java | 243 -
.../pinot/common/data/TimeGranularitySpec.java | 303 -
.../pinot/common/exception/QueryException.java | 2 -
.../common/exception/SchemaNotFoundException.java | 26 +
.../common/function/AggregationFunctionType.java | 58 +-
.../function/FunctionDefinitionRegistry.java | 15 +-
.../common/function/TransformFunctionType.java | 72 +
.../pinot/common/lineage/SegmentMergeLineage.java | 2 +-
.../common/messages/SegmentRefreshMessage.java | 46 +-
.../common/messages/TableConfigRefreshMessage.java | 64 +
.../messages/TimeboundaryRefreshMessage.java | 45 -
.../apache/pinot/common/metadata/RowMetadata.java | 43 -
.../pinot/common/metadata/ZKMetadataProvider.java | 19 +-
.../metadata/instance/InstanceZKMetadata.java | 10 +-
.../segment/LLCRealtimeSegmentZKMetadata.java | 8 +-
.../metadata/segment/OfflineSegmentZKMetadata.java | 8 +-
.../segment/RealtimeSegmentZKMetadata.java | 8 +-
.../metadata/segment/SegmentPartitionMetadata.java | 2 +-
.../common/metadata/segment/SegmentZKMetadata.java | 32 +-
.../SegmentZKMetadataCustomMapModifier.java | 2 +-
.../apache/pinot/common/metrics/BrokerMeter.java | 8 +-
.../pinot/common/metrics/ControllerGauge.java | 10 +-
.../pinot/common/metrics/ControllerMeter.java | 20 +-
.../apache/pinot/common/metrics/ServerGauge.java | 5 -
.../apache/pinot/common/metrics/ServerMeter.java | 8 +-
.../apache/pinot/common/metrics/ServerTimer.java | 7 +-
.../pinot/common/metrics/ValidationMetrics.java | 37 -
.../common/partition/PartitionAssignment.java | 109 -
...roupBasedStreamPartitionAssignmentStrategy.java | 83 -
.../partition/ReplicaGroupPartitionAssignment.java | 124 -
.../ReplicaGroupPartitionAssignmentGenerator.java | 128 -
.../StreamPartitionAssignmentGenerator.java | 139 -
.../StreamPartitionAssignmentStrategy.java | 40 -
.../StreamPartitionAssignmentStrategyFactory.java | 45 -
.../UniformStreamPartitionAssignmentStrategy.java | 66 -
.../protocols/SegmentCompletionProtocol.java | 17 +-
.../apache/pinot/common/query/ReduceService.java | 51 -
.../pinot/common/query/ReduceServiceRegistry.java | 70 -
.../pinot/common/request/AggregationInfo.java | 215 +-
.../apache/pinot/common/request/BrokerRequest.java | 199 +-
.../pinot/common/request/FilterOperator.java | 19 +-
.../request/transform/TransformExpressionTree.java | 20 +-
.../common/response/BrokerResponseFactory.java | 117 -
.../pinot/common/response/ServerInstance.java | 172 -
.../response/broker/BrokerResponseNative.java | 16 +-
.../pinot/common/response/broker/ResultTable.java | 53 +
.../common/restlet/resources/ResourceUtils.java | 2 +-
.../pinot/common/segment/SegmentMetadata.java | 123 -
.../pinot/common/segment/StarTreeMetadata.java | 73 -
.../common/segment/fetcher/HdfsSegmentFetcher.java | 132 -
.../common/segment/fetcher/HttpSegmentFetcher.java | 87 -
.../segment/fetcher/HttpsSegmentFetcher.java | 70 -
.../segment/fetcher/LocalFileSegmentFetcher.java | 49 -
.../pinot/common/segment/fetcher/NoOpFetcher.java | 48 -
.../segment/fetcher/PinotFSSegmentFetcher.java | 57 -
.../common/segment/fetcher/SegmentFetcher.java | 49 -
.../segment/fetcher/SegmentFetcherFactory.java | 108 -
.../org/apache/pinot/common/utils/BytesUtils.java | 56 -
.../apache/pinot/common/utils/CommonConstants.java | 87 +-
.../org/apache/pinot/common/utils/DataSchema.java | 65 +-
.../org/apache/pinot/common/utils/DataSize.java | 91 -
.../org/apache/pinot/common/utils/DataTable.java | 15 +-
.../apache/pinot/common/utils/EqualityUtils.java | 134 -
.../common/utils/FileUploadDownloadClient.java | 11 +
.../org/apache/pinot/common/utils/HashUtil.java | 13 +-
.../org/apache/pinot/common/utils/JsonUtils.java | 180 -
.../org/apache/pinot/common/utils/SchemaUtils.java | 4 +-
.../org/apache/pinot/common/utils/SegmentName.java | 39 +-
.../org/apache/pinot/common/utils/ServerType.java | 23 -
.../org/apache/pinot/common/utils/StringUtil.java | 1 +
.../pinot/common/utils/TarGzCompressionUtils.java | 25 +-
.../org/apache/pinot/common/utils/TenantRole.java | 23 -
.../pinot/common/utils/config/InstanceUtils.java | 80 +
.../common/utils/config/TableConfigUtils.java | 204 +
.../pinot/common/utils/config/TagNameUtils.java | 162 +
.../common/utils/fetcher/BaseSegmentFetcher.java | 86 +
.../common/utils/fetcher/HttpSegmentFetcher.java | 66 +
.../common/utils/fetcher/HttpsSegmentFetcher.java | 76 +
.../utils/fetcher/PinotFSSegmentFetcher.java | 33 +
.../pinot/common/utils/fetcher/SegmentFetcher.java | 38 +
.../utils/fetcher/SegmentFetcherFactory.java | 118 +
.../pinot/common/utils/helix/HelixHelper.java | 31 +-
.../common/utils/helix/LeadControllerUtils.java | 49 +
.../pinot/common/utils/helix/TableCache.java | 200 +
.../pinot/common/utils/primitive/ByteArray.java | 113 -
.../common/utils/request/FilterQueryTree.java | 23 +-
.../common/utils/request/HavingQueryTree.java | 2 +-
.../pinot/common/utils/request/RequestUtils.java | 60 +-
.../utils/retry/AttemptFailureException.java | 37 -
.../utils/retry/AttemptsExceededException.java | 30 -
.../pinot/common/utils/retry/BaseRetryPolicy.java | 63 -
.../utils/retry/ExponentialBackoffRetryPolicy.java | 46 -
.../common/utils/retry/FixedDelayRetryPolicy.java | 36 -
.../common/utils/retry/NoDelayRetryPolicy.java | 34 -
.../utils/retry/RetriableOperationException.java | 29 -
.../pinot/common/utils/retry/RetryPolicies.java | 61 -
.../pinot/common/utils/retry/RetryPolicy.java | 39 -
.../pinot/common/utils/time/TimeConverter.java | 67 -
.../apache/pinot/common/utils/time/TimeUtils.java | 185 -
.../org/apache/pinot/filesystem/LocalPinotFS.java | 165 -
.../java/org/apache/pinot/filesystem/PinotFS.java | 218 -
.../apache/pinot/filesystem/PinotFSFactory.java | 88 -
.../apache/pinot/parsers/CompilerConstants.java | 32 +
.../utils/BrokerRequestComparisonUtils.java | 90 +-
.../parsers/PinotQuery2BrokerRequestConverter.java | 101 +-
.../apache/pinot/pql/parsers/Pql2AstListener.java | 21 +-
.../org/apache/pinot/pql/parsers/Pql2Compiler.java | 25 +-
.../pql2/ast/ComparisonPredicateAstNode.java | 4 +
.../pinot/pql/parsers/pql2/ast/FilterKind.java | 5 +-
.../pql/parsers/pql2/ast/FunctionCallAstNode.java | 45 +-
.../pql/parsers/pql2/ast/InPredicateAstNode.java | 76 +-
.../parsers/pql2/ast/IsNullPredicateAstNode.java | 84 +
.../pql/parsers/pql2/ast/IsPredicateAstNode.java | 31 -
.../pinot/pql/parsers/pql2/ast/OrderByAstNode.java | 57 +-
.../pql2/ast/RegexpLikePredicateAstNode.java | 24 +-
.../pinot/pql/parsers/pql2/ast/SelectAstNode.java | 61 +-
.../pql2/ast/TextMatchPredicateAstNode.java | 93 +
.../apache/pinot/sql/parsers/CalciteSqlParser.java | 377 +-
.../org/apache/pinot/startree/hll/HllConfig.java | 186 -
.../apache/pinot/startree/hll/HllConstants.java | 24 -
.../apache/pinot/startree/hll/HllSizeUtils.java | 60 -
.../pinot/common/config/IndexingConfigTest.java | 141 -
.../pinot/common/config/QuotaConfigTest.java | 120 -
.../pinot/common/config/TableConfigTest.java | 472 -
.../pinot/common/config/TagOverrideConfigTest.java | 115 -
.../org/apache/pinot/common/config/TenantTest.java | 49 -
.../common/config/TestConfigSerialization.java | 70 -
.../pinot/common/data/DateTimeFormatSpecTest.java | 24 +-
.../common/data/DateTimeGranularitySpecTest.java | 1 +
.../apache/pinot/common/data/FieldSpecTest.java | 48 +-
.../org/apache/pinot/common/data/SchemaTest.java | 113 +-
.../function/AggregationFunctionTypeTest.java | 69 +
.../metadata/MetadataEqualsHashCodeTest.java | 10 +-
.../common/metadata/SegmentZKMetadataTest.java | 6 +-
.../segment/ColumnPartitionMetadataTest.java | 2 +-
.../common/partition/IdealStateBuilderUtil.java | 179 -
...icaGroupBasedStreamPartitionAssignmentTest.java | 136 -
.../StreamPartitionAssignmentGeneratorTest.java | 364 -
.../UniformStreamPartitionAssignmentTest.java | 93 -
.../pinot/common/query/gen/AvroQueryGenerator.java | 430 -
.../segment/fetcher/SegmentFetcherFactoryTest.java | 115 -
.../apache/pinot/common/utils/DataSchemaTest.java | 2 +-
.../apache/pinot/common/utils/DataSizeTest.java | 44 -
.../pinot/common/utils/DataSizeUtilsTest.java | 92 +
.../pinot/common/utils/EqualityUtilsTest.java | 1 +
.../common/utils/FileUploadDownloadClientTest.java | 1 +
.../pinot/common/utils/SegmentNameBuilderTest.java | 9 +-
.../org/apache/pinot/common/utils/UtilsTest.java | 2 +-
.../common/utils/config/TableConfigSerDeTest.java | 392 +
.../common/utils/config/TableConfigUtilsTest.java | 66 +
.../common/utils/config/TagNameUtilsTest.java | 67 +
.../utils/fetcher/SegmentFetcherFactoryTest.java | 92 +
.../pinot/common/utils/retry/RetryPolicyTest.java | 93 -
.../pinot/common/utils/time/TimeConverterTest.java | 100 -
.../apache/pinot/filesystem/LocalPinotFSTest.java | 237 -
.../pinot/filesystem/PinotFSFactoryTest.java | 143 -
.../apache/pinot/pql/parsers/Pql2CompilerTest.java | 90 +-
.../request/BrokerRequestSerializationTest.java | 9 +-
.../pinot/sql/parsers/CalciteSqlCompilerTest.java | 1061 +-
pinot-common/src/test/resources/pql_queries.list | 8 +
pinot-common/src/test/resources/sql_queries.list | 8 +
.../src/test/resources/test-table-config.conf | 32 -
pinot-common/src/thrift/request.thrift | 11 +-
.../pinot-connector-kafka-0.9/README.md | 24 -
pinot-connectors/pinot-connector-kafka-0.9/pom.xml | 77 -
.../realtime/impl/kafka/ConsumerAndIterator.java | 57 -
.../realtime/impl/kafka/KafkaBrokerWrapper.java | 81 -
.../impl/kafka/KafkaConnectionHandler.java | 442 -
.../realtime/impl/kafka/KafkaConsumerFactory.java | 81 -
.../realtime/impl/kafka/KafkaConsumerManager.java | 191 -
.../impl/kafka/KafkaHighLevelStreamConfig.java | 161 -
.../impl/kafka/KafkaLowLevelStreamConfig.java | 145 -
.../impl/kafka/KafkaPartitionLevelConsumer.java | 135 -
.../impl/kafka/KafkaSimpleConsumerFactory.java | 30 -
.../impl/kafka/KafkaSimpleConsumerFactoryImpl.java | 32 -
.../impl/kafka/KafkaStreamLevelConsumer.java | 141 -
.../impl/kafka/KafkaStreamMetadataProvider.java | 231 -
.../realtime/impl/kafka/SimpleConsumerFactory.java | 29 -
.../impl/kafka/SimpleConsumerMessageBatch.java | 55 -
.../impl/kafka/server/KafkaDataProducer.java | 57 -
.../kafka/server/KafkaDataServerStartable.java | 109 -
...inot.core.realtime.stream.StreamConsumerFactory | 19 -
.../impl/kafka/KafkaLowLevelStreamConfigTest.java | 161 -
.../kafka/KafkaPartitionLevelConsumerTest.java | 359 -
.../pinot-connector-kafka-2.0/README.md | 57 -
pinot-connectors/pinot-connector-kafka-2.0/pom.xml | 103 -
.../realtime/impl/kafka2/KafkaConsumerFactory.java | 51 -
.../realtime/impl/kafka2/KafkaMessageBatch.java | 63 -
.../KafkaPartitionLevelConnectionHandler.java | 73 -
.../impl/kafka2/KafkaPartitionLevelConsumer.java | 66 -
.../kafka2/KafkaPartitionLevelStreamConfig.java | 147 -
.../impl/kafka2/KafkaStreamLevelConsumer.java | 179 -
.../kafka2/KafkaStreamLevelConsumerManager.java | 194 -
.../impl/kafka2/KafkaStreamLevelStreamConfig.java | 136 -
.../impl/kafka2/KafkaStreamMetadataProvider.java | 67 -
.../impl/kafka2/server/KafkaDataProducer.java | 77 -
.../kafka2/server/KafkaDataServerStartable.java | 98 -
...inot.core.realtime.stream.StreamConsumerFactory | 19 -
.../kafka2/KafkaPartitionLevelConsumerTest.java | 298 -
.../KafkaPartitionLevelStreamConfigTest.java | 163 -
.../impl/kafka2/utils/EmbeddedZooKeeper.java | 60 -
.../impl/kafka2/utils/MiniKafkaCluster.java | 175 -
.../pinot-connector-kafka-base/pom.xml | 38 -
.../impl/kafka/KafkaAvroMessageDecoder.java | 289 -
.../impl/kafka/KafkaJSONMessageDecoder.java | 63 -
.../realtime/impl/kafka/KafkaStarterUtils.java | 118 -
.../impl/kafka/KafkaStreamConfigProperties.java | 66 -
.../core/realtime/impl/kafka/MessageAndOffset.java | 53 -
pinot-connectors/pom.xml | 78 -
pinot-controller/pom.xml | 52 +-
.../apache/pinot/controller/ControllerConf.java | 16 +-
.../apache/pinot/controller/ControllerStarter.java | 27 +-
.../pinot/controller/LeadControllerManager.java | 58 +-
.../pinot/controller/api/access/AccessControl.java | 4 +-
.../api/access/AccessControlFactory.java | 4 +-
.../api/events/DefaultMetadataEventNotifier.java | 5 +-
.../api/events/MetadataEventNotifier.java | 5 +-
.../pinot/controller/api/resources/Constants.java | 14 +-
.../api/resources/ControllerFilePathProvider.java | 139 +
.../api/resources/FileUploadPathProvider.java | 145 -
.../resources/LLCSegmentCompletionHandlers.java | 380 +-
.../api/resources/PinotClusterConfigs.java | 121 +
.../PinotInstanceAssignmentRestletResource.java | 12 +-
.../resources/PinotInstanceRestletResource.java | 21 +-
.../PinotLeadControllerRestletResource.java | 202 +
.../api/resources/PinotQueryResource.java | 334 +
.../api/resources/PinotSchemaRestletResource.java | 138 +-
.../api/resources/PinotSegmentRestletResource.java | 713 +-
.../PinotSegmentUploadDownloadRestletResource.java | 466 +
.../PinotSegmentUploadRestletResource.java | 556 -
.../resources/PinotTableConfigRestletResource.java | 195 -
.../api/resources/PinotTableIndexingConfigs.java | 18 +-
.../api/resources/PinotTableInstances.java | 4 +-
.../api/resources/PinotTableMetadataConfigs.java | 14 +-
.../api/resources/PinotTableRestletResource.java | 149 +-
.../controller/api/resources/PinotTableSchema.java | 2 +-
.../api/resources/PinotTableSegmentConfigs.java | 22 +-
.../api/resources/PinotTaskRestletResource.java | 248 +-
.../api/resources/PinotTenantRestletResource.java | 44 +-
.../api/resources/PinotVersionRestletResource.java | 2 +-
.../controller/api/resources/PqlQueryResource.java | 242 -
.../api/resources/ServerTableSizeReader.java | 2 +-
.../pinot/controller/api/resources/TableViews.java | 49 +-
.../resources/WebApplicationExceptionMapper.java | 2 +-
.../controller/api/upload/SegmentValidator.java | 58 +-
.../pinot/controller/api/upload/ZKOperator.java | 26 +-
.../helix/ControllerRequestURLBuilder.java | 19 +-
.../controller/helix/SegmentStatusChecker.java | 4 +-
.../helix/core/PinotHelixResourceManager.java | 911 +-
.../helix/core/PinotTableIdealStateBuilder.java | 22 +-
.../helix/core/SegmentDeletionManager.java | 6 +-
.../instance/InstanceAssignmentDriver.java | 24 +-
.../InstanceReplicaGroupPartitionSelector.java | 2 +-
.../instance/InstanceTagPoolSelector.java | 11 +-
.../segment/OfflineSegmentAssignment.java | 178 +-
.../segment/RealtimeSegmentAssignment.java | 209 +-
.../core/assignment/segment/SegmentAssignment.java | 4 +-
.../segment/SegmentAssignmentFactory.java | 4 +-
.../assignment/segment/SegmentAssignmentUtils.java | 71 +-
.../helix/core/minion/ClusterInfoProvider.java | 40 +-
.../core/minion/PinotHelixTaskResourceManager.java | 70 +-
.../helix/core/minion/PinotTaskManager.java | 9 +-
.../generator/ConvertToRawIndexTaskGenerator.java | 26 +-
.../core/minion/generator/PinotTaskGenerator.java | 28 +-
.../core/minion/generator/TaskGeneratorUtils.java | 2 +-
.../realtime/PinotLLCRealtimeSegmentManager.java | 1429 +-
.../core/realtime/PinotRealtimeSegmentManager.java | 13 +-
.../core/realtime/SegmentCompletionManager.java | 74 +-
.../helix/core/realtime/TableConfigCache.java | 14 +-
.../segment/CommittingSegmentDescriptor.java | 2 +-
.../segment/DefaultFlushThresholdUpdater.java | 45 +-
.../segment/FlushThresholdUpdateManager.java | 37 +-
.../realtime/segment/FlushThresholdUpdater.java | 20 +-
.../SegmentSizeBasedFlushThresholdUpdater.java | 123 +-
.../core/rebalance/RebalanceConfigConstants.java | 27 +-
.../helix/core/rebalance/RebalanceResult.java | 2 +-
.../helix/core/rebalance/TableRebalancer.java | 466 +-
.../core/relocation/RealtimeSegmentRelocator.java | 73 +-
.../helix/core/retention/RetentionManager.java | 8 +-
.../retention/strategy/TimeRetentionStrategy.java | 2 +-
.../helix/core/util/HelixSetupUtils.java | 15 +-
.../helix/core/util/ZKMetadataUtils.java | 8 +-
.../controller/util/AutoAddInvertedIndex.java | 30 +-
.../controller/util/SegmentIntervalUtils.java | 14 +-
.../controller/util/TableRetentionValidator.java | 11 +-
.../pinot/controller/util/TableSizeReader.java | 10 +-
.../BrokerResourceValidationManager.java | 2 +-
.../validation/OfflineSegmentIntervalChecker.java | 17 +-
.../RealtimeSegmentValidationManager.java | 26 +-
.../controller/validation/StorageQuotaChecker.java | 70 +-
.../src/main/resources/static/js/init.js | 96 +-
.../src/main/resources/static/query/index.html | 11 +-
.../src/main/resources/webapp/index.html | 11 +-
.../src/main/resources/webapp/js/init.js | 25 +-
.../controller/LeadControllerManagerTest.java | 17 +-
.../api/ControllerFilePathProviderTest.java | 116 +
.../controller/api/FileUploadPathProviderTest.java | 59 -
.../pinot/controller/api/PinotFileUploadTest.java | 7 +-
...PinotInstanceAssignmentRestletResourceTest.java | 55 +-
.../api/PinotInstanceRestletResourceTest.java | 146 +-
.../api/PinotSchemaRestletResourceTest.java | 36 +-
.../api/PinotSegmentRestletResourceTest.java | 14 +-
.../api/PinotTableRestletResourceTest.java | 191 +-
.../api/PinotTenantRestletResourceTest.java | 10 +-
.../api/SegmentCompletionProtocolDeserTest.java | 2 +-
.../controller/api/ServerTableSizeReaderTest.java | 2 +-
.../pinot/controller/api/TableSizeReaderTest.java | 4 +-
.../pinot/controller/api/TableViewsTest.java | 20 +-
.../controller/api/upload/ZKOperatorTest.java | 141 +
.../helix/ControllerInstanceToggleTest.java | 41 +-
.../controller/helix/ControllerSentinelTestV2.java | 13 +-
.../controller/helix/ControllerTenantTest.java | 14 +-
.../pinot/controller/helix/ControllerTest.java | 59 +-
.../pinot/controller/helix/HelixHelperTest.java | 2 +-
.../controller/helix/PinotControllerModeTest.java | 23 +-
.../controller/helix/PinotResourceManagerTest.java | 10 +-
.../controller/helix/SegmentStatusCheckerTest.java | 2 +-
.../helix/core/PinotHelixResourceManagerTest.java | 125 +-
.../instance/InstanceAssignmentTest.java | 160 +-
...fflineNonReplicaGroupSegmentAssignmentTest.java | 39 +-
.../OfflineReplicaGroupSegmentAssignmentTest.java | 90 +-
...altimeNonReplicaGroupSegmentAssignmentTest.java | 78 +-
.../RealtimeReplicaGroupSegmentAssignmentTest.java | 80 +-
.../segment/SegmentAssignmentUtilsTest.java | 4 +-
.../PinotLLCRealtimeSegmentManagerTest.java | 2132 +-
.../helix/core/realtime/SegmentCompletionTest.java | 32 +-
.../segment/FlushThresholdUpdaterTest.java | 770 +-
.../core/rebalance/TableRebalancerClusterTest.java | 55 +-
.../helix/core/rebalance/TableRebalancerTest.java | 91 +-
.../helix/core/retention/RetentionManagerTest.java | 26 +-
.../core/util/SegmentDeletionManagerTest.java | 4 +-
.../controller/utils/SegmentMetadataMockUtils.java | 10 +-
.../validation/StorageQuotaCheckerTest.java | 183 +-
.../validation/ValidationManagerTest.java | 26 +-
pinot-core/pom.xml | 69 +-
.../apache/pinot/core/common/BaseBlockValSet.java | 9 +-
.../apache/pinot/core/common/BlockMetadata.java | 2 +-
.../org/apache/pinot/core/common/BlockValSet.java | 4 +-
.../apache/pinot/core/common/DataBlockCache.java | 4 +-
.../org/apache/pinot/core/common/DataFetcher.java | 36 +-
.../org/apache/pinot/core/common/DataSource.java | 34 +-
.../pinot/core/common/DataSourceMetadata.java | 69 +-
.../apache/pinot/core/common/ObjectSerDeUtils.java | 54 +-
.../org/apache/pinot/core/common/Operator.java | 6 +-
.../org/apache/pinot/core/common/Predicate.java | 18 +-
.../core/common/RowBasedBlockValueFetcher.java | 217 +
.../core/common/datatable/DataTableBuilder.java | 150 +-
.../core/common/datatable/DataTableImplV2.java | 29 +-
.../core/common/datatable/DataTableUtils.java | 117 +-
.../core/common/predicate/BaseInPredicate.java | 16 +-
.../core/common/predicate/IsNotNullPredicate.java | 33 +
.../core/common/predicate/IsNullPredicate.java | 33 +
.../core/common/predicate/TextMatchPredicate.java | 44 +
.../apache/pinot/core/crypt/NoOpPinotCrypter.java | 47 -
.../org/apache/pinot/core/crypt/PinotCrypter.java | 50 -
.../pinot/core/crypt/PinotCrypterFactory.java | 87 -
.../org/apache/pinot/core/data/GenericRow.java | 128 -
.../core/data/aggregator/AvgValueAggregator.java | 4 +-
.../core/data/aggregator/CountValueAggregator.java | 2 +-
.../DistinctCountHLLValueAggregator.java | 4 +-
.../core/data/aggregator/MaxValueAggregator.java | 2 +-
.../aggregator/MinMaxRangeValueAggregator.java | 4 +-
.../core/data/aggregator/MinValueAggregator.java | 2 +-
.../aggregator/PercentileEstValueAggregator.java | 4 +-
.../PercentileTDigestValueAggregator.java | 4 +-
.../core/data/aggregator/SumValueAggregator.java | 2 +-
.../core/data/aggregator/ValueAggregator.java | 2 +-
.../data/aggregator/ValueAggregatorFactory.java | 2 +-
.../core/data/function/DateTimeFunctions.java | 43 +
.../data/function/DefaultFunctionEvaluator.java | 166 +
.../core/data/function/FunctionEvaluator.java | 39 +
.../data/function/FunctionEvaluatorFactory.java | 116 +
.../data/function/FunctionExpressionEvaluator.java | 156 -
.../pinot/core/data/function/FunctionRegistry.java | 16 +
.../data/function/GroovyFunctionEvaluator.java | 95 +
.../data/function/TimeSpecFunctionEvaluator.java | 72 +
.../core/data/manager/BaseTableDataManager.java | 77 +-
.../core/data/manager/InstanceDataManager.java | 48 +-
.../pinot/core/data/manager/TableDataManager.java | 48 +-
.../manager/config/TableDataManagerConfig.java | 6 +-
.../manager/offline/OfflineTableDataManager.java | 5 +-
.../manager/offline/TableDataManagerProvider.java | 4 +-
.../manager/realtime/DefaultSegmentCommitter.java | 53 +
.../realtime/HLRealtimeSegmentDataManager.java | 332 +-
.../realtime/LLRealtimeSegmentDataManager.java | 348 +-
.../manager/realtime/RealtimeTableDataManager.java | 113 +-
.../data/manager/realtime/SegmentCommitter.java | 36 +
.../manager/realtime/SegmentCommitterFactory.java | 49 +
.../data/manager/realtime/SegmentUploader.java | 28 +
.../realtime/Server2ControllerSegmentUploader.java | 90 +
.../manager/realtime/SplitSegmentCommitter.java | 81 +
.../apache/pinot/core/data/order/OrderByUtils.java | 295 -
.../pinot/core/data/readers/AvroRecordReader.java | 109 -
.../pinot/core/data/readers/CSVRecordReader.java | 153 -
.../core/data/readers/CSVRecordReaderConfig.java | 71 -
.../apache/pinot/core/data/readers/FileFormat.java | 23 -
.../core/data/readers/GenericRowRecordReader.java | 26 +-
.../pinot/core/data/readers/JSONRecordReader.java | 111 -
.../readers/MultiplePinotSegmentRecordReader.java | 43 +-
.../data/readers/PinotSegmentColumnReader.java | 6 +-
.../data/readers/PinotSegmentRecordReader.java | 55 +-
.../pinot/core/data/readers/RecordReader.java | 70 -
.../core/data/readers/RecordReaderConfig.java | 23 -
.../core/data/readers/RecordReaderFactory.java | 77 -
.../pinot/core/data/readers/RecordReaderUtils.java | 243 -
.../core/data/readers/ThriftRecordReader.java | 149 -
.../data/readers/ThriftRecordReaderConfig.java | 41 -
.../core/data/readers/sort/PinotSegmentSorter.java | 4 +-
.../recordtransformer/CompositeTransformer.java | 12 +-
.../recordtransformer/DataTypeTransformer.java | 71 +-
.../recordtransformer/ExpressionTransformer.java | 38 +-
.../recordtransformer/NullValueTransformer.java | 40 +-
.../core/data/recordtransformer/PinotDataType.java | 223 +-
.../data/recordtransformer/RecordTransformer.java | 2 +-
.../recordtransformer/SanitizationTransformer.java | 18 +-
.../data/recordtransformer/TimeTransformer.java | 95 -
.../apache/pinot/core/data/table/BaseTable.java | 101 +
.../core/data/table/ConcurrentIndexedTable.java | 161 +-
.../apache/pinot/core/data/table/IndexedTable.java | 67 +-
.../java/org/apache/pinot/core/data/table/Key.java | 44 +-
.../org/apache/pinot/core/data/table/Record.java | 51 +-
.../pinot/core/data/table/SimpleIndexedTable.java | 154 +-
.../org/apache/pinot/core/data/table/Table.java | 29 +-
.../apache/pinot/core/data/table/TableResizer.java | 437 +
.../pinot/core/indexsegment/IndexSegment.java | 7 +-
.../pinot/core/indexsegment/IndexSegmentUtils.java | 2 +-
.../generator/SegmentGeneratorConfig.java | 307 +-
.../immutable/ImmutableSegmentImpl.java | 15 +-
.../immutable/ImmutableSegmentLoader.java | 40 +-
.../core/indexsegment/mutable/MutableSegment.java | 6 +-
.../indexsegment/mutable/MutableSegmentImpl.java | 459 +-
.../io/reader/impl/ConstantMVForwardIndex.java | 52 +
.../io/reader/impl/ConstantMVInvertedIndex.java | 51 +
.../core/io/reader/impl/ConstantSVSortedIndex.java | 73 +
.../reader/impl/v1/BaseChunkSingleValueReader.java | 27 +-
.../io/reader/impl/v1/SortedIndexReaderImpl.java | 7 +
.../impl/v1/VarByteChunkSingleValueReader.java | 10 +-
.../BaseSingleColumnSingleValueReaderWriter.java | 10 +-
...xedByteSingleColumnSingleValueReaderWriter.java | 10 +
...VarByteSingleColumnSingleValueReaderWriter.java | 120 +
.../io/util/DictionaryDelegatingValueReader.java | 79 -
.../core/io/util/FixedByteValueReaderWriter.java | 11 +-
.../org/apache/pinot/core/io/util/ValueReader.java | 15 +-
.../io/util/VarLengthBytesValueReaderWriter.java | 53 +-
.../writer/impl/MutableOffHeapByteArrayStore.java | 81 +-
.../core/io/writer/impl/OffHeapStringStore.java | 222 -
.../writer/impl/v1/BaseChunkSingleValueWriter.java | 30 +-
.../impl/v1/FixedByteChunkSingleValueWriter.java | 5 +-
.../impl/v1/VarByteChunkSingleValueWriter.java | 15 +-
.../core/metadata/DefaultMetadataExtractor.java | 4 +-
.../pinot/core/metadata/MetadataExtractor.java | 2 +-
.../pinot/core/minion/BackfillDateTimeColumn.java | 207 -
.../apache/pinot/core/minion/PinotTaskConfig.java | 86 +
.../pinot/core/minion/RawIndexConverter.java | 27 +-
.../apache/pinot/core/minion/SegmentConverter.java | 77 +-
.../apache/pinot/core/minion/SegmentPurger.java | 101 +-
.../minion/rollup/MergeRollupSegmentConverter.java | 35 +-
.../core/minion/rollup/RollupRecordAggregator.java | 6 +-
.../rollup/aggregate/MaxValueAggregator.java | 2 +-
.../rollup/aggregate/SumValueAggregator.java | 2 +-
.../minion/rollup/aggregate/ValueAggregator.java | 2 +-
.../minion/segment/DefaultRecordPartitioner.java | 2 +-
.../core/minion/segment/MapperRecordReader.java | 37 +-
.../core/minion/segment/RecordAggregator.java | 2 +-
.../core/minion/segment/RecordPartitioner.java | 2 +-
.../core/minion/segment/RecordTransformer.java | 2 +-
.../core/minion/segment/ReducerRecordReader.java | 42 +-
.../apache/pinot/core/operator/BaseOperator.java | 4 +
.../core/operator/CombineGroupByOperator.java | 45 +-
.../operator/CombineGroupByOrderByOperator.java | 271 +
.../pinot/core/operator/CombineOperator.java | 190 +-
.../pinot/core/operator/DocIdSetOperator.java | 17 +-
.../pinot/core/operator/ExecutionStatistics.java | 23 +-
.../pinot/core/operator/ProjectionOperator.java | 15 +-
.../core/operator/blocks/BlockMetadataImpl.java | 2 +-
.../operator/blocks/IntermediateResultsBlock.java | 150 +-
.../core/operator/blocks/MultiValueBlock.java | 2 +-
.../core/operator/blocks/ProjectionBlock.java | 9 +-
.../core/operator/blocks/SingleValueBlock.java | 2 +-
.../operator/dociditerators/AndDocIdIterator.java | 16 +-
.../ExpressionScanDocIdIterator.java | 342 +
.../dociditerators/MVScanDocIdIterator.java | 21 +-
.../dociditerators/SVScanDocIdIterator.java | 12 +-
.../dociditerators/ScanBasedDocIdIterator.java | 7 +-
.../dociditerators/SortedDocIdIterator.java | 6 -
.../core/operator/docidsets/AndBlockDocIdSet.java | 218 +-
.../core/operator/docidsets/BitmapDocIdSet.java | 1 +
.../docidsets/ExpressionFilterDocIdSet.java | 84 +
.../operator/docidsets/FilterBlockDocIdSet.java | 4 +
.../core/operator/docidsets/ScanBasedDocIdSet.java | 28 +
.../docidsets/ScanBasedMultiValueDocIdSet.java | 2 +-
.../docidsets/ScanBasedSingleValueDocIdSet.java | 2 +-
.../core/operator/docidsets/SizeBasedDocIdSet.java | 3 +-
.../core/operator/docidsets/SortedDocIdSet.java | 1 +
.../core/operator/docidsets/StarTreeDocIdSet.java | 104 -
.../core/operator/docvalsets/MultiValueSet.java | 7 +-
.../operator/docvalsets/ProjectionBlockValSet.java | 75 +-
.../core/operator/docvalsets/SingleValueSet.java | 7 +-
.../operator/docvalsets/TransformBlockValSet.java | 12 +-
.../operator/filter/ExpressionFilterOperator.java | 336 +-
.../core/operator/filter/FilterOperatorUtils.java | 42 +-
.../SortedInvertedIndexBasedFilterOperator.java | 153 +-
.../operator/filter/TextMatchFilterOperator.java | 75 +
.../BaseDictionaryBasedPredicateEvaluator.java | 6 +-
.../BaseRawValueBasedPredicateEvaluator.java | 6 +-
.../predicate/EqualsPredicateEvaluatorFactory.java | 6 +-
.../predicate/InPredicateEvaluatorFactory.java | 8 +-
.../NotEqualsPredicateEvaluatorFactory.java | 6 +-
.../predicate/NotInPredicateEvaluatorFactory.java | 9 +-
.../filter/predicate/PredicateEvaluator.java | 3 +-
.../predicate/PredicateEvaluatorProvider.java | 10 +-
.../predicate/RangePredicateEvaluatorFactory.java | 63 +-
.../RegexpLikePredicateEvaluatorFactory.java | 2 +-
.../TextMatchPredicateEvaluatorFactory.java | 58 +
.../operator/query/AggregationGroupByOperator.java | 33 +-
.../query/AggregationGroupByOrderByOperator.java | 127 +
.../core/operator/query/AggregationOperator.java | 31 +-
.../query/DictionaryBasedAggregationOperator.java | 23 +-
.../operator/query/EmptySelectionOperator.java | 28 +-
.../query/MetadataBasedAggregationOperator.java | 18 +-
.../core/operator/query/SelectionOnlyOperator.java | 109 +
.../core/operator/query/SelectionOperator.java | 282 -
.../operator/query/SelectionOrderByOperator.java | 177 +
.../transform/TransformBlockDataFetcher.java | 337 -
.../core/operator/transform/TransformOperator.java | 26 +-
.../transform/TransformResultMetadata.java | 2 +-
.../function/AdditionTransformFunction.java | 41 +-
.../function/ArrayLengthTransformFunction.java | 112 +
.../transform/function/BaseTransformFunction.java | 751 +-
.../transform/function/CastTransformFunction.java | 108 +
.../DateTimeConversionTransformFunction.java | 21 +-
.../function/DateTruncTransformFunction.java | 256 +
.../function/DivisionTransformFunction.java | 69 +-
.../function/IdentifierTransformFunction.java | 42 +-
.../function/LiteralTransformFunction.java | 34 +-
.../function/MapValueTransformFunction.java | 93 +-
.../function/ModuloTransformFunction.java | 106 +
.../function/MultiplicationTransformFunction.java | 41 +-
.../function/SingleParamMathTransformFunction.java | 51 +-
.../function/SubtractionTransformFunction.java | 68 +-
.../function/TimeConversionTransformFunction.java | 5 +-
.../operator/transform/function/TimeZoneKey.java | 266 +
.../transform/function/TransformFunction.java | 38 +-
.../function/TransformFunctionFactory.java | 57 +-
.../function/ValueInTransformFunction.java | 42 +-
.../datetime/BaseDateTimeTransformer.java | 6 +-
.../datetime/DateTimeTransformerFactory.java | 6 +-
.../datetime/EpochToEpochTransformer.java | 4 +-
.../datetime/EpochToSDFTransformer.java | 4 +-
.../datetime/SDFToEpochTransformer.java | 4 +-
.../transformer/datetime/SDFToSDFTransformer.java | 4 +-
.../core/plan/AggregationFunctionInitializer.java | 38 -
.../plan/AggregationGroupByOrderByPlanNode.java | 126 +
.../core/plan/AggregationGroupByPlanNode.java | 11 +-
.../pinot/core/plan/AggregationPlanNode.java | 11 +-
.../apache/pinot/core/plan/CombinePlanNode.java | 82 +-
.../plan/DictionaryBasedAggregationPlanNode.java | 14 +-
.../org/apache/pinot/core/plan/FilterPlanNode.java | 20 +-
.../plan/MetadataBasedAggregationPlanNode.java | 17 +-
.../apache/pinot/core/plan/SelectionPlanNode.java | 35 +-
.../apache/pinot/core/plan/TransformPlanNode.java | 104 +-
.../core/plan/maker/BrokerRequestPreProcessor.java | 97 -
.../core/plan/maker/InstancePlanMakerImplV2.java | 22 +-
.../query/aggregation/AggregationExecutor.java | 3 +-
.../aggregation/AggregationFunctionContext.java | 42 +-
.../aggregation/DefaultAggregationExecutor.java | 67 +-
.../core/query/aggregation/DistinctTable.java | 249 +
.../aggregation/function/AggregationFunction.java | 91 +-
.../function/AggregationFunctionFactory.java | 89 +-
.../function/AggregationFunctionUtils.java | 130 +-
.../function/AggregationFunctionVisitorBase.java | 53 +-
.../function/AvgAggregationFunction.java | 197 +-
.../function/AvgMVAggregationFunction.java | 35 +-
.../function/CountAggregationFunction.java | 72 +-
.../function/CountMVAggregationFunction.java | 43 +-
.../function/DistinctAggregationFunction.java | 195 +
.../function/DistinctCountAggregationFunction.java | 114 +-
.../DistinctCountHLLAggregationFunction.java | 330 +-
.../DistinctCountHLLMVAggregationFunction.java | 125 +-
.../DistinctCountMVAggregationFunction.java | 70 +-
.../DistinctCountRawHLLAggregationFunction.java | 79 +-
.../DistinctCountRawHLLMVAggregationFunction.java | 37 +-
.../function/FastHLLAggregationFunction.java | 167 +-
.../function/MaxAggregationFunction.java | 68 +-
.../function/MaxMVAggregationFunction.java | 33 +-
.../function/MinAggregationFunction.java | 67 +-
.../function/MinMVAggregationFunction.java | 33 +-
.../function/MinMaxRangeAggregationFunction.java | 213 +-
.../function/MinMaxRangeMVAggregationFunction.java | 35 +-
.../function/PercentileAggregationFunction.java | 83 +-
.../function/PercentileEstAggregationFunction.java | 209 +-
.../PercentileEstMVAggregationFunction.java | 69 +-
.../function/PercentileMVAggregationFunction.java | 49 +-
.../PercentileTDigestAggregationFunction.java | 219 +-
.../PercentileTDigestMVAggregationFunction.java | 55 +-
.../function/SumAggregationFunction.java | 67 +-
.../function/SumMVAggregationFunction.java | 33 +-
.../function/customobject/SerializedHLL.java | 26 +-
.../groupby/AggregationGroupByTrimmingService.java | 6 +-
.../groupby/DefaultGroupByExecutor.java | 18 +-
.../groupby/DictionaryBasedGroupKeyGenerator.java | 27 +-
.../aggregation/groupby/GroupKeyGenerator.java | 1 +
.../NoDictionaryMultiColumnGroupKeyGenerator.java | 4 +-
.../NoDictionarySingleColumnGroupKeyGenerator.java | 2 +-
.../groupby/utils/ValueToIdMapFactory.java | 2 +-
.../core/query/config/SegmentPrunerConfig.java | 53 +-
.../query/exception/EarlyTerminationException.java | 32 +
.../pinot/core/query/executor/QueryExecutor.java | 5 -
.../query/executor/ServerQueryExecutorV1Impl.java | 91 +-
.../core/query/pruner/AbstractSegmentPruner.java | 106 -
.../query/pruner/ColumnValueSegmentPruner.java | 311 +-
.../core/query/pruner/DataSchemaSegmentPruner.java | 4 +-
.../core/query/pruner/PartitionSegmentPruner.java | 117 -
.../core/query/pruner/SegmentPrunerProvider.java | 1 -
.../core/query/pruner/SegmentPrunerService.java | 4 +-
.../core/query/pruner/ValidSegmentPruner.java | 2 +-
.../query/reduce/AggregationDataTableReducer.java | 166 +
.../core/query/reduce/BrokerReduceService.java | 402 +-
.../pinot/core/query/reduce/CombineService.java | 18 +-
.../pinot/core/query/reduce/DataTableReducer.java | 45 +
.../query/reduce/DistinctDataTableReducer.java | 175 +
.../core/query/reduce/GroupByDataTableReducer.java | 602 +
.../core/query/reduce/ResultReducerFactory.java | 60 +
.../query/reduce/SelectionDataTableReducer.java | 149 +
.../core/query/request/ServerQueryRequest.java | 7 +-
.../core/query/selection/SelectionFetcher.java | 125 -
.../query/selection/SelectionOperatorService.java | 330 +-
.../query/selection/SelectionOperatorUtils.java | 572 +-
.../comparator/CompositeDocIdValComparator.java | 85 -
.../comparator/DocIdDoubleValComparator.java | 44 -
.../comparator/DocIdFloatValComparator.java | 44 -
.../comparator/DocIdIntValComparator.java | 44 -
.../comparator/DocIdLongValComparator.java | 44 -
.../selection/comparator/IDocIdValComparator.java | 24 -
.../iterator/BytesSelectionColumnIterator.java | 50 -
.../DoubleArraySelectionColumnIterator.java | 45 -
.../iterator/DoubleSelectionColumnIterator.java | 42 -
.../FloatArraySelectionColumnIterator.java | 45 -
.../iterator/FloatSelectionColumnIterator.java | 42 -
.../iterator/IntArraySelectionColumnIterator.java | 45 -
.../iterator/IntSelectionColumnIterator.java | 42 -
.../iterator/LongArraySelectionColumnIterator.java | 45 -
.../iterator/LongSelectionColumnIterator.java | 42 -
.../iterator/SelectionColumnIterator.java | 31 -
.../SelectionMultiValueColumnIterator.java | 44 -
...SelectionSingleValueColumnWithDictIterator.java | 49 -
.../StringArraySelectionColumnIterator.java | 45 -
.../iterator/StringSelectionColumnIterator.java | 50 -
.../converter/RealtimeSegmentConverter.java | 152 +-
.../converter/RealtimeSegmentRecordReader.java | 35 +-
.../converter/stats/RealtimeColumnStatistics.java | 101 +-
.../stats/RealtimeNoDictionaryColStatistics.java | 58 +-
.../RealtimeSegmentSegmentCreationDataSource.java | 4 +-
.../stats/RealtimeSegmentStatsContainer.java | 29 +-
.../core/realtime/impl/RealtimeSegmentConfig.java | 106 +-
.../impl/ThreadSafeMutableRoaringBitmap.java | 54 +
.../impl/dictionary/BaseMutableDictionary.java | 72 +
.../dictionary/BaseOffHeapMutableDictionary.java | 86 +-
.../dictionary/BaseOnHeapMutableDictionary.java | 35 +-
.../dictionary/BytesOffHeapMutableDictionary.java | 184 +-
.../dictionary/BytesOnHeapMutableDictionary.java | 147 +-
.../dictionary/DoubleOffHeapMutableDictionary.java | 222 +-
.../dictionary/DoubleOnHeapMutableDictionary.java | 160 +-
.../dictionary/FloatOffHeapMutableDictionary.java | 223 +-
.../dictionary/FloatOnHeapMutableDictionary.java | 160 +-
.../dictionary/IntOffHeapMutableDictionary.java | 223 +-
.../dictionary/IntOnHeapMutableDictionary.java | 160 +-
.../dictionary/LongOffHeapMutableDictionary.java | 224 +-
.../dictionary/LongOnHeapMutableDictionary.java | 160 +-
.../impl/dictionary/MutableDictionary.java | 92 -
.../impl/dictionary/MutableDictionaryFactory.java | 4 +-
.../impl/dictionary/OffHeapMutableBytesStore.java | 259 +
.../dictionary/StringOffHeapMutableDictionary.java | 176 +-
.../dictionary/StringOnHeapMutableDictionary.java | 119 +-
.../invertedindex/RealtimeInvertedIndexReader.java | 33 +-
.../RealtimeLuceneDocIdCollector.java | 64 +
.../RealtimeLuceneIndexReaderRefreshThread.java | 151 +
.../RealtimeLuceneIndexRefreshState.java | 139 +
.../RealtimeLuceneTextIndexReader.java | 165 +
.../RealtimeNullValueVectorReaderWriter.java | 49 +
.../ConsumingSegmentAssignmentStrategy.java | 61 -
.../segment/RealtimeSegmentAssignmentStrategy.java | 41 -
.../stream/AvroRecordToPinotRowGenerator.java | 52 -
.../pinot/core/realtime/stream/MessageBatch.java | 75 -
.../pinot/core/realtime/stream/OffsetCriteria.java | 218 -
.../realtime/stream/PartitionCountFetcher.java | 81 -
.../realtime/stream/PartitionLevelConsumer.java | 43 -
.../stream/PartitionLevelStreamConfig.java | 84 -
.../realtime/stream/PartitionOffsetFetcher.java | 87 -
.../stream/PermanentConsumerException.java | 29 -
.../realtime/stream/SimpleAvroMessageDecoder.java | 84 -
.../pinot/core/realtime/stream/StreamConfig.java | 376 -
.../realtime/stream/StreamConfigProperties.java | 111 -
.../realtime/stream/StreamConsumerFactory.java | 74 -
.../stream/StreamConsumerFactoryProvider.java | 44 -
.../core/realtime/stream/StreamDataProducer.java | 35 -
.../core/realtime/stream/StreamDataProvider.java | 46 -
.../realtime/stream/StreamDataServerStartable.java | 56 -
.../realtime/stream/StreamDecoderProvider.java | 49 -
.../core/realtime/stream/StreamLevelConsumer.java | 60 -
.../core/realtime/stream/StreamMessageDecoder.java | 61 -
.../realtime/stream/StreamMessageMetadata.java | 47 -
.../realtime/stream/StreamMetadataProvider.java | 49 -
.../stream/TransientConsumerException.java | 29 -
.../core/segment/creator/InvertedIndexCreator.java | 13 +-
.../RecordReaderSegmentCreationDataSource.java | 15 +-
.../segment/creator/SegmentCreationDataSource.java | 2 +-
.../pinot/core/segment/creator/SegmentCreator.java | 4 +-
.../segment/creator/SegmentIndexCreationInfo.java | 27 -
.../creator/SegmentPreIndexStatsCollector.java | 5 +-
.../creator/SegmentPreIndexStatsContainer.java | 4 -
.../core/segment/creator/StatsCollectorConfig.java | 6 +-
.../pinot/core/segment/creator/TextIndexType.java | 24 +
.../creator/impl/SegmentColumnarIndexCreator.java | 315 +-
.../creator/impl/SegmentDictionaryCreator.java | 7 +-
.../impl/SegmentIndexCreationDriverImpl.java | 259 +-
.../core/segment/creator/impl/V1Constants.java | 62 +-
.../fwd/SingleValueVarByteRawIndexCreator.java | 11 +-
.../inv/OffHeapBitmapInvertedIndexCreator.java | 7 +-
.../impl/inv/OnHeapBitmapInvertedIndexCreator.java | 5 +
.../impl/inv/text/LuceneTextIndexCreator.java | 180 +
.../impl/nullvalue/NullValueVectorCreator.java | 65 +
.../stats/AbstractColumnStatisticsCollector.java | 39 +-
.../stats/BytesColumnPredIndexStatsCollector.java | 94 +-
.../stats/DoubleColumnPreIndexStatsCollector.java | 114 +-
.../stats/FloatColumnPreIndexStatsCollector.java | 114 +-
.../stats/IntColumnPreIndexStatsCollector.java | 111 +-
.../stats/LongColumnPreIndexStatsCollector.java | 114 +-
.../stats/SegmentPreIndexStatsCollectorImpl.java | 38 +-
.../stats/StringColumnPreIndexStatsCollector.java | 136 +-
.../pinot/core/segment/index/ColumnMetadata.java | 619 -
.../core/segment/index/SegmentMetadataImpl.java | 616 -
.../index/column/BaseVirtualColumnProvider.java | 45 +
.../segment/index/column/ColumnIndexContainer.java | 11 +
.../DefaultNullValueVirtualColumnProvider.java | 87 +
.../index/column/PhysicalColumnIndexContainer.java | 45 +-
.../converter/SegmentV1V2ToV3FormatConverter.java | 79 +-
.../index/data/source/ColumnDataSource.java | 182 -
.../segment/index/datasource/BaseDataSource.java | 108 +
.../index/datasource/ImmutableDataSource.java | 119 +
.../index/datasource/MutableDataSource.java | 123 +
.../segment/index/loader/IndexLoadingConfig.java | 72 +-
.../segment/index/loader/SegmentPreProcessor.java | 17 +-
.../index/loader/V3UpdateIndexException.java | 29 +
.../loader/bloomfilter/BloomFilterHandler.java | 17 +-
.../ColumnMinMaxValueGenerator.java | 11 +-
.../defaultcolumn/BaseDefaultColumnHandler.java | 168 +-
.../loader/defaultcolumn/DefaultColumnHandler.java | 5 +-
.../defaultcolumn/DefaultColumnHandlerFactory.java | 6 +-
.../defaultcolumn/V1DefaultColumnHandler.java | 23 +-
.../defaultcolumn/V3DefaultColumnHandler.java | 54 +-
.../loader/invertedindex/InvertedIndexHandler.java | 4 +-
.../loader/invertedindex/TextIndexHandler.java | 185 +
.../segment/index/metadata/ColumnMetadata.java | 570 +
.../segment/index/metadata/SegmentMetadata.java | 108 +
.../index/metadata/SegmentMetadataImpl.java | 528 +
.../core/segment/index/readers/BaseDictionary.java | 75 +-
.../index/readers/BaseImmutableDictionary.java | 267 +
.../index/readers/BitmapInvertedIndexReader.java | 68 +-
.../segment/index/readers/BytesDictionary.java | 44 +-
.../readers/ConstantValueBytesDictionary.java | 82 +
.../readers/ConstantValueDoubleDictionary.java | 73 +
.../readers/ConstantValueFloatDictionary.java | 73 +
.../index/readers/ConstantValueIntDictionary.java | 73 +
.../index/readers/ConstantValueLongDictionary.java | 73 +
.../readers/ConstantValueStringDictionary.java | 81 +
.../core/segment/index/readers/Dictionary.java | 50 +-
.../segment/index/readers/DocIdDictionary.java | 73 +
.../segment/index/readers/DoubleDictionary.java | 18 +-
.../segment/index/readers/FloatDictionary.java | 18 +-
.../index/readers/ImmutableDictionaryReader.java | 257 -
.../core/segment/index/readers/IntDictionary.java | 23 +-
.../segment/index/readers/InvertedIndexReader.java | 7 +
.../core/segment/index/readers/LongDictionary.java | 18 +-
.../index/readers/NullValueVectorReader.java | 43 +
.../index/readers/NullValueVectorReaderImpl.java | 43 +
.../segment/index/readers/OnHeapDictionary.java | 5 +-
.../index/readers/OnHeapDoubleDictionary.java | 43 +-
.../index/readers/OnHeapFloatDictionary.java | 38 +-
.../segment/index/readers/OnHeapIntDictionary.java | 28 +-
.../index/readers/OnHeapLongDictionary.java | 43 +-
.../index/readers/OnHeapStringDictionary.java | 73 +-
.../segment/index/readers/StringDictionary.java | 84 +-
.../index/readers/text/LuceneDocIdCollector.java | 74 +
.../index/readers/text/LuceneTextIndexReader.java | 214 +
.../pinot/core/segment/memory/PinotByteBuffer.java | 14 +-
.../pinot/core/segment/memory/PinotDataBuffer.java | 2 +-
.../segment/memory/PinotNativeOrderLBuffer.java | 2 +-
.../segment/memory/PinotNonNativeOrderLBuffer.java | 2 +-
.../name/NormalizedDateSegmentNameGenerator.java | 2 +-
.../core/segment/store/ColumnIndexDirectory.java | 77 +-
.../pinot/core/segment/store/ColumnIndexType.java | 4 +-
.../core/segment/store/FilePerIndexDirectory.java | 68 +-
.../pinot/core/segment/store/SegmentDirectory.java | 35 +-
.../core/segment/store/SegmentDirectoryPaths.java | 36 +-
.../segment/store/SegmentLocalFSDirectory.java | 121 +-
.../segment/store/SingleFileIndexDirectory.java | 65 +-
.../virtualcolumn/BaseVirtualColumnProvider.java | 43 -
.../virtualcolumn/DocIdVirtualColumnProvider.java | 96 +-
.../HostNameVirtualColumnProvider.java | 29 -
.../IntSingleValueDataFileReader.java | 62 -
.../SegmentNameVirtualColumnProvider.java | 29 -
.../SingleStringVirtualColumnProvider.java | 174 -
.../virtualcolumn/VirtualColumnContext.java | 29 +-
.../virtualcolumn/VirtualColumnIndexContainer.java | 6 +
.../virtualcolumn/VirtualColumnProvider.java | 2 +-
.../VirtualColumnProviderFactory.java | 42 +-
.../pinot/core/startree/DimensionBuffer.java | 77 -
.../apache/pinot/core/startree/MetricBuffer.java | 150 -
.../core/startree/OffHeapStarTreeBuilder.java | 855 -
.../pinot/core/startree/StarTreeBuilder.java | 85 -
.../pinot/core/startree/StarTreeBuilderConfig.java | 125 -
.../pinot/core/startree/StarTreeDataTable.java | 216 -
.../apache/pinot/core/startree/StarTreeNode.java | 1 -
.../apache/pinot/core/startree/StarTreeUtils.java | 19 +-
.../executor/StarTreeAggregationExecutor.java | 27 +-
.../startree/executor/StarTreeGroupByExecutor.java | 38 +-
.../apache/pinot/core/startree/hll/HllUtil.java | 157 -
.../startree/plan/StarTreeTransformPlanNode.java | 3 +-
.../startree/v2/builder/BaseSingleTreeBuilder.java | 8 +-
.../startree/v2/builder/MultipleTreesBuilder.java | 3 -
.../v2/builder/StarTreeV2BuilderConfig.java | 2 +-
.../core/startree/v2/store/StarTreeDataSource.java | 98 +
.../v2/store/StarTreeDimensionDataSource.java | 125 -
.../startree/v2/store/StarTreeIndexContainer.java | 39 +-
.../startree/v2/store/StarTreeLoaderUtils.java | 93 +-
.../v2/store/StarTreeMetricDataSource.java | 130 -
.../pinot/core/transport/AsyncQueryResponse.java | 27 +-
.../pinot/core/transport/DataTableHandler.java | 29 +-
.../core/transport/InstanceRequestHandler.java | 126 +
.../apache/pinot/core/transport/QueryRouter.java | 41 +-
.../apache/pinot/core/transport/QueryServer.java | 89 +
.../org/apache/pinot/core/transport/Server.java | 107 -
.../pinot/core/transport/ServerChannels.java | 24 +-
.../pinot/core/transport/ServerInstance.java | 99 +
.../pinot/core/transport/ServerResponse.java | 26 +-
.../core/transport/ServerRoutingInstance.java | 95 +
.../org/apache/pinot/core/util/ArrayCopyUtils.java | 15 +
.../java/org/apache/pinot/core/util/AvroUtils.java | 334 -
.../org/apache/pinot/core/util/CleanerUtil.java | 199 +
.../java/org/apache/pinot/core/util/CrcUtils.java | 18 +-
.../pinot/core/util/FixedIntArrayOffHeapIdMap.java | 100 +-
.../org/apache/pinot/core/util/GroupByUtils.java | 57 +
.../org/apache/pinot/core/util/QueryOptions.java | 78 +
.../apache/pinot/core/util/ReplicationUtils.java | 13 +-
.../org/apache/pinot/core/util/SchemaUtils.java | 126 +
.../core/util/SegmentCompletionProtocolUtils.java | 74 +
.../apache/pinot/core/util/trace/TraceContext.java | 2 +-
.../server/realtime/ControllerLeaderLocator.java | 236 +-
.../ServerSegmentCompletionProtocolHandler.java | 105 +-
.../transform/function/zone-index.properties | 2215 ++
.../apache/pinot/core/common/DataFetcherTest.java | 15 +-
.../core/common/RealtimeNoDictionaryTest.java | 70 +-
.../core/common/datatable/DataTableUtilsTest.java | 86 +
.../pinot/core/crypt/PinotCrypterFactoryTest.java | 68 -
.../function/DateTimeFunctionEvaluatorTest.java | 59 +
.../function/DefaultFunctionEvaluatorTest.java | 102 +
.../function/FunctionExpressionEvaluatorTest.java | 98 -
.../data/function/GroovyFunctionEvaluatorTest.java | 87 +
.../data/manager/BaseTableDataManagerTest.java | 7 +-
.../realtime/LLRealtimeSegmentDataManagerTest.java | 144 +-
.../Server2ControllerSegmentUploaderTest.java | 104 +
.../pinot/core/data/order/OrderByUtilsTest.java | 265 -
.../readers/BackfillDateTimeRecordReaderTest.java | 255 -
.../core/data/readers/CSVRecordReaderTest.java | 75 -
.../core/data/readers/JSONRecordReaderTest.java | 69 -
.../MultiplePinotSegmentRecordReaderTest.java | 28 +-
.../data/readers/PinotSegmentRecordReaderTest.java | 30 +-
.../pinot/core/data/readers/PinotSegmentUtil.java | 19 +-
.../data/readers/RecordReaderSampleDataTest.java | 135 +-
.../pinot/core/data/readers/RecordReaderTest.java | 53 -
.../core/data/readers/RecordReaderUtilsTest.java | 88 -
.../core/data/readers/ThriftRecordReaderTest.java | 156 -
.../pinot/core/data/readers/ThriftSampleData.java | 1256 -
.../ExpressionTransformerTest.java | 162 +
.../ExpressionTransformerTimeTest.java | 173 +
.../data/recordtransformer/PinotDataTypeTest.java | 150 +-
.../recordtransformer/RecordTransformerTest.java | 157 +-
.../recordtransformer/TimeTransformerTest.java | 151 -
.../pinot/core/data/table/IndexedTableTest.java | 353 +-
.../pinot/core/data/table/TableResizerTest.java | 627 +
.../generator/SegmentGeneratorConfigTest.java | 34 +-
.../MutableSegmentImplAggregateMetricsTest.java | 12 +-
.../MutableSegmentImplNullValueVectorTest.java | 94 +
.../mutable/MutableSegmentImplTest.java | 41 +-
.../mutable/MutableSegmentImplTestUtils.java | 17 +-
.../util/VarLengthBytesValueReaderWriterTest.java | 8 +-
.../io/writer/impl/OffHeapStringStoreTest.java | 119 -
.../minion/MergeRollupSegmentConverterTest.java | 28 +-
.../pinot/core/minion/SegmentConverterTest.java | 107 +-
.../pinot/core/minion/SegmentPurgerTest.java | 35 +-
.../core/operator/CombineSlowOperatorsTest.java | 155 +
.../function/ArrayLengthTransformFunctionTest.java | 61 +
.../function/BaseTransformFunctionTest.java | 26 +-
.../function/CastTransformFunctionTest.java | 74 +
.../function/DateTruncTransformFunctionTest.java | 177 +
.../function/ModuloTransformFunctionTest.java | 104 +
.../function/ValueInTransformFunctionTest.java | 3 +-
.../pinot/core/plan/CombinePlanNodeTest.java | 11 +-
...adataAndDictionaryAggregationPlanMakerTest.java | 117 +-
.../pinot/core/predicate/InPredicateTest.java | 2 +-
.../NoDictionaryEqualsPredicateEvaluatorsTest.java | 14 +-
.../NoDictionaryInPredicateEvaluatorTest.java | 10 +-
.../NoDictionaryRangePredicateEvaluatorTest.java | 5 +-
.../predicate/PredicateEvaluatorTestUtils.java | 1 -
...ngeOfflineDictionaryPredicateEvaluatorTest.java | 55 +-
.../function/AggregationFunctionFactoryTest.java | 225 +-
.../function/AggregationFunctionTypeTest.java | 70 -
.../function/AggregationFunctionUtilsTest.java | 66 +
.../query/pruner/ColumnValueSegmentPrunerTest.java | 127 +
.../query/scheduler/PrioritySchedulerTest.java | 7 +-
.../resources/BoundedAccountingExecutorTest.java | 31 +-
.../impl/dictionary/DictionaryPerfRunner.java | 140 -
.../impl/dictionary/MultiValueDictionaryTest.java | 71 +-
.../impl/dictionary/MutableDictionaryTest.java | 98 +-
.../dictionary/OffHeapMutableBytesStoreTest.java | 142 +
.../fakestream/FakePartitionLevelConsumer.java | 8 +-
.../impl/fakestream/FakeStreamConfigUtils.java | 6 +-
.../impl/fakestream/FakeStreamConsumerFactory.java | 38 +-
.../impl/fakestream/FakeStreamLevelConsumer.java | 4 +-
.../impl/fakestream/FakeStreamMessageBatch.java | 2 +-
.../impl/fakestream/FakeStreamMessageDecoder.java | 38 +-
.../fakestream/FakeStreamMetadataProvider.java | 8 +-
.../RealtimeNullValueVectorReaderWriterTest.java | 51 +
.../ConsumingSegmentAssignmentStrategyTest.java | 285 -
.../stream/AvroRecordToPinotRowGeneratorTest.java | 55 -
.../stream/MetadataEqualsHashCodeTest.java | 1 +
.../core/realtime/stream/OffsetCriteriaTest.java | 1 +
.../core/realtime/stream/StreamConfigTest.java | 252 +-
.../impl/nullvalue/NullValueVectorCreatorTest.java | 68 +
.../core/segment/index/ColumnMetadataTest.java | 50 +-
.../segment/index/SegmentMetadataImplTest.java | 12 +-
.../DefaultNullValueVirtualColumnProviderTest.java | 177 +
.../SegmentV1V2ToV3FormatConverterTest.java | 12 +-
.../segment/index/creator/RawIndexCreatorTest.java | 14 +-
.../SegmentGenerationWithBytesTypeTest.java | 46 +-
.../SegmentGenerationWithNullValueVectorTest.java | 282 +
.../SegmentGenerationWithTimeColumnTest.java | 75 +-
.../index/creator/SegmentPartitionTest.java | 89 +-
.../core/segment/index/loader/LoaderTest.java | 227 +-
.../index/loader/SegmentPreProcessorTest.java | 194 +-
.../BaseDefaultColumnHandlerTest.java | 208 +
.../readers/ImmutableDictionaryReaderTest.java | 295 -
.../index/readers/ImmutableDictionaryTest.java | 360 +
.../ImmutableDictionaryTypeConversionTest.java | 385 +
.../readers/NullValueVectorReaderImplTest.java | 68 +
.../store/ColumnIndexDirectoryTestHelper.java | 44 +-
.../segment/store/FilePerIndexDirectoryTest.java | 20 +-
.../segment/store/SegmentLocalFSDirectoryTest.java | 33 +-
.../store/SingleFileIndexDirectoryTest.java | 16 +-
.../pinot/core/startree/BaseStarTreeIndexTest.java | 128 -
.../core/startree/OffHeapStarTreeBuilderTest.java | 126 -
.../pinot/core/startree/StarTreeDataTableTest.java | 79 -
.../startree/StarTreeIndexTestSegmentHelper.java | 130 -
.../pinot/core/startree/SumStarTreeIndexTest.java | 114 -
.../pinot/core/startree/TestStarTreeMetadata.java | 131 -
.../pinot/core/startree/hll/HllFieldSizeTest.java | 53 -
.../core/startree/hll/HllIndexCreationTest.java | 182 -
.../core/startree/hll/HllStarTreeIndexTest.java | 138 -
.../core/startree/hll/HllTypeConversionTest.java | 72 -
.../OffHeapStarTreeBuilderWithHllFieldTest.java | 252 -
.../hll/SegmentWithHllIndexCreateHelper.java | 189 -
.../pinot/core/startree/v2/AvgStarTreeV2Test.java | 2 +-
.../pinot/core/startree/v2/BaseStarTreeV2Test.java | 12 +-
.../core/startree/v2/CountStarTreeV2Test.java | 2 +-
.../v2/DistinctCountHLLStarTreeV2Test.java | 2 +-
.../pinot/core/startree/v2/MaxStarTreeV2Test.java | 2 +-
.../startree/v2/MinMaxRangeStarTreeV2Test.java | 2 +-
.../pinot/core/startree/v2/MinStarTreeV2Test.java | 2 +-
.../startree/v2/PercentileEstStarTreeV2Test.java | 2 +-
.../v2/PercentileTDigestStarTreeV2Test.java | 2 +-
.../v2/PreAggregatedAvgStarTreeV2Test.java | 2 +-
...reAggregatedDistinctCountHLLStarTreeV2Test.java | 2 +-
.../v2/PreAggregatedMinMaxRangeStarTreeV2Test.java | 2 +-
.../PreAggregatedPercentileEstStarTreeV2Test.java | 2 +-
...eAggregatedPercentileTDigestStarTreeV2Test.java | 2 +-
.../pinot/core/startree/v2/SumStarTreeV2Test.java | 2 +-
.../apache/pinot/core/transport/DummyServer.java | 97 -
.../pinot/core/transport/QueryRouterTest.java | 230 -
.../pinot/core/transport/QueryRoutingTest.java | 236 +
.../org/apache/pinot/core/util/CrcUtilsTest.java | 5 +-
.../apache/pinot/core/util/SchemaUtilsTest.java | 191 +
.../pinot/core/util/trace/TraceContextTest.java | 2 +-
.../FixedByteChunkSingleValueReaderWriteTest.java | 25 +-
...ByteSingleColumnMultiValueReaderWriterTest.java | 2 +-
.../VarByteChunkSingleValueReaderWriteTest.java | 120 +-
...yteSingleColumnSingleValueReaderWriterTest.java | 96 +
.../pinot/queries/BaseMultiValueQueriesTest.java | 13 +-
.../org/apache/pinot/queries/BaseQueriesTest.java | 141 +-
.../pinot/queries/BaseSingleValueQueriesTest.java | 26 +-
.../apache/pinot/queries/DistinctQueriesTest.java | 679 +
.../apache/pinot/queries/FastHllQueriesTest.java | 110 +-
...nerSegmentAggregationMultiValueQueriesTest.java | 24 +-
...erSegmentAggregationSingleValueQueriesTest.java | 70 +
...InnerSegmentSelectionMultiValueQueriesTest.java | 103 +-
...nnerSegmentSelectionSingleValueQueriesTest.java | 127 +-
...terSegmentAggregationMultiValueQueriesTest.java | 311 +-
...erSegmentAggregationSingleValueQueriesTest.java | 209 +-
.../InterSegmentOrderByMultiValueQueriesTest.java | 141 +
.../InterSegmentOrderBySingleValueQueriesTest.java | 686 +
...terSegmentResultTableMultiValueQueriesTest.java | 902 +
...erSegmentResultTableSingleValueQueriesTest.java | 987 +
.../queries/PercentileTDigestMVQueriesTest.java | 16 +-
.../queries/PercentileTDigestQueriesTest.java | 24 +-
.../org/apache/pinot/queries/QueriesTestUtils.java | 114 +-
.../RangePredicateWithSortedInvertedIndexTest.java | 242 +
.../queries/SelectionOnlyEarlyTerminationTest.java | 123 +
.../pinot/queries/SerializedBytesQueriesTest.java | 794 +
.../pinot/queries/TextSearchQueriesTest.java | 1234 +
.../apache/pinot/queries/TransformQueriesTest.java | 89 +-
.../DefaultAggregationExecutorTest.java | 26 +-
.../AggregationGroupByTrimmingServiceTest.java | 24 +-
.../DictionaryBasedGroupKeyGeneratorTest.java | 12 +-
.../groupby/NoDictionaryGroupKeyGeneratorTest.java | 17 +-
.../pinot/query/executor/QueryExecutorTest.java | 50 +-
.../query/pruner/ColumnValueSegmentPrunerTest.java | 100 -
.../selection/SelectionOperatorServiceTest.java | 232 +-
.../converter/RealtimeSegmentConverterTest.java | 34 +-
.../v1/creator/BitmapInvertedIndexCreatorTest.java | 4 +-
.../v1/creator/BitmapInvertedIndexTest.java | 9 +-
.../pinot/segments/v1/creator/BlocksTest.java | 2 +-
.../segments/v1/creator/DictionariesTest.java | 161 +-
.../pinot/segments/v1/creator/IntArraysTest.java | 13 +-
.../v1/creator/OnHeapDictionariesTest.java | 14 +-
.../segments/v1/creator/SegmentTestUtils.java | 79 +-
.../realtime/ControllerLeaderLocatorTest.java | 174 +-
.../pinot/spi/crypt/PinotCrypterFactoryTest.java | 68 +
.../test/java/org/apache/pinot/util/TestUtils.java | 19 +-
.../test/resources/conf/query-executor.properties | 6 +-
.../groovy_expression_transformer.json | 62 +
.../src/test/resources/data/fixedByteCompressed.v2 | Bin 0 -> 8098 bytes
pinot-core/src/test/resources/data/fixedByteRaw.v2 | Bin 0 -> 16036 bytes
.../src/test/resources/data/newColumnsSchema3.json | 10 +
.../resources/data/newColumnsWithTextSchema.json | 76 +
.../data/test_null_value_vector_data.json | 12 +
.../data/test_null_value_vector_pinot_schema.json | 26 +
.../text_search_data/group_by_grep_results.out | 26 +
.../resources/data/text_search_data/pql_query1.txt | 24150 +++++++++++++++++++
.../resources/data/text_search_data/skills.txt | 24 +
.../resources/data/varByteStringsCompressed.v2 | Bin 0 -> 17355 bytes
.../src/test/resources/data/varByteStringsRaw.v2 | Bin 0 -> 286902 bytes
pinot-distribution/pinot-assembly.xml | 104 +-
pinot-distribution/pinot-source-assembly.xml | 2 +-
pinot-distribution/pom.xml | 94 +-
pinot-hadoop-filesystem/pom.xml | 79 -
.../org/apache/pinot/filesystem/HadoopPinotFS.java | 263 -
pinot-hadoop/README.md | 78 -
pinot-hadoop/pom.xml | 171 -
.../pinot/hadoop/PinotHadoopJobLauncher.java | 92 -
.../org/apache/pinot/hadoop/io/FileHandler.java | 172 -
.../pinot/hadoop/io/JsonPinotOutputFormat.java | 99 -
.../apache/pinot/hadoop/io/PinotOutputFormat.java | 258 -
.../org/apache/pinot/hadoop/io/PinotRecord.java | 83 -
.../pinot/hadoop/io/PinotRecordSerialization.java | 47 -
.../apache/pinot/hadoop/io/PinotRecordWriter.java | 129 -
.../apache/pinot/hadoop/job/BaseSegmentJob.java | 84 -
.../apache/pinot/hadoop/job/ControllerRestApi.java | 42 -
.../pinot/hadoop/job/DefaultControllerRestApi.java | 192 -
.../pinot/hadoop/job/JobConfigConstants.java | 62 -
.../pinot/hadoop/job/SegmentCreationJob.java | 267 -
.../pinot/hadoop/job/SegmentPreprocessingJob.java | 453 -
.../apache/pinot/hadoop/job/SegmentTarPushJob.java | 115 -
.../apache/pinot/hadoop/job/SegmentUriPushJob.java | 68 -
.../hadoop/job/mappers/SegmentCreationMapper.java | 348 -
.../job/mappers/SegmentPreprocessingMapper.java | 122 -
.../job/partitioners/GenericPartitioner.java | 65 -
.../job/partitioners/PartitionFunctionFactory.java | 98 -
.../job/reducers/SegmentPreprocessingReducer.java | 84 -
.../pinot/hadoop/utils/JobPreparationHelper.java | 69 -
.../apache/pinot/hadoop/utils/PushLocation.java | 54 -
.../hadoop/io/DeleteExtraPushedSegmentsTest.java | 102 -
.../pinot/hadoop/io/PinotOutputFormatTest.java | 179 -
pinot-integration-tests/pom.xml | 83 +-
.../tests/BaseClusterIntegrationTest.java | 81 +-
.../tests/BaseClusterIntegrationTestSet.java | 334 +-
.../tests/ChaosMonkeyIntegrationTest.java | 4 +-
.../tests/ClusterIntegrationTestUtils.java | 224 +-
.../pinot/integration/tests/ClusterTest.java | 230 +-
.../ControllerPeriodicTasksIntegrationTests.java | 68 +-
...vertToRawIndexMinionClusterIntegrationTest.java | 46 +-
.../DefaultCommitterRealtimeIntegrationTest.java | 202 +
.../DeleteAPIHybridClusterIntegrationTest.java | 320 -
...lakyConsumerRealtimeClusterIntegrationTest.java | 37 +-
...mentBuildPushOfflineClusterIntegrationTest.java | 255 -
.../tests/HybridClusterIntegrationTest.java | 74 +-
...ridClusterIntegrationTestCommandLineRunner.java | 22 +-
.../tests/LLCRealtimeClusterIntegrationTest.java | 31 +-
.../LuceneRealtimeClusterIntegrationTest.java | 188 +
.../tests/MapTypeClusterIntegrationTest.java | 308 +-
...onaryAggregationPlanClusterIntegrationTest.java | 12 +-
.../MultiNodesOfflineClusterIntegrationTest.java | 16 +-
.../tests/NewConfigApplyIntegrationTest.java | 116 -
.../tests/OfflineClusterIntegrationTest.java | 176 +-
.../tests/PinotURIUploadIntegrationTest.java | 34 +-
.../pinot/integration/tests/QueryGenerator.java | 2 +-
.../tests/RealtimeClusterIntegrationTest.java | 22 +-
.../tests/SegmentCompletionIntegrationTest.java | 4 +-
.../tests/ServerStarterIntegrationTest.java | 123 +
.../tests/SimpleMinionClusterIntegrationTest.java | 66 +-
.../tests/StarTreeClusterIntegrationTest.java | 91 +-
.../tests/StarTreeV2ClusterIntegrationTest.java | 156 -
.../ControllerLeaderLocatorIntegrationTest.java | 168 +
.../apache/pinot/server/util/SegmentTestUtils.java | 61 +
.../src/test/resources/OnTimeStarTreeQueries.txt | 1000 -
...rformance_2014_100k_subset.test_queries_10K.sql | 10005 ++++++++
.../src/test/resources/log4j2.xml | 2 +-
.../src/test/resources/mytable-updated.conf | 16 -
.../src/test/resources/mytable.conf | 16 -
.../src/test/resources/profiles/test1.conf | 1 -
.../src/test/resources/profiles/test2.conf | 1 -
pinot-minion/pom.xml | 8 +-
.../org/apache/pinot/minion/MinionContext.java | 12 +-
.../org/apache/pinot/minion/MinionStarter.java | 53 +-
.../minion/events/DefaultMinionEventObserver.java | 11 +-
.../events/EventObserverFactoryRegistry.java | 6 +-
.../pinot/minion/events/MinionEventObserver.java | 11 +-
.../BaseMultipleSegmentsConversionExecutor.java | 14 +-
.../BaseSingleSegmentConversionExecutor.java | 55 +-
.../executor/ConvertToRawIndexTaskExecutor.java | 10 +-
.../pinot/minion/executor/PinotTaskExecutor.java | 13 +-
.../pinot/minion/executor/PurgeTaskExecutor.java | 18 +-
.../minion/executor/SegmentConversionResult.java | 2 +-
.../minion/executor/SegmentConversionUtils.java | 4 +-
.../minion/taskfactory/TaskFactoryRegistry.java | 2 +-
.../minion/executor/PurgeTaskExecutorTest.java | 45 +-
pinot-orc/pom.xml | 77 -
.../pinot/orc/data/readers/ORCRecordReader.java | 209 -
.../orc/data/readers/ORCRecordReaderTest.java | 176 -
pinot-parquet/pom.xml | 90 -
.../parquet/data/readers/ParquetRecordReader.java | 102 -
.../pinot/parquet/data/readers/ParquetUtils.java | 87 -
.../data/readers/ParquetRecordReaderTest.java | 101 -
pinot-perf/pom.xml | 5 +-
.../apache/pinot/perf/BenchmarkCombineGroupBy.java | 256 +
.../org/apache/pinot/perf/BenchmarkDictionary.java | 117 +-
.../pinot/perf/BenchmarkDictionaryCreation.java | 4 +-
.../perf/BenchmarkGroovyExpressionEvaluation.java | 190 +
.../apache/pinot/perf/BenchmarkIndexedTable.java | 94 +-
.../perf/BenchmarkOffHeapDictionaryMemory.java | 10 +-
.../perf/BenchmarkOffHeapMutableBytesStore.java | 147 +
.../pinot/perf/BenchmarkOfflineIndexReader.java | 14 +-
.../pinot/perf/BenchmarkPinotDataBuffer.java | 139 +
.../apache/pinot/perf/BenchmarkQueryEngine.java | 4 +-
.../perf/BenchmarkRealtimeConsumptionSpeed.java | 4 +-
.../pinot/perf/BenchmarkStringDictionary.java | 10 +-
.../org/apache/pinot/perf/RawIndexBenchmark.java | 12 +-
.../org/apache/pinot/perf/RealtimeStressTest.java | 4 +-
.../pinot/perf/StringDictionaryPerfTest.java | 97 +-
.../pinot-batch-ingestion-common/pom.xml | 39 +
.../batch/common/SegmentGenerationTaskRunner.java | 149 +
.../batch/common/SegmentGenerationUtils.java | 166 +
.../ingestion/batch/common/SegmentPushUtils.java | 153 +
.../batch/common/TestSegmentGenerationUtils.java | 40 +
.../pinot-batch-ingestion-hadoop/pom.xml | 84 +
.../batch/hadoop/HadoopSegmentCreationMapper.java | 228 +
.../hadoop/HadoopSegmentGenerationJobRunner.java | 323 +
.../hadoop/HadoopSegmentTarPushJobRunner.java | 107 +
.../hadoop/HadoopSegmentUriPushJobRunner.java | 107 +
.../segmentCreationAndTarPushJobSpec.yaml | 45 +
.../segmentCreationAndUriPushJobSpec.yaml | 45 +
.../src/main/resources/segmentCreationJobSpec.yaml | 42 +
.../src/main/resources/segmentTarPushJobSpec.yaml | 45 +
.../src/main/resources/segmentUriPushJobSpec.yaml | 45 +
.../pinot-batch-ingestion-spark/pom.xml | 75 +
.../spark/SparkSegmentGenerationJobRunner.java | 356 +
.../batch/spark/SparkSegmentTarPushJobRunner.java | 128 +
.../batch/spark/SparkSegmentUriPushJobRunner.java | 128 +
.../segmentCreationAndTarPushJobSpec.yaml | 45 +
.../segmentCreationAndUriPushJobSpec.yaml | 45 +
.../src/main/resources/segmentCreationJobSpec.yaml | 42 +
.../src/main/resources/segmentTarPushJobSpec.yaml | 45 +
.../src/main/resources/segmentUriPushJobSpec.yaml | 45 +
.../pinot-batch-ingestion-standalone/pom.xml | 46 +
.../standalone/SegmentGenerationJobRunner.java | 219 +
.../batch/standalone/SegmentTarPushJobRunner.java | 100 +
.../batch/standalone/SegmentUriPushJobRunner.java | 105 +
.../segmentCreationAndTarPushJobSpec.yaml | 45 +
.../segmentCreationAndUriPushJobSpec.yaml | 45 +
.../src/main/resources/segmentCreationJobSpec.yaml | 42 +
.../src/main/resources/segmentTarPushJobSpec.yaml | 45 +
.../src/main/resources/segmentUriPushJobSpec.yaml | 45 +
pinot-plugins/pinot-batch-ingestion/pom.xml | 67 +
.../v0_deprecated/pinot-hadoop/README.md | 25 +
.../v0_deprecated/pinot-hadoop/pom.xml | 204 +
.../pinot/hadoop/PinotHadoopJobLauncher.java | 88 +
.../pinot/hadoop/io/CombineAvroKeyInputFormat.java | 0
.../org/apache/pinot/hadoop/io/FileHandler.java | 172 +
.../pinot/hadoop/io/JsonPinotOutputFormat.java | 99 +
.../apache/pinot/hadoop/io/PinotOutputFormat.java | 182 +
.../org/apache/pinot/hadoop/io/PinotRecord.java | 83 +
.../pinot/hadoop/io/PinotRecordSerialization.java | 47 +
.../apache/pinot/hadoop/io/PinotRecordWriter.java | 129 +
.../pinot/hadoop/job/HadoopSegmentCreationJob.java | 179 +
.../hadoop/job/HadoopSegmentPreprocessingJob.java | 432 +
.../pinot/hadoop/job/InternalConfigConstants.java | 0
.../hadoop/job/mappers/SegmentCreationMapper.java | 382 +
.../job/mappers/SegmentPreprocessingMapper.java | 126 +
.../job/partitioners/GenericPartitioner.java | 67 +
.../job/partitioners/PartitionFunctionFactory.java | 95 +
.../job/reducers/SegmentPreprocessingReducer.java | 85 +
.../utils/PinotHadoopJobPreparationHelper.java | 48 +
.../hadoop/io/DeleteExtraPushedSegmentsTest.java | 102 +
.../pinot/hadoop/io/PinotOutputFormatTest.java | 169 +
.../hadoop/job/mappers/SegmentCreationTest.java | 75 +
.../v0_deprecated/pinot-ingestion-common/pom.xml | 59 +
.../pinot/ingestion/common/ControllerRestApi.java | 42 +
.../ingestion/common/DefaultControllerRestApi.java | 211 +
.../pinot/ingestion/common/JobConfigConstants.java | 79 +
.../ingestion/common/PinotIngestionJobType.java | 28 +
.../pinot/ingestion/jobs/BaseSegmentJob.java | 178 +
.../pinot/ingestion/jobs/SegmentCreationJob.java | 169 +
.../ingestion/jobs/SegmentPreprocessingJob.java | 115 +
.../pinot/ingestion/jobs/SegmentTarPushJob.java | 123 +
.../pinot/ingestion/jobs/SegmentUriPushJob.java | 77 +
.../ingestion/utils/JobPreparationHelper.java | 51 +
.../apache/pinot/ingestion/utils/PushLocation.java | 55 +
.../v0_deprecated/pinot-spark/README.md | 25 +
.../v0_deprecated/pinot-spark/pom.xml | 198 +
.../apache/pinot/spark/PinotSparkJobLauncher.java | 84 +
.../spark/jobs/SparkSegmentCreationFunction.java | 319 +
.../pinot/spark/jobs/SparkSegmentCreationJob.java | 180 +
.../pinot/spark/jobs/SparkSegmentTarPushJob.java | 88 +
.../pinot/spark/jobs/SparkSegmentUriPushJob.java | 71 +
.../utils/PinotSparkJobPreparationHelper.java | 49 +
.../pinot-batch-ingestion/v0_deprecated/pom.xml | 47 +
pinot-plugins/pinot-file-system/pinot-adls/pom.xml | 49 +
.../pinot/plugin/filesystem/ADLSGen2PinotFS.java | 462 +
.../pinot/plugin/filesystem/AzurePinotFS.java | 262 +
.../pinot/plugin/filesystem/AzurePinotFSUtil.java | 89 +
.../datalake/store/MockADLFileInputStream.java | 0
.../plugin/filesystem/test/AzurePinotFSTest.java | 88 +
.../filesystem/test/AzurePinotFSUtilTest.java | 101 +
pinot-plugins/pinot-file-system/pinot-gcs/pom.xml | 134 +
.../apache/pinot/plugin/filesystem/GcsPinotFS.java | 399 +
pinot-plugins/pinot-file-system/pinot-hdfs/pom.xml | 43 +
.../pinot/plugin/filesystem/HadoopPinotFS.java | 268 +
.../pinot/plugin/filesystem/HadoopPinotFSTest.java | 58 +
pinot-plugins/pinot-file-system/pinot-s3/pom.xml | 183 +
.../apache/pinot/plugin/filesystem/S3PinotFS.java | 516 +
.../pinot/plugin/filesystem/S3PinotFSTest.java | 315 +
.../pinot/plugin/filesystem/S3TestUtils.java | 45 +
.../pinot-s3/src/test/resources/copyFile.txt | 10 +
.../pinot-s3/src/test/resources/log4j2.xml | 5 +
pinot-plugins/pinot-file-system/pom.xml | 58 +
.../pinot-input-format/pinot-avro-base/pom.xml | 54 +
.../inputformat/avro/AvroRecordExtractor.java | 49 +
.../plugin/inputformat/avro/AvroRecordReader.java | 84 +
.../plugin/inputformat/avro/AvroSchemaUtil.java | 84 +
.../pinot/plugin/inputformat/avro/AvroUtils.java | 332 +
.../avro/AvroRecordExtractorMapTypeTest.java | 123 +
.../inputformat/avro/AvroRecordExtractorTest.java | 84 +
.../inputformat/avro/AvroRecordReaderTest.java | 62 +
.../avro/AvroRecordToPinotRowGeneratorTest.java | 61 +
.../plugin/inputformat/avro/AvroUtilsTest.java | 66 +
.../src/test/resources/fake_avro_schema.avsc | 0
.../pinot-input-format/pinot-avro/pom.xml | 45 +
.../inputformat/avro/KafkaAvroMessageDecoder.java | 297 +
.../inputformat/avro/SimpleAvroMessageDecoder.java | 96 +
.../pinot-confluent-avro/pom.xml | 109 +
...aConfluentSchemaRegistryAvroMessageDecoder.java | 72 +
pinot-plugins/pinot-input-format/pinot-csv/pom.xml | 48 +
.../plugin/inputformat/csv/CSVRecordExtractor.java | 72 +
.../inputformat/csv/CSVRecordExtractorConfig.java | 38 +
.../plugin/inputformat/csv/CSVRecordReader.java | 135 +
.../inputformat/csv/CSVRecordReaderConfig.java | 72 +
.../inputformat/csv/CSVRecordExtractorTest.java | 103 +
.../inputformat/csv/CSVRecordReaderTest.java | 99 +
.../pinot-input-format/pinot-json/pom.xml | 44 +
.../inputformat/json/JSONRecordExtractor.java | 99 +
.../plugin/inputformat/json/JSONRecordReader.java | 97 +
.../inputformat/json/JSONRecordExtractorTest.java | 65 +
.../inputformat/json/JSONRecordReaderTest.java | 81 +
pinot-plugins/pinot-input-format/pinot-orc/pom.xml | 53 +
.../plugin/inputformat/orc/ORCRecordReader.java | 344 +
.../inputformat/orc/ORCRecordExtractorTest.java | 120 +
.../inputformat/orc/ORCRecordReaderTest.java | 144 +
.../pinot-input-format/pinot-parquet/pom.xml | 48 +
.../parquet/ParquetRecordExtractor.java | 51 +
.../inputformat/parquet/ParquetRecordReader.java | 84 +
.../plugin/inputformat/parquet/ParquetUtils.java | 255 +
.../parquet/ParquetRecordExtractorTest.java | 86 +
.../parquet/ParquetRecordReaderTest.java | 65 +
.../pinot-input-format/pinot-thrift/pom.xml | 48 +
.../inputformat/thrift/ThriftRecordExtractor.java | 58 +
.../thrift/ThriftRecordExtractorConfig.java | 39 +
.../inputformat/thrift/ThriftRecordReader.java | 131 +
.../thrift/ThriftRecordReaderConfig.java | 42 +
.../inputformat/thrift/ThriftRecordReaderTest.java | 162 +
.../inputformat/thrift/ThriftSampleData.java | 1256 +
pinot-plugins/pinot-input-format/pom.xml | 72 +
.../pinot-stream-ingestion}/README.md | 0
.../pinot-kafka-0.9/README.md | 24 +
.../pinot-stream-ingestion/pinot-kafka-0.9/pom.xml | 74 +
.../plugin/stream/kafka09/ConsumerAndIterator.java | 57 +
.../plugin/stream/kafka09/KafkaBrokerWrapper.java | 81 +
.../stream/kafka09/KafkaConnectionHandler.java | 442 +
.../stream/kafka09/KafkaConsumerFactory.java | 53 +
.../stream/kafka09/KafkaConsumerManager.java | 191 +
.../stream/kafka09/KafkaHighLevelStreamConfig.java | 161 +
.../stream/kafka09/KafkaLowLevelStreamConfig.java | 146 +
.../kafka09/KafkaPartitionLevelConsumer.java | 135 +
.../stream/kafka09/KafkaSimpleConsumerFactory.java | 30 +
.../kafka09/KafkaSimpleConsumerFactoryImpl.java | 32 +
.../stream/kafka09/KafkaStreamLevelConsumer.java | 120 +
.../kafka09/KafkaStreamMetadataProvider.java | 231 +
.../stream/kafka09/SimpleConsumerFactory.java | 29 +
.../stream/kafka09/SimpleConsumerMessageBatch.java | 55 +
.../stream/kafka09/server/KafkaDataProducer.java | 57 +
.../kafka09/server/KafkaDataServerStartable.java | 109 +
...g.apache.pinot.spi.stream.StreamConsumerFactory | 19 +
.../kafka09/KafkaLowLevelStreamConfigTest.java | 163 +
.../kafka09/KafkaPartitionLevelConsumerTest.java | 356 +
.../pinot-kafka-2.0/README.md | 57 +
.../pinot-stream-ingestion/pinot-kafka-2.0/pom.xml | 96 +
.../stream/kafka20/KafkaConsumerFactory.java | 50 +
.../plugin/stream/kafka20/KafkaMessageBatch.java | 63 +
.../KafkaPartitionLevelConnectionHandler.java | 73 +
.../kafka20/KafkaPartitionLevelConsumer.java | 66 +
.../kafka20/KafkaPartitionLevelStreamConfig.java | 147 +
.../stream/kafka20/KafkaStreamLevelConsumer.java | 161 +
.../kafka20/KafkaStreamLevelConsumerManager.java | 194 +
.../kafka20/KafkaStreamLevelStreamConfig.java | 135 +
.../kafka20/KafkaStreamMetadataProvider.java | 67 +
.../stream/kafka20/server/KafkaDataProducer.java | 77 +
.../kafka20/server/KafkaDataServerStartable.java | 98 +
...g.apache.pinot.spi.stream.StreamConsumerFactory | 19 +
...tionLevelConsumerBackwardCompatibilityTest.java | 55 +
.../kafka20/KafkaPartitionLevelConsumerTest.java | 302 +
.../KafkaPartitionLevelStreamConfigTest.java | 164 +
.../stream/kafka20/utils/EmbeddedZooKeeper.java | 60 +
.../stream/kafka20/utils/MiniKafkaCluster.java | 175 +
.../pinot-kafka-base}/README.md | 0
.../pinot-kafka-base/pom.xml | 47 +
.../stream/kafka/KafkaJSONMessageDecoder.java | 79 +
.../stream/kafka/KafkaStreamConfigProperties.java | 66 +
.../plugin/stream/kafka/MessageAndOffset.java | 53 +
.../stream/kafka/KafkaJSONMessageDecoderTest.java | 119 +
.../src/test/resources/data/test_sample_data.json | 10001 ++++++++
.../test_sample_data_schema_no_time_field.json | 51 +
...sample_data_schema_with_outgoing_time_spec.json | 63 +
...ple_data_schema_without_outgoing_time_spec.json | 58 +
pinot-plugins/pinot-stream-ingestion/pom.xml | 47 +
pinot-plugins/pom.xml | 133 +
pinot-server/pom.xml | 48 +-
.../pinot/server/api/access/AccessControl.java | 38 +
.../server/api/access/AccessControlFactory.java | 30 +
.../server/api/access/AllowAllAccessFactory.java | 37 +
.../api/resources/DefaultExceptionMapper.java | 2 +-
.../server/api/resources/SchedulerResource.java | 48 -
.../pinot/server/api/resources/TablesResource.java | 77 +-
.../server/request/ScheduledRequestHandler.java | 77 -
.../apache/pinot/server/starter/ServerBuilder.java | 127 -
.../pinot/server/starter/ServerInstance.java | 112 +-
.../server/starter/helix/AdminApiApplication.java | 6 +-
.../helix/DefaultHelixStarterServerConfig.java | 8 +-
.../starter/helix/HelixInstanceDataManager.java | 134 +-
.../helix/HelixInstanceDataManagerConfig.java | 8 +
.../server/starter/helix/HelixServerStarter.java | 167 +-
.../starter/helix/SegmentFetcherAndLoader.java | 40 +-
.../helix/SegmentMessageHandlerFactory.java | 64 +-
.../SegmentOnlineOfflineStateModelFactory.java | 20 +-
.../apache/pinot/server/api/AccessControlTest.java | 87 +
.../apache/pinot/server/api/BaseResourceTest.java | 47 +-
.../pinot/server/api/TableSizeResourceTest.java | 55 +-
.../pinot/server/api/TablesResourceTest.java | 116 +-
.../request/ScheduledRequestHandlerTest.java | 210 -
.../apache/pinot/server/util/SegmentTestUtils.java | 61 -
pinot-spi/pom.xml | 140 +
.../pinot/spi/annotations/InterfaceAudience.java | 76 +
.../pinot/spi/annotations/InterfaceStability.java | 75 +
.../apache/pinot/spi/config/BaseJsonConfig.java | 67 +
.../apache/pinot/spi/config/instance/Instance.java | 87 +
.../pinot/spi/config/instance/InstanceType.java | 23 +
.../spi/config/table/ColumnPartitionConfig.java | 57 +
.../pinot/spi/config/table/CompletionConfig.java | 45 +
.../apache/pinot/spi/config/table/FieldConfig.java | 85 +
.../pinot/spi/config/table/IndexingConfig.java | 201 +
.../apache/pinot/spi/config/table/QueryConfig.java | 51 +
.../apache/pinot/spi/config/table/QuotaConfig.java | 96 +
.../config/table/ReplicaGroupStrategyConfig.java | 64 +
.../pinot/spi/config/table/RoutingConfig.java | 63 +
.../spi/config/table/SegmentPartitionConfig.java | 69 +
.../SegmentsValidationAndRetentionConfig.java | 155 +
.../spi/config/table/StarTreeIndexConfig.java | 66 +
.../apache/pinot/spi/config/table/TableConfig.java | 236 +
.../pinot/spi/config/table/TableCustomConfig.java | 43 +
.../pinot/spi/config/table/TableTaskConfig.java | 51 +
.../apache/pinot/spi/config/table/TableType.java | 23 +
.../pinot/spi/config/table/TagOverrideConfig.java | 69 +
.../pinot/spi/config/table/TenantConfig.java | 62 +
.../pinot/spi/config/table/UpsertConfig.java | 70 +
.../table/assignment/InstanceAssignmentConfig.java | 65 +
.../table/assignment/InstanceConstraintConfig.java | 43 +
.../table/assignment/InstancePartitionsType.java | 37 +
.../InstanceReplicaGroupPartitionConfig.java | 84 +
.../table/assignment/InstanceTagPoolConfig.java | 71 +
.../org/apache/pinot/spi/config/tenant/Tenant.java | 74 +
.../apache/pinot/spi/config/tenant/TenantRole.java | 23 +
.../apache/pinot/spi/crypt/NoOpPinotCrypter.java | 47 +
.../org/apache/pinot/spi/crypt/PinotCrypter.java | 50 +
.../pinot/spi/crypt/PinotCrypterFactory.java | 87 +
.../apache/pinot/spi/data/DateTimeFieldSpec.java | 142 +
.../pinot/spi/data/DateTimeFormatPatternSpec.java | 106 +
.../apache/pinot/spi/data/DateTimeFormatSpec.java | 253 +
.../pinot/spi/data/DateTimeFormatUnitSpec.java | 152 +
.../pinot/spi/data/DateTimeGranularitySpec.java | 140 +
.../apache/pinot/spi/data/DimensionFieldSpec.java | 67 +
.../java/org/apache/pinot/spi/data/FieldSpec.java | 387 +
.../org/apache/pinot/spi/data/MetricFieldSpec.java | 62 +
.../java/org/apache/pinot/spi/data/Schema.java | 634 +
.../org/apache/pinot/spi/data/TimeFieldSpec.java | 227 +
.../apache/pinot/spi/data/TimeGranularitySpec.java | 285 +
.../apache/pinot/spi/data/readers/FileFormat.java | 23 +
.../apache/pinot/spi/data/readers/GenericRow.java | 201 +
.../pinot/spi/data/readers/RecordExtractor.java | 46 +
.../spi/data/readers/RecordExtractorConfig.java | 25 +
.../pinot/spi/data/readers/RecordReader.java | 69 +
.../pinot/spi/data/readers/RecordReaderConfig.java | 23 +
.../spi/data/readers/RecordReaderFactory.java | 178 +
.../pinot/spi/data/readers/RecordReaderUtils.java | 123 +
.../apache/pinot/spi/filesystem/LocalPinotFS.java | 179 +
.../org/apache/pinot/spi/filesystem/PinotFS.java | 241 +
.../pinot/spi/filesystem/PinotFSFactory.java | 91 +
.../spi/ingestion/batch/IngestionJobLauncher.java | 102 +
.../ingestion/batch/runner/IngestionJobRunner.java | 49 +
.../pinot/spi/ingestion/batch/spec/Constants.java | 26 +
.../batch/spec/ExecutionFrameworkSpec.java | 93 +
.../spi/ingestion/batch/spec/PinotClusterSpec.java | 48 +
.../spi/ingestion/batch/spec/PinotFSSpec.java | 89 +
.../spi/ingestion/batch/spec/PushJobSpec.java | 108 +
.../spi/ingestion/batch/spec/RecordReaderSpec.java | 120 +
.../batch/spec/SegmentGenerationJobSpec.java | 237 +
.../batch/spec/SegmentGenerationTaskSpec.java | 122 +
.../batch/spec/SegmentNameGeneratorSpec.java | 56 +
.../pinot/spi/ingestion/batch/spec/TableSpec.java | 75 +
.../java/org/apache/pinot/spi/plugin/Plugin.java | 53 +
.../apache/pinot/spi/plugin/PluginClassLoader.java | 148 +
.../org/apache/pinot/spi/plugin/PluginManager.java | 284 +
.../org/apache/pinot/spi/stream/MessageBatch.java | 74 +
.../apache/pinot/spi/stream/OffsetCriteria.java | 218 +
.../pinot/spi/stream/PartitionCountFetcher.java | 81 +
.../pinot/spi/stream/PartitionLevelConsumer.java | 43 +
.../spi/stream/PartitionLevelStreamConfig.java | 79 +
.../pinot/spi/stream/PartitionOffsetFetcher.java | 87 +
.../spi/stream/PermanentConsumerException.java | 29 +
.../org/apache/pinot/spi/stream/RowMetadata.java | 43 +
.../org/apache/pinot/spi/stream/StreamConfig.java | 371 +
.../pinot/spi/stream/StreamConfigProperties.java | 111 +
.../pinot/spi/stream/StreamConsumerFactory.java | 72 +
.../spi/stream/StreamConsumerFactoryProvider.java | 45 +
.../pinot/spi/stream/StreamDataProducer.java | 35 +
.../pinot/spi/stream/StreamDataProvider.java | 45 +
.../spi/stream/StreamDataServerStartable.java | 56 +
.../pinot/spi/stream/StreamDecoderProvider.java | 52 +
.../pinot/spi/stream/StreamLevelConsumer.java | 59 +
.../pinot/spi/stream/StreamMessageDecoder.java | 67 +
.../pinot/spi/stream/StreamMessageMetadata.java | 44 +
.../pinot/spi/stream/StreamMetadataProvider.java | 49 +
.../spi/stream/TransientConsumerException.java | 29 +
.../java/org/apache/pinot/spi/utils/ByteArray.java | 112 +
.../org/apache/pinot/spi/utils/BytesUtils.java | 62 +
.../org/apache/pinot/spi/utils/DataSizeUtils.java | 94 +
.../org/apache/pinot/spi/utils/EqualityUtils.java | 134 +
.../java/org/apache/pinot/spi/utils/JsonUtils.java | 188 +
.../org/apache/pinot/spi/utils/StringUtils.java | 53 +
.../org/apache/pinot/spi/utils/TimeConverter.java | 67 +
.../java/org/apache/pinot/spi/utils/TimeUtils.java | 182 +
.../spi/utils/builder/TableConfigBuilder.java | 328 +
.../pinot/spi/utils/builder/TableNameBuilder.java | 130 +
.../spi/utils/retry/AttemptFailureException.java | 37 +
.../spi/utils/retry/AttemptsExceededException.java | 30 +
.../pinot/spi/utils/retry/BaseRetryPolicy.java | 63 +
.../utils/retry/ExponentialBackoffRetryPolicy.java | 46 +
.../spi/utils/retry/FixedDelayRetryPolicy.java | 36 +
.../pinot/spi/utils/retry/NoDelayRetryPolicy.java | 34 +
.../utils/retry/RetriableOperationException.java | 29 +
.../pinot/spi/utils/retry/RetryPolicies.java | 61 +
.../apache/pinot/spi/utils/retry/RetryPolicy.java | 39 +
.../pinot/spi/config/table/IndexingConfigTest.java | 93 +
.../pinot/spi/config/table/QuotaConfigTest.java | 129 +
.../pinot/spi/config/table/UpsertConfigTest.java | 72 +
.../apache/pinot/spi/config/tenant/TenantTest.java | 41 +
.../data/readers/AbstractRecordExtractorTest.java | 154 +
.../spi/data/readers/AbstractRecordReaderTest.java | 174 +
.../spi/data/readers/RecordReaderUtilsTest.java | 46 +
.../pinot/spi/filesystem/LocalPinotFSTest.java | 245 +
.../pinot/spi/filesystem/PinotFSFactoryTest.java | 138 +
.../apache/pinot/spi/plugin/PluginManagerTest.java | 145 +
.../apache/pinot/spi/utils/TimeConverterTest.java | 100 +
.../pinot/spi/utils/retry/RetryPolicyTest.java | 100 +
pinot-spi/src/test/resources/TestRecordReader.java | 62 +
.../groovy_map_transform_functions_schema.json | 27 +
.../groovy_transform_functions_schema.json | 44 +
.../src/test/resources/log4j2.xml | 0
pinot-tools/pom.xml | 75 +-
.../apache/pinot/tools/ClusterStateVerifier.java | 2 +-
.../apache/pinot/tools/GitHubEventsQuickstart.java | 151 +
.../org/apache/pinot/tools/HybridQuickstart.java | 95 +-
.../apache/pinot/tools/PinotIdealstateChanger.java | 2 +-
.../apache/pinot/tools/PinotNumReplicaChanger.java | 6 +-
.../apache/pinot/tools/PinotTableRebalancer.java | 7 +-
.../org/apache/pinot/tools/PinotToolLauncher.java | 12 +-
.../org/apache/pinot/tools/PinotZKChanger.java | 2 +-
.../java/org/apache/pinot/tools/Quickstart.java | 30 +-
.../apache/pinot/tools/QuickstartTableRequest.java | 16 +-
.../org/apache/pinot/tools/RealtimeQuickStart.java | 19 +-
.../org/apache/pinot/tools/SegmentDumpTool.java | 6 +-
.../apache/pinot/tools/StarTreeIndexViewer.java | 4 +-
.../org/apache/pinot/tools/UpdateSegmentState.java | 5 +-
.../pinot/tools/admin/PinotAdministrator.java | 26 +-
.../admin/command/AbstractBaseAdminCommand.java | 37 +-
.../tools/admin/command/AddSchemaCommand.java | 8 +-
.../pinot/tools/admin/command/AddTableCommand.java | 80 +-
.../tools/admin/command/AddTenantCommand.java | 11 +-
.../tools/admin/command/AnonymizeDataCommand.java | 185 +
.../admin/command/ApplyTableConfigCommand.java | 150 -
.../admin/command/AvroSchemaToPinotSchema.java | 9 +-
.../command/BackfillDateTimeColumnCommand.java | 230 -
.../tools/admin/command/CreateSegmentCommand.java | 256 +-
.../tools/admin/command/GenerateDataCommand.java | 75 +-
.../command/GitHubEventsQuickStartCommand.java | 72 +
.../command/LaunchDataIngestionJobCommand.java | 72 +
.../tools/admin/command/MoveReplicaGroup.java | 16 +-
.../OfflineSegmentIntervalCheckerCommand.java | 7 +-
.../admin/command/OperateClusterConfigCommand.java | 149 +
.../tools/admin/command/PostQueryCommand.java | 25 +-
.../tools/admin/command/QuickStartCommand.java | 91 +
.../tools/admin/command/QuickstartRunner.java | 58 +-
.../command/RealtimeProvisioningHelperCommand.java | 14 +-
.../tools/admin/command/RebalanceTableCommand.java | 58 +-
.../admin/command/ShowClusterInfoCommand.java | 2 +-
.../admin/command/StartControllerCommand.java | 5 -
.../tools/admin/command/StartKafkaCommand.java | 18 +-
.../tools/admin/command/StartZookeeperCommand.java | 25 +-
.../admin/command/StreamAvroIntoKafkaCommand.java | 68 +-
.../admin/command/StreamGitHubEventsCommand.java | 111 +
.../tools/admin/command/ValidateConfigCommand.java | 7 +-
.../tools/admin/command/VerifySegmentState.java | 2 +-
.../anonymizer/ArrayBasedGlobalDictionaries.java | 384 +
.../pinot/tools/anonymizer/GlobalDictionaries.java | 39 +
.../anonymizer/MapBasedGlobalDictionaries.java | 288 +
.../anonymizer/PinotDataAndQueryAnonymizer.java | 1207 +
.../pinot/tools/backfill/BackfillSegmentUtils.java | 2 +-
.../tools/config/validator/SchemaValidator.java | 5 +-
.../config/validator/TableConfigValidator.java | 3 +-
.../pinot/tools/data/generator/AvroWriter.java | 9 +-
.../pinot/tools/data/generator/DataGenerator.java | 70 +-
.../tools/data/generator/DataGeneratorSpec.java | 23 +-
.../tools/data/generator/GeneratorFactory.java | 50 +-
.../tools/data/generator/NumberGenerator.java | 2 +-
.../data/generator/PatternMixtureGenerator.java | 96 +
.../data/generator/PatternSeasonalGenerator.java | 119 +
.../data/generator/PatternSequenceGenerator.java | 73 +
.../data/generator/PatternSpikeGenerator.java | 95 +
.../data/generator/PatternStringGenerator.java | 69 +
.../pinot/tools/data/generator/PatternType.java | 33 +
.../tools/data/generator/SchemaAnnotation.java | 16 +
.../tools/filesystem/PinotFSBenchmarkDriver.java | 249 +
.../tools/filesystem/PinotFSBenchmarkRunner.java | 79 +
.../pinot/tools/perf/PerfBenchmarkDriver.java | 35 +-
.../pinot/tools/perf/PerfBenchmarkRunner.java | 2 +-
.../tools/query/comparison/ClusterStarter.java | 32 +-
.../tools/query/comparison/QueryComparison.java | 2 +-
.../query/comparison/SegmentInfoProvider.java | 4 +-
.../query/comparison/StarQueryComparison.java | 130 -
.../query/comparison/StarTreeQueryGenerator.java | 57 -
.../realtime/provisioning/MemoryEstimator.java | 50 +-
.../apache/pinot/tools/scan/query/Aggregation.java | 6 +-
.../pinot/tools/scan/query/InPredicateFilter.java | 19 +-
.../tools/scan/query/NotInPredicateFilter.java | 15 +-
.../apache/pinot/tools/scan/query/Projection.java | 4 +-
.../pinot/tools/scan/query/QueryResponse.java | 2 +-
.../tools/scan/query/ScanBasedQueryProcessor.java | 2 +-
.../tools/scan/query/SegmentQueryProcessor.java | 16 +-
.../apache/pinot/tools/scan/query/Selection.java | 2 +-
.../converter/ColumnarToStarTreeConverter.java | 170 -
.../converter/DictionaryToRawIndexConverter.java | 4 +-
.../converter/PinotSegmentConvertCommand.java | 2 +-
.../converter/PinotSegmentToAvroConverter.java | 14 +-
.../converter/PinotSegmentToCsvConverter.java | 2 +-
.../converter/PinotSegmentToJsonConverter.java | 4 +-
.../segment/converter/SegmentMergeCommand.java | 33 +-
.../pinot/tools/streams/AirlineDataStream.java | 43 +-
.../pinot/tools/streams/MeetupRsvpStream.java | 22 +-
.../streams/githubevents/GitHubAPICaller.java | 205 +
.../githubevents/PullRequestMergedEvent.java | 370 +
.../PullRequestMergedEventsStream.java | 307 +
.../pinot/tools/tuner/IndexTunerCommand.java | 4 +-
.../meta/manager/JsonFileMetaManagerImpl.java | 2 +-
.../manager/collector/CompressedFilePathIter.java | 58 +-
.../collector/SegmentMetadataCollector.java | 2 +-
.../pinot/tools/tuner/strategy/FrequencyImpl.java | 40 +-
.../tools/tuner/strategy/ParserBasedImpl.java | 95 +-
.../strategy/QuantileAnalysisAccumulator.java | 19 +-
.../tools/tuner/strategy/QuantileAnalysisImpl.java | 72 +-
.../org/apache/pinot/tools/utils/JarUtils.java | 83 +
.../pinot/tools/utils/KafkaStarterUtils.java | 118 +
.../src/main/resources/appAssemblerScriptTemplate | 81 +-
.../src/main/resources/conf/pinot-admin-log4j2.xml | 14 +-
.../main/resources/conf/pinot-broker-log4j2.xml | 9 +-
.../resources/conf/pinot-controller-log4j2.xml | 9 +-
.../resources/conf/pinot-ingestion-job-log4j2.xml | 46 +
.../main/resources/conf/pinot-server-log4j2.xml | 9 +-
.../src/main/resources/conf/pinot-tools-log4j2.xml | 14 +-
.../src/main/resources/conf/quickstart-log4j2.xml | 14 +-
.../conf/sample_filesystem_benchmark.conf | 5 +
.../conf/sample_realtime_table_config.json | 2 +-
.../airlineStats_offline_table_config.json | 18 +
.../batch/airlineStats}/airlineStats_schema.json | 0
.../batch/airlineStats/hadoopIngestionJobSpec.yaml | 149 +
.../batch/airlineStats/ingestionJobSpec.yaml | 129 +
.../2014/01/01/airlineStats_data_2014-01-01.avro | Bin 0 -> 95558 bytes
.../2014/01/02/airlineStats_data_2014-01-02.avro | Bin 0 -> 131341 bytes
.../2014/01/03/airlineStats_data_2014-01-03.avro | Bin 0 -> 133695 bytes
.../2014/01/04/airlineStats_data_2014-01-04.avro | Bin 0 -> 99505 bytes
.../2014/01/05/airlineStats_data_2014-01-05.avro | Bin 0 -> 138821 bytes
.../2014/01/06/airlineStats_data_2014-01-06.avro | Bin 0 -> 117175 bytes
.../2014/01/07/airlineStats_data_2014-01-07.avro | Bin 0 -> 94419 bytes
.../2014/01/08/airlineStats_data_2014-01-08.avro | Bin 0 -> 103923 bytes
.../2014/01/09/airlineStats_data_2014-01-09.avro | Bin 0 -> 115270 bytes
.../2014/01/10/airlineStats_data_2014-01-10.avro | Bin 0 -> 111616 bytes
.../2014/01/11/airlineStats_data_2014-01-11.avro | Bin 0 -> 88295 bytes
.../2014/01/12/airlineStats_data_2014-01-12.avro | Bin 0 -> 90734 bytes
.../2014/01/13/airlineStats_data_2014-01-13.avro | Bin 0 -> 96718 bytes
.../2014/01/14/airlineStats_data_2014-01-14.avro | Bin 0 -> 103051 bytes
.../2014/01/15/airlineStats_data_2014-01-15.avro | Bin 0 -> 102655 bytes
.../2014/01/16/airlineStats_data_2014-01-16.avro | Bin 0 -> 103979 bytes
.../2014/01/17/airlineStats_data_2014-01-17.avro | Bin 0 -> 95776 bytes
.../2014/01/18/airlineStats_data_2014-01-18.avro | Bin 0 -> 81763 bytes
.../2014/01/19/airlineStats_data_2014-01-19.avro | Bin 0 -> 90973 bytes
.../2014/01/20/airlineStats_data_2014-01-20.avro | Bin 0 -> 92739 bytes
.../2014/01/21/airlineStats_data_2014-01-21.avro | Bin 0 -> 99818 bytes
.../2014/01/22/airlineStats_data_2014-01-22.avro | Bin 0 -> 95224 bytes
.../2014/01/23/airlineStats_data_2014-01-23.avro | Bin 0 -> 104126 bytes
.../2014/01/24/airlineStats_data_2014-01-24.avro | Bin 0 -> 112604 bytes
.../2014/01/25/airlineStats_data_2014-01-25.avro | Bin 0 -> 77018 bytes
.../2014/01/26/airlineStats_data_2014-01-26.avro | Bin 0 -> 105531 bytes
.../2014/01/27/airlineStats_data_2014-01-27.avro | Bin 0 -> 94743 bytes
.../2014/01/28/airlineStats_data_2014-01-28.avro | Bin 0 -> 100545 bytes
.../2014/01/29/airlineStats_data_2014-01-29.avro | Bin 0 -> 105114 bytes
.../2014/01/30/airlineStats_data_2014-01-30.avro | Bin 0 -> 109276 bytes
.../2014/01/31/airlineStats_data_2014-01-31.avro | Bin 0 -> 114550 bytes
.../batch/airlineStats/sparkIngestionJobSpec.yaml | 151 +
.../baseballStats_offline_table_config.json | 0
.../batch/baseballStats}/baseballStats_schema.json | 0
.../batch/baseballStats/ingestionJobSpec.yaml | 139 +
.../baseballStats/rawdata}/baseballStats_data.csv | 0
.../batch/baseballStats/sparkIngestionJobSpec.yaml | 147 +
.../airlineStats_realtime_table_config.json | 35 +
.../stream/airlineStats}/airlineStats_schema.json | 0
.../docker/airlineStats_realtime_table_config.json | 35 +
.../airlineStats_realtime_table_config.json | 35 +
.../airlineStats_realtime_table_config.json | 35 +
.../sample_data/airlineStats_data.avro | Bin
.../sample_data/airlineStats_data.json | 19492 +++++++++++++++
.../airlineStats/sample_data/airlineStats_data.orc | Bin 0 -> 584802 bytes
...lRequestMergedEvents_realtime_table_config.json | 36 +
...lRequestMergedEvents_realtime_table_config.json | 37 +
.../pullRequestMergedEvents_schema.json | 151 +
.../meetupRsvp_realtime_table_config.json | 29 +
.../meetupRsvp_realtime_table_config.json | 29 +
.../meetupRsvp_realtime_table_config.json | 29 +
.../stream/meetupRsvp}/meetupRsvp_schema.json | 0
pinot-tools/src/main/resources/generator/README.md | 85 +
.../resources/generator/complexWebsite_config.json | 17 +
.../generator/complexWebsite_generator.json | 113 +
.../resources/generator/complexWebsite_schema.json | 38 +
.../src/main/resources/generator/generator.sh | 76 +
.../resources/generator/simpleWebsite_config.json | 17 +
.../generator/simpleWebsite_generator.json | 46 +
.../resources/generator/simpleWebsite_schema.json | 26 +
pinot-tools/src/main/resources/log4j2.xml | 13 +-
.../airlineStats_offline_table_config.json | 21 -
.../airlineStats_realtime_table_config.json | 37 -
.../docker/airlineStats_offline_table_config.json | 21 -
.../docker/airlineStats_realtime_table_config.json | 38 -
.../airlineStats_realtime_table_config.json | 37 -
.../meetupRsvp_realtime_table_config.json | 28 -
.../airlineStats_realtime_table_config.json | 38 -
.../meetupRsvp_realtime_table_config.json | 29 -
.../meetupRsvp_realtime_table_config.json | 28 -
.../pinot/tools/TestDataAndQueryAnonymizer.java | 108 +
pinot-tools/src/test/resources/C11.dict | 12 +
pinot-tools/src/test/resources/columns.mapping | 13 +
pinot-tools/src/test/resources/queries.generated | 18 +
pinot-tools/src/test/resources/queries.raw | 18 +
pinot-transport/pom.xml | 114 -
.../common/AbstractCompositeListenableFuture.java | 238 -
.../transport/common/AsyncResponseFuture.java | 343 -
.../apache/pinot/transport/common/Callback.java | 39 -
.../apache/pinot/transport/common/Cancellable.java | 28 -
.../pinot/transport/common/CompositeFuture.java | 228 -
.../pinot/transport/common/LinkedDequeue.java | 359 -
.../apache/pinot/transport/common/NoneType.java | 28 -
.../pinot/transport/common/SelectingFuture.java | 178 -
.../transport/common/ServerResponseFuture.java | 96 -
.../pinot/transport/conf/TransportClientConf.java | 77 -
.../transport/config/ConnectionPoolConfig.java | 138 -
.../transport/config/PerTableRoutingConfig.java | 145 -
.../pinot/transport/config/RoutingTableConfig.java | 81 -
.../pinot/transport/config/ThreadPoolConfig.java | 79 -
.../transport/metrics/AggregatedPoolStats.java | 249 -
.../metrics/AggregatedTransportClientMetrics.java | 200 -
.../metrics/AggregatedTransportServerMetrics.java | 180 -
.../pinot/transport/metrics/AsyncPoolStats.java | 239 -
.../transport/metrics/NettyClientMetrics.java | 168 -
.../transport/metrics/NettyServerMetrics.java | 138 -
.../apache/pinot/transport/metrics/PoolStats.java | 164 -
.../pinot/transport/metrics/PoolStatsProvider.java | 35 -
.../transport/metrics/TransportClientMetrics.java | 69 -
.../transport/metrics/TransportServerMetrics.java | 63 -
.../transport/netty/NettyClientConnection.java | 152 -
.../apache/pinot/transport/netty/NettyServer.java | 313 -
.../transport/netty/NettyTCPClientConnection.java | 435 -
.../pinot/transport/netty/NettyTCPServer.java | 118 -
.../netty/PooledNettyClientResourceManager.java | 146 -
.../org/apache/pinot/transport/pool/AsyncPool.java | 136 -
.../apache/pinot/transport/pool/AsyncPoolImpl.java | 711 -
.../pool/AsyncPoolResourceManagerAdapter.java | 125 -
.../org/apache/pinot/transport/pool/KeyedPool.java | 108 -
.../apache/pinot/transport/pool/KeyedPoolImpl.java | 223 -
.../transport/pool/PooledResourceManager.java | 58 -
.../transport/pool/SizeLimitExceededException.java | 32 -
.../transport/scattergather/ScatterGather.java | 64 -
.../transport/scattergather/ScatterGatherImpl.java | 393 -
.../scattergather/ScatterGatherRequest.java | 65 -
.../scattergather/ScatterGatherStats.java | 112 -
.../src/test/java/org/apache/pinot/Checkable.java | 31 -
.../src/test/java/org/apache/pinot/TestUtils.java | 57 -
.../transport/common/CompositeFutureTest.java | 662 -
.../pinot/transport/common/ResponseFutureTest.java | 711 -
.../transport/common/SelectingFutureTest.java | 289 -
.../pinot/transport/common/ServerInstanceTest.java | 56 -
.../transport/netty/NettyCloseChannelTest.java | 123 -
.../NettySingleConnectionIntegrationTest.java | 308 -
.../pinot/transport/netty/NettyTestUtils.java | 106 -
.../transport/perf/ScatterGatherPerfClient.java | 481 -
.../transport/perf/ScatterGatherPerfServer.java | 204 -
.../transport/perf/ScatterGatherPerfTester.java | 331 -
.../pool/AsyncPoolResourceManagerAdapterTest.java | 244 -
.../pinot/transport/pool/KeyedPoolImplTest.java | 639 -
.../transport/scattergather/ScatterGatherTest.java | 317 -
pom.xml | 345 +-
thirdeye/docker/Dockerfile | 45 +
thirdeye/docker/README.md | 38 +
thirdeye/docker/docker-compose.yml | 15 +
thirdeye/docs/appendix.rst | 2 +-
thirdeye/docs/cache_intro.rst | 35 +
thirdeye/docs/caches.rst | 29 +
thirdeye/docs/configuration.rst | 41 +
thirdeye/docs/couchbase.rst | 123 +
thirdeye/docs/index.rst | 3 +-
thirdeye/docs/setup_cache_datastore.rst | 43 +
thirdeye/docs/templates.rst | 4 +-
thirdeye/pom.xml | 15 +-
thirdeye/thirdeye-frontend/.travis.yml | 2 +-
.../app/mirage/factories/alert.js | 6 +-
.../app/mirage/factories/anomaly.js | 3 +-
.../app/pods/aiavailability/route.js | 30 +-
.../app/pods/anomalies/controller.js | 46 +-
.../app/pods/application/route.js | 1 +
.../app/pods/components/alert-details/component.js | 1160 +-
.../app/pods/components/alert-details/template.hbs | 283 +-
.../components/alert-report-modal/template.hbs | 1 +
.../pods/components/anomaly-summary/component.js | 32 +-
.../components/contribution-table/component.js | 211 -
.../components/contribution-table/template.hbs | 249 -
.../app/pods/components/cube-tooltip/component.js | 23 +
.../app/pods/components/cube-tooltip/template.hbs | 20 +
.../pods/components/detection-yaml/component.js | 72 +-
.../pods/components/detection-yaml/template.hbs | 116 +-
.../components/modals/error-modal/component.js | 19 +
.../components/modals/error-modal/template.hbs | 15 +
.../components/range-pill-selectors/component.js | 65 +-
.../components/range-pill-selectors/template.hbs | 60 +-
.../pods/components/rootcause-anomaly/component.js | 57 +-
.../pods/components/rootcause-anomaly/template.hbs | 12 +-
.../pods/components/rootcause-chart/component.js | 17 +-
.../rootcause-dimensions-algorithm/component.js | 50 +-
.../rootcause-dimensions-settings/template.hbs | 2 +
.../pods/components/rootcause-heatmap/component.js | 7 +-
.../pods/components/rootcause-heatmap/template.hbs | 10 +-
.../pods/components/rootcause-slider/component.js | 216 -
.../pods/components/rootcause-slider/template.hbs | 78 -
.../self-serve-alert-details/component.js | 185 +-
.../self-serve-alert-details/template.hbs | 97 +-
.../self-serve-alert-yaml-details/component.js | 19 +-
.../self-serve-alert-yaml-details/template.hbs | 27 +-
.../app/pods/components/stats-cards/component.js | 15 +-
.../app/pods/components/stats-cards/template.hbs | 60 +-
.../pods/components/subscription-yaml/component.js | 33 +-
.../pods/components/subscription-yaml/template.hbs | 61 +-
.../app/pods/components/te-modal/component.js | 1 +
.../app/pods/components/te-modal/template.hbs | 8 +-
.../pods/components/timeseries-chart/component.js | 4 +-
.../app/pods/components/yaml-editor/component.js | 565 -
.../app/pods/components/yaml-editor/template.hbs | 174 -
.../anomalies-table/current-wow/template.hbs | 2 +-
.../anomalies-table/dimensions-only/template.hbs | 7 +
.../custom/anomalies-table/resolution/component.js | 10 +-
.../dimensions-table/change-bars/component.js | 4 +-
.../dimensions-table/change-bars/template.hbs | 2 +-
.../contribution-change/component.js | 25 -
.../contribution-change/template.hbs | 1 -
.../custom/dimensions-table/dimension/template.hbs | 8 +-
.../{percent-change => node-size}/component.js | 0
.../custom/dimensions-table/node-size/template.hbs | 1 +
.../dimensions-table/percent-change/component.js | 4 +-
.../app/pods/home/index/controller.js | 27 +-
.../thirdeye-frontend/app/pods/home/index/route.js | 66 +-
.../app/pods/home/index/template.hbs | 52 +-
.../app/pods/home/share-dashboard/route.js | 37 +-
thirdeye/thirdeye-frontend/app/pods/login/route.js | 25 +-
.../app/pods/manage/alerts/index/controller.js | 20 +-
.../app/pods/manage/alerts/index/route.js | 43 +-
.../app/pods/manage/alerts/index/template.hbs | 1 +
.../app/pods/manage/alerts/route.js | 13 +-
.../app/pods/manage/explore/controller.js | 25 +
.../app/pods/manage/explore/route.js | 58 +-
.../app/pods/manage/explore/template.hbs | 5 +-
.../thirdeye-frontend/app/pods/manage/route.js | 13 +-
.../app/pods/manage/yaml/controller.js | 94 +-
.../app/pods/manage/yaml/route.js | 59 +-
.../app/pods/manage/yaml/template.hbs | 12 +
.../partials/rootcause/dimensions/template.hbs | 3 +
.../app/pods/rootcause/controller.js | 21 +-
.../thirdeye-frontend/app/pods/rootcause/route.js | 22 +-
.../app/pods/screenshot/controller.js | 20 +-
.../app/pods/self-serve/create-alert/controller.js | 41 +-
.../app/pods/self-serve/create-alert/route.js | 6 +-
.../app/pods/self-serve/create-alert/template.hbs | 14 +-
.../app/pods/services/api/anomalies/service.js | 13 +-
.../app/pods/services/query-cache/service.js | 8 +-
.../services/rootcause-entities-cache/service.js | 2 +-
.../app/shared/dimensionAnalysisTableConfig.js | 31 +-
.../app/shared/filterBarConfig.js | 33 +
thirdeye/thirdeye-frontend/app/styles/app.scss | 5 +-
.../app/styles/components/alert-details.scss | 35 +
.../app/styles/components/button.scss | 32 +
.../app/styles/components/contribution-table.scss | 132 -
.../app/styles/components/detection-yaml.scss | 67 +
.../app/styles/components/links.scss | 25 +
.../styles/components/range-pill-selectors.scss | 73 +-
.../app/styles/components/subscription-yaml.scss | 40 +
.../app/styles/components/te-anomaly-table.scss | 16 +-
.../app/styles/components/timeseries-chart.scss | 34 +-
.../app/styles/components/yaml-editor.scss | 26 -
.../app/styles/pods/custom/dimensions-table.scss | 31 +-
.../app/styles/pods/home/index/dashboard.scss | 23 +-
.../app/styles/pods/self-serve/create-alert.scss | 4 +
.../app/styles/shared/_color.scss | 4 +
.../app/styles/shared/_styles.scss | 120 +-
.../app/styles/wrapper/styles.scss | 2 +-
.../thirdeye-frontend/app/templates/dropdown.hbs | 37 +
thirdeye/thirdeye-frontend/app/utils/anomaly.js | 27 +-
.../thirdeye-frontend/app/utils/api/anomaly.js | 2 +-
.../thirdeye-frontend/app/utils/api/self-serve.js | 10 +-
thirdeye/thirdeye-frontend/app/utils/constants.js | 74 -
.../app/utils/manage-alert-utils.js | 67 +-
thirdeye/thirdeye-frontend/app/utils/rca-utils.js | 6 +-
thirdeye/thirdeye-frontend/app/utils/utils.js | 127 +-
thirdeye/thirdeye-frontend/app/utils/yaml-tools.js | 345 +
thirdeye/thirdeye-frontend/config/environment.js | 3 +-
thirdeye/thirdeye-frontend/package.json | 64 +-
thirdeye/thirdeye-frontend/pom.xml | 2 +-
.../acceptance/self-serve-alert-tuning-test.js | 4 +-
.../acceptance/self-serve-import-metric-test.js | 4 +-
.../contribution-table/component-test.js | 26 -
.../components/detection-yaml/component-test.js | 54 +
.../component-test.js | 4 +-
.../components/subscription-yaml/component-test.js | 57 +
.../pods/components/yaml-editor/component-test.js | 73 -
.../thirdeye-frontend/tests/utils/constants.js | 1 +
thirdeye/thirdeye-frontend/yarn.lock | 8858 ++++++-
.../push/DeleteOverlappingSegmentsInPinot.java | 2 +-
.../config/data-sources/cache-config.yml | 34 +
.../config/data-sources/data-sources-config.yml | 15 +
thirdeye/thirdeye-pinot/config/data/pageviews.csv | 67 +
thirdeye/thirdeye-pinot/config/detector.yml | 6 +
thirdeye/thirdeye-pinot/config/h2db.mv.db | Bin 4947968 -> 2949120 bytes
thirdeye/thirdeye-pinot/pom.xml | 56 +-
.../thirdeye/alert/commons/AnomalyFeedConfig.java | 6 +-
.../commons/EmailContentFormatterFactory.java | 34 -
.../pinot/thirdeye/alert/commons/EmailEntity.java | 74 -
.../alert/content/BaseEmailContentFormatter.java | 927 -
.../alert/content/EmailContentFormatter.java | 62 -
.../EmailContentFormatterConfiguration.java | 128 -
.../content/EmailContentFormatterContext.java | 64 -
.../content/EntityGroupKeyContentFormatter.java | 191 -
...HierarchicalAnomaliesEmailContentFormatter.java | 204 -
.../MetricAnomaliesEmailContentFormatter.java | 193 -
...nboardingNotificationEmailContentFormatter.java | 107 -
.../thirdeye/alert/fetcher/BaseAnomalyFetcher.java | 4 +-
.../apache/pinot/thirdeye/anomaly/AnomalyType.java | 41 +
.../pinot/thirdeye/anomaly/SmtpConfiguration.java | 109 -
.../anomaly/ThirdEyeAnomalyApplication.java | 48 +-
.../anomaly/ThirdEyeAnomalyConfiguration.java | 32 +-
.../thirdeye/anomaly/alert/AlertJobContext.java | 1 +
.../thirdeye/anomaly/alert/AlertTaskInfo.java | 1 +
.../anomaly/alert/util/AlertScreenshotHelper.java | 79 +
.../anomaly/alert/util/AnomalyReportGenerator.java | 6 +-
.../thirdeye/anomaly/alert/util/EmailHelper.java | 33 +-
.../anomaly/alert/util/EmailScreenshotHelper.java | 121 -
.../anomaly/alert/v2/AlertTaskRunnerV2.java | 363 +-
.../anomaly/detection/DetectionTaskRunner.java | 9 +-
.../detection/lib/FunctionReplayRunnable.java | 295 -
.../detection/trigger/DataAvailabilityEvent.java | 63 +
.../trigger/DataAvailabilityEventListener.java | 106 +
.../DataAvailabilityEventListenerDriver.java | 103 +
.../trigger/DataAvailabilityKafkaConsumer.java | 61 +
.../trigger/DataAvailabilityTaskScheduler.java | 264 +
.../trigger/filter/ActiveDatasetFilter.java | 35 +
.../filter/DataAvailabilityEventFilter.java | 26 +
.../detection/trigger/filter/OnTimeFilter.java | 35 +
.../DataAvailabilitySchedulingConfiguration.java | 169 +
.../trigger/utils/DatasetTriggerInfoRepo.java | 128 +
.../anomaly/merge/AnomalyTimeBasedSummarizer.java | 1 +
.../thirdeye/anomaly/monitor/MonitorConstants.java | 2 +-
.../anomaly/monitor/MonitorTaskRunner.java | 109 +-
.../anomaly/onboard/DetectionOnboardResource.java | 185 -
.../thirdeye/anomaly/onboard/ReplayTaskInfo.java | 46 -
.../thirdeye/anomaly/onboard/ReplayTaskRunner.java | 147 -
.../onboard/framework/BaseDetectionOnboardJob.java | 43 -
.../framework/BaseDetectionOnboardTask.java | 50 -
.../framework/DetectionOnBoardJobRunner.java | 184 -
.../DetectionOnboardExecutionContext.java | 54 -
.../onboard/framework/DetectionOnboardJob.java | 50 -
.../framework/DetectionOnboardJobContext.java | 113 -
.../framework/DetectionOnboardJobStatus.java | 93 -
.../onboard/framework/DetectionOnboardTask.java | 50 -
.../framework/DetectionOnboardTaskContext.java | 52 -
.../framework/DetectionOnboardTaskRunner.java | 55 -
.../framework/DetectionOnboardTaskStatus.java | 69 -
.../tasks/AlertFilterAutoTuneOnboardingTask.java | 127 -
.../tasks/DataPreparationOnboardingTask.java | 79 -
.../onboard/tasks/DefaultDetectionOnboardJob.java | 319 -
.../tasks/FunctionCreationOnboardingTask.java | 365 -
.../tasks/FunctionReplayOnboardingTask.java | 129 -
.../onboard/tasks/NotificationOnboardingTask.java | 164 -
.../onboard/utils/FunctionCreationUtils.java | 52 -
.../anomaly/onboard/utils/PropertyCheckUtils.java | 50 -
.../pinot/thirdeye/anomaly/task/TaskConstants.java | 1 +
.../pinot/thirdeye/anomaly/task/TaskDriver.java | 26 +-
.../thirdeye/anomaly/task/TaskInfoFactory.java | 7 +-
.../thirdeye/anomaly/task/TaskRunnerFactory.java | 7 +-
.../anomaly/utils/ThirdeyeMetricsUtil.java | 42 +
.../context/AnomalyDetectionContext.java | 17 -
.../anomalydetection/context/AnomalyResult.java | 2 +
.../AbstractModularizedAnomalyFunction.java | 369 -
.../function/MinMaxThresholdFunction.java | 104 -
.../ModularizedAnomalyFunctionModelProvider.java | 66 -
.../function/WeekOverWeekRuleFunction.java | 176 -
.../model/data/AbstractDataModel.java | 36 -
.../anomalydetection/model/data/DataModel.java | 57 -
.../anomalydetection/model/data/NoopDataModel.java | 40 -
.../model/data/SeasonalDataModel.java | 82 -
.../model/detection/AbstractDetectionModel.java | 36 -
.../model/detection/DetectionModel.java | 49 -
.../detection/MinMaxThresholdDetectionModel.java | 99 -
.../model/detection/NoopDetectionModel.java | 32 -
.../detection/SimpleThresholdDetectionModel.java | 124 -
.../model/merge/AbstractMergeModel.java | 36 -
.../anomalydetection/model/merge/MergeModel.java | 48 -
.../model/merge/MinMaxThresholdMergeModel.java | 93 -
.../model/merge/NoPredictionMergeModel.java | 27 -
.../model/merge/NoopMergeModel.java | 31 -
.../model/merge/SimplePercentageMergeModel.java | 106 -
.../model/prediction/AbstractPredictionModel.java | 36 -
.../ExpectedTimeSeriesPredictionModel.java | 31 -
.../model/prediction/NoopPredictionModel.java | 31 -
.../model/prediction/PredictionModel.java | 47 -
.../prediction/SeasonalAveragePredictionModel.java | 109 -
.../transform/AbstractTransformationFunction.java | 36 -
.../model/transform/AnomalyRemovalFunction.java | 206 -
.../transform/MovingAverageSmoothingFunction.java | 98 -
.../TotalCountThresholdRemovalFunction.java | 70 -
.../model/transform/TransformationFunction.java | 54 -
.../model/transform/ZeroRemovalFunction.java | 53 -
.../api/user/dashboard/UserDashboardResource.java | 48 +-
.../onboard/AutoOnboardPinotMetadataSource.java | 63 +-
.../thirdeye/auto/onboard/ConfigGenerator.java | 13 +
.../thirdeye/common/ThirdEyeConfiguration.java | 29 +-
.../thirdeye/common/dimension/DimensionMap.java | 16 +
.../thirdeye/common/time/TimeGranularity.java | 3 +
.../pinot/thirdeye/cube/summary/Summary.java | 2 +-
.../thirdeye/cube/summary/SummaryResponse.java | 72 +-
.../dashboard/ThirdEyeDashboardApplication.java | 19 +-
.../dashboard/ThirdEyeDashboardConfiguration.java | 13 +
.../dashboard/resources/AnomalyResource.java | 214 -
.../dashboard/resources/DetectionJobResource.java | 439 -
.../dashboard/resources/EmailResource.java | 4 +-
.../dashboard/resources/OnboardResource.java | 681 -
.../dashboard/resources/SummaryResource.java | 69 +-
.../dashboard/resources/v2/AnomaliesResource.java | 10 +-
.../dashboard/resources/v2/DataResource.java | 13 +-
.../resources/v2/RootCauseSessionResource.java | 6 +
.../v2/rootcause/AnomalyEventFormatter.java | 4 +
.../v2/rootcause/MetricEntityFormatter.java | 4 +-
.../apache/pinot/thirdeye/dataframe/Grouping.java | 53 +
.../pinot/thirdeye/dataframe/LongSeries.java | 6 +
.../pinot/thirdeye/dataframe/util/MetricSlice.java | 1 +
.../datalayer/bao/DatasetConfigManager.java | 4 +
.../datalayer/bao/DetectionConfigManager.java | 3 +-
.../datalayer/bao/MergedAnomalyResultManager.java | 9 +-
.../pinot/thirdeye/datalayer/bao/TaskManager.java | 8 +-
.../bao/jdbc/DatasetConfigManagerImpl.java | 8 +
.../bao/jdbc/DetectionConfigManagerImpl.java | 7 +
.../bao/jdbc/MergedAnomalyResultManagerImpl.java | 41 +-
.../datalayer/bao/jdbc/TaskManagerImpl.java | 36 +-
.../thirdeye/datalayer/dao/GenericPojoDao.java | 8 +-
.../pinot/thirdeye/datalayer/dto/AbstractDTO.java | 13 +-
.../thirdeye/datalayer/dto/AnomalyFunctionDTO.java | 7 +-
.../thirdeye/datalayer/dto/DatasetConfigDTO.java | 9 +
.../datalayer/dto/MergedAnomalyResultDTO.java | 18 +-
.../datalayer/entity/DatasetConfigIndex.java | 22 +
.../thirdeye/datalayer/pojo/AbstractBean.java | 3 +-
.../datalayer/pojo/AnomalyFunctionBean.java | 15 +-
.../thirdeye/datalayer/pojo/DatasetConfigBean.java | 84 +-
.../datalayer/pojo/DetectionAlertConfigBean.java | 33 +-
.../datalayer/pojo/DetectionConfigBean.java | 44 +-
.../datalayer/pojo/MergedAnomalyResultBean.java | 24 +-
.../datalayer/pojo/RootcauseSessionBean.java | 17 +-
.../pinot/thirdeye/datalayer/util/StringUtils.java | 70 -
.../datalayer/util/ThirdEyeStringUtils.java | 70 +
.../datasource/RelationalThirdEyeResponse.java | 3 +
.../thirdeye/datasource/ThirdEyeCacheRegistry.java | 56 +-
.../datasource/loader/DefaultTimeSeriesLoader.java | 20 +-
.../datasource/mock/MockThirdEyeDataSource.java | 89 +-
.../pinot/resultset/ThirdEyeResultSetUtils.java | 25 +-
.../datasource/sql/SqlResponseCacheLoader.java | 66 +-
.../pinot/thirdeye/datasource/sql/SqlUtils.java | 44 +-
.../pinot/thirdeye/detection/ConfigUtils.java | 29 +
.../pinot/thirdeye/detection/DataProvider.java | 10 +-
.../thirdeye/detection/DefaultDataProvider.java | 191 +-
.../detection/DefaultInputDataFetcher.java | 9 +-
.../thirdeye/detection/DetectionDataSLAJob.java | 68 +
.../thirdeye/detection/DetectionPipelineJob.java | 71 +-
.../detection/DetectionPipelineScheduler.java | 171 -
.../detection/DetectionPipelineTaskRunner.java | 16 +-
.../thirdeye/detection/DetectionResource.java | 30 +-
.../pinot/thirdeye/detection/DetectionUtils.java | 97 +-
.../detection/StaticDetectionPipeline.java | 9 +-
.../apache/pinot/thirdeye/detection/TaskUtils.java | 98 +
.../pinot/thirdeye/detection/alert/AlertUtils.java | 18 +-
.../alert/DetectionAlertFilterNotification.java | 79 +
.../alert/DetectionAlertFilterResult.java | 16 +-
.../detection/alert/DetectionAlertJob.java | 33 +-
.../detection/alert/DetectionAlertScheduler.java | 185 -
.../detection/alert/DetectionAlertTaskFactory.java | 26 +-
.../detection/alert/DetectionAlertTaskRunner.java | 37 +-
.../alert/StatefulDetectionAlertFilter.java | 90 +-
.../filter/DimensionDetectionAlertFilter.java | 122 -
.../filter/DimensionsRecipientAlertFilter.java | 125 +
.../alert/filter/PerUserDimensionAlertFilter.java | 70 +-
.../detection/alert/filter/SubscriptionUtils.java | 70 +
.../ToAllRecipientsDetectionAlertFilter.java | 66 +-
.../alert/scheme/DetectionAlertScheme.java | 70 +-
.../alert/scheme/DetectionEmailAlerter.java | 255 +-
.../alert/scheme/DetectionJiraAlerter.java | 196 +
.../DetectionAlertTimeWindowSuppressor.java | 2 +-
.../detection/algorithm/DimensionWrapper.java | 181 +-
.../algorithm/LegacyAnomalyFunctionAlgorithm.java | 7 +-
.../detection/algorithm/LegacyMergeWrapper.java | 3 +-
.../thirdeye/detection/algorithm/MergeWrapper.java | 135 +-
.../detection/algorithm/MovingWindowAlgorithm.java | 9 +-
.../annotation/registry/DetectionRegistry.java | 7 -
.../thirdeye/detection/cache/CacheConfig.java | 53 +
.../detection/cache/CacheConfigLoader.java | 58 +
.../thirdeye/detection/cache/CacheConstants.java | 42 +
.../pinot/thirdeye/detection/cache/CacheDAO.java | 41 +
.../thirdeye/detection/cache/CacheDataSource.java | 50 +
.../detection/cache/CentralizedCacheConfig.java | 69 +
.../detection/cache/CouchbaseCacheDAO.java | 195 +
.../detection/cache/DefaultTimeSeriesCache.java | 197 +
.../detection/cache/ThirdEyeCacheRequest.java | 64 +
.../detection/cache/ThirdEyeCacheResponse.java | 187 +
.../thirdeye/detection/cache/TimeSeriesCache.java | 49 +
.../detection/cache/TimeSeriesDataPoint.java | 104 +
.../cache/builder/AnomaliesCacheBuilder.java | 176 +
.../cache/builder/TimeSeriesCacheBuilder.java | 174 +
.../detection/components/HoltWintersDetector.java | 102 +-
.../components/PercentageChangeRuleDetector.java | 38 +-
.../components/ThresholdRuleAnomalyFilter.java | 32 +-
.../components/ThresholdRuleDetector.java | 18 +-
.../detection/datasla/DatasetSlaTaskRunner.java | 320 +
.../finetune/GridSearchTuningAlgorithm.java | 11 +-
.../detection/health/AnomalyCoverageStatus.java | 5 +
.../thirdeye/detection/health/DetectionHealth.java | 47 +-
.../detection/health/DetectionTaskStatus.java | 66 +-
.../detection/health/RegressionStatus.java | 8 +
.../onboard/YamlOnboardingTaskRunner.java | 7 +-
.../spec/AbsoluteChangeRuleAnomalyFilterSpec.java | 2 +-
.../spec/AbsoluteChangeRuleDetectorSpec.java | 2 +-
.../thirdeye/detection/spec/AbstractSpec.java | 1 +
.../detection/spec/HoltWintersDetectorSpec.java | 9 +
.../PercentageChangeRuleAnomalyFilterSpec.java | 2 +-
.../spec/PercentageChangeRuleDetectorSpec.java | 11 +-
.../detection/spec/RuleBaselineProviderSpec.java | 2 +-
.../spec/SitewideImpactRuleAnomalyFilterSpec.java | 2 +-
.../thirdeye/detection/spi/model/AnomalySlice.java | 168 +-
.../validators/DetectionConfigValidator.java | 59 +-
.../validators/SubscriptionConfigValidator.java | 60 +-
.../detection/wrapper/AnomalyDetectorWrapper.java | 52 +-
.../wrapper/BaselineFillingMergeWrapper.java | 19 +-
.../wrapper/ChildKeepingMergeWrapper.java | 26 +-
.../wrapper/EntityAnomalyMergeWrapper.java | 78 +
.../thirdeye/detection/wrapper/GrouperWrapper.java | 2 +-
.../detection/yaml/DetectionConfigTuner.java | 4 +-
.../thirdeye/detection/yaml/YamlResource.java | 446 +-
.../yaml/translator/DetectionConfigTranslator.java | 42 +-
.../translator/DetectionMetricAttributeHolder.java | 13 +-
.../translator/SubscriptionConfigTranslator.java | 19 +-
.../formatter/DetectionAlertConfigFormatter.java | 4 +
.../formatter/DetectionConfigFormatter.java | 148 +-
.../thirdeye/model/download/ModelDownloader.java | 48 +
.../download/ModelDownloaderConfiguration.java | 65 +
.../model/download/ModelDownloaderManager.java | 88 +
.../thirdeye/notification/commons/EmailEntity.java | 74 +
.../notification/commons/JiraConfiguration.java | 119 +
.../thirdeye/notification/commons/JiraEntity.java | 142 +
.../notification/commons/SmtpConfiguration.java | 111 +
.../notification/commons/ThirdEyeJiraClient.java | 260 +
.../content/BaseNotificationContent.java | 877 +
.../notification/content/NotificationContent.java | 54 +
.../content/templates/EntityGroupKeyContent.java | 214 +
.../templates/HierarchicalAnomaliesContent.java | 257 +
.../content/templates/MetricAnomaliesContent.java | 204 +
.../formatter/AlertContentFormatterFactory.java | 34 +
.../formatter/channels/AlertContentFormatter.java | 44 +
.../formatter/channels/EmailContentFormatter.java | 113 +
.../formatter/channels/JiraContentFormatter.java | 177 +
.../rootcause/impl/MetricBreakdownPipeline.java | 19 +-
.../pinot/thirdeye/rootcause/util/EntityUtils.java | 2 +-
.../thirdeye/scheduler/DetectionCronScheduler.java | 189 +
.../scheduler/SubscriptionCronScheduler.java | 190 +
.../thirdeye/scheduler/ThirdEyeCronScheduler.java | 53 +
.../org/apache/pinot/thirdeye/util/CacheUtils.java | 136 +
.../apache/pinot/thirdeye/util/IntervalUtils.java | 36 +
.../apache/pinot/thirdeye/util/ThirdEyeUtils.java | 174 +-
.../detector/jira-metric-anomalies-template.ftl | 48 +
.../detector/metric-anomalies-template.ftl | 6 +-
.../src/main/resources/schema/create-schema.sql | 16 +-
.../src/main/resources/schema/drop-tables.sql | 16 +-
.../commons/TestEmailContentFormatterFactory.java | 39 -
.../alert/content/ContentFormatterUtils.java | 48 -
.../TestEntityGroupKeyEmailContentFormatter.java | 290 -
...HierarchicalAnomaliesEmailContentFormatter.java | 161 -
.../TestMetricAnomaliesEmailContentFormatter.java | 142 -
...TestOnboardingNotificationContentFormatter.java | 137 -
.../thirdeye/alert/feed/TestUnionAnomalyFeed.java | 104 -
.../alert/fetcher/TestContinuumAnomalyFetcher.java | 86 -
.../fetcher/TestUnnotifiedAnomalyFetcher.java | 81 -
.../trigger/DataAvailabilityEventListenerTest.java | 149 +
.../trigger/DataAvailabilityTaskSchedulerTest.java | 325 +
.../trigger/DatasetTriggerInfoRepoTest.java | 155 +
.../trigger/MockConsumerDataAvailability.java | 55 +
.../trigger/MockDataAvailabilityEvent.java | 74 +
.../merge/TestAnomalyTimeBasedSummarizer.java | 101 -
.../onboard/DetectionOnBoardJobRunnerTest.java | 344 -
.../onboard/DetectionOnboardResourceTest.java | 97 -
.../anomaly/onboard/OnboardingTaskTestUtils.java | 72 -
.../anomaly/onboard/tasks/TestOnboardingTasks.java | 128 -
.../function/TestAnomalyFunctionFactory.java | 67 -
.../function/TestMinMaxThresholdFunction.java | 206 -
.../function/TestWeekOverWeekRuleFunction.java | 468 -
.../transform/testAnomalyRemovalFunction.java | 51 -
.../user/dashboard/UserDashboardResourceTest.java | 13 +
.../AutoOnboardPinotMetricsServiceTest.java | 9 +-
.../thirdeye/cube/summary/SummaryResponseTest.java | 166 +
.../dashboard/resource/OnboardResourceTest.java | 100 -
.../pinot/thirdeye/datalayer/DaoTestUtils.java | 42 +-
.../datalayer/bao/TestAnomalyTaskManager.java | 5 +-
.../bao/TestMergedAnomalyResultManager.java | 91 +-
.../thirdeye/datalayer/util/StringUtilsTest.java | 18 -
.../datalayer/util/ThirdEyeStringUtilsTest.java | 18 +
.../pinot/PinotThirdEyeDataSourceTest.java | 2 +-
.../pinot/thirdeye/detection/DataProviderTest.java | 102 +-
.../detection/DetectionPipelineTaskRunnerTest.java | 3 +
.../thirdeye/detection/DetectionTestUtils.java | 9 +
.../pinot/thirdeye/detection/MockDataProvider.java | 24 +-
.../alert/DetectionAlertTaskFactoryTest.java | 23 +-
.../thirdeye/detection/alert/SendAlertTest.java | 51 +-
.../detection/alert/filter/AlertFilterUtils.java | 125 +
.../filter/DimensionDetectionAlertFilterTest.java | 201 -
.../filter/DimensionsRecipientAlertFilterTest.java | 336 +
.../filter/PerUserDimensionAlertFilterTest.java | 116 +-
.../ToAllRecipientsDetectionAlertFilterTest.java | 291 +-
.../alert/scheme/AnotherRandomAlerter.java | 4 +-
.../alert/scheme/DetectionEmailAlerterTest.java | 160 +
.../alert/scheme/DetectionJiraAlerterTest.java | 148 +
.../detection/alert/scheme/RandomAlerter.java | 4 +-
.../DetectionTimeWindowSuppressorTest.java | 24 +-
.../detection/algorithm/DimensionWrapperTest.java | 40 +
.../algorithm/LegacyAlertFilterWrapperTest.java | 109 -
.../LegacyAnomalyFunctionAlgorithmTest.java | 98 -
.../algorithm/LegacyDimensionWrapperTest.java | 154 -
.../algorithm/LegacyMergeWrapperTest.java | 137 -
.../detection/algorithm/MergeWrapperTest.java | 58 +-
.../detection/cache/ThirdEyeCacheResponseTest.java | 337 +
.../detection/cache/TimeSeriesCacheTest.java | 310 +
.../PercentageChangeRuleDetectorTest.java | 43 +-
.../components/ThresholdRuleDetectorTest.java | 4 +-
.../datasla/DatasetSlaTaskRunnerTest.java | 478 +
.../LegacyEmulationIntegrationTest.java | 148 -
.../validators/DetectionConfigValidatorTest.java | 9 -
.../wrapper/AnomalyDetectorWrapperTest.java | 2 +-
.../wrapper/ChildKeepingMergeWrapperTest.java | 5 +-
.../wrapper/EntityAnomalyMergeWrapperTest.java | 137 +
.../thirdeye/detection/yaml/YamlResourceTest.java | 131 +-
.../translator/DetectionConfigTranslatorTest.java | 6 +
.../YamlDetectionAlertConfigTranslatorTest.java | 5 +-
.../formatter/DetectionConfigFormatterTest.java | 14 +-
.../AnomalyApplicationEndToEndTest.java | 435 -
.../integration/NotificationTaskSchedulerTest.java | 21 +-
.../notification/ContentFormatterUtils.java | 48 +
.../commons/TestThirdEyeJiraClient.java | 61 +
.../templates/TestEntityGroupKeyContent.java | 287 +
.../TestHierarchicalAnomaliesContent.java | 160 +
.../templates/TestMetricAnomaliesContent.java | 229 +
.../TestAlertContentFormatterFactory.java | 41 +
.../channels/TestJiraContentFormatter.java | 310 +
.../rootcause/MockDatasetConfigManager.java | 5 +
.../tools/CleanupAndRegenerateAnomaliesTool.java | 262 -
.../tools/RunAdhocDatabaseQueriesTool.java | 147 +-
.../tools/anomaly/report/AnomalyReportDriver.java | 4 +-
.../anomaly/report/GenerateAnomalyReport.java | 4 +-
.../apache/pinot/thirdeye/util/CacheUtilTest.java | 104 +
.../pinot/thirdeye/util/ThirdEyeUtilsTest.java | 20 +
.../test/resources/data-sources/cache-config.yml | 23 +
.../detection/yaml/alertconfig/alert-config-1.yaml | 37 -
.../detection/yaml/alertconfig/alert-config-2.yaml | 39 -
.../detection/yaml/alertconfig/alert-config-3.yaml | 40 -
.../detection/yaml/alertconfig/alert-config-4.yaml | 40 -
.../detection/yaml/alertconfig/alert-config-5.yaml | 43 -
.../yaml/detection/detection-config-1.yaml | 2 +-
.../yaml/detection/detection-config-2.yaml | 2 +-
.../yaml/subscription/subscription-config-1.yaml | 38 +
.../yaml/subscription/subscription-config-2.yaml | 37 +
.../yaml/subscription/subscription-config-3.yaml | 38 +
.../yaml/subscription/subscription-config-4.yaml | 38 +
.../yaml/subscription/subscription-config-5.yaml | 40 +
.../yaml/subscription/subscription-config-6.yaml | 22 +
.../compositePipelineTranslatorTestResult-1.json | 93 +-
.../notification/commons/jira_create_schema.json | 85 +
.../src/test/resources/sample-alert-config.yml | 24 +-
.../src/test/resources/sample-detection-config.yml | 7 +-
.../resources/test-jira-anomalies-template.ftl | 21 +
.../resources/test-metric-anomalies-template.html | 79 +-
website/.gitignore | 28 +
website/README.md | 35 +
website/docs/about.md | 14 +
website/docs/about/features_of_pinot.md | 40 +
website/docs/about/what_is_pinot.md | 35 +
website/docs/about/who_use_pinot.md | 26 +
website/docs/administration.md | 14 +
.../docs/administration/guides/troubleshooting.md | 6 +
.../docs/administration/installation/cloud/aws.md | 150 +
.../administration/installation/cloud/azure.md | 129 +
.../docs/administration/installation/cloud/gcp.md | 134 +
.../installation/cloud/on-premise.md | 287 +
.../docs/administration/installation/containers.md | 12 +
.../installation/containers/docker.md | 136 +
.../installation/operating-systems/macos.md | 11 +
.../installation/operating-systems/ubuntu.md | 14 +
website/docs/administration/running_locally.md | 60 +
website/docs/components.md | 14 +
website/docs/components/broker.md | 13 +
website/docs/components/cluster.md | 137 +
website/docs/components/controller.md | 7 +
.../docs/components/minion.md | 0
.../docs/components/schema.md | 0
.../docs/components/segments.md | 0
.../docs/components/server.md | 0
.../docs/components/tables.md | 0
.../docs/components/tenants.md | 0
website/docs/concepts.md | 14 +
website/docs/concepts/pinot-architecture.md | 17 +
website/docs/how-to.md | 14 +
website/docs/misc.md | 14 +
website/docs/misc/build-docker.md | 183 +
website/docs/user-guide.md | 14 +
website/docs/user-guide/clients/golang.md | 166 +
website/docs/user-guide/clients/java.md | 132 +
website/docs/user-guide/pql.md | 254 +
website/docs/user-guide/query-pinot.md | 77 +
website/docs/user-guide/response-format.md | 381 +
website/docs/user-guide/rest-admin-interface.md | 7 +
website/docusaurus.config.js | 180 +
website/package.json | 50 +
website/scripts/build-site.sh | 36 +
website/scripts/publish_site.sh | 51 +
website/sidebars.js | 73 +
website/src/components/Alert/index.js | 52 +
website/src/components/Alert/styles.css | 66 +
website/src/components/BlogPostTags/index.js | 39 +
.../src/components/BlogPostTags/styles.module.css | 3 +
website/src/components/Changelog/index.js | 151 +
website/src/components/CheckboxList/index.js | 59 +
.../src/components/CheckboxList/styles.css | 0
website/src/components/CodeHeader/index.js | 39 +
website/src/components/CodeHeader/styles.css | 17 +
website/src/components/Field/index.js | 200 +
website/src/components/Fields/index.js | 109 +
website/src/components/Fields/styles.css | 31 +
website/src/components/Jump/index.js | 51 +
website/src/components/Jump/styles.css | 109 +
website/src/components/Step/index.js | 31 +
.../src/components/Step/styles.css | 0
website/src/components/Steps/index.js | 31 +
website/src/components/Steps/styles.css | 15 +
website/src/css/custom.css | 1812 ++
website/src/exports/animatedGraph.js | 82 +
website/src/exports/cloudify.js | 349 +
website/src/exports/newPost.js | 49 +
website/src/exports/newRelease.js | 49 +
website/src/exports/repoUrl.js | 26 +
website/src/pages/download.css | 28 +
website/src/pages/download.js | 147 +
website/src/pages/index.css | 131 +
website/src/pages/index.js | 297 +
website/src/pages/index.module.css | 334 +
website/static/img/companies/factual.svg | 1 +
website/static/img/companies/linkedin.svg | 1 +
website/static/img/companies/microsoft-teams.svg | 21 +
website/static/img/companies/slack.svg | 1 +
website/static/img/companies/uber.svg | 9 +
website/static/img/companies/weibo.svg | 1 +
website/static/img/components/Broker.png | Bin 0 -> 16477 bytes
website/static/img/components/ClusterLogical.png | Bin 0 -> 10056 bytes
website/static/img/components/TimeBoundary.jpg | Bin 0 -> 34893 bytes
website/static/img/components/components.png | Bin 0 -> 8582 bytes
website/static/img/dynamic-table.png | Bin 0 -> 241500 bytes
website/static/img/favicon-16x16.png | Bin 0 -> 1535 bytes
website/static/img/favicon-32x32.png | Bin 0 -> 2576 bytes
website/static/img/favicon-96x96.png | Bin 0 -> 8369 bytes
website/static/img/favicon.ico | Bin 0 -> 1150 bytes
website/static/img/ingest-query.svg | 321 +
website/static/img/logo.svg | 1 +
website/static/img/pinot-320x320.png | Bin 0 -> 32566 bytes
.../static}/img/pinot-architecture.png | Bin
website/static/img/pinot-components.svg | 247 +
website/static/img/pinot-navbar-logo.svg | 19 +
website/static/img/pinot-overview-dark.png | Bin 0 -> 317730 bytes
website/static/img/pinot-overview-light.png | Bin 0 -> 145510 bytes
website/static/img/pinot-overview.svg | 247 +
website/static/img/pinot-query.svg | 277 +
website/static/img/pinot.png | Bin 0 -> 124842 bytes
website/static/img/pql-query.png | Bin 0 -> 138225 bytes
website/static/img/pql/pql-query-console.png | Bin 0 -> 301189 bytes
website/static/img/undraw_docusaurus_mountain.svg | 170 +
website/static/img/undraw_docusaurus_react.svg | 169 +
website/static/img/undraw_docusaurus_tree.svg | 1 +
2734 files changed, 214221 insertions(+), 108931 deletions(-)
create mode 100644 .github/workflows/maven.yml
create mode 100644 .travis/.ci.settings.xml
create mode 100755 .travis/.travis_install.sh
create mode 100755 .travis/.travis_nightly_build.sh
create mode 100755 .travis/.travis_quickstart.sh
create mode 100755 .travis/.travis_quickstart_openjdk.sh
create mode 100755 .travis/.travis_set_deploy_build_opts.sh
create mode 100755 .travis/.travis_test.sh
delete mode 100755 .travis_install.sh
delete mode 100755 .travis_test.sh
delete mode 100644 docker/Dockerfile
delete mode 100644 docker/README.md
delete mode 100644 docker/docker-compose.yml
create mode 100644 docker/images/pinot-presto/Dockerfile
create mode 100644 docker/images/pinot-presto/README.md
create mode 100755 docker/images/pinot-presto/docker-build.sh
create mode 100644 docker/images/pinot-presto/etc/catalog/pinot.properties
create mode 100644 docker/images/pinot-presto/etc/catalog/pinot_quickstart.properties
create mode 100644 docker/images/pinot-presto/etc/config.properties
create mode 100644 docker/images/pinot-presto/etc/jvm.config
create mode 100644 docker/images/pinot-presto/etc/log.properties
create mode 100644 docker/images/pinot-presto/etc/node.properties
create mode 100644 docker/images/pinot-superset/.dockerignore
create mode 100644 docker/images/pinot-superset/.python-version
create mode 100644 docker/images/pinot-superset/Dockerfile
create mode 100644 docker/images/pinot-superset/Makefile
create mode 100644 docker/images/pinot-superset/README.md
create mode 100644 docker/images/pinot-superset/requirements-db.txt
create mode 100644 docker/images/pinot-thirdeye/Dockerfile
create mode 100644 docker/images/pinot-thirdeye/README.md
create mode 100755 docker/images/pinot-thirdeye/bin/start-thirdeye.sh
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/dashboard.yml
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/data-sources/cache-config.yml
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/data-sources/data-sources-config-backend.yml
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/data-sources/data-sources-config-frontend.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/data/README.md (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/data/daily.csv (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/data/hourly.csv (100%)
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/data/pageviews.csv
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/detector-config/anomaly-functions/alertFilter.properties (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/detector-config/anomaly-functions/alertFilterAutotune.properties (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => docker/images/pinot-thirdeye/config/ephemeral/detector-config/anomaly-functions/anomalyClassifier.properties (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/detector-config/anomaly-functions/functions.properties (100%)
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/detector.yml
create mode 100644 docker/images/pinot-thirdeye/config/ephemeral/persistence.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/ephemeral}/rca.yml (100%)
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/bootstrap.sql
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/dashboard.yml (100%)
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/data-sources/cache-config.yml
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/data-sources/data-sources-config.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/data/README.md (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/data/daily.csv (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/data/hourly.csv (100%)
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/data/pageviews.csv
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/detector-config/anomaly-functions/alertFilter.properties (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/detector-config/anomaly-functions/alertFilterAutotune.properties (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => docker/images/pinot-thirdeye/config/pinot-quickstart/detector-config/anomaly-functions/anomalyClassifier.properties (100%)
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/detector-config/anomaly-functions/functions.properties (100%)
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/detector.yml
create mode 100644 docker/images/pinot-thirdeye/config/pinot-quickstart/persistence.yml
copy {thirdeye/thirdeye-pinot/config => docker/images/pinot-thirdeye/config/pinot-quickstart}/rca.yml (100%)
create mode 100755 docker/images/pinot-thirdeye/docker-build-and-push.sh
create mode 100755 docker/images/pinot-thirdeye/docker-build.sh
create mode 100755 docker/images/pinot-thirdeye/docker-push.sh
create mode 100644 docker/images/pinot/Dockerfile
create mode 100644 docker/images/pinot/README.md
create mode 100755 docker/images/pinot/bin/generator.sh
rename docker/{ => images/pinot}/docker-build-and-push.sh (100%)
rename docker/{ => images/pinot}/docker-build.sh (100%)
create mode 100644 docker/images/pinot/docker-compose.yml
rename docker/{ => images/pinot}/docker-push.sh (100%)
create mode 100644 docker/images/pinot/ingestion-job-specs/airlineStats.yaml
create mode 100644 docker/images/pinot/ingestion-job-specs/baseballStats.yaml
create mode 100644 docker/images/pinot/table-configs/airlineStats_realtime_table_config.json
create mode 100644 docker/images/pinot/table-configs/meetupRsvp_realtime_table_config.json
create mode 100644 docs/batch_data_ingestion.rst
create mode 100644 docs/schema.rst
create mode 100755 docs/star-tree/example.png
create mode 100755 docs/star-tree/space-time.png
create mode 100644 docs/star-tree/star-tree.rst
create mode 100755 docs/star-tree/structure.png
create mode 100644 docs/tuning_realtime_performance.rst
delete mode 100644 kubernetes/examples/gke/skaffold/README.md
delete mode 100644 kubernetes/examples/gke/skaffold/gke-storageclass-kafka-pd.yml
delete mode 100644 kubernetes/examples/gke/skaffold/gke-storageclass-pinot-controller-pd.yml
delete mode 100644 kubernetes/examples/gke/skaffold/gke-storageclass-pinot-server-pd.yml
delete mode 100644 kubernetes/examples/gke/skaffold/gke-storageclass-zk-pd.yml
delete mode 100644 kubernetes/examples/gke/skaffold/pinot-broker.yml
delete mode 100644 kubernetes/examples/gke/skaffold/pinot-controller.yml
delete mode 100644 kubernetes/examples/gke/skaffold/pinot-example-loader.yml
delete mode 100644 kubernetes/examples/gke/skaffold/pinot-server.yml
create mode 100644 kubernetes/helm/Chart.yaml
create mode 100644 kubernetes/helm/README.md
create mode 100644 kubernetes/helm/charts/zookeeper-2.1.3.tgz
create mode 100644 kubernetes/helm/gke-pd.yaml
create mode 100644 kubernetes/helm/gke-ssd.yaml
create mode 100644 kubernetes/helm/helm-rbac.yaml
create mode 100755 kubernetes/helm/launch-presto-ui.sh
create mode 100755 kubernetes/helm/open-superset-ui.sh
create mode 100644 kubernetes/helm/pinot-github-events-setup.yml
create mode 100755 kubernetes/helm/pinot-presto-cli.sh
create mode 100644 kubernetes/helm/pinot-realtime-quickstart.yml
create mode 100644 kubernetes/helm/presto-cli.sh
create mode 100644 kubernetes/helm/presto-coordinator.yaml
create mode 100644 kubernetes/helm/presto-worker.yaml
copy kubernetes/{examples/gke/skaffold => helm}/query-pinot-data.sh (100%)
create mode 100644 kubernetes/helm/requirements.lock
create mode 100644 kubernetes/helm/requirements.yaml
create mode 100755 kubernetes/helm/setup_gke.sh
create mode 100644 kubernetes/helm/superset.yaml
create mode 100644 kubernetes/helm/templates/_helpers.tpl
create mode 100644 kubernetes/helm/templates/broker/configmap.yaml
create mode 100644 kubernetes/helm/templates/broker/service-external.yaml
create mode 100644 kubernetes/helm/templates/broker/service-headless.yaml
create mode 100644 kubernetes/helm/templates/broker/service.yaml
create mode 100644 kubernetes/helm/templates/broker/statefulset.yml
create mode 100644 kubernetes/helm/templates/controller/configmap.yaml
create mode 100644 kubernetes/helm/templates/controller/service-external.yaml
create mode 100644 kubernetes/helm/templates/controller/service-headless.yaml
create mode 100644 kubernetes/helm/templates/controller/service.yaml
create mode 100644 kubernetes/helm/templates/controller/statefulset.yaml
create mode 100644 kubernetes/helm/templates/server/configmap.yaml
create mode 100644 kubernetes/helm/templates/server/service-headless.yaml
create mode 100644 kubernetes/helm/templates/server/service.yaml
create mode 100644 kubernetes/helm/templates/server/statefulset.yml
create mode 100644 kubernetes/helm/values.yaml
create mode 100644 kubernetes/skaffold/gke/README.md
rename kubernetes/{examples/gke/skaffold => skaffold/gke}/cleanup.sh (100%)
create mode 100644 kubernetes/skaffold/gke/gke-storageclass-kafka-pd.yml
create mode 100644 kubernetes/skaffold/gke/gke-storageclass-pinot-controller-pd.yml
create mode 100644 kubernetes/skaffold/gke/gke-storageclass-pinot-server-pd.yml
create mode 100644 kubernetes/skaffold/gke/gke-storageclass-zk-pd.yml
rename kubernetes/{examples/gke/skaffold => skaffold/gke}/kafka.yml (100%)
create mode 100644 kubernetes/skaffold/gke/pinot-broker.yml
create mode 100644 kubernetes/skaffold/gke/pinot-controller.yml
create mode 100644 kubernetes/skaffold/gke/pinot-realtime-quickstart.yml
create mode 100644 kubernetes/skaffold/gke/pinot-server.yml
rename kubernetes/{examples/gke/skaffold => skaffold/gke}/query-pinot-data.sh (100%)
rename kubernetes/{examples/gke/skaffold => skaffold/gke}/setup.sh (100%)
rename kubernetes/{examples/gke/skaffold => skaffold/gke}/skaffold.yaml (100%)
rename kubernetes/{examples/gke/skaffold => skaffold/gke}/zookeeper.yml (100%)
create mode 100644 licenses-binary/LICENSE-fusesource.txt
create mode 100644 licenses-binary/LICENSE-jquery-requestAnimationFrame.txt
create mode 100644 licenses-binary/LICENSE-jquery-sizzle.txt
create mode 100644 licenses-binary/LICENSE-py4j.txt
create mode 100644 licenses-binary/LICENSE-threeten.txt
create mode 100644 licenses/LICENSE-jquery-requestAnimationFrame.txt
create mode 100644 licenses/LICENSE-jquery-sizzle.txt
delete mode 100644 pinot-api/pom.xml
delete mode 100644 pinot-api/src/main/java/org/apache/pinot/client/BrokerResponse.java
delete mode 100644 pinot-api/src/main/java/org/apache/pinot/client/Connection.java
delete mode 100644 pinot-api/src/main/java/org/apache/pinot/client/JsonAsyncHttpPinotClientTransport.java
delete mode 100644 pinot-api/src/main/java/org/apache/pinot/client/PreparedStatement.java
delete mode 100644 pinot-api/src/main/java/org/apache/pinot/client/ResultSetGroup.java
delete mode 100644 pinot-api/src/main/java/org/apache/pinot/client/package-info.java
delete mode 100644 pinot-api/src/test/java/org/apache/pinot/client/PreparedStatementTest.java
delete mode 100644 pinot-azure-filesystem/pom.xml
delete mode 100644 pinot-azure-filesystem/src/main/java/org/apache/pinot/filesystem/AzurePinotFS.java
delete mode 100644 pinot-azure-filesystem/src/test/java/org/apache/pinot/filesystem/test/AzurePinotFSTest.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/api/resources/PinotBrokerRouting.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/BrokerServerBuilder.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/BrokerUserDefinedMessageHandlerFactory.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/LiveInstanceChangeHandler.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/broker/helix/TimeboundaryRefreshMessageHandlerFactory.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/queryquota/QueryQuotaConfig.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/queryquota/QueryQuotaEntity.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/requesthandler/ConnectionPoolBrokerRequestHandler.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/HelixExternalViewBasedRouting.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/HelixExternalViewBasedTimeBoundaryService.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/RoutingManager.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/RoutingTable.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/RoutingTableBuilderFactory.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/RoutingTableLookupRequest.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/TimeBoundaryService.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/BalancedRandomRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/BasePartitionAwareRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/BaseRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/DefaultOfflineRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/DefaultRealtimeRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/GeneratorBasedRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/HighLevelConsumerBasedRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/LargeClusterRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/LowLevelConsumerRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/LowLevelRoutingTableBuilderUtil.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/PartitionAwareOfflineRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/PartitionAwareRealtimeRoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/RoutingTableBuilder.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/RoutingTableInstancePruner.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/BalancedInstanceSelector.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/BaseInstanceSelector.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/InstanceSelector.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/InstanceSelectorFactory.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/instanceselector/ReplicaGroupInstanceSelector.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/PartitionSegmentPruner.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/SegmentPruner.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentpruner/SegmentPrunerFactory.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentselector/OfflineSegmentSelector.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentselector/RealtimeSegmentSelector.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentselector/SegmentSelector.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/segmentselector/SegmentSelectorFactory.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/selector/MergedSegmentSelector.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/selector/SegmentSelector.java
delete mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/selector/SegmentSelectorProvider.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/timeboundary/TimeBoundaryInfo.java
create mode 100644 pinot-broker/src/main/java/org/apache/pinot/broker/routing/timeboundary/TimeBoundaryManager.java
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/requesthandler/BrokerRequestOptionsTest.java
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/requesthandler/QueryLimitOverrideTest.java
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/requesthandler/QueryValidationTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/HelixExternalViewBasedTimeBoundaryServiceTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/RandomRoutingTableTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/RoutingTableTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/BalancedRandomRoutingTableBuilderTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/HighLevelConsumerRoutingTableBuilderTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/LargeClusterRoutingTableBuilderTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/LowLevelConsumerRoutingTableBuilderTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/PartitionAwareOfflineRoutingTableBuilderTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/PartitionAwareRealtimeRoutingTableBuilderTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/builder/RoutingTableBuilderTestUtil.java
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/instanceselector/InstanceSelectorTest.java
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/segmentpruner/SegmentPrunerTest.java
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/segmentselector/SegmentSelectorTest.java
delete mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/selector/MergedSegmentSelectorTest.java
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/routing/timeboundary/TimeBoundaryManagerTest.java
create mode 100644 pinot-clients/pinot-java-client/pom.xml
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/AbstractResultSet.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/AggregationResultSet.java (100%)
create mode 100644 pinot-clients/pinot-java-client/src/main/java/org/apache/pinot/client/BrokerResponse.java
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/BrokerSelector.java (100%)
create mode 100644 pinot-clients/pinot-java-client/src/main/java/org/apache/pinot/client/Connection.java
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/ConnectionFactory.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/DynamicBrokerSelector.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/ExternalViewReader.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/GroupByResultSet.java (100%)
create mode 100644 pinot-clients/pinot-java-client/src/main/java/org/apache/pinot/client/JsonAsyncHttpPinotClientTransport.java
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/JsonAsyncHttpPinotClientTransportFactory.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/PinotClientException.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/PinotClientTransport.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/PinotClientTransportFactory.java (100%)
create mode 100644 pinot-clients/pinot-java-client/src/main/java/org/apache/pinot/client/PreparedStatement.java
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/Request.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/ResultSet.java (100%)
create mode 100644 pinot-clients/pinot-java-client/src/main/java/org/apache/pinot/client/ResultSetGroup.java
create mode 100644 pinot-clients/pinot-java-client/src/main/java/org/apache/pinot/client/ResultTableResultSet.java
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/SelectionResultSet.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/SimpleBrokerSelector.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/main/java/org/apache/pinot/client/TextTable.java (100%)
create mode 100644 pinot-clients/pinot-java-client/src/main/java/org/apache/pinot/client/package-info.java
rename {pinot-api => pinot-clients/pinot-java-client}/src/test/java/org/apache/pinot/client/ConnectionFactoryTest.java (100%)
create mode 100644 pinot-clients/pinot-java-client/src/test/java/org/apache/pinot/client/PreparedStatementTest.java
rename {pinot-api => pinot-clients/pinot-java-client}/src/test/java/org/apache/pinot/client/ResultSetGroupTest.java (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/test/resources/log4j2.xml (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/test/resources/org/apache/pinot/client/aggregation.json (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/test/resources/org/apache/pinot/client/aggregationGroupBy.json (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/test/resources/org/apache/pinot/client/exception.json (100%)
rename {pinot-api => pinot-clients/pinot-java-client}/src/test/resources/org/apache/pinot/client/selection.json (100%)
create mode 100644 pinot-clients/pom.xml
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/annotations/InterfaceAudience.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/annotations/InterfaceStability.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/assignment/InstanceAssignmentConfigUtils.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/assignment/InstancePartitionsType.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/AdjustTableNameChildKeyTransformer.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/ChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/ChildKeyTransformer.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/ColumnPartitionConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/ColumnPartitionMapChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/CombinedConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/CombinedConfigLoader.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/CombinedConfigSeparatorChildKeyTransformer.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/CompletionConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/ConfigDoc.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/ConfigKey.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/ConfigNodeLifecycleAware.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/Deserializer.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/Duration.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/DurationDsl.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/IndexingConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/Instance.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/NamedListChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/NestedConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/OfflineTagConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/PinotTaskConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/QuotaConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/RealtimeTagConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/RemapTableTypesChildKeyTransformer.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/ReplicaGroupStrategyConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/RoutingConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/SegmentPartitionConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/SegmentsValidationAndRetentionConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/Serializer.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/SimpleMapChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/SingleKeyDsl.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/StarTreeIndexConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/StreamConsumptionConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TableConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TableCustomConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TableNameBuilder.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TableTaskConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TagConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TagNameUtils.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TagOverrideConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TaskConfigMapChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/Tenant.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TenantConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/TypedMapChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/UseChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/UseChildKeyTransformers.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/UseDsl.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/instance/InstanceAssignmentConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/instance/InstanceAssignmentConfigMapChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/instance/InstanceAssignmentConfigUtils.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/instance/InstanceConstraintConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/instance/InstanceReplicaGroupPartitionConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/config/instance/InstanceTagPoolConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/DateTimeFieldSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/DateTimeFieldSpecChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/DateTimeFormatPatternSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/DateTimeFormatSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/DateTimeFormatUnitSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/DateTimeGranularitySpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/DimensionFieldSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/DimensionFieldSpecChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/FieldSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/MetricFieldSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/MetricFieldSpecChildKeyHandler.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/RowEvent.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/Schema.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/StarTreeIndexSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/TimeFieldSpec.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/data/TimeGranularitySpec.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/exception/SchemaNotFoundException.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/function/TransformFunctionType.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/messages/TableConfigRefreshMessage.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/messages/TimeboundaryRefreshMessage.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/metadata/RowMetadata.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/PartitionAssignment.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/ReplicaGroupBasedStreamPartitionAssignmentStrategy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/ReplicaGroupPartitionAssignment.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/ReplicaGroupPartitionAssignmentGenerator.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/StreamPartitionAssignmentGenerator.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/StreamPartitionAssignmentStrategy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/StreamPartitionAssignmentStrategyFactory.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/partition/UniformStreamPartitionAssignmentStrategy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/query/ReduceService.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/query/ReduceServiceRegistry.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/response/BrokerResponseFactory.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/response/ServerInstance.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/response/broker/ResultTable.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/SegmentMetadata.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/StarTreeMetadata.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/HdfsSegmentFetcher.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/HttpSegmentFetcher.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/HttpsSegmentFetcher.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/LocalFileSegmentFetcher.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/NoOpFetcher.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/PinotFSSegmentFetcher.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/SegmentFetcher.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/segment/fetcher/SegmentFetcherFactory.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/BytesUtils.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/DataSize.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/EqualityUtils.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/JsonUtils.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/ServerType.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/TenantRole.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/config/InstanceUtils.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/config/TableConfigUtils.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/config/TagNameUtils.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/BaseSegmentFetcher.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/HttpSegmentFetcher.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/HttpsSegmentFetcher.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/PinotFSSegmentFetcher.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/SegmentFetcher.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/fetcher/SegmentFetcherFactory.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/helix/TableCache.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/primitive/ByteArray.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/AttemptFailureException.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/AttemptsExceededException.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/BaseRetryPolicy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/ExponentialBackoffRetryPolicy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/FixedDelayRetryPolicy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/NoDelayRetryPolicy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/RetriableOperationException.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/RetryPolicies.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/retry/RetryPolicy.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/time/TimeConverter.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/utils/time/TimeUtils.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/filesystem/LocalPinotFS.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/filesystem/PinotFS.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/filesystem/PinotFSFactory.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/parsers/CompilerConstants.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/IsNullPredicateAstNode.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/IsPredicateAstNode.java
create mode 100644 pinot-common/src/main/java/org/apache/pinot/pql/parsers/pql2/ast/TextMatchPredicateAstNode.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/startree/hll/HllConfig.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/startree/hll/HllConstants.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/startree/hll/HllSizeUtils.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/config/IndexingConfigTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/config/QuotaConfigTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/config/TableConfigTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/config/TagOverrideConfigTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/config/TenantTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/config/TestConfigSerialization.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/function/AggregationFunctionTypeTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/partition/IdealStateBuilderUtil.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/partition/ReplicaGroupBasedStreamPartitionAssignmentTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/partition/StreamPartitionAssignmentGeneratorTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/partition/UniformStreamPartitionAssignmentTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/query/gen/AvroQueryGenerator.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/segment/fetcher/SegmentFetcherFactoryTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/DataSizeTest.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/DataSizeUtilsTest.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/config/TableConfigSerDeTest.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/config/TableConfigUtilsTest.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/config/TagNameUtilsTest.java
create mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/fetcher/SegmentFetcherFactoryTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/retry/RetryPolicyTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/common/utils/time/TimeConverterTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/filesystem/LocalPinotFSTest.java
delete mode 100644 pinot-common/src/test/java/org/apache/pinot/filesystem/PinotFSFactoryTest.java
delete mode 100644 pinot-common/src/test/resources/test-table-config.conf
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/README.md
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/pom.xml
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/ConsumerAndIterator.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaBrokerWrapper.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConnectionHandler.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerFactory.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaConsumerManager.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaHighLevelStreamConfig.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfig.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaPartitionLevelConsumer.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactory.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaSimpleConsumerFactoryImpl.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamLevelConsumer.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamMetadataProvider.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerFactory.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/SimpleConsumerMessageBatch.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/server/KafkaDataProducer.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/java/org/apache/pinot/core/realtime/impl/kafka/server/KafkaDataServerStartable.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/main/resources/META-INF/services/org.apache.pinot.core.realtime.stream.StreamConsumerFactory
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/test/java/org/apache/pinot/core/realtime/impl/kafka/KafkaLowLevelStreamConfigTest.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-0.9/src/test/java/org/apache/pinot/core/realtime/impl/kafka/KafkaPartitionLevelConsumerTest.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/README.md
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/pom.xml
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaConsumerFactory.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaMessageBatch.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelConnectionHandler.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelConsumer.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelStreamConfig.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaStreamLevelConsumer.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaStreamLevelConsumerManager.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaStreamLevelStreamConfig.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaStreamMetadataProvider.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/server/KafkaDataProducer.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/java/org/apache/pinot/core/realtime/impl/kafka2/server/KafkaDataServerStartable.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/main/resources/META-INF/services/org.apache.pinot.core.realtime.stream.StreamConsumerFactory
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/test/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelConsumerTest.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/test/java/org/apache/pinot/core/realtime/impl/kafka2/KafkaPartitionLevelStreamConfigTest.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/test/java/org/apache/pinot/core/realtime/impl/kafka2/utils/EmbeddedZooKeeper.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-2.0/src/test/java/org/apache/pinot/core/realtime/impl/kafka2/utils/MiniKafkaCluster.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-base/pom.xml
delete mode 100644 pinot-connectors/pinot-connector-kafka-base/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaAvroMessageDecoder.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-base/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaJSONMessageDecoder.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-base/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStarterUtils.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-base/src/main/java/org/apache/pinot/core/realtime/impl/kafka/KafkaStreamConfigProperties.java
delete mode 100644 pinot-connectors/pinot-connector-kafka-base/src/main/java/org/apache/pinot/core/realtime/impl/kafka/MessageAndOffset.java
delete mode 100644 pinot-connectors/pom.xml
create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/ControllerFilePathProvider.java
delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/FileUploadPathProvider.java
create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotClusterConfigs.java
create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotLeadControllerRestletResource.java
create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotQueryResource.java
create mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotSegmentUploadDownloadRestletResource.java
delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotSegmentUploadRestletResource.java
delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PinotTableConfigRestletResource.java
delete mode 100644 pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/PqlQueryResource.java
create mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/api/ControllerFilePathProviderTest.java
delete mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/api/FileUploadPathProviderTest.java
create mode 100644 pinot-controller/src/test/java/org/apache/pinot/controller/api/upload/ZKOperatorTest.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/common/RowBasedBlockValueFetcher.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/common/predicate/IsNotNullPredicate.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/common/predicate/IsNullPredicate.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/common/predicate/TextMatchPredicate.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/crypt/NoOpPinotCrypter.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/crypt/PinotCrypter.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/crypt/PinotCrypterFactory.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/GenericRow.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/function/DateTimeFunctions.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/function/DefaultFunctionEvaluator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/function/FunctionEvaluator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/function/FunctionEvaluatorFactory.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/function/FunctionExpressionEvaluator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/function/GroovyFunctionEvaluator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/function/TimeSpecFunctionEvaluator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/DefaultSegmentCommitter.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SegmentCommitter.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SegmentCommitterFactory.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SegmentUploader.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/Server2ControllerSegmentUploader.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SplitSegmentCommitter.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/order/OrderByUtils.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/AvroRecordReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/CSVRecordReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/CSVRecordReaderConfig.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/FileFormat.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/JSONRecordReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/RecordReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/RecordReaderConfig.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/RecordReaderFactory.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/RecordReaderUtils.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/ThriftRecordReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/readers/ThriftRecordReaderConfig.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/recordtransformer/TimeTransformer.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/table/BaseTable.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/table/TableResizer.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/reader/impl/ConstantMVForwardIndex.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/reader/impl/ConstantMVInvertedIndex.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/reader/impl/ConstantSVSortedIndex.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/readerwriter/impl/VarByteSingleColumnSingleValueReaderWriter.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/util/DictionaryDelegatingValueReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/io/writer/impl/OffHeapStringStore.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/minion/BackfillDateTimeColumn.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/minion/PinotTaskConfig.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/CombineGroupByOrderByOperator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/dociditerators/ExpressionScanDocIdIterator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/ExpressionFilterDocIdSet.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/ScanBasedDocIdSet.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/docidsets/StarTreeDocIdSet.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/filter/TextMatchFilterOperator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/filter/predicate/TextMatchPredicateEvaluatorFactory.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/query/AggregationGroupByOrderByOperator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/query/SelectionOnlyOperator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/query/SelectionOperator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/query/SelectionOrderByOperator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/TransformBlockDataFetcher.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/ArrayLengthTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/CastTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/DateTruncTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/ModuloTransformFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/operator/transform/function/TimeZoneKey.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/plan/AggregationFunctionInitializer.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/plan/AggregationGroupByOrderByPlanNode.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/plan/maker/BrokerRequestPreProcessor.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/DistinctTable.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/aggregation/function/DistinctAggregationFunction.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/exception/EarlyTerminationException.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/pruner/AbstractSegmentPruner.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/pruner/PartitionSegmentPruner.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/reduce/AggregationDataTableReducer.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/reduce/DataTableReducer.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/reduce/DistinctDataTableReducer.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/reduce/GroupByDataTableReducer.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/reduce/ResultReducerFactory.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/reduce/SelectionDataTableReducer.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/SelectionFetcher.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/CompositeDocIdValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/DocIdDoubleValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/DocIdFloatValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/DocIdIntValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/DocIdLongValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/comparator/IDocIdValComparator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/BytesSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/DoubleArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/DoubleSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/FloatArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/FloatSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/IntArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/IntSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/LongArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/LongSelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/SelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/SelectionMultiValueColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/SelectionSingleValueColumnWithDictIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/StringArraySelectionColumnIterator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/query/selection/iterator/StringSelectionColumnIterator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/ThreadSafeMutableRoaringBitmap.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/dictionary/BaseMutableDictionary.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/dictionary/MutableDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/dictionary/OffHeapMutableBytesStore.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneDocIdCollector.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneIndexReaderRefreshThread.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneIndexRefreshState.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/invertedindex/RealtimeLuceneTextIndexReader.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/impl/nullvalue/RealtimeNullValueVectorReaderWriter.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/segment/ConsumingSegmentAssignmentStrategy.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/segment/RealtimeSegmentAssignmentStrategy.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/AvroRecordToPinotRowGenerator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/MessageBatch.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/OffsetCriteria.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/PartitionCountFetcher.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/PartitionLevelConsumer.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/PartitionLevelStreamConfig.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/PartitionOffsetFetcher.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/PermanentConsumerException.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/SimpleAvroMessageDecoder.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamConfig.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamConfigProperties.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamConsumerFactory.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamConsumerFactoryProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamDataProducer.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamDataProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamDataServerStartable.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamDecoderProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamLevelConsumer.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamMessageDecoder.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamMessageMetadata.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/StreamMetadataProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/realtime/stream/TransientConsumerException.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/creator/TextIndexType.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/inv/text/LuceneTextIndexCreator.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/creator/impl/nullvalue/NullValueVectorCreator.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/ColumnMetadata.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/SegmentMetadataImpl.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/column/BaseVirtualColumnProvider.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/column/DefaultNullValueVirtualColumnProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/data/source/ColumnDataSource.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/datasource/BaseDataSource.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/datasource/ImmutableDataSource.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/datasource/MutableDataSource.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/loader/V3UpdateIndexException.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/loader/invertedindex/TextIndexHandler.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/metadata/ColumnMetadata.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/metadata/SegmentMetadata.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/metadata/SegmentMetadataImpl.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/BaseImmutableDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ConstantValueBytesDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ConstantValueDoubleDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ConstantValueFloatDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ConstantValueIntDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ConstantValueLongDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ConstantValueStringDictionary.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/DocIdDictionary.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/ImmutableDictionaryReader.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/NullValueVectorReader.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/NullValueVectorReaderImpl.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/text/LuceneDocIdCollector.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/index/readers/text/LuceneTextIndexReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/virtualcolumn/BaseVirtualColumnProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/virtualcolumn/HostNameVirtualColumnProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/virtualcolumn/IntSingleValueDataFileReader.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/virtualcolumn/SegmentNameVirtualColumnProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/segment/virtualcolumn/SingleStringVirtualColumnProvider.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/DimensionBuffer.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/MetricBuffer.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/OffHeapStarTreeBuilder.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/StarTreeBuilder.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/StarTreeBuilderConfig.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/StarTreeDataTable.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/hll/HllUtil.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/v2/store/StarTreeDataSource.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/v2/store/StarTreeDimensionDataSource.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/startree/v2/store/StarTreeMetricDataSource.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/transport/InstanceRequestHandler.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/transport/QueryServer.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/transport/Server.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/transport/ServerInstance.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/transport/ServerRoutingInstance.java
delete mode 100644 pinot-core/src/main/java/org/apache/pinot/core/util/AvroUtils.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/util/CleanerUtil.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/util/GroupByUtils.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/util/QueryOptions.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/util/SchemaUtils.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/util/SegmentCompletionProtocolUtils.java
create mode 100644 pinot-core/src/main/resources/org/apache/pinot/core/operator/transform/function/zone-index.properties
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/common/datatable/DataTableUtilsTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/crypt/PinotCrypterFactoryTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/function/DateTimeFunctionEvaluatorTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/function/DefaultFunctionEvaluatorTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/function/FunctionExpressionEvaluatorTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/function/GroovyFunctionEvaluatorTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/manager/realtime/Server2ControllerSegmentUploaderTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/order/OrderByUtilsTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/BackfillDateTimeRecordReaderTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/CSVRecordReaderTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/JSONRecordReaderTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/RecordReaderTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/RecordReaderUtilsTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/ThriftRecordReaderTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/readers/ThriftSampleData.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/recordtransformer/ExpressionTransformerTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/recordtransformer/ExpressionTransformerTimeTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/recordtransformer/TimeTransformerTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/table/TableResizerTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/indexsegment/mutable/MutableSegmentImplNullValueVectorTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/io/writer/impl/OffHeapStringStoreTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/CombineSlowOperatorsTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/transform/function/ArrayLengthTransformFunctionTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/transform/function/CastTransformFunctionTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/transform/function/DateTruncTransformFunctionTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/operator/transform/function/ModuloTransformFunctionTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/query/aggregation/function/AggregationFunctionTypeTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/query/aggregation/function/AggregationFunctionUtilsTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/query/pruner/ColumnValueSegmentPrunerTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/impl/dictionary/DictionaryPerfRunner.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/impl/dictionary/OffHeapMutableBytesStoreTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/impl/nullvalue/RealtimeNullValueVectorReaderWriterTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/segment/ConsumingSegmentAssignmentStrategyTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/realtime/stream/AvroRecordToPinotRowGeneratorTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/creator/impl/nullvalue/NullValueVectorCreatorTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/column/DefaultNullValueVirtualColumnProviderTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/creator/SegmentGenerationWithNullValueVectorTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/loader/defaultcolumn/BaseDefaultColumnHandlerTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/readers/ImmutableDictionaryReaderTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/readers/ImmutableDictionaryTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/readers/ImmutableDictionaryTypeConversionTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/segment/index/readers/NullValueVectorReaderImplTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/BaseStarTreeIndexTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/OffHeapStarTreeBuilderTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/StarTreeDataTableTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/StarTreeIndexTestSegmentHelper.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/SumStarTreeIndexTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/TestStarTreeMetadata.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/HllFieldSizeTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/HllIndexCreationTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/HllStarTreeIndexTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/HllTypeConversionTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/OffHeapStarTreeBuilderWithHllFieldTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/startree/hll/SegmentWithHllIndexCreateHelper.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/transport/DummyServer.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/transport/QueryRouterTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/transport/QueryRoutingTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/util/SchemaUtilsTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/index/readerwriter/VarByteSingleColumnSingleValueReaderWriterTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/DistinctQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/InterSegmentOrderByMultiValueQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/InterSegmentOrderBySingleValueQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/InterSegmentResultTableMultiValueQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/InterSegmentResultTableSingleValueQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/RangePredicateWithSortedInvertedIndexTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/SelectionOnlyEarlyTerminationTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/SerializedBytesQueriesTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/queries/TextSearchQueriesTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/query/pruner/ColumnValueSegmentPrunerTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/spi/crypt/PinotCrypterFactoryTest.java
create mode 100644 pinot-core/src/test/resources/data/expression_transformer/groovy_expression_transformer.json
create mode 100644 pinot-core/src/test/resources/data/fixedByteCompressed.v2
create mode 100644 pinot-core/src/test/resources/data/fixedByteRaw.v2
create mode 100644 pinot-core/src/test/resources/data/newColumnsWithTextSchema.json
create mode 100644 pinot-core/src/test/resources/data/test_null_value_vector_data.json
create mode 100644 pinot-core/src/test/resources/data/test_null_value_vector_pinot_schema.json
create mode 100644 pinot-core/src/test/resources/data/text_search_data/group_by_grep_results.out
create mode 100644 pinot-core/src/test/resources/data/text_search_data/pql_query1.txt
create mode 100644 pinot-core/src/test/resources/data/text_search_data/skills.txt
create mode 100644 pinot-core/src/test/resources/data/varByteStringsCompressed.v2
create mode 100644 pinot-core/src/test/resources/data/varByteStringsRaw.v2
delete mode 100644 pinot-hadoop-filesystem/pom.xml
delete mode 100644 pinot-hadoop-filesystem/src/main/java/org/apache/pinot/filesystem/HadoopPinotFS.java
delete mode 100644 pinot-hadoop/README.md
delete mode 100644 pinot-hadoop/pom.xml
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/PinotHadoopJobLauncher.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/FileHandler.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/JsonPinotOutputFormat.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/PinotOutputFormat.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/PinotRecord.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/PinotRecordSerialization.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/PinotRecordWriter.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/BaseSegmentJob.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/ControllerRestApi.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/DefaultControllerRestApi.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/JobConfigConstants.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/SegmentCreationJob.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/SegmentPreprocessingJob.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/SegmentTarPushJob.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/SegmentUriPushJob.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/mappers/SegmentCreationMapper.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/mappers/SegmentPreprocessingMapper.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/partitioners/GenericPartitioner.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/partitioners/PartitionFunctionFactory.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/reducers/SegmentPreprocessingReducer.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/utils/JobPreparationHelper.java
delete mode 100644 pinot-hadoop/src/main/java/org/apache/pinot/hadoop/utils/PushLocation.java
delete mode 100644 pinot-hadoop/src/test/java/org/apache/pinot/hadoop/io/DeleteExtraPushedSegmentsTest.java
delete mode 100644 pinot-hadoop/src/test/java/org/apache/pinot/hadoop/io/PinotOutputFormatTest.java
create mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/DefaultCommitterRealtimeIntegrationTest.java
delete mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/DeleteAPIHybridClusterIntegrationTest.java
delete mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/HadoopSegmentBuildPushOfflineClusterIntegrationTest.java
create mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/LuceneRealtimeClusterIntegrationTest.java
delete mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/NewConfigApplyIntegrationTest.java
create mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/ServerStarterIntegrationTest.java
delete mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/StarTreeV2ClusterIntegrationTest.java
create mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/server/realtime/ControllerLeaderLocatorIntegrationTest.java
create mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/server/util/SegmentTestUtils.java
delete mode 100644 pinot-integration-tests/src/test/resources/OnTimeStarTreeQueries.txt
create mode 100644 pinot-integration-tests/src/test/resources/On_Time_On_Time_Performance_2014_100k_subset.test_queries_10K.sql
delete mode 100644 pinot-integration-tests/src/test/resources/mytable-updated.conf
delete mode 100644 pinot-integration-tests/src/test/resources/mytable.conf
delete mode 100644 pinot-integration-tests/src/test/resources/profiles/test1.conf
delete mode 100644 pinot-integration-tests/src/test/resources/profiles/test2.conf
delete mode 100644 pinot-orc/pom.xml
delete mode 100644 pinot-orc/src/main/java/org/apache/pinot/orc/data/readers/ORCRecordReader.java
delete mode 100644 pinot-orc/src/test/java/org/apache/pinot/orc/data/readers/ORCRecordReaderTest.java
delete mode 100644 pinot-parquet/pom.xml
delete mode 100644 pinot-parquet/src/main/java/org/apache/pinot/parquet/data/readers/ParquetRecordReader.java
delete mode 100644 pinot-parquet/src/main/java/org/apache/pinot/parquet/data/readers/ParquetUtils.java
delete mode 100644 pinot-parquet/src/test/java/org/apache/pinot/parquet/data/readers/ParquetRecordReaderTest.java
create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkCombineGroupBy.java
create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkGroovyExpressionEvaluation.java
create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkOffHeapMutableBytesStore.java
create mode 100644 pinot-perf/src/main/java/org/apache/pinot/perf/BenchmarkPinotDataBuffer.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/pom.xml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationTaskRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentGenerationUtils.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/main/java/org/apache/pinot/plugin/ingestion/batch/common/SegmentPushUtils.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-common/src/test/java/org/apache/pinot/plugin/ingestion/batch/common/TestSegmentGenerationUtils.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/pom.xml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegmentCreationMapper.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegmentGenerationJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegmentTarPushJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/java/org/apache/pinot/plugin/ingestion/batch/hadoop/HadoopSegmentUriPushJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/resources/segmentCreationAndTarPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/resources/segmentCreationAndUriPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/resources/segmentCreationJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/resources/segmentTarPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-hadoop/src/main/resources/segmentUriPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/pom.xml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/src/main/java/org/apache/pinot/plugin/ingestion/batch/spark/SparkSegmentGenerationJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/src/main/java/org/apache/pinot/plugin/ingestion/batch/spark/SparkSegmentTarPushJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/src/main/java/org/apache/pinot/plugin/ingestion/batch/spark/SparkSegmentUriPushJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/src/main/resources/segmentCreationAndTarPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/src/main/resources/segmentCreationAndUriPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/src/main/resources/segmentCreationJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/src/main/resources/segmentTarPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-spark/src/main/resources/segmentUriPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/pom.xml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/main/java/org/apache/pinot/plugin/ingestion/batch/standalone/SegmentGenerationJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/main/java/org/apache/pinot/plugin/ingestion/batch/standalone/SegmentTarPushJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/main/java/org/apache/pinot/plugin/ingestion/batch/standalone/SegmentUriPushJobRunner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/main/resources/segmentCreationAndTarPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/main/resources/segmentCreationAndUriPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/main/resources/segmentCreationJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/main/resources/segmentTarPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pinot-batch-ingestion-standalone/src/main/resources/segmentUriPushJobSpec.yaml
create mode 100644 pinot-plugins/pinot-batch-ingestion/pom.xml
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/README.md
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/pom.xml
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/PinotHadoopJobLauncher.java
rename {pinot-hadoop => pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop}/src/main/java/org/apache/pinot/hadoop/io/CombineAvroKeyInputFormat.java (100%)
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/FileHandler.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/JsonPinotOutputFormat.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/PinotOutputFormat.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/PinotRecord.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/PinotRecordSerialization.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/io/PinotRecordWriter.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/HadoopSegmentCreationJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/HadoopSegmentPreprocessingJob.java
rename {pinot-hadoop => pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop}/src/main/java/org/apache/pinot/hadoop/job/InternalConfigConstants.java (100%)
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/mappers/SegmentCreationMapper.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/mappers/SegmentPreprocessingMapper.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/partitioners/GenericPartitioner.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/partitioners/PartitionFunctionFactory.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/job/reducers/SegmentPreprocessingReducer.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/main/java/org/apache/pinot/hadoop/utils/PinotHadoopJobPreparationHelper.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/test/java/org/apache/pinot/hadoop/io/DeleteExtraPushedSegmentsTest.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/test/java/org/apache/pinot/hadoop/io/PinotOutputFormatTest.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-hadoop/src/test/java/org/apache/pinot/hadoop/job/mappers/SegmentCreationTest.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/pom.xml
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/common/ControllerRestApi.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/common/DefaultControllerRestApi.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/common/JobConfigConstants.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/common/PinotIngestionJobType.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/jobs/BaseSegmentJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/jobs/SegmentCreationJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/jobs/SegmentPreprocessingJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/jobs/SegmentTarPushJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/jobs/SegmentUriPushJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/utils/JobPreparationHelper.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-ingestion-common/src/main/java/org/apache/pinot/ingestion/utils/PushLocation.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/README.md
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/pom.xml
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/src/main/java/org/apache/pinot/spark/PinotSparkJobLauncher.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/src/main/java/org/apache/pinot/spark/jobs/SparkSegmentCreationFunction.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/src/main/java/org/apache/pinot/spark/jobs/SparkSegmentCreationJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/src/main/java/org/apache/pinot/spark/jobs/SparkSegmentTarPushJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/src/main/java/org/apache/pinot/spark/jobs/SparkSegmentUriPushJob.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pinot-spark/src/main/java/org/apache/pinot/spark/utils/PinotSparkJobPreparationHelper.java
create mode 100644 pinot-plugins/pinot-batch-ingestion/v0_deprecated/pom.xml
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/pom.xml
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/ADLSGen2PinotFS.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/AzurePinotFS.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/src/main/java/org/apache/pinot/plugin/filesystem/AzurePinotFSUtil.java
rename {pinot-azure-filesystem => pinot-plugins/pinot-file-system/pinot-adls}/src/test/java/com/microsoft/azure/datalake/store/MockADLFileInputStream.java (100%)
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/src/test/java/org/apache/pinot/plugin/filesystem/test/AzurePinotFSTest.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-adls/src/test/java/org/apache/pinot/plugin/filesystem/test/AzurePinotFSUtilTest.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-gcs/pom.xml
create mode 100644 pinot-plugins/pinot-file-system/pinot-gcs/src/main/java/org/apache/pinot/plugin/filesystem/GcsPinotFS.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-hdfs/pom.xml
create mode 100644 pinot-plugins/pinot-file-system/pinot-hdfs/src/main/java/org/apache/pinot/plugin/filesystem/HadoopPinotFS.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-hdfs/src/test/java/org/apache/pinot/plugin/filesystem/HadoopPinotFSTest.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-s3/pom.xml
create mode 100644 pinot-plugins/pinot-file-system/pinot-s3/src/main/java/org/apache/pinot/plugin/filesystem/S3PinotFS.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-s3/src/test/java/org/apache/pinot/plugin/filesystem/S3PinotFSTest.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-s3/src/test/java/org/apache/pinot/plugin/filesystem/S3TestUtils.java
create mode 100644 pinot-plugins/pinot-file-system/pinot-s3/src/test/resources/copyFile.txt
create mode 100644 pinot-plugins/pinot-file-system/pinot-s3/src/test/resources/log4j2.xml
create mode 100644 pinot-plugins/pinot-file-system/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractor.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordReader.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroSchemaUtil.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/main/java/org/apache/pinot/plugin/inputformat/avro/AvroUtils.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractorMapTypeTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordExtractorTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordReaderTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroRecordToPinotRowGeneratorTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro-base/src/test/java/org/apache/pinot/plugin/inputformat/avro/AvroUtilsTest.java
copy thirdeye/thirdeye-hadoop/src/test/resources/schema.avsc => pinot-plugins/pinot-input-format/pinot-avro-base/src/test/resources/fake_avro_schema.avsc (100%)
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro/src/main/java/org/apache/pinot/plugin/inputformat/avro/KafkaAvroMessageDecoder.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-avro/src/main/java/org/apache/pinot/plugin/inputformat/avro/SimpleAvroMessageDecoder.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-confluent-avro/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-confluent-avro/src/main/java/org/apache/pinot/plugin/inputformat/avro/confluent/KafkaConfluentSchemaRegistryAvroMessageDecoder.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-csv/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-csv/src/main/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordExtractor.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-csv/src/main/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordExtractorConfig.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-csv/src/main/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordReader.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-csv/src/main/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordReaderConfig.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-csv/src/test/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordExtractorTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-csv/src/test/java/org/apache/pinot/plugin/inputformat/csv/CSVRecordReaderTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-json/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/JSONRecordExtractor.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-json/src/main/java/org/apache/pinot/plugin/inputformat/json/JSONRecordReader.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-json/src/test/java/org/apache/pinot/plugin/inputformat/json/JSONRecordExtractorTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-json/src/test/java/org/apache/pinot/plugin/inputformat/json/JSONRecordReaderTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-orc/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-orc/src/main/java/org/apache/pinot/plugin/inputformat/orc/ORCRecordReader.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-orc/src/test/java/org/apache/pinot/plugin/inputformat/orc/ORCRecordExtractorTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-orc/src/test/java/org/apache/pinot/plugin/inputformat/orc/ORCRecordReaderTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-parquet/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-parquet/src/main/java/org/apache/pinot/plugin/inputformat/parquet/ParquetRecordExtractor.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-parquet/src/main/java/org/apache/pinot/plugin/inputformat/parquet/ParquetRecordReader.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-parquet/src/main/java/org/apache/pinot/plugin/inputformat/parquet/ParquetUtils.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-parquet/src/test/java/org/apache/pinot/plugin/inputformat/parquet/ParquetRecordExtractorTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-parquet/src/test/java/org/apache/pinot/plugin/inputformat/parquet/ParquetRecordReaderTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-thrift/pom.xml
create mode 100644 pinot-plugins/pinot-input-format/pinot-thrift/src/main/java/org/apache/pinot/plugin/inputformat/thrift/ThriftRecordExtractor.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-thrift/src/main/java/org/apache/pinot/plugin/inputformat/thrift/ThriftRecordExtractorConfig.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-thrift/src/main/java/org/apache/pinot/plugin/inputformat/thrift/ThriftRecordReader.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-thrift/src/main/java/org/apache/pinot/plugin/inputformat/thrift/ThriftRecordReaderConfig.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-thrift/src/test/java/org/apache/pinot/plugin/inputformat/thrift/ThriftRecordReaderTest.java
create mode 100644 pinot-plugins/pinot-input-format/pinot-thrift/src/test/java/org/apache/pinot/plugin/inputformat/thrift/ThriftSampleData.java
create mode 100644 pinot-plugins/pinot-input-format/pom.xml
rename {pinot-connectors => pinot-plugins/pinot-stream-ingestion}/README.md (100%)
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/README.md
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/pom.xml
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/ConsumerAndIterator.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaBrokerWrapper.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaConnectionHandler.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaConsumerFactory.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaConsumerManager.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaHighLevelStreamConfig.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaLowLevelStreamConfig.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaPartitionLevelConsumer.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaSimpleConsumerFactory.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaSimpleConsumerFactoryImpl.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaStreamLevelConsumer.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/KafkaStreamMetadataProvider.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/SimpleConsumerFactory.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/SimpleConsumerMessageBatch.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/server/KafkaDataProducer.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/java/org/apache/pinot/plugin/stream/kafka09/server/KafkaDataServerStartable.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/main/resources/META-INF/services/org.apache.pinot.spi.stream.StreamConsumerFactory
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/test/java/org/apache/pinot/plugin/stream/kafka09/KafkaLowLevelStreamConfigTest.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-0.9/src/test/java/org/apache/pinot/plugin/stream/kafka09/KafkaPartitionLevelConsumerTest.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/README.md
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/pom.xml
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaConsumerFactory.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaMessageBatch.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaPartitionLevelConnectionHandler.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaPartitionLevelConsumer.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaPartitionLevelStreamConfig.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaStreamLevelConsumer.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaStreamLevelConsumerManager.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaStreamLevelStreamConfig.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/KafkaStreamMetadataProvider.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/server/KafkaDataProducer.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/java/org/apache/pinot/plugin/stream/kafka20/server/KafkaDataServerStartable.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/main/resources/META-INF/services/org.apache.pinot.spi.stream.StreamConsumerFactory
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/test/java/org/apache/pinot/plugin/stream/kafka20/KafkaPartitionLevelConsumerBackwardCompatibilityTest.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/test/java/org/apache/pinot/plugin/stream/kafka20/KafkaPartitionLevelConsumerTest.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/test/java/org/apache/pinot/plugin/stream/kafka20/KafkaPartitionLevelStreamConfigTest.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/test/java/org/apache/pinot/plugin/stream/kafka20/utils/EmbeddedZooKeeper.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-2.0/src/test/java/org/apache/pinot/plugin/stream/kafka20/utils/MiniKafkaCluster.java
rename {pinot-connectors/pinot-connector-kafka-base => pinot-plugins/pinot-stream-ingestion/pinot-kafka-base}/README.md (100%)
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/pom.xml
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/src/main/java/org/apache/pinot/plugin/stream/kafka/KafkaJSONMessageDecoder.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/src/main/java/org/apache/pinot/plugin/stream/kafka/KafkaStreamConfigProperties.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/src/main/java/org/apache/pinot/plugin/stream/kafka/MessageAndOffset.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/src/test/java/org/apache/pinot/plugin/stream/kafka/KafkaJSONMessageDecoderTest.java
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/src/test/resources/data/test_sample_data.json
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/src/test/resources/data/test_sample_data_schema_no_time_field.json
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/src/test/resources/data/test_sample_data_schema_with_outgoing_time_spec.json
create mode 100644 pinot-plugins/pinot-stream-ingestion/pinot-kafka-base/src/test/resources/data/test_sample_data_schema_without_outgoing_time_spec.json
create mode 100644 pinot-plugins/pinot-stream-ingestion/pom.xml
create mode 100644 pinot-plugins/pom.xml
create mode 100644 pinot-server/src/main/java/org/apache/pinot/server/api/access/AccessControl.java
create mode 100644 pinot-server/src/main/java/org/apache/pinot/server/api/access/AccessControlFactory.java
create mode 100644 pinot-server/src/main/java/org/apache/pinot/server/api/access/AllowAllAccessFactory.java
delete mode 100644 pinot-server/src/main/java/org/apache/pinot/server/api/resources/SchedulerResource.java
delete mode 100644 pinot-server/src/main/java/org/apache/pinot/server/request/ScheduledRequestHandler.java
delete mode 100644 pinot-server/src/main/java/org/apache/pinot/server/starter/ServerBuilder.java
create mode 100644 pinot-server/src/test/java/org/apache/pinot/server/api/AccessControlTest.java
delete mode 100644 pinot-server/src/test/java/org/apache/pinot/server/request/ScheduledRequestHandlerTest.java
delete mode 100644 pinot-server/src/test/java/org/apache/pinot/server/util/SegmentTestUtils.java
create mode 100644 pinot-spi/pom.xml
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/annotations/InterfaceAudience.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/annotations/InterfaceStability.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/BaseJsonConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/instance/Instance.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/instance/InstanceType.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/ColumnPartitionConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/CompletionConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/FieldConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/IndexingConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/QueryConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/QuotaConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/ReplicaGroupStrategyConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/RoutingConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/SegmentPartitionConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/SegmentsValidationAndRetentionConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/StarTreeIndexConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/TableConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/TableCustomConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/TableTaskConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/TableType.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/TagOverrideConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/TenantConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/UpsertConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/assignment/InstanceAssignmentConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/assignment/InstanceConstraintConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/assignment/InstancePartitionsType.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/assignment/InstanceReplicaGroupPartitionConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/table/assignment/InstanceTagPoolConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/tenant/Tenant.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/config/tenant/TenantRole.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/crypt/NoOpPinotCrypter.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/crypt/PinotCrypter.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/crypt/PinotCrypterFactory.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/DateTimeFieldSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/DateTimeFormatPatternSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/DateTimeFormatSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/DateTimeFormatUnitSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/DateTimeGranularitySpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/DimensionFieldSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/FieldSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/MetricFieldSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/Schema.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/TimeFieldSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/TimeGranularitySpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/FileFormat.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/GenericRow.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/RecordExtractor.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/RecordExtractorConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/RecordReader.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/RecordReaderConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/RecordReaderFactory.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/data/readers/RecordReaderUtils.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/filesystem/LocalPinotFS.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/filesystem/PinotFS.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/filesystem/PinotFSFactory.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/IngestionJobLauncher.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/runner/IngestionJobRunner.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/Constants.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/ExecutionFrameworkSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/PinotClusterSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/PinotFSSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/PushJobSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/RecordReaderSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/SegmentGenerationJobSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/SegmentGenerationTaskSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/SegmentNameGeneratorSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/ingestion/batch/spec/TableSpec.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/plugin/Plugin.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/plugin/PluginClassLoader.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/plugin/PluginManager.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/MessageBatch.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/OffsetCriteria.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/PartitionCountFetcher.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/PartitionLevelConsumer.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/PartitionLevelStreamConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/PartitionOffsetFetcher.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/PermanentConsumerException.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/RowMetadata.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamConfig.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamConfigProperties.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamConsumerFactory.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamConsumerFactoryProvider.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamDataProducer.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamDataProvider.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamDataServerStartable.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamDecoderProvider.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamLevelConsumer.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamMessageDecoder.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamMessageMetadata.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/StreamMetadataProvider.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/stream/TransientConsumerException.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/ByteArray.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/BytesUtils.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/DataSizeUtils.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/EqualityUtils.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/JsonUtils.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/StringUtils.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/TimeConverter.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/TimeUtils.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/builder/TableConfigBuilder.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/builder/TableNameBuilder.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/AttemptFailureException.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/AttemptsExceededException.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/BaseRetryPolicy.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/ExponentialBackoffRetryPolicy.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/FixedDelayRetryPolicy.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/NoDelayRetryPolicy.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/RetriableOperationException.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/RetryPolicies.java
create mode 100644 pinot-spi/src/main/java/org/apache/pinot/spi/utils/retry/RetryPolicy.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/config/table/IndexingConfigTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/config/table/QuotaConfigTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/config/table/UpsertConfigTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/config/tenant/TenantTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/data/readers/AbstractRecordExtractorTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/data/readers/AbstractRecordReaderTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/data/readers/RecordReaderUtilsTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/filesystem/LocalPinotFSTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/filesystem/PinotFSFactoryTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/plugin/PluginManagerTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/utils/TimeConverterTest.java
create mode 100644 pinot-spi/src/test/java/org/apache/pinot/spi/utils/retry/RetryPolicyTest.java
create mode 100644 pinot-spi/src/test/resources/TestRecordReader.java
create mode 100644 pinot-spi/src/test/resources/groovy_map_transform_functions_schema.json
create mode 100644 pinot-spi/src/test/resources/groovy_transform_functions_schema.json
copy {pinot-minion => pinot-spi}/src/test/resources/log4j2.xml (100%)
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/GitHubEventsQuickstart.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/AnonymizeDataCommand.java
delete mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/ApplyTableConfigCommand.java
delete mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/BackfillDateTimeColumnCommand.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/GitHubEventsQuickStartCommand.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/LaunchDataIngestionJobCommand.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/OperateClusterConfigCommand.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/QuickStartCommand.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/StreamGitHubEventsCommand.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/anonymizer/ArrayBasedGlobalDictionaries.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/anonymizer/GlobalDictionaries.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/anonymizer/MapBasedGlobalDictionaries.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/anonymizer/PinotDataAndQueryAnonymizer.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/data/generator/PatternMixtureGenerator.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/data/generator/PatternSeasonalGenerator.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/data/generator/PatternSequenceGenerator.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/data/generator/PatternSpikeGenerator.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/data/generator/PatternStringGenerator.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/data/generator/PatternType.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkDriver.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/filesystem/PinotFSBenchmarkRunner.java
delete mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/query/comparison/StarQueryComparison.java
delete mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/segment/converter/ColumnarToStarTreeConverter.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/GitHubAPICaller.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/PullRequestMergedEvent.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/streams/githubevents/PullRequestMergedEventsStream.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/utils/JarUtils.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/utils/KafkaStarterUtils.java
create mode 100644 pinot-tools/src/main/resources/conf/pinot-ingestion-job-log4j2.xml
create mode 100644 pinot-tools/src/main/resources/conf/sample_filesystem_benchmark.conf
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/airlineStats_offline_table_config.json
copy pinot-tools/src/main/resources/{sample_data => examples/batch/airlineStats}/airlineStats_schema.json (100%)
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/hadoopIngestionJobSpec.yaml
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/ingestionJobSpec.yaml
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/01/airlineStats_data_2014-01-01.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/02/airlineStats_data_2014-01-02.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/03/airlineStats_data_2014-01-03.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/04/airlineStats_data_2014-01-04.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/05/airlineStats_data_2014-01-05.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/06/airlineStats_data_2014-01-06.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/07/airlineStats_data_2014-01-07.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/08/airlineStats_data_2014-01-08.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/09/airlineStats_data_2014-01-09.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/10/airlineStats_data_2014-01-10.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/11/airlineStats_data_2014-01-11.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/12/airlineStats_data_2014-01-12.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/13/airlineStats_data_2014-01-13.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/14/airlineStats_data_2014-01-14.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/15/airlineStats_data_2014-01-15.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/16/airlineStats_data_2014-01-16.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/17/airlineStats_data_2014-01-17.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/18/airlineStats_data_2014-01-18.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/19/airlineStats_data_2014-01-19.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/20/airlineStats_data_2014-01-20.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/21/airlineStats_data_2014-01-21.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/22/airlineStats_data_2014-01-22.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/23/airlineStats_data_2014-01-23.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/24/airlineStats_data_2014-01-24.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/25/airlineStats_data_2014-01-25.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/26/airlineStats_data_2014-01-26.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/27/airlineStats_data_2014-01-27.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/28/airlineStats_data_2014-01-28.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/29/airlineStats_data_2014-01-29.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/30/airlineStats_data_2014-01-30.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/rawdata/2014/01/31/airlineStats_data_2014-01-31.avro
create mode 100644 pinot-tools/src/main/resources/examples/batch/airlineStats/sparkIngestionJobSpec.yaml
rename pinot-tools/src/main/resources/{sample_data => examples/batch/baseballStats}/baseballStats_offline_table_config.json (100%)
rename pinot-tools/src/main/resources/{sample_data => examples/batch/baseballStats}/baseballStats_schema.json (100%)
create mode 100644 pinot-tools/src/main/resources/examples/batch/baseballStats/ingestionJobSpec.yaml
rename pinot-tools/src/main/resources/{sample_data => examples/batch/baseballStats/rawdata}/baseballStats_data.csv (100%)
create mode 100644 pinot-tools/src/main/resources/examples/batch/baseballStats/sparkIngestionJobSpec.yaml
create mode 100644 pinot-tools/src/main/resources/examples/stream/airlineStats/airlineStats_realtime_table_config.json
rename pinot-tools/src/main/resources/{sample_data => examples/stream/airlineStats}/airlineStats_schema.json (100%)
create mode 100644 pinot-tools/src/main/resources/examples/stream/airlineStats/docker/airlineStats_realtime_table_config.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/airlineStats/kafka_0.9/airlineStats_realtime_table_config.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/airlineStats/kafka_2.0/airlineStats_realtime_table_config.json
rename pinot-tools/src/main/resources/{ => examples/stream/airlineStats}/sample_data/airlineStats_data.avro (100%)
create mode 100644 pinot-tools/src/main/resources/examples/stream/airlineStats/sample_data/airlineStats_data.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/airlineStats/sample_data/airlineStats_data.orc
create mode 100644 pinot-tools/src/main/resources/examples/stream/githubEvents/docker/pullRequestMergedEvents_realtime_table_config.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/githubEvents/pullRequestMergedEvents_realtime_table_config.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/githubEvents/pullRequestMergedEvents_schema.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/meetupRsvp/kafka_0.9/meetupRsvp_realtime_table_config.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/meetupRsvp/kafka_2.0/meetupRsvp_realtime_table_config.json
create mode 100644 pinot-tools/src/main/resources/examples/stream/meetupRsvp/meetupRsvp_realtime_table_config.json
rename pinot-tools/src/main/resources/{sample_data => examples/stream/meetupRsvp}/meetupRsvp_schema.json (100%)
create mode 100644 pinot-tools/src/main/resources/generator/README.md
create mode 100644 pinot-tools/src/main/resources/generator/complexWebsite_config.json
create mode 100644 pinot-tools/src/main/resources/generator/complexWebsite_generator.json
create mode 100644 pinot-tools/src/main/resources/generator/complexWebsite_schema.json
create mode 100755 pinot-tools/src/main/resources/generator/generator.sh
create mode 100644 pinot-tools/src/main/resources/generator/simpleWebsite_config.json
create mode 100644 pinot-tools/src/main/resources/generator/simpleWebsite_generator.json
create mode 100644 pinot-tools/src/main/resources/generator/simpleWebsite_schema.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/airlineStats_offline_table_config.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/airlineStats_realtime_table_config.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/docker/airlineStats_offline_table_config.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/docker/airlineStats_realtime_table_config.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/kafka_0.9/airlineStats_realtime_table_config.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/kafka_0.9/meetupRsvp_realtime_table_config.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/kafka_2.0/airlineStats_realtime_table_config.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/kafka_2.0/meetupRsvp_realtime_table_config.json
delete mode 100644 pinot-tools/src/main/resources/sample_data/meetupRsvp_realtime_table_config.json
create mode 100644 pinot-tools/src/test/java/org/apache/pinot/tools/TestDataAndQueryAnonymizer.java
create mode 100644 pinot-tools/src/test/resources/C11.dict
create mode 100644 pinot-tools/src/test/resources/columns.mapping
create mode 100644 pinot-tools/src/test/resources/queries.generated
create mode 100644 pinot-tools/src/test/resources/queries.raw
delete mode 100644 pinot-transport/pom.xml
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/AbstractCompositeListenableFuture.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/AsyncResponseFuture.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/Callback.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/Cancellable.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/CompositeFuture.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/LinkedDequeue.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/NoneType.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/SelectingFuture.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/common/ServerResponseFuture.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/conf/TransportClientConf.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/config/ConnectionPoolConfig.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/config/PerTableRoutingConfig.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/config/RoutingTableConfig.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/config/ThreadPoolConfig.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/AggregatedPoolStats.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/AggregatedTransportClientMetrics.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/AggregatedTransportServerMetrics.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/AsyncPoolStats.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/NettyClientMetrics.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/NettyServerMetrics.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/PoolStats.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/PoolStatsProvider.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/TransportClientMetrics.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/metrics/TransportServerMetrics.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/netty/NettyClientConnection.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/netty/NettyServer.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/netty/NettyTCPClientConnection.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/netty/NettyTCPServer.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/netty/PooledNettyClientResourceManager.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/pool/AsyncPool.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/pool/AsyncPoolImpl.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/pool/AsyncPoolResourceManagerAdapter.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/pool/KeyedPool.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/pool/KeyedPoolImpl.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/pool/PooledResourceManager.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/pool/SizeLimitExceededException.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/scattergather/ScatterGather.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/scattergather/ScatterGatherImpl.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/scattergather/ScatterGatherRequest.java
delete mode 100644 pinot-transport/src/main/java/org/apache/pinot/transport/scattergather/ScatterGatherStats.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/Checkable.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/TestUtils.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/common/CompositeFutureTest.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/common/ResponseFutureTest.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/common/SelectingFutureTest.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/common/ServerInstanceTest.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/netty/NettyCloseChannelTest.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/netty/NettySingleConnectionIntegrationTest.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/netty/NettyTestUtils.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/perf/ScatterGatherPerfClient.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/perf/ScatterGatherPerfServer.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/perf/ScatterGatherPerfTester.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/pool/AsyncPoolResourceManagerAdapterTest.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/pool/KeyedPoolImplTest.java
delete mode 100644 pinot-transport/src/test/java/org/apache/pinot/transport/scattergather/ScatterGatherTest.java
create mode 100644 thirdeye/docker/Dockerfile
create mode 100644 thirdeye/docker/README.md
create mode 100644 thirdeye/docker/docker-compose.yml
create mode 100644 thirdeye/docs/cache_intro.rst
create mode 100644 thirdeye/docs/caches.rst
create mode 100644 thirdeye/docs/couchbase.rst
create mode 100644 thirdeye/docs/setup_cache_datastore.rst
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/contribution-table/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/contribution-table/template.hbs
create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/cube-tooltip/component.js
create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/cube-tooltip/template.hbs
create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/modals/error-modal/component.js
create mode 100644 thirdeye/thirdeye-frontend/app/pods/components/modals/error-modal/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/rootcause-slider/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/rootcause-slider/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/yaml-editor/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/components/yaml-editor/template.hbs
create mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/anomalies-table/dimensions-only/template.hbs
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/contribution-change/component.js
delete mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/contribution-change/template.hbs
copy thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/{percent-change => node-size}/component.js (100%)
create mode 100644 thirdeye/thirdeye-frontend/app/pods/custom/dimensions-table/node-size/template.hbs
create mode 100644 thirdeye/thirdeye-frontend/app/styles/components/alert-details.scss
delete mode 100644 thirdeye/thirdeye-frontend/app/styles/components/contribution-table.scss
create mode 100644 thirdeye/thirdeye-frontend/app/styles/components/detection-yaml.scss
create mode 100644 thirdeye/thirdeye-frontend/app/styles/components/subscription-yaml.scss
delete mode 100644 thirdeye/thirdeye-frontend/app/styles/components/yaml-editor.scss
create mode 100644 thirdeye/thirdeye-frontend/app/templates/dropdown.hbs
create mode 100644 thirdeye/thirdeye-frontend/app/utils/yaml-tools.js
delete mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/contribution-table/component-test.js
create mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/detection-yaml/component-test.js
create mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/subscription-yaml/component-test.js
delete mode 100644 thirdeye/thirdeye-frontend/tests/integration/pods/components/yaml-editor/component-test.js
create mode 100644 thirdeye/thirdeye-pinot/config/data-sources/cache-config.yml
create mode 100644 thirdeye/thirdeye-pinot/config/data/pageviews.csv
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/commons/EmailContentFormatterFactory.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/commons/EmailEntity.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/BaseEmailContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/EmailContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/EmailContentFormatterConfiguration.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/EmailContentFormatterContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/EntityGroupKeyContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/HierarchicalAnomaliesEmailContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/MetricAnomaliesEmailContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/alert/content/OnboardingNotificationEmailContentFormatter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/AnomalyType.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/SmtpConfiguration.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/util/AlertScreenshotHelper.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/alert/util/EmailScreenshotHelper.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/lib/FunctionReplayRunnable.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityEvent.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityEventListener.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityEventListenerDriver.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityKafkaConsumer.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityTaskScheduler.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/filter/ActiveDatasetFilter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/filter/DataAvailabilityEventFilter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/filter/OnTimeFilter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/utils/DataAvailabilitySchedulingConfiguration.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/utils/DatasetTriggerInfoRepo.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/DetectionOnboardResource.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/ReplayTaskInfo.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/ReplayTaskRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/BaseDetectionOnboardJob.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/BaseDetectionOnboardTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnBoardJobRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardExecutionContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardJob.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardJobContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardJobStatus.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardTaskContext.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardTaskRunner.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/framework/DetectionOnboardTaskStatus.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/AlertFilterAutoTuneOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/DataPreparationOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/DefaultDetectionOnboardJob.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/FunctionCreationOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/FunctionReplayOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/NotificationOnboardingTask.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/utils/FunctionCreationUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/onboard/utils/PropertyCheckUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/function/AbstractModularizedAnomalyFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/function/MinMaxThresholdFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/function/ModularizedAnomalyFunctionModelProvider.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/function/WeekOverWeekRuleFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/data/AbstractDataModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/data/DataModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/data/NoopDataModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/data/SeasonalDataModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/detection/AbstractDetectionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/detection/DetectionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/detection/MinMaxThresholdDetectionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/detection/NoopDetectionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/detection/SimpleThresholdDetectionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/merge/AbstractMergeModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/merge/MergeModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/merge/MinMaxThresholdMergeModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/merge/NoPredictionMergeModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/merge/NoopMergeModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/merge/SimplePercentageMergeModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/prediction/AbstractPredictionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/prediction/ExpectedTimeSeriesPredictionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/prediction/NoopPredictionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/prediction/PredictionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/prediction/SeasonalAveragePredictionModel.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/transform/AbstractTransformationFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/transform/AnomalyRemovalFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/transform/MovingAverageSmoothingFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/transform/TotalCountThresholdRemovalFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/transform/TransformationFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomalydetection/model/transform/ZeroRemovalFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/dashboard/resources/OnboardResource.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datalayer/util/StringUtils.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/datalayer/util/ThirdEyeStringUtils.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/DetectionDataSLAJob.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/DetectionPipelineScheduler.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/TaskUtils.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/DetectionAlertFilterNotification.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/DetectionAlertScheduler.java
delete mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/filter/DimensionDetectionAlertFilter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/filter/DimensionsRecipientAlertFilter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/filter/SubscriptionUtils.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/alert/scheme/DetectionJiraAlerter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheConfig.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheConfigLoader.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheConstants.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheDAO.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CacheDataSource.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CentralizedCacheConfig.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/CouchbaseCacheDAO.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/DefaultTimeSeriesCache.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/ThirdEyeCacheRequest.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/ThirdEyeCacheResponse.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/TimeSeriesCache.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/TimeSeriesDataPoint.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/builder/AnomaliesCacheBuilder.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/cache/builder/TimeSeriesCacheBuilder.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/datasla/DatasetSlaTaskRunner.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/detection/wrapper/EntityAnomalyMergeWrapper.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/model/download/ModelDownloader.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/model/download/ModelDownloaderConfiguration.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/model/download/ModelDownloaderManager.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/commons/EmailEntity.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/commons/JiraConfiguration.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/commons/JiraEntity.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/commons/SmtpConfiguration.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/commons/ThirdEyeJiraClient.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/content/BaseNotificationContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/content/NotificationContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/content/templates/EntityGroupKeyContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/content/templates/HierarchicalAnomaliesContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/content/templates/MetricAnomaliesContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/formatter/AlertContentFormatterFactory.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/formatter/channels/AlertContentFormatter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/formatter/channels/EmailContentFormatter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/notification/formatter/channels/JiraContentFormatter.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/scheduler/DetectionCronScheduler.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/scheduler/SubscriptionCronScheduler.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/scheduler/ThirdEyeCronScheduler.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/util/CacheUtils.java
create mode 100644 thirdeye/thirdeye-pinot/src/main/resources/org/apache/pinot/thirdeye/detector/jira-metric-anomalies-template.ftl
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/commons/TestEmailContentFormatterFactory.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/content/ContentFormatterUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/content/TestEntityGroupKeyEmailContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/content/TestHierarchicalAnomaliesEmailContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/content/TestMetricAnomaliesEmailContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/content/TestOnboardingNotificationContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/feed/TestUnionAnomalyFeed.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/fetcher/TestContinuumAnomalyFetcher.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/alert/fetcher/TestUnnotifiedAnomalyFetcher.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityEventListenerTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityTaskSchedulerTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DatasetTriggerInfoRepoTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/MockConsumerDataAvailability.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/MockDataAvailabilityEvent.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/merge/TestAnomalyTimeBasedSummarizer.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/onboard/DetectionOnBoardJobRunnerTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/onboard/DetectionOnboardResourceTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/onboard/OnboardingTaskTestUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/onboard/tasks/TestOnboardingTasks.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomalydetection/function/TestAnomalyFunctionFactory.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomalydetection/function/TestMinMaxThresholdFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomalydetection/function/TestWeekOverWeekRuleFunction.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomalydetection/model/transform/testAnomalyRemovalFunction.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/cube/summary/SummaryResponseTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/dashboard/resource/OnboardResourceTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/datalayer/util/StringUtilsTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/datalayer/util/ThirdEyeStringUtilsTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/filter/AlertFilterUtils.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/filter/DimensionDetectionAlertFilterTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/filter/DimensionsRecipientAlertFilterTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/scheme/DetectionEmailAlerterTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/alert/scheme/DetectionJiraAlerterTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/algorithm/LegacyAlertFilterWrapperTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/algorithm/LegacyAnomalyFunctionAlgorithmTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/algorithm/LegacyDimensionWrapperTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/algorithm/LegacyMergeWrapperTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/cache/ThirdEyeCacheResponseTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/cache/TimeSeriesCacheTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/datasla/DatasetSlaTaskRunnerTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/integration/LegacyEmulationIntegrationTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/detection/wrapper/EntityAnomalyMergeWrapperTest.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/integration/AnomalyApplicationEndToEndTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/ContentFormatterUtils.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/commons/TestThirdEyeJiraClient.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/content/templates/TestEntityGroupKeyContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/content/templates/TestHierarchicalAnomaliesContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/content/templates/TestMetricAnomaliesContent.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/formatter/TestAlertContentFormatterFactory.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/formatter/channels/TestJiraContentFormatter.java
delete mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/tools/CleanupAndRegenerateAnomaliesTool.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/util/CacheUtilTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/data-sources/cache-config.yml
delete mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/alertconfig/alert-config-1.yaml
delete mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/alertconfig/alert-config-2.yaml
delete mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/alertconfig/alert-config-3.yaml
delete mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/alertconfig/alert-config-4.yaml
delete mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/alertconfig/alert-config-5.yaml
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/subscription/subscription-config-1.yaml
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/subscription/subscription-config-2.yaml
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/subscription/subscription-config-3.yaml
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/subscription/subscription-config-4.yaml
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/subscription/subscription-config-5.yaml
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/detection/yaml/subscription/subscription-config-6.yaml
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/notification/commons/jira_create_schema.json
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/test-jira-anomalies-template.ftl
create mode 100755 website/.gitignore
create mode 100755 website/README.md
create mode 100644 website/docs/about.md
create mode 100644 website/docs/about/features_of_pinot.md
create mode 100644 website/docs/about/what_is_pinot.md
create mode 100644 website/docs/about/who_use_pinot.md
create mode 100644 website/docs/administration.md
create mode 100644 website/docs/administration/guides/troubleshooting.md
create mode 100644 website/docs/administration/installation/cloud/aws.md
create mode 100644 website/docs/administration/installation/cloud/azure.md
create mode 100644 website/docs/administration/installation/cloud/gcp.md
create mode 100644 website/docs/administration/installation/cloud/on-premise.md
create mode 100644 website/docs/administration/installation/containers.md
create mode 100644 website/docs/administration/installation/containers/docker.md
create mode 100644 website/docs/administration/installation/operating-systems/macos.md
create mode 100644 website/docs/administration/installation/operating-systems/ubuntu.md
create mode 100644 website/docs/administration/running_locally.md
create mode 100644 website/docs/components.md
create mode 100644 website/docs/components/broker.md
create mode 100644 website/docs/components/cluster.md
create mode 100644 website/docs/components/controller.md
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/minion.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/schema.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/segments.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/server.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/tables.md (100%)
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/docs/components/tenants.md (100%)
create mode 100644 website/docs/concepts.md
create mode 100644 website/docs/concepts/pinot-architecture.md
create mode 100644 website/docs/how-to.md
create mode 100644 website/docs/misc.md
create mode 100644 website/docs/misc/build-docker.md
create mode 100644 website/docs/user-guide.md
create mode 100644 website/docs/user-guide/clients/golang.md
create mode 100644 website/docs/user-guide/clients/java.md
create mode 100644 website/docs/user-guide/pql.md
create mode 100644 website/docs/user-guide/query-pinot.md
create mode 100644 website/docs/user-guide/response-format.md
create mode 100644 website/docs/user-guide/rest-admin-interface.md
create mode 100755 website/docusaurus.config.js
create mode 100755 website/package.json
create mode 100755 website/scripts/build-site.sh
create mode 100644 website/scripts/publish_site.sh
create mode 100755 website/sidebars.js
create mode 100644 website/src/components/Alert/index.js
create mode 100644 website/src/components/Alert/styles.css
create mode 100644 website/src/components/BlogPostTags/index.js
create mode 100644 website/src/components/BlogPostTags/styles.module.css
create mode 100644 website/src/components/Changelog/index.js
create mode 100644 website/src/components/CheckboxList/index.js
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/src/components/CheckboxList/styles.css (100%)
create mode 100644 website/src/components/CodeHeader/index.js
create mode 100644 website/src/components/CodeHeader/styles.css
create mode 100644 website/src/components/Field/index.js
create mode 100644 website/src/components/Fields/index.js
create mode 100644 website/src/components/Fields/styles.css
create mode 100644 website/src/components/Jump/index.js
create mode 100644 website/src/components/Jump/styles.css
create mode 100644 website/src/components/Step/index.js
copy thirdeye/thirdeye-pinot/config/detector-config/anomaly-functions/functions.properties => website/src/components/Step/styles.css (100%)
create mode 100644 website/src/components/Steps/index.js
create mode 100644 website/src/components/Steps/styles.css
create mode 100644 website/src/css/custom.css
create mode 100644 website/src/exports/animatedGraph.js
create mode 100644 website/src/exports/cloudify.js
create mode 100644 website/src/exports/newPost.js
create mode 100644 website/src/exports/newRelease.js
create mode 100644 website/src/exports/repoUrl.js
create mode 100644 website/src/pages/download.css
create mode 100644 website/src/pages/download.js
create mode 100644 website/src/pages/index.css
create mode 100755 website/src/pages/index.js
create mode 100644 website/src/pages/index.module.css
create mode 100644 website/static/img/companies/factual.svg
create mode 100644 website/static/img/companies/linkedin.svg
create mode 100644 website/static/img/companies/microsoft-teams.svg
create mode 100644 website/static/img/companies/slack.svg
create mode 100644 website/static/img/companies/uber.svg
create mode 100644 website/static/img/companies/weibo.svg
create mode 100644 website/static/img/components/Broker.png
create mode 100644 website/static/img/components/ClusterLogical.png
create mode 100644 website/static/img/components/TimeBoundary.jpg
create mode 100644 website/static/img/components/components.png
create mode 100644 website/static/img/dynamic-table.png
create mode 100644 website/static/img/favicon-16x16.png
create mode 100644 website/static/img/favicon-32x32.png
create mode 100644 website/static/img/favicon-96x96.png
create mode 100644 website/static/img/favicon.ico
create mode 100644 website/static/img/ingest-query.svg
create mode 100644 website/static/img/logo.svg
create mode 100644 website/static/img/pinot-320x320.png
copy {docs => website/static}/img/pinot-architecture.png (100%)
create mode 100644 website/static/img/pinot-components.svg
create mode 100644 website/static/img/pinot-navbar-logo.svg
create mode 100644 website/static/img/pinot-overview-dark.png
create mode 100644 website/static/img/pinot-overview-light.png
create mode 100644 website/static/img/pinot-overview.svg
create mode 100644 website/static/img/pinot-query.svg
create mode 100644 website/static/img/pinot.png
create mode 100644 website/static/img/pql-query.png
create mode 100644 website/static/img/pql/pql-query-console.png
create mode 100755 website/static/img/undraw_docusaurus_mountain.svg
create mode 100755 website/static/img/undraw_docusaurus_react.svg
create mode 100755 website/static/img/undraw_docusaurus_tree.svg
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org