You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pinot.apache.org by xi...@apache.org on 2019/11/21 18:11:12 UTC
[incubator-pinot] branch pinot-ingestion-refactor updated (ce0187f
-> c7dfc90)
This is an automated email from the ASF dual-hosted git repository.
xiangfu pushed a change to branch pinot-ingestion-refactor
in repository https://gitbox.apache.org/repos/asf/incubator-pinot.git.
discard ce0187f Adding config to control spark job push parallism
discard 25ffe89 Fixing parent directory creation issue
discard 7222b9b don't use default conf
discard 285eb63 fixing class: com.databricks.backend.daemon.data.client.DBFS not serializable issue
discard 72c2d02 Ensure segment push job is Serializable
discard 7cb987d Make spark job an option to parallel push segments
discard 58d423e Address comments
discard e554ee9 Move segment tars recursively and override existed files
discard 557fedd Initial refactor
omit cd86d4d Make temp directory with uuid appended
omit d607b19 Make PushLocation Serializable
omit 34885ec Use SparkContext.getOrCreate() to use shared SparkContext if possible.
omit 02152df Initial commit for pinot-spark
add 4445fdc Fix the bug of uneven task distribution for threads (#4793)
add 8147714 Adding example for aws (#4789)
add aba5482 Data Anonymizer Tool (#4747)
add 343aadb Disable compression when numPartitions are less than the threshold (#4797)
add 8516fdb [TE] frontend - harleyjj/alert-details - small patch for dimensions column in anomaly table (#4799)
add ea3ef34 Add query options from json to existing query options, instead of overriding (#4786)
add ed4e3ae [TE] Initiate docker for ThirdEye (#4780)
add 7790e15 Fix controller download segment api on non-local PinotFS. (#4757)
add 98140bc Decouple Key from Record (#4798)
add 103f538 [TE] Remove datepartition for presto queries to unblock other usecases (#4802)
add c9f465a Revert "Fix controller download segment api on non-local PinotFS. (#4757)" (#4804)
add 64e1342 Small typo fix (confifurations -> configurations) (#4805)
add a92d88d [TE] revert the default settings; update indexes on task table (#4810)
add 01b1de5 Include dataSchema in the ResultTable to retain column type information (#4807)
add b9fd128 Adding pinot presto docker image (#4812)
add e92f94b [TE] Fail alert task if unable to notify receipients with exception of dimensions alerter (#4811)
add 895c7ee Make default timeout to 15s for all queries in tests (#4813)
add e6624fe [TE] Set non additive dataset for Pinot (#4803)
add 36ef2c3 [TE] frontend - harleyjj/homepage - homepage facelift and default to application tier0-tier1 if none chosen (#4794)
add 5282e11 [TE] frontend - harleyjj/alert-overview - fix report anomaly bugs (#4816)
add a7b4aff [TE] web - harleyjj/rca - add detectionConfigId to anomaly entity attributes (#4821)
add 094fffa [TE] frontend - harleyjj/rca - add link from RCA to Alert Overview whe RCA is exploring an anomaly (#4822)
add 2e221e6 [TE] frontend - harleyjj/preview - disable preview button instead of removing from DOM (#4485)
add 3ffbab9 [TE][notification] Minor cleaning up of the jira related code (#4814)
add 1f79d29 Bug Fix: Fix segment download url in SegmentZkMetadata. (#4825)
add d764ea6 Enhance table rebalance rest API argument check (#4824)
add 648d02a Replace ServerInstance with ServerRoutingInstance for Broker scatter-gather (#4817)
add eb45b43 [TE] add event driven scheduler (#4777)
add 57f67c9 Refactor segments admin rest APIs (#4806)
add 75dbe8c Enhance RoutingTable with ServerInstance (#4823)
add 687ac69 Reorg k8s related scripts structure and update readme (#4827)
add 85c7f5a Add segment batch deletion rest API (#4828)
add c33da6b [TE] change default time zone to pacific time zone (#4830)
add d493707 Add user guide for pluggable storage for realtime table (#4783)
add 54a4991 Misc enhancements to the broker routing (#4831)
add 3c00da7 [TE][notification] Jira Alerting improvements (#4829)
add 12dd36c [TE] fix mismatch in dataset names in data availability listener (#4832)
add a9f6591 Replace NettyTCPServer with QueryServer for server side query handling (#4834)
add 2189c92 Adding example of pinot-quickstart with Avro encoded messages in Kafka (#4836)
add 2f203df Support ORDER BY for DISTINCT queries (#4790)
add 8763494 Fix documentation on LLC configs (#4839)
add e189f5e Refactoring realtime segment committer (#4713)
add 94f687a Handle default value after adding new byte column (#4844)
add c272587 Initial commit for pinot-spark
add c05d660 Use SparkContext.getOrCreate() to use shared SparkContext if possible.
add b56cc1c Make PushLocation Serializable
add becc214 Make temp directory with uuid appended
add f9c983c Initial refactor
add 9636308 Move segment tars recursively and override existed files
add 80d2d79 Address comments
add 5cde44b Make spark job an option to parallel push segments
add 37d6e55 Ensure segment push job is Serializable
add 7b476aa fixing class: com.databricks.backend.daemon.data.client.DBFS not serializable issue
add bb5b808 don't use default conf
add 66f043e Fixing parent directory creation issue
add c7dfc90 Adding config to control spark job push parallism
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (ce0187f)
\
N -- N -- N refs/heads/pinot-ingestion-refactor (c7dfc90)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
README.md | 5 +
docker/images/pinot-presto/Dockerfile | 59 +
docker/images/pinot-presto/README.md | 61 +
.../images/pinot-presto/docker-build.sh | 34 +-
.../images/pinot-presto/etc/config.properties | 17 +-
docker/images/pinot-presto/etc/jvm.config | 8 +
.../images/pinot-presto/etc/log.properties | 6 +-
.../images/pinot-presto/etc/node.properties | 8 +-
docs/code_modules.rst | 4 +-
docs/dev_env.rst | 2 +-
docs/pluggable_storage.rst | 33 +-
docs/pluggable_streams.rst | 18 +-
docs/pql_examples.rst | 4 +-
docs/tableconfig_schema.rst | 7 +-
kubernetes/README.md | 8 +-
kubernetes/{examples => }/helm/Chart.yaml | 0
kubernetes/{examples => }/helm/README.md | 197 ++-
kubernetes/helm/charts/zookeeper-2.0.0.tgz | Bin 0 -> 10633 bytes
kubernetes/{examples => }/helm/helm-rbac.yaml | 0
kubernetes/{examples => }/helm/open-superset-ui.sh | 0
.../pinot-presto-cli.sh} | 19 +-
.../helm/pinot-realtime-quickstart.yml | 101 +-
kubernetes/helm/presto-coordinator.yaml | 158 +++
.../skaffold/gke => helm}/query-pinot-data.sh | 0
kubernetes/{examples => }/helm/requirements.lock | 0
kubernetes/{examples => }/helm/requirements.yaml | 0
kubernetes/{examples => }/helm/setup_gke.sh | 0
kubernetes/{examples => }/helm/superset.yaml | 2 +-
.../{examples => }/helm/templates/_helpers.tpl | 0
.../helm/templates/broker/configmap.yaml | 0
.../helm/templates/broker/service-external.yaml | 0
.../helm/templates/broker/service-headless.yaml | 0
.../helm/templates/broker/service.yaml | 0
.../helm/templates/broker/statefulset.yml | 0
.../helm/templates/controller/configmap.yaml | 0
.../templates/controller/service-external.yaml | 0
.../templates/controller/service-headless.yaml | 0
.../helm/templates/controller/service.yaml | 0
.../helm/templates/controller/statefulset.yaml | 0
.../helm/templates/server/configmap.yaml | 0
.../helm/templates/server/service-headless.yaml | 0
.../helm/templates/server/service.yaml | 0
.../helm/templates/server/statefulset.yml | 0
kubernetes/{examples => }/helm/values.yaml | 0
kubernetes/{examples => }/skaffold/gke/README.md | 0
kubernetes/{examples => }/skaffold/gke/cleanup.sh | 0
.../skaffold/gke/gke-storageclass-kafka-pd.yml | 0
.../gke/gke-storageclass-pinot-controller-pd.yml | 0
.../gke/gke-storageclass-pinot-server-pd.yml | 0
.../skaffold/gke/gke-storageclass-zk-pd.yml | 0
kubernetes/{examples => }/skaffold/gke/kafka.yml | 0
.../{examples => }/skaffold/gke/pinot-broker.yml | 0
.../skaffold/gke/pinot-controller.yml | 0
.../skaffold/gke/pinot-realtime-quickstart.yml | 0
.../{examples => }/skaffold/gke/pinot-server.yml | 0
.../helm => skaffold/gke}/query-pinot-data.sh | 0
kubernetes/{examples => }/skaffold/gke/setup.sh | 0
.../{examples => }/skaffold/gke/skaffold.yaml | 0
.../{examples => }/skaffold/gke/zookeeper.yml | 0
.../requesthandler/BaseBrokerRequestHandler.java | 87 +-
.../ConnectionPoolBrokerRequestHandler.java | 45 +-
.../SingleConnectionBrokerRequestHandler.java | 24 +-
.../routing/HelixExternalViewBasedRouting.java | 24 +-
.../apache/pinot/broker/routing/RoutingTable.java | 22 +-
.../builder/BalancedRandomRoutingTableBuilder.java | 18 +-
.../BasePartitionAwareRoutingTableBuilder.java | 24 +-
.../routing/builder/BaseRoutingTableBuilder.java | 88 +-
.../builder/DefaultOfflineRoutingTableBuilder.java | 6 +-
.../DefaultRealtimeRoutingTableBuilder.java | 6 +-
.../builder/GeneratorBasedRoutingTableBuilder.java | 68 +-
.../HighLevelConsumerBasedRoutingTableBuilder.java | 57 +-
...tancePruner.java => InstanceConfigManager.java} | 50 +-
.../LowLevelConsumerRoutingTableBuilder.java | 46 +-
.../PartitionAwareOfflineRoutingTableBuilder.java | 48 +-
.../PartitionAwareRealtimeRoutingTableBuilder.java | 55 +-
.../routing/builder/RoutingTableBuilder.java | 5 +-
.../broker/broker/HelixBrokerStarterTest.java | 3 +-
.../requesthandler/BrokerRequestOptionsTest.java | 140 +++
.../broker/requesthandler/QueryValidationTest.java | 7 +-
.../broker/routing/RandomRoutingTableTest.java | 4 +-
.../pinot/broker/routing/RoutingTableTest.java | 5 +-
.../BalancedRandomRoutingTableBuilderTest.java | 11 +-
.../HighLevelConsumerRoutingTableBuilderTest.java | 3 +-
.../LargeClusterRoutingTableBuilderTest.java | 53 +-
.../LowLevelConsumerRoutingTableBuilderTest.java | 17 +-
...rtitionAwareOfflineRoutingTableBuilderTest.java | 11 +-
...titionAwareRealtimeRoutingTableBuilderTest.java | 9 +-
.../apache/pinot/common/metrics/ServerMeter.java | 8 +-
.../apache/pinot/common/metrics/ServerTimer.java | 7 +-
.../protocols/SegmentCompletionProtocol.java | 13 +
.../apache/pinot/common/query/ReduceService.java | 49 -
.../pinot/common/query/ReduceServiceRegistry.java | 70 --
.../pinot/common/response/broker/ResultTable.java | 27 +-
.../org/apache/pinot/common/utils/HashUtil.java | 11 +-
.../org/apache/pinot/common/utils/SegmentName.java | 39 +-
.../pinot/common/utils/helix/HelixHelper.java | 24 +-
.../org/apache/pinot/pql/parsers/Pql2Compiler.java | 23 +
.../pql2/ast/ComparisonPredicateAstNode.java | 4 +
.../pinot/pql/parsers/pql2/ast/SelectAstNode.java | 16 +
.../apache/pinot/sql/parsers/CalciteSqlParser.java | 8 -
.../pinot/common/utils/SegmentNameBuilderTest.java | 9 +-
.../pinot/sql/parsers/CalciteSqlCompilerTest.java | 10 -
.../pinot/controller/api/resources/Constants.java | 6 +-
.../resources/LLCSegmentCompletionHandlers.java | 2 +-
.../api/resources/PinotSchemaRestletResource.java | 2 +-
.../api/resources/PinotSegmentRestletResource.java | 707 ++++++-----
...PinotSegmentUploadDownloadRestletResource.java} | 128 +-
.../api/resources/PinotTableRestletResource.java | 26 +-
.../helix/ControllerRequestURLBuilder.java | 9 -
.../helix/core/PinotHelixResourceManager.java | 64 +-
.../helix/core/rebalance/TableRebalancer.java | 3 +-
.../manager/realtime/DefaultSegmentCommitter.java | 53 +
.../realtime/LLRealtimeSegmentDataManager.java | 99 +-
.../realtime/SegmentCommitter.java} | 38 +-
.../manager/realtime/SegmentCommitterFactory.java | 49 +
.../manager/realtime/SplitSegmentCommitter.java | 84 ++
.../table/{IndexedTable.java => BaseTable.java} | 35 +-
.../core/data/table/ConcurrentIndexedTable.java | 19 +-
.../apache/pinot/core/data/table/IndexedTable.java | 82 +-
.../org/apache/pinot/core/data/table/Record.java | 28 +-
.../pinot/core/data/table/SimpleIndexedTable.java | 17 +-
.../org/apache/pinot/core/data/table/Table.java | 7 +-
...{IndexedTableResizer.java => TableResizer.java} | 204 ++-
.../operator/CombineGroupByOrderByOperator.java | 18 +-
.../pinot/core/operator/CombineOperator.java | 7 +-
.../operator/blocks/IntermediateResultsBlock.java | 9 +-
.../apache/pinot/core/plan/CombinePlanNode.java | 13 +-
.../core/plan/maker/InstancePlanMakerImplV2.java | 8 +-
.../core/query/aggregation/DistinctTable.java | 254 ++--
.../function/AggregationFunctionFactory.java | 2 +-
.../function/DistinctAggregationFunction.java | 67 +-
.../core/query/reduce/BrokerReduceService.java | 363 +++---
.../query/selection/SelectionOperatorService.java | 11 +-
.../query/selection/SelectionOperatorUtils.java | 12 +-
.../defaultcolumn/BaseDefaultColumnHandler.java | 11 +-
.../pinot/core/transport/AsyncQueryResponse.java | 27 +-
.../pinot/core/transport/DataTableHandler.java | 29 +-
.../core/transport/InstanceRequestHandler.java | 124 ++
.../apache/pinot/core/transport/QueryRouter.java | 39 +-
.../apache/pinot/core/transport/QueryServer.java} | 41 +-
.../pinot/core/transport/ServerChannels.java | 24 +-
.../pinot/core/transport/ServerInstance.java | 98 ++
.../pinot/core/transport/ServerResponse.java | 26 +-
.../{Server.java => ServerRoutingInstance.java} | 62 +-
.../org/apache/pinot/core/util/GroupByUtils.java | 16 -
.../org/apache/pinot/core/util/QueryOptions.java | 55 +
.../realtime/LLRealtimeSegmentDataManagerTest.java | 6 +-
.../pinot/core/data/readers/PinotSegmentUtil.java | 4 +-
.../core/data/table/IndexedTableResizerTest.java | 434 -------
.../pinot/core/data/table/IndexedTableTest.java | 127 +-
.../pinot/core/data/table/TableResizerTest.java | 624 ++++++++++
.../core/segment/index/loader/LoaderTest.java | 18 +
.../pinot/core/transport/QueryRouterTest.java | 230 ----
.../pinot/core/transport/QueryRoutingTest.java | 256 ++++
.../org/apache/pinot/queries/BaseQueriesTest.java | 13 +-
.../apache/pinot/queries/DistinctQueriesTest.java | 393 ++++--
...erSegmentAggregationSingleValueQueriesTest.java | 53 +-
.../InterSegmentOrderByMultiValueQueriesTest.java | 67 +-
.../InterSegmentOrderBySingleValueQueriesTest.java | 582 ++++++---
.../org/apache/pinot/queries/QueriesTestUtils.java | 41 +-
pinot-integration-tests/pom.xml | 4 +
.../DefaultCommitterRealtimeIntegrationTest.java | 197 +++
.../tests/LLCRealtimeClusterIntegrationTest.java | 13 +-
.../apache/pinot/perf/BenchmarkCombineGroupBy.java | 7 +-
.../apache/pinot/perf/BenchmarkIndexedTable.java | 7 +-
.../server/api/resources/SchedulerResource.java | 48 -
.../pinot/server/starter/ServerInstance.java | 40 +-
.../pinot/tools/PinotDataAndQueryAnonymizer.java | 1303 ++++++++++++++++++++
.../pinot/tools/admin/PinotAdministrator.java | 4 +-
.../tools/admin/command/AddSchemaCommand.java | 4 +-
.../pinot/tools/admin/command/AddTableCommand.java | 5 +-
.../tools/admin/command/AnonymizeDataCommand.java | 181 +++
.../admin/command/StreamAvroIntoKafkaCommand.java | 28 +-
.../pinot/tools/TestDataAndQueryAnonymizer.java | 105 ++
pinot-tools/src/test/resources/C11.dict | 12 +
pinot-tools/src/test/resources/columns.mapping | 11 +
pinot-tools/src/test/resources/queries.generated | 6 +
pinot-tools/src/test/resources/queries.raw | 6 +
pom.xml | 1 +
thirdeye/docker/Dockerfile | 45 +
thirdeye/docker/README.md | 38 +
thirdeye/docker/docker-compose.yml | 15 +
.../app/pods/components/alert-details/component.js | 21 +-
.../app/pods/components/alert-details/template.hbs | 25 +-
.../components/alert-report-modal/template.hbs | 1 +
.../components/range-pill-selectors/component.js | 65 +-
.../components/range-pill-selectors/template.hbs | 60 +-
.../pods/components/rootcause-anomaly/component.js | 7 +-
.../pods/components/rootcause-anomaly/template.hbs | 8 +-
.../app/pods/home/index/controller.js | 25 +-
.../thirdeye-frontend/app/pods/home/index/route.js | 25 +-
.../app/pods/home/index/template.hbs | 52 +-
.../app/pods/services/api/anomalies/service.js | 4 +-
.../styles/components/range-pill-selectors.scss | 73 +-
.../app/styles/pods/home/index/dashboard.scss | 23 +-
.../anomaly/ThirdEyeAnomalyApplication.java | 12 +-
.../anomaly/ThirdEyeAnomalyConfiguration.java | 35 +-
.../trigger/DataAvailabilityEventListener.java | 24 +-
.../DataAvailabilityEventListenerDriver.java | 12 +-
.../trigger/DataAvailabilityTaskScheduler.java | 217 ++++
...> DataAvailabilitySchedulingConfiguration.java} | 23 +-
.../trigger/utils/DatasetTriggerInfoRepo.java | 37 +-
.../thirdeye/anomaly/monitor/MonitorConstants.java | 8 +-
.../pinot/thirdeye/anomaly/task/TaskDriver.java | 17 +-
.../anomaly/utils/ThirdeyeMetricsUtil.java | 6 +
.../onboard/AutoOnboardPinotMetadataSource.java | 5 +-
.../thirdeye/auto/onboard/ConfigGenerator.java | 13 +
.../v2/rootcause/AnomalyEventFormatter.java | 4 +
.../pinot/thirdeye/datalayer/bao/TaskManager.java | 8 +-
.../datalayer/bao/jdbc/TaskManagerImpl.java | 36 +-
.../datalayer/pojo/DetectionConfigBean.java | 22 +-
.../datasource/sql/SqlResponseCacheLoader.java | 1 +
.../pinot/thirdeye/datasource/sql/SqlUtils.java | 17 +-
.../detection/DetectionPipelineScheduler.java | 16 +-
.../alert/scheme/DetectionAlertScheme.java | 13 +
.../alert/scheme/DetectionEmailAlerter.java | 6 +-
.../alert/scheme/DetectionJiraAlerter.java | 9 +-
.../spec/AbsoluteChangeRuleAnomalyFilterSpec.java | 2 +-
.../spec/AbsoluteChangeRuleDetectorSpec.java | 2 +-
.../thirdeye/detection/spec/AbstractSpec.java | 1 +
.../PercentageChangeRuleAnomalyFilterSpec.java | 2 +-
.../spec/PercentageChangeRuleDetectorSpec.java | 2 +-
.../detection/spec/RuleBaselineProviderSpec.java | 2 +-
.../spec/SitewideImpactRuleAnomalyFilterSpec.java | 2 +-
.../thirdeye/notification/commons/JiraEntity.java | 29 +-
.../notification/commons/ThirdEyeJiraClient.java | 143 ++-
.../formatter/channels/JiraContentFormatter.java | 99 +-
.../apache/pinot/thirdeye/util/ThirdEyeUtils.java | 31 +-
.../detector/jira-metric-anomalies-template.ftl | 2 +-
.../src/main/resources/schema/create-schema.sql | 4 +
.../trigger/DataAvailabilityEventListenerTest.java | 49 +-
.../trigger/DataAvailabilityTaskSchedulerTest.java | 234 ++++
.../trigger/DatasetTriggerInfoRepoTest.java | 33 +-
.../trigger/MockConsumerDataAvailability.java | 2 +
.../datalayer/bao/TestAnomalyTaskManager.java | 5 +-
.../PercentageChangeRuleDetectorTest.java | 1 +
.../commons/TestThirdEyeJiraClient.java | 61 +
.../channels/TestJiraContentFormatter.java | 1 +
.../notification/commons/jira_create_schema.json | 85 ++
.../resources/test-jira-anomalies-template.ftl | 2 +-
240 files changed, 8210 insertions(+), 3425 deletions(-)
create mode 100644 docker/images/pinot-presto/Dockerfile
create mode 100644 docker/images/pinot-presto/README.md
copy kubernetes/examples/skaffold/gke/cleanup.sh => docker/images/pinot-presto/docker-build.sh (52%)
copy kubernetes/examples/skaffold/gke/gke-storageclass-pinot-controller-pd.yml => docker/images/pinot-presto/etc/config.properties (76%)
create mode 100644 docker/images/pinot-presto/etc/jvm.config
copy kubernetes/examples/helm/requirements.yaml => docker/images/pinot-presto/etc/log.properties (80%)
copy kubernetes/examples/helm/requirements.yaml => docker/images/pinot-presto/etc/node.properties (80%)
rename kubernetes/{examples => }/helm/Chart.yaml (100%)
rename kubernetes/{examples => }/helm/README.md (87%)
create mode 100644 kubernetes/helm/charts/zookeeper-2.0.0.tgz
rename kubernetes/{examples => }/helm/helm-rbac.yaml (100%)
rename kubernetes/{examples => }/helm/open-superset-ui.sh (100%)
copy kubernetes/{examples/helm/query-pinot-data.sh => helm/pinot-presto-cli.sh} (61%)
rename kubernetes/{examples => }/helm/pinot-realtime-quickstart.yml (58%)
create mode 100644 kubernetes/helm/presto-coordinator.yaml
rename kubernetes/{examples/skaffold/gke => helm}/query-pinot-data.sh (100%)
rename kubernetes/{examples => }/helm/requirements.lock (100%)
rename kubernetes/{examples => }/helm/requirements.yaml (100%)
rename kubernetes/{examples => }/helm/setup_gke.sh (100%)
rename kubernetes/{examples => }/helm/superset.yaml (99%)
rename kubernetes/{examples => }/helm/templates/_helpers.tpl (100%)
rename kubernetes/{examples => }/helm/templates/broker/configmap.yaml (100%)
rename kubernetes/{examples => }/helm/templates/broker/service-external.yaml (100%)
rename kubernetes/{examples => }/helm/templates/broker/service-headless.yaml (100%)
rename kubernetes/{examples => }/helm/templates/broker/service.yaml (100%)
rename kubernetes/{examples => }/helm/templates/broker/statefulset.yml (100%)
rename kubernetes/{examples => }/helm/templates/controller/configmap.yaml (100%)
rename kubernetes/{examples => }/helm/templates/controller/service-external.yaml (100%)
rename kubernetes/{examples => }/helm/templates/controller/service-headless.yaml (100%)
rename kubernetes/{examples => }/helm/templates/controller/service.yaml (100%)
rename kubernetes/{examples => }/helm/templates/controller/statefulset.yaml (100%)
rename kubernetes/{examples => }/helm/templates/server/configmap.yaml (100%)
rename kubernetes/{examples => }/helm/templates/server/service-headless.yaml (100%)
rename kubernetes/{examples => }/helm/templates/server/service.yaml (100%)
rename kubernetes/{examples => }/helm/templates/server/statefulset.yml (100%)
rename kubernetes/{examples => }/helm/values.yaml (100%)
rename kubernetes/{examples => }/skaffold/gke/README.md (100%)
rename kubernetes/{examples => }/skaffold/gke/cleanup.sh (100%)
rename kubernetes/{examples => }/skaffold/gke/gke-storageclass-kafka-pd.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/gke-storageclass-pinot-controller-pd.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/gke-storageclass-pinot-server-pd.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/gke-storageclass-zk-pd.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/kafka.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/pinot-broker.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/pinot-controller.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/pinot-realtime-quickstart.yml (100%)
rename kubernetes/{examples => }/skaffold/gke/pinot-server.yml (100%)
rename kubernetes/{examples/helm => skaffold/gke}/query-pinot-data.sh (100%)
rename kubernetes/{examples => }/skaffold/gke/setup.sh (100%)
rename kubernetes/{examples => }/skaffold/gke/skaffold.yaml (100%)
rename kubernetes/{examples => }/skaffold/gke/zookeeper.yml (100%)
rename pinot-broker/src/main/java/org/apache/pinot/broker/routing/builder/{RoutingTableInstancePruner.java => InstanceConfigManager.java} (52%)
create mode 100644 pinot-broker/src/test/java/org/apache/pinot/broker/requesthandler/BrokerRequestOptionsTest.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/query/ReduceService.java
delete mode 100644 pinot-common/src/main/java/org/apache/pinot/common/query/ReduceServiceRegistry.java
rename pinot-controller/src/main/java/org/apache/pinot/controller/api/resources/{PinotSegmentUploadRestletResource.java => PinotSegmentUploadDownloadRestletResource.java} (78%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/DefaultSegmentCommitter.java
copy pinot-core/src/main/java/org/apache/pinot/core/data/{table/Record.java => manager/realtime/SegmentCommitter.java} (57%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SegmentCommitterFactory.java
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/data/manager/realtime/SplitSegmentCommitter.java
copy pinot-core/src/main/java/org/apache/pinot/core/data/table/{IndexedTable.java => BaseTable.java} (73%)
rename pinot-core/src/main/java/org/apache/pinot/core/data/table/{IndexedTableResizer.java => TableResizer.java} (59%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/transport/InstanceRequestHandler.java
rename pinot-core/src/{test/java/org/apache/pinot/core/transport/DummyServer.java => main/java/org/apache/pinot/core/transport/QueryServer.java} (69%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/transport/ServerInstance.java
rename pinot-core/src/main/java/org/apache/pinot/core/transport/{Server.java => ServerRoutingInstance.java} (54%)
create mode 100644 pinot-core/src/main/java/org/apache/pinot/core/util/QueryOptions.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/table/IndexedTableResizerTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/data/table/TableResizerTest.java
delete mode 100644 pinot-core/src/test/java/org/apache/pinot/core/transport/QueryRouterTest.java
create mode 100644 pinot-core/src/test/java/org/apache/pinot/core/transport/QueryRoutingTest.java
create mode 100644 pinot-integration-tests/src/test/java/org/apache/pinot/integration/tests/DefaultCommitterRealtimeIntegrationTest.java
delete mode 100644 pinot-server/src/main/java/org/apache/pinot/server/api/resources/SchedulerResource.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/PinotDataAndQueryAnonymizer.java
create mode 100644 pinot-tools/src/main/java/org/apache/pinot/tools/admin/command/AnonymizeDataCommand.java
create mode 100644 pinot-tools/src/test/java/org/apache/pinot/tools/TestDataAndQueryAnonymizer.java
create mode 100644 pinot-tools/src/test/resources/C11.dict
create mode 100644 pinot-tools/src/test/resources/columns.mapping
create mode 100644 pinot-tools/src/test/resources/queries.generated
create mode 100644 pinot-tools/src/test/resources/queries.raw
create mode 100644 thirdeye/docker/Dockerfile
create mode 100644 thirdeye/docker/README.md
create mode 100644 thirdeye/docker/docker-compose.yml
create mode 100644 thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityTaskScheduler.java
rename thirdeye/thirdeye-pinot/src/main/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/utils/{DataAvailabilityListenerConfiguration.java => DataAvailabilitySchedulingConfiguration.java} (84%)
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/anomaly/detection/trigger/DataAvailabilityTaskSchedulerTest.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/java/org/apache/pinot/thirdeye/notification/commons/TestThirdEyeJiraClient.java
create mode 100644 thirdeye/thirdeye-pinot/src/test/resources/org/apache/pinot/thirdeye/notification/commons/jira_create_schema.json
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org