You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by vo...@apache.org on 2024/04/22 22:58:48 UTC
(druid) branch better_supervisor_view updated (d67a6790bfc -> 77366fe1c9f)
This is an automated email from the ASF dual-hosted git repository.
vogievetsky pushed a change to branch better_supervisor_view
in repository https://gitbox.apache.org/repos/asf/druid.git
discard d67a6790bfc update tests
discard 06ef03402b6 add recent errors
discard bab61e1fd4f detail
discard 78ad36ba850 better tabs
discard 151a2060981 add rate and stats
omit 45b8464cb5b fix the supervisor offset reset dialog
omit 5d3bd0aebdd Init fixes for reset offsets
omit 9b2f64f6bdb Add host to query output
add 9f358f5f4a1 SQL tests: avoid mixing skip and cannot vectorize. (#16251)
add fc2600b8e2c Adding jvmVersion dimension in JVM Monitor (#16262)
add da9feb44309 Introduce TaskContextReport for reporting task context (#16041)
add f65c166327b Windowed aggregates should update the aggregation value based on final compute (#16244)
add cce2d0f1272 Upload openrewrite patch via GHA (#16270)
add 3340b200db2 Fix window function drill tests failures falling under RESULT_MISMATCH & RESULT_COUNT_MISMATCH (#16264)
add 7f06a53cb19 [Docs] Fix API placeholder formatting (#16240)
add b0c5184f9d6 Fix ORDER BY on certain GROUPING SETS. (#16268)
add 041d0bff5e0 Set default `KillUnusedSegments` duty to coordinator's indexing period & `killTaskSlotRatio` to 0.1 (#16247)
add 81d7b6ebe19 Fix OverlordClient to read reports as a concrete `ReportMap` (#16226)
add 3df00aef9d2 Add manifest file for MSQ export (#15953)
add 5247059d2f9 Allow Double & null values in sql type array through dynamic params (#16274)
add a805c5612e2 Adds Druid SQL query examples for the Stats aggregator Native Queries (#16277)
add 6964297b530 Remove the unused Controller context reference from Worker (#16285)
add c45da431fb5 update netty and zookeeper dependencies to address CVEs (#16267)
add ad6bd621405 Handle task location fetch from overlord during rolling upgrades (#16227)
add cf841b8e67a Fix incorrect class in BaseMacroFunctionExpr.equals. (#16294)
add a5428e75ff9 INSERT/REPLACE complex target column types are validated against source input expressions (#16223)
add f3d69f30e68 Associate pending segments with the tasks that requested them (#16144)
add 4fa377c7fd6 Improve logging for lookups (#16287)
add ccc1ffb0323 Additional short circuiting knowledge in filter bundles. (#16292)
add 34237bc1127 Consider max lag for kinesis while autoscaling (#16284)
add 0bf5e7745d3 Add configurable parameters for statsd client (#16283)
add 2351f038eb7 Kafka with topicPattern can ignore old offsets spuriously (#16190)
add aa230642ddd use PeekableIntIterator for OR filter "partial index" value matchers (#16300)
add 3f2dd46edec Catalog table should not need explicit segment granularity set (#16278)
add 6974498d983 Improve error message when task fails before becoming ready (#16286)
add 4285a5e2c6c Update documentation for exceptions to subquery limit. (#16295)
add 960a674442a Corrected Strict NON NULL return type checks (#16279)
add 79e48c6b45a Fix NPE while loading lookups from empty JDBC source (#16307)
add ad5701e8914 new SCALAR_IN_ARRAY function analogous to DRUID_IN (#16306)
add 3e42ebbaead Web console: Fix the supervisor offset reset dialog. (#16298)
add cff5d1e3695 Add method Supervisor.computeLagForAutoScaler (#16314)
add b9bbde5c0a1 Fix deadlock that can occur while merging group by results (#15420)
add 173a206829e Fix incorrect check of InvalidFieldException to InvalidFieldFault while generating MSQ Error Report (#16273)
add 08b5a8b88e9 Ignore append locks for compaction when using concurrent locks (#16316)
add f50ee8f3282 add rate and stats
add 0bab940d2cb better tabs
add 60e4cc6cbcf detail
add 04c1c679952 add recent errors
add 77366fe1c9f update tests
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (d67a6790bfc)
\
N -- N -- N refs/heads/better_supervisor_view (77366fe1c9f)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/static-checks.yml | 8 +
.../benchmark/GroupByTypeInterfaceBenchmark.java | 7 +-
.../query/CachingClusteredClientBenchmark.java | 9 +-
.../druid/benchmark/query/GroupByBenchmark.java | 7 +-
.../apache/druid/benchmark/query/SqlBenchmark.java | 7 +-
docs/api-reference/automatic-compaction-api.md | 26 +-
docs/api-reference/data-management-api.md | 29 +-
docs/api-reference/dynamic-configuration-api.md | 27 +-
docs/api-reference/json-querying-api.md | 12 +-
docs/api-reference/lookups-api.md | 13 +-
docs/api-reference/retention-rules-api.md | 18 +-
docs/api-reference/service-status-api.md | 80 ++-
docs/api-reference/sql-api.md | 21 +-
docs/api-reference/sql-ingestion-api.md | 278 +++++---
docs/api-reference/sql-jdbc.md | 4 +-
docs/api-reference/supervisor-api.md | 76 +--
docs/api-reference/tasks-api.md | 62 +-
docs/configuration/index.md | 4 +-
docs/development/extensions-contrib/statsd.md | 4 +
docs/development/extensions-core/stats.md | 59 +-
docs/ingestion/tasks.md | 18 +-
docs/multi-stage-query/reference.md | 10 +
docs/operations/clean-metadata-store.md | 2 +-
docs/operations/metrics.md | 28 +-
docs/querying/math-expr.md | 1 +
docs/querying/query-execution.md | 6 +-
docs/querying/sql-array-functions.md | 1 +
docs/querying/sql-functions.md | 8 +
.../DistinctCountGroupByQueryTest.java | 4 +-
.../MaterializedViewQueryQueryToolChest.java | 25 +-
.../MaterializedViewQueryQueryToolChestTest.java | 6 +-
.../apache/druid/emitter/statsd/StatsDEmitter.java | 4 +
.../druid/emitter/statsd/StatsDEmitterConfig.java | 53 +-
.../druid/emitter/statsd/StatsDEmitterTest.java | 23 +-
.../druid/segment/MapVirtualColumnGroupByTest.java | 10 +-
.../hll/sql/HllSketchSqlAggregatorTest.java | 2 -
.../theta/sql/ThetaSketchSqlAggregatorTest.java | 1 -
.../druid/catalog/sql/CatalogInsertTest.java | 13 +-
.../druid/catalog/sql/CatalogReplaceTest.java | 7 +-
.../druid/server/http/catalog/EditorTest.java | 21 +-
.../google/output/GoogleExportStorageProvider.java | 9 +
.../ApproximateHistogramGroupByQueryTest.java | 6 +-
.../FixedBucketsHistogramGroupByQueryTest.java | 6 +-
.../indexing/kafka/KafkaDataSourceMetadata.java | 91 ++-
.../KafkaSeekableStreamEndSequenceNumbers.java | 179 ++++++
.../KafkaSeekableStreamStartSequenceNumbers.java | 214 ++++++
.../indexing/kafka/supervisor/KafkaSupervisor.java | 80 +++
.../kafka/KafkaDataSourceMetadataTest.java | 716 ++++++++++++++++++++-
.../druid/indexing/kafka/KafkaIndexTaskTest.java | 2 +-
.../KafkaSeekableStreamEndSequenceNumbersTest.java | 129 ++++
...afkaSeekableStreamStartSequenceNumbersTest.java | 141 ++++
.../kafka/supervisor/KafkaSupervisorTest.java | 230 ++++++-
.../kinesis/supervisor/KinesisSupervisor.java | 7 +
.../indexing/kinesis/KinesisIndexTaskTest.java | 2 +-
.../lookup/namespace/JdbcCacheGenerator.java | 22 +-
.../namespace/NamespacedExtractorModuleTest.java | 2 +-
.../cache/JdbcExtractionNamespaceTest.java | 30 +
.../java/org/apache/druid/msq/exec/Controller.java | 2 +-
.../apache/druid/msq/exec/ControllerContext.java | 2 +-
.../org/apache/druid/msq/exec/ControllerImpl.java | 60 +-
.../druid/msq/exec/ExportMetadataManager.java | 93 +++
.../msq/indexing/IndexerControllerContext.java | 2 +-
.../druid/msq/indexing/MSQControllerTask.java | 15 +-
.../apache/druid/msq/indexing/MSQWorkerTask.java | 9 +-
.../msq/indexing/client/ControllerChatHandler.java | 2 +-
.../client/IndexerWorkerManagerClient.java | 40 +-
.../indexing/destination/ExportMSQDestination.java | 2 -
.../druid/msq/indexing/report/MSQTaskReport.java | 2 +-
.../results/ExportResultsFrameProcessor.java | 3 +-
.../ExportResultsFrameProcessorFactory.java | 58 +-
.../msq/sql/resources/SqlStatementResource.java | 16 +-
.../druid/msq/util/SqlStatementResourceHelper.java | 67 +-
.../org/apache/druid/msq/exec/MSQExportTest.java | 55 +-
.../druid/msq/indexing/MSQControllerTaskTest.java | 26 +-
.../druid/msq/indexing/MSQWorkerTaskTest.java | 8 +-
.../druid/msq/indexing/WorkerChatHandlerTest.java | 4 +-
.../indexing/client/ControllerChatHandlerTest.java | 4 +-
.../client/IndexerWorkerManagerClientTest.java | 104 +++
.../msq/indexing/report/MSQTaskReportTest.java | 9 +-
.../sql/resources/SqlStatementResourceTest.java | 46 +-
.../org/apache/druid/msq/test/MSQTestBase.java | 9 -
.../druid/msq/test/MSQTestControllerContext.java | 2 +-
.../msq/test/MSQTestOverlordServiceClient.java | 21 +-
.../druid/msq/test/MSQTestWorkerContext.java | 4 +-
.../storage/s3/output/S3ExportStorageProvider.java | 9 +
.../s3/output/S3ExportStorageProviderTest.java | 9 +
.../common/MultipleFileTaskReportFileWriter.java | 3 +
.../apache/druid/indexing/common/TaskToolbox.java | 1 +
.../druid/indexing/common/TaskToolboxFactory.java | 1 +
.../common/actions/SegmentAllocateAction.java | 8 +
.../actions/SegmentTransactionalAppendAction.java | 28 +-
.../actions/SegmentTransactionalReplaceAction.java | 76 ++-
.../common/task/AbstractBatchIndexTask.java | 13 +-
.../task/AppenderatorDriverRealtimeIndexTask.java | 19 +-
.../druid/indexing/common/task/CompactionTask.java | 10 +-
.../indexing/common/task/HadoopIndexTask.java | 2 +-
.../druid/indexing/common/task/IndexTask.java | 10 +-
.../common/task/KillUnusedSegmentsTask.java | 4 +-
.../druid/indexing/common/task/NoopTask.java | 8 +-
.../common/task/NoopTaskContextEnricher.java | 24 +-
.../common/task/PendingSegmentAllocatingTask.java} | 24 +-
.../indexing/common/task/TaskContextEnricher.java | 45 ++
.../GeneratedPartitionsMetadataReport.java | 2 +-
.../batch/parallel/GeneratedPartitionsReport.java | 2 +-
.../parallel/ParallelIndexSupervisorTask.java | 33 +-
.../parallel/PartialHashSegmentGenerateTask.java | 2 +-
.../parallel/PartialRangeSegmentGenerateTask.java | 2 +-
.../batch/parallel/PartialSegmentGenerateTask.java | 2 +-
.../batch/parallel/PartialSegmentMergeTask.java | 2 +-
.../task/batch/parallel/PushedSegmentsReport.java | 2 +-
.../task/batch/parallel/SinglePhaseSubTask.java | 13 +-
.../druid/indexing/overlord/TaskLockbox.java | 105 ++-
.../apache/druid/indexing/overlord/TaskMaster.java | 7 +-
.../apache/druid/indexing/overlord/TaskQueue.java | 14 +-
.../indexing/overlord/ThreadingTaskRunner.java | 2 +-
.../overlord/supervisor/SupervisorManager.java | 12 +-
.../SeekableStreamEndSequenceNumbers.java | 27 +-
.../seekablestream/SeekableStreamIndexTask.java | 9 +-
.../SeekableStreamIndexTaskRunner.java | 10 +-
.../SeekableStreamSequenceNumbers.java | 28 +-
.../SeekableStreamStartSequenceNumbers.java | 27 +-
.../supervisor/SeekableStreamSupervisor.java | 10 +-
.../supervisor/autoscaler/LagBasedAutoScaler.java | 10 +-
.../AppenderatorDriverRealtimeIndexTaskTest.java | 6 +-
.../common/task/CompactionTaskParallelRunTest.java | 2 +-
.../common/task/CompactionTaskRunTest.java | 4 +-
.../druid/indexing/common/task/IndexTaskTest.java | 4 +-
.../indexing/common/task/IngestionTestBase.java | 15 +-
.../common/task/KillUnusedSegmentsTaskTest.java | 9 +-
.../common/task/NoopTestTaskReportFileWriter.java | 4 +-
.../indexing/common/task/ParseExceptionReport.java | 2 +-
.../indexing/common/task/TaskReportSerdeTest.java | 217 -------
.../AbstractMultiPhaseParallelIndexingTest.java | 5 +-
.../AbstractParallelIndexSupervisorTaskTest.java | 92 ++-
.../MultiPhaseParallelIndexingRowStatsTest.java | 2 +-
.../ParallelIndexSupervisorTaskResourceTest.java | 2 +-
.../parallel/ParallelIndexSupervisorTaskTest.java | 4 +-
.../batch/parallel/PushedSegmentsReportTest.java | 4 +-
.../parallel/SinglePhaseParallelIndexingTest.java | 37 +-
.../common/task/concurrent/ActionsTestTask.java | 41 +-
.../common/task/concurrent/CommandQueueTask.java | 9 +-
.../concurrent/ConcurrentReplaceAndAppendTest.java | 10 +-
...> ConcurrentReplaceAndStreamingAppendTest.java} | 476 +++++---------
.../indexing/common/tasklogs/FileTaskLogsTest.java | 2 +-
.../overlord/SingleTaskBackgroundRunnerTest.java | 2 +-
.../druid/indexing/overlord/TaskLifecycleTest.java | 14 +-
.../indexing/overlord/TaskLockConfigTest.java | 4 +-
.../druid/indexing/overlord/TaskLockboxTest.java | 37 +-
.../indexing/overlord/TaskQueueScaleTest.java | 4 +-
.../druid/indexing/overlord/TaskQueueTest.java | 18 +-
.../indexing/overlord/TestTaskToolboxFactory.java | 2 +-
.../druid/indexing/overlord/http/OverlordTest.java | 4 +-
.../SeekableStreamIndexTaskTestBase.java | 11 +-
.../TestIndexerMetadataStorageCoordinator.java | 25 +-
.../cases/cluster/Common/dependencies.yaml | 4 +-
.../testsEx/indexer/AbstractITBatchIndexTest.java | 11 +-
.../druid/testsEx/msq/ITMultiStageQuery.java | 11 +-
.../clients/OverlordResourceTestClient.java | 18 +-
.../clients/msq/MsqOverlordResourceTestClient.java | 79 ---
.../apache/druid/testing/utils/ITRetryUtil.java | 9 +-
.../druid/testing/utils/MsqTestQueryHelper.java | 18 +-
.../tests/indexer/AbstractITBatchIndexTest.java | 12 +-
.../druid/tests/indexer/ITCompactionTaskTest.java | 33 +-
licenses.yaml | 6 +-
pom.xml | 4 +-
.../druid/frame/write/InvalidFieldException.java | 23 +
.../indexer/report}/IngestionStatsAndErrors.java | 2 +-
.../report}/IngestionStatsAndErrorsTaskReport.java | 2 +-
.../druid/indexer/report}/KillTaskReport.java | 2 +-
.../report}/SingleFileTaskReportFileWriter.java | 2 +-
.../druid/indexer/report/TaskContextReport.java | 45 +-
.../apache/druid/indexer/report}/TaskReport.java | 9 +-
.../indexer/report}/TaskReportFileWriter.java | 2 +-
.../apache/druid/java/util/metrics/JvmMonitor.java | 42 +-
.../org/apache/druid/math/expr/ExprMacroTable.java | 2 +-
.../java/org/apache/druid/math/expr/Function.java | 42 +-
.../org/apache/druid/query/FluentQueryRunner.java | 9 +-
.../java/org/apache/druid/query/QueryContext.java | 4 +
.../java/org/apache/druid/query/QueryContexts.java | 4 +-
.../org/apache/druid/query/QueryResourceId.java | 119 ++++
.../org/apache/druid/query/QueryToolChest.java | 24 +
.../any/StringAnyAggregatorFactory.java | 6 +-
.../java/org/apache/druid/query/filter/Filter.java | 10 +-
.../apache/druid/query/filter/FilterBundle.java | 74 ++-
.../query/groupby/GroupByQueryQueryToolChest.java | 51 +-
.../druid/query/groupby/GroupByQueryResources.java | 119 +++-
.../query/groupby/GroupByQueryRunnerFactory.java | 3 +
.../groupby/GroupByResourcesReservationPool.java | 141 ++++
.../apache/druid/query/groupby/GroupingEngine.java | 61 +-
.../epinephelinae/GroupByMergingQueryRunner.java | 78 ++-
.../groupby/epinephelinae/GroupByQueryEngine.java | 3 +
.../groupby/epinephelinae/GroupByRowProcessor.java | 2 +-
.../query/groupby/orderby/DefaultLimitSpec.java | 8 +-
.../semantic/DefaultFramedOnHeapAggregatable.java | 30 +-
.../org/apache/druid/segment/filter/AndFilter.java | 14 +-
.../druid/segment/filter/IsBooleanFilter.java | 6 +-
.../org/apache/druid/segment/filter/NotFilter.java | 4 +-
.../org/apache/druid/segment/filter/OrFilter.java | 67 +-
.../druid/segment/index/BitmapColumnIndex.java | 8 +-
.../index/DictionaryRangeScanningBitmapIndex.java | 4 +-
.../index/DictionaryScanningBitmapIndex.java | 4 +-
.../druid/storage/ExportStorageProvider.java | 2 +
.../local/LocalFileExportStorageProvider.java | 8 +
.../druid/frame/write/RowBasedFrameWriterTest.java | 74 +++
.../druid/indexer/report/TaskReportSerdeTest.java | 397 ++++++++++++
.../org/apache/druid/math/expr/FunctionTest.java | 14 +
.../apache/druid/query/QueryResourceIdTest.java | 34 +-
.../apache/druid/query/QueryRunnerTestHelper.java | 4 +-
.../query/aggregation/AggregationTestHelper.java | 10 +-
.../any/StringAnyAggregatorFactoryTest.java | 50 +-
.../druid/query/context/ResponseContextTest.java | 4 +-
...GroupByLimitPushDownInsufficientBufferTest.java | 83 ++-
.../GroupByLimitPushDownMultiNodeMergeTest.java | 174 +++--
.../query/groupby/GroupByMultiSegmentTest.java | 17 +-
.../query/groupby/GroupByQueryMergeBufferTest.java | 25 +-
.../groupby/GroupByQueryQueryToolChestTest.java | 110 ++--
.../groupby/GroupByQueryRunnerFactoryTest.java | 15 +-
.../groupby/GroupByQueryRunnerFailureTest.java | 14 +-
.../query/groupby/GroupByQueryRunnerTest.java | 226 +++++--
.../groupby/GroupByQueryRunnerTestHelper.java | 22 +-
.../groupby/GroupByTimeseriesQueryRunnerTest.java | 1 +
.../query/groupby/NestedQueryPushDownTest.java | 33 +-
.../groupby/UnnestGroupByQueryRunnerTest.java | 7 +-
.../groupby/orderby/DefaultLimitSpecTest.java | 74 +++
.../druid/query/search/SearchQueryRunnerTest.java | 2 +-
.../java/org/apache/druid/segment/TestIndex.java | 67 ++
.../druid/segment/filter/FilterBundleTest.java | 328 ++++++++++
.../local/LocalFileExportStorageProviderTest.java | 13 +
.../wikiticker-2015-09-12-sampled.json.gz | Bin
.../druid/catalog/model/table/DatasourceDefn.java | 4 -
.../apache/druid/guice/BrokerProcessingModule.java | 13 +
.../apache/druid/guice/DruidProcessingModule.java | 13 +
.../apache/druid/guice/RouterProcessingModule.java | 16 +
.../IndexerMetadataStorageCoordinator.java | 33 +-
.../indexing/overlord/SegmentCreateRequest.java | 18 +-
.../indexing/overlord/supervisor/Supervisor.java | 9 +
.../IndexerSQLMetadataStorageCoordinator.java | 533 ++++++---------
.../druid/metadata/PendingSegmentRecord.java | 142 ++++
.../druid/metadata/SQLMetadataConnector.java | 21 +
.../query/lookup/LookupReferencesManager.java | 2 +-
.../apache/druid/rpc/indexing/OverlordClient.java | 3 +-
.../druid/rpc/indexing/OverlordClientImpl.java | 5 +-
.../rpc/indexing/SpecificTaskServiceLocator.java | 33 +-
.../appenderator/SinkQuerySegmentWalker.java | 28 +-
.../druid/server/ClientQuerySegmentWalker.java | 43 +-
.../druid/server/LocalQuerySegmentWalker.java | 2 +-
.../druid/server/QuerySwappingQueryRunner.java | 62 ++
.../server/ResourceIdPopulatingQueryRunner.java | 68 ++
.../druid/server/coordination/ServerManager.java | 36 +-
.../coordinator/CoordinatorCompactionConfig.java | 4 +-
.../coordinator/CoordinatorDynamicConfig.java | 10 +-
.../server/coordinator/DruidCoordinatorConfig.java | 12 +-
.../coordinator/duty/KillUnusedSegments.java | 11 -
.../catalog/model/table/DatasourceTableTest.java | 8 +-
.../druid/client/CachingClusteredClientTest.java | 2 +-
.../druid/client/indexing/NoopOverlordClient.java | 3 +-
.../druid/discovery/DataServerClientTest.java | 2 +-
.../overlord/SegmentCreateRequestTest.java | 4 +-
.../overlord/supervisor/SupervisorTest.java | 32 +-
.../IndexerSQLMetadataStorageCoordinatorTest.java | 239 ++++---
.../druid/rpc/indexing/OverlordClientImplTest.java | 10 +-
.../indexing/SpecificTaskServiceLocatorTest.java | 60 ++
.../druid/server/ClientQuerySegmentWalkerTest.java | 61 +-
.../apache/druid/server/QuerySchedulerTest.java | 7 +-
.../org/apache/druid/server/QueryStackTests.java | 3 +-
.../server/SpecificSegmentsQuerySegmentWalker.java | 14 +-
.../server/TestClusterQuerySegmentWalker.java | 33 +-
.../server/coordination/ServerManagerTest.java | 2 +-
.../coordinator/DruidCoordinatorConfigTest.java | 42 +-
.../coordinator/TestDruidCoordinatorConfig.java | 4 +-
.../coordinator/duty/KillUnusedSegmentsTest.java | 33 +-
.../server/http/CoordinatorDynamicConfigTest.java | 44 +-
.../main/java/org/apache/druid/cli/CliIndexer.java | 2 +-
.../java/org/apache/druid/cli/CliOverlord.java | 14 +
.../main/java/org/apache/druid/cli/CliPeon.java | 21 +-
.../java/org/apache/druid/cli/DumpSegment.java | 5 +-
.../java/org/apache/druid/cli/DumpSegmentTest.java | 2 +
.../builtin/ContainsOperatorConversion.java | 2 +-
.../builtin/RegexpLikeOperatorConversion.java | 2 +-
.../builtin/ScalarInArrayOperatorConversion.java | 50 ++
.../builtin/SubstringOperatorConversion.java | 3 +-
.../sql/calcite/planner/DruidOperatorTable.java | 2 +
.../sql/calcite/planner/DruidSqlValidator.java | 60 +-
.../calcite/planner/SqlParameterizerShuttle.java | 11 +-
.../TimeInIntervalConvertletFactory.java | 4 +-
.../druid/sql/calcite/CalciteArraysQueryTest.java | 249 +++----
.../calcite/CalciteCatalogIngestionDmlTest.java | 522 ++++++++++++++-
.../sql/calcite/CalciteCatalogInsertTest.java | 294 +--------
.../sql/calcite/CalciteCatalogReplaceTest.java | 290 +--------
.../druid/sql/calcite/CalciteExportTest.java | 57 +-
.../druid/sql/calcite/CalciteJoinQueryTest.java | 2 -
.../sql/calcite/CalciteNestedDataQueryTest.java | 1 -
.../apache/druid/sql/calcite/CalciteQueryTest.java | 95 ++-
.../druid/sql/calcite/CalciteReplaceDmlTest.java | 4 -
.../druid/sql/calcite/CalciteSelectQueryTest.java | 1 -
.../druid/sql/calcite/CalciteSubqueryTest.java | 6 -
.../druid/sql/calcite/DrillWindowQueryTest.java | 69 +-
.../apache/druid/sql/calcite/NotYetSupported.java | 2 +-
.../apache/druid/sql/calcite/QueryTestRunner.java | 17 +-
.../druid/sql/calcite/export/TestExportModule.java | 52 --
.../calcite/export/TestExportStorageConnector.java | 92 ---
.../druid/sql/calcite/util/TestDataBuilder.java | 64 +-
.../wikipediaFinalComputedAggregation.sqlTest | 18 +
.../drill/window/queries/aggregates/aggOWnFn_10.e | 2 +-
.../drill/window/queries/aggregates/aggOWnFn_12.e | 2 +-
.../drill/window/queries/aggregates/aggOWnFn_18.e | 2 +-
.../drill/window/queries/aggregates/aggOWnFn_19.e | 2 +-
.../drill/window/queries/aggregates/aggOWnFn_22.e | 2 +-
.../drill/window/queries/aggregates/aggOWnFn_23.e | 2 +-
.../window/queries/aggregates/testW_Nulls_1.q | 4 +-
.../drill/window/queries/aggregates/winFnQry_83.e | 46 +-
.../drill/window/queries/aggregates/winFnQry_84.e | 46 +-
.../drill/window/queries/aggregates/winFnQry_85.e | 46 +-
.../drill/window/queries/first_val/firstValFn_18.q | 12 +-
.../drill/window/queries/first_val/firstValFn_19.q | 12 +-
.../drill/window/queries/first_val/firstValFn_21.q | 5 +-
.../drill/window/queries/first_val/firstValFn_22.q | 9 +-
.../drill/window/queries/first_val/firstValFn_24.q | 5 +-
.../drill/window/queries/first_val/firstValFn_25.q | 18 +-
.../drill/window/queries/first_val/firstValFn_33.e | 6 +-
.../frameclause/subQueries/frmInSubQry_26.q | 2 +-
.../frameclause/subQueries/frmInSubQry_28.q | 2 +-
.../frameclause/subQueries/frmInSubQry_47.q | 2 +-
.../frameclause/subQueries/frmInSubQry_48.q | 2 +-
.../frameclause/subQueries/frmInSubQry_49.q | 2 +-
.../drill/window/queries/lag_func/lag_Fn_100.q | 9 +-
.../drill/window/queries/lag_func/lag_Fn_102.q | 6 +-
.../drill/window/queries/lag_func/lag_Fn_103.q | 17 +-
.../drill/window/queries/lag_func/lag_Fn_41.q | 4 +-
.../drill/window/queries/lag_func/lag_Fn_42.q | 4 +-
.../drill/window/queries/lag_func/lag_Fn_45.q | 4 +-
.../drill/window/queries/lag_func/lag_Fn_63.q | 7 +-
.../drill/window/queries/lag_func/lag_Fn_96.q | 12 +-
.../drill/window/queries/lag_func/lag_Fn_97.q | 12 +-
.../drill/window/queries/lag_func/lag_Fn_99.q | 6 +-
.../drill/window/queries/last_val/lastValFn_18.q | 12 +-
.../drill/window/queries/last_val/lastValFn_19.q | 12 +-
.../drill/window/queries/last_val/lastValFn_21.q | 6 +-
.../drill/window/queries/last_val/lastValFn_22.q | 10 +-
.../drill/window/queries/last_val/lastValFn_24.q | 6 +-
.../drill/window/queries/last_val/lastValFn_25.q | 17 +-
.../drill/window/queries/lead_func/lead_Fn_36.q | 6 +-
.../drill/window/queries/lead_func/lead_Fn_45.q | 4 +-
.../drill/window/queries/lead_func/lead_Fn_91.q | 12 +-
.../drill/window/queries/lead_func/lead_Fn_92.q | 12 +-
.../drill/window/queries/lead_func/lead_Fn_94.q | 6 +-
.../drill/window/queries/lead_func/lead_Fn_95.q | 10 +-
.../drill/window/queries/lead_func/lead_Fn_97.q | 6 +-
.../drill/window/queries/lead_func/lead_Fn_98.q | 17 +-
.../drill/window/queries/nestedAggs/woutPrtnBy_1.e | 12 +-
.../drill/window/queries/nestedAggs/woutPrtnBy_2.e | 4 +-
.../drill/window/queries/nestedAggs/woutPrtnBy_3.e | 10 +-
.../drill/window/queries/nestedAggs/woutPrtnBy_4.e | 12 +-
.../drill/window/queries/nestedAggs/woutPrtnBy_5.e | 12 +-
.../drill/window/queries/ntile_func/ntileFn_45.e | 4 +-
.../drill/window/queries/ntile_func/ntileFn_47.e | 15 +-
.../drill/window/queries/ntile_func/ntileFn_48.e | 2 +
.../drill/window/queries/ntile_func/ntileFn_49.e | 6 +-
.../drill/window/queries/ntile_func/ntileFn_50.e | 9 +-
.../drill/window/queries/ntile_func/ntileFn_51.e | 15 +-
.../drill/window/queries/ntile_func/ntileFn_52.e | 34 +-
.../drill/window/queries/ntile_func/ntileFn_53.e | 26 +-
.../drill/window/queries/ntile_func/ntileFn_54.e | 20 +-
.../drill/window/queries/ntile_func/ntileFn_55.e | 26 +-
.../drill/window/queries/ntile_func/ntileFn_56.e | 20 +-
.../drill/window/queries/ntile_func/ntileFn_57.e | 10 +-
.../drill/window/queries/ntile_func/ntileFn_58.e | 20 +-
.../drill/window/queries/ntile_func/ntileFn_59.e | 14 +-
.../coordinator-dynamic-config.mock.ts | 2 +-
.../src/views/load-data-view/load-data-view.tsx | 13 +-
website/.spelling | 2 +
371 files changed, 8709 insertions(+), 4011 deletions(-)
create mode 100644 extensions-core/kafka-indexing-service/src/main/java/org/apache/druid/indexing/kafka/KafkaSeekableStreamEndSequenceNumbers.java
create mode 100644 extensions-core/kafka-indexing-service/src/main/java/org/apache/druid/indexing/kafka/KafkaSeekableStreamStartSequenceNumbers.java
create mode 100644 extensions-core/kafka-indexing-service/src/test/java/org/apache/druid/indexing/kafka/KafkaSeekableStreamEndSequenceNumbersTest.java
create mode 100644 extensions-core/kafka-indexing-service/src/test/java/org/apache/druid/indexing/kafka/KafkaSeekableStreamStartSequenceNumbersTest.java
create mode 100644 extensions-core/multi-stage-query/src/main/java/org/apache/druid/msq/exec/ExportMetadataManager.java
create mode 100644 extensions-core/multi-stage-query/src/test/java/org/apache/druid/msq/indexing/client/IndexerWorkerManagerClientTest.java
copy sql/src/test/java/org/apache/druid/sql/calcite/export/TestExportStorageConnectorProvider.java => indexing-service/src/main/java/org/apache/druid/indexing/common/task/NoopTaskContextEnricher.java (60%)
copy indexing-service/src/{test/java/org/apache/druid/indexing/common/task/NoopTestTaskReportFileWriter.java => main/java/org/apache/druid/indexing/common/task/PendingSegmentAllocatingTask.java} (68%)
create mode 100644 indexing-service/src/main/java/org/apache/druid/indexing/common/task/TaskContextEnricher.java
delete mode 100644 indexing-service/src/test/java/org/apache/druid/indexing/common/task/TaskReportSerdeTest.java
copy indexing-service/src/test/java/org/apache/druid/indexing/common/task/concurrent/{ConcurrentReplaceAndAppendTest.java => ConcurrentReplaceAndStreamingAppendTest.java} (66%)
delete mode 100644 integration-tests/src/main/java/org/apache/druid/testing/clients/msq/MsqOverlordResourceTestClient.java
rename {indexing-service/src/main/java/org/apache/druid/indexing/common => processing/src/main/java/org/apache/druid/indexer/report}/IngestionStatsAndErrors.java (99%)
copy {indexing-service/src/main/java/org/apache/druid/indexing/common => processing/src/main/java/org/apache/druid/indexer/report}/IngestionStatsAndErrorsTaskReport.java (98%)
rename {indexing-service/src/main/java/org/apache/druid/indexing/common => processing/src/main/java/org/apache/druid/indexer/report}/KillTaskReport.java (98%)
rename {indexing-service/src/main/java/org/apache/druid/indexing/common => processing/src/main/java/org/apache/druid/indexer/report}/SingleFileTaskReportFileWriter.java (98%)
rename indexing-service/src/main/java/org/apache/druid/indexing/common/IngestionStatsAndErrorsTaskReport.java => processing/src/main/java/org/apache/druid/indexer/report/TaskContextReport.java (61%)
rename {indexing-service/src/main/java/org/apache/druid/indexing/common => processing/src/main/java/org/apache/druid/indexer/report}/TaskReport.java (91%)
rename {indexing-service/src/main/java/org/apache/druid/indexing/common => processing/src/main/java/org/apache/druid/indexer/report}/TaskReportFileWriter.java (96%)
create mode 100644 processing/src/main/java/org/apache/druid/query/QueryResourceId.java
create mode 100644 processing/src/main/java/org/apache/druid/query/groupby/GroupByResourcesReservationPool.java
create mode 100644 processing/src/test/java/org/apache/druid/frame/write/RowBasedFrameWriterTest.java
create mode 100644 processing/src/test/java/org/apache/druid/indexer/report/TaskReportSerdeTest.java
copy indexing-service/src/test/java/org/apache/druid/indexing/common/task/batch/parallel/PushedSegmentsReportTest.java => processing/src/test/java/org/apache/druid/query/QueryResourceIdTest.java (58%)
create mode 100644 processing/src/test/java/org/apache/druid/segment/filter/FilterBundleTest.java
rename {sql/src/test/resources/calcite/tests => processing/src/test/resources/wikipedia}/wikiticker-2015-09-12-sampled.json.gz (100%)
create mode 100644 server/src/main/java/org/apache/druid/metadata/PendingSegmentRecord.java
create mode 100644 server/src/main/java/org/apache/druid/server/QuerySwappingQueryRunner.java
create mode 100644 server/src/main/java/org/apache/druid/server/ResourceIdPopulatingQueryRunner.java
rename sql/src/test/java/org/apache/druid/sql/calcite/export/TestExportStorageConnectorProvider.java => server/src/test/java/org/apache/druid/indexing/overlord/supervisor/SupervisorTest.java (57%)
create mode 100644 sql/src/main/java/org/apache/druid/sql/calcite/expression/builtin/ScalarInArrayOperatorConversion.java
delete mode 100644 sql/src/test/java/org/apache/druid/sql/calcite/export/TestExportModule.java
delete mode 100644 sql/src/test/java/org/apache/druid/sql/calcite/export/TestExportStorageConnector.java
create mode 100644 sql/src/test/resources/calcite/tests/window/wikipediaFinalComputedAggregation.sqlTest
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org