You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by gi...@apache.org on 2025/05/14 03:49:06 UTC
(doris) branch dependabot/go_modules/extension/beats/golang.org/x/net-0.38.0 updated (3cb1dee0ecd -> bcc2ea07489)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch dependabot/go_modules/extension/beats/golang.org/x/net-0.38.0
in repository https://gitbox.apache.org/repos/asf/doris.git
omit 3cb1dee0ecd Bump golang.org/x/net in /extension/beats
add b45513e0a4b [fix](dialect)fix starrocks dialect (#50099)
add afae45d233e [fix](group commit)Group Commit with stream load mode should wait schema change done (#49854)
add f7f6bd2fa7f [chore](be) remove some unused code to improve code test converage (#50089)
add 9701457c364 [refine](SetOperator) refine some SetOperator code. (#49772)
add b957896d817 [fix](mtmv) Fix exception when calc mtmv function dependency but the table in mtmv def sql is deleted (#50096)
add 7076744de8a [opt](BinaryArithmetic)Optimize FunctionBinaryArithmetic by distributing types during the open phase. (#50082)
add cf56a35a88f [fix](mv) Add sync mv test that had been commented (#49970)
add 44f093dc463 [Opt](mow) Forbid time_series compaction policy on unique table (#49905)
add 095bf84b822 [Enhancement] (nereids) implement alterUserCommand in nereids (#48428)
add 035bc7e278e [Enhancement](nereids)Support show global function (#50034)
add 692c422f18e [refactor]Separate StringOP and SubstringUtil (#48054)
add 028717935ea [improve](schema) add column comment length limit (#49989)
add 719dcd2dcf6 [opt](deps) patch re2 to add ignore_replace_escape option (#50124)
add dc966005238 [fix](nereids)Use utf-8 when convert string like literal to double. (#50085)
add 2ad60c9c893 [Fix](filecache) Fix file cache sync clear API failing to delete correctly due to relative paths (#50111)
add 0ceafea35aa [minor](refactor) Make time slice configurable (#50116)
add d55ece302e9 [fix](orc-reader) Fix orc lazy materialization should not be bundled with pushdown. (#49835)
add 6fdada1a098 [Refactor](beut) Make function be-ut test aware of result's precision (#49608)
add 29b67164501 [Chore](namespace) move allocator into doris namepspace (#50127)
add f5651e77aec [Enhencement](datetime) Implicit conversion from DATE gets DATETIME(0) instead of DATETIME(6) (#50108)
add 11ba26c790e [opt](Nereids) aggregate function sum support string type as parameter (#49954)
add 1e4f8bdf985 [improve](cloud-mow) MS can choose use new way or old way when processing delete bitmap lock (#49223)
add 59deb20024b [opt](mtmv) Support null aware left anti join rewrite by materialized view (#45815)
add a2552b0add3 [fix](load) reset routine load task EOF sign correctly (#50048)
add 16c5374af44 [fix](orc) Should not pass selection vector when decode child column of List or Map (#50136)
add 0d09cfefaed Reapply "[enhancement](hive)Initial support for Hive org.openx.data.jsonserde.JsonSerDe" (#49928) (#49958)
add 5d450f5ae90 [Chore](runtime-filter) add lock for all runtime filter producer/consumer's public method (#50110)
add ec6f0e7d332 [chore](type) assign explicit value for enum (#50157)
add be7617e192d [feat]Refactor: Storage Property Conversion Separation and Unification (#50031)
add 9fcbecaf4fb [bugfix](spill) use batch_size session var to limit spill sort output block batch row count (#50158)
add b32f8c6b003 [fix](hive/iceberg) rectify the fs name if path already contains fs (#49998)
add 60a6393d98c [fix](txn) Restart fe after commit txn causes `loadedTblIndexes` lossing (#50123)
add 38a3d6fdae4 [fix](transaction) limit abort txn reason to avoid value length exceeds limit error (#50152)
add 3aa18fc50d9 [feature](agg function) support corr_welford agg function (#49712)
add 726ac650f4b [chore](unit test) Unit test for some string related function. (#50177)
add 88dc0a9c22c [Chore](build) remove unused target DorisUdf (#50175)
add 23ae760fd7b [opt](mtmv) Chose mv more easier when mv on external table (#46368)
add c962900c52a [Fix](function) fix wrong floor of function date_diff when unit less than day (#49429)
add 2eb2a419ea3 [chore](show engines)Change `palo` to `Doris` (#47861)
add e63ae90f066 [fix](Export) fix the lock leak issue of Export (#50088)
add 2d7697d3caf [Bug](analytic) fix analytic operator maybe used after free about column (#49924)
add 2cca4814cb4 [Fix](case) Fix case that use time series compaction on unique table (#50194)
add 3ebf9e755aa [improve](function) Optimize the performance of the window funnel function (#50109)
add f38cd875732 [fix](missing version) not catchup is worse than lastFailed (#50094)
add c511f0c792e [Bug](function) fix Could not find function explode_json_array_json_outer (#50164)
add 66b8e8d06ae [fix](statistics)No need to forward show table stats command. (#50207)
add eee5c1a77a5 [sample](load) add s3 load batch demo (#50210)
add 2ec0eed823d [fix](array-index) Fix types that do not support indexing also in array nesting should also not be supported. (#50162)
add 4572b5997a1 [Fix](Variant) fix variant cast to jsonb into wrong NULL values (#50180)
add c679c831e5a [fix](nereids) fix fold constant return wrong scale of datetime type (#50142)
add bb625d52213 [fix](cloud) remove unnecessary DCHECK existence when delete file cache directory (#50049)
add 1ef07ff8f62 [improve](sample) unified s3 load script sample (#50249)
add 4fc040cfc08 [Feat](refactor-param)Abstract Endpoint and Region Extraction Logic with Azure Support (#50220)
add f18f48ad93a [fix](connect) fix wrong format causing connection fail (#50214)
add 234c8eb6bfa [opt](hive) add option to get schema from table object (#50038)
add 6422049fd3f [fix](auditlog)Set sqlHash in executeInternalQuery (#49984)
add 339d763c9de [case](auth)fix case test_dml_stream_load_auth (#50172)
add 917da4dcba9 [fix](load) fix routine load job progress fallback after FE master node restart (#50221)
add f48e20d5f72 [fix](test) fix be-ut failed as conflict (#50276)
add 17e2272d937 [fix](test) fix non stable regression test test_alter_column_comment (#50264)
add ff84594cc4c [opt](resource) Refactor process and workload group revoke memory (#50107)
add dbc66e4fbbd [Enhancement] (nereids)implement CreateResourceCommand in nereids (#48424)
add 172dd569a5f [feat](nereids) experimental hbo initial support (#49570)
add 6aa9a337c13 [fix](cloud) Some resource APIs should not check if cluster_name is empty (#50148)
add 77879b99a0b [Fix](compaction) Only print delete compaction log when there is a delete rowset (#49953)
add 9a92b3dbf77 [Enhancement](grant)Sort the grants by userIdentity (#50156)
add 1f03d4b42dc [feat](function) SUBSTRING_INDEX function delimiter supports dynamic (#50149)
add 163834a474d [fix](bdbje) set maxMessageSize for bdbje (#50213)
add b12e627fb2d [fix](nereids) avoid normalize ColumnStatistics.numNull twice (#49891)
add eb5b24fd8d9 [opt](s3io) Check data integrity after an upload for S3FileWriter (#50168)
add c354fec2cf4 [opt](nereids) logical filter replace null to false (#49457)
add e431ba3f3c4 [fix](cloud mow) modify mow_tablet_compaction_key (#50242)
add 07ec763ab6c [Opt](mow) Add more logs for mow delete bitmap (#49752)
add 8de63d819dd [fix](test) fix s3 tables cases (#50287)
add 7f409595b32 [fix](Hudi-mtmv) Support asynchronous materialized view partition refresh feature for Hudi external tables. (#49956)
add df664dbf516 [fix](ut)Fix StmtExecutorTest (#50322)
add f3cba4afbb4 [Opt](cloud) Refactor `OlapScanLocalState::hold_tablets` (#49945)
add b5dcdcbf065 [Improvement](join) support lazy materialize on mark join (#50250)
add c5d09308220 [feat](refactor-param) Add New Metastore Adaptation (#50254)
add 742c42cc947 [Enhancement](nereids) support show resources (#50230)
add 34fb45b22e3 [Enhancement](compaction) Try get global lock when execute compaction (#49882)
add 3e100936a2a [opt](recycler) Speed up recycling txn info by introducing parallelism (#50037)
add b4a27ed3478 [fix](array_map) fix array_map functions avoid core (#50201)
add 3d8b938cf6b [fix](cloud-mow)Schema change fail should release delete bitmap lock (#49889)
add be228e82de2 [improve](cloud-mow)Add update delete bitmap case for delete bitmap lock version (#50281)
add ed0a38f8f7c [fix](cloud) Fix docker case `test_sql_mode_node_mgr` (#50182)
add 6a00ced8fb7 [fix](Nereids) Fix add BE with properties return UnsupportedOperationException err (#50163)
add ac0c0661f5f [fix](serDe) global function could not deserialization from image (#50279)
add 4be0d69d0b4 [chore](function) remove some unused close function (#50285)
add 0bec2995328 [fix](test) fix wrong out result (#50263)
add 47f49ea16a6 [Fix](orc-reader-merge-io) Clear streams map when all row groups are filtered by row group stats, despite stripe stats remaining unfiltered. (#50185)
add a36a572d8c4 [fix](paimon)Set the target size of the split. (#50083)
add b0b0c2fd6e0 [opt](paimon)Enhance the observability of split and JNI in profile (#49688)
add 2484c356dfe [fix](orc) fix orc push down for hive acid table (#49927)
add f61e55e7756 [fix](parquet)Fixed the problem that when Parquert reader use index to read files, there will be multiple threads modify same object (#50161)
add e9d2daa4608 [test](beut) add cases for spilling in MultiCastDataStreamerTest (#50266)
add 85b7beec894 [fix](json-functions)fix json-replace/insert/set/array behavior with complex type (#50308)
add 9505da1969c [feature](k8s) add ddc workload group support for doris-operator (#50247)
add df14c2d765f [chore](compile) add compile check for load (#50354)
add 84de478994b [feat](binlog) add modify distribution type binlog (#50077)
add 88942bd8807 [Fix](vault) Remove double slashes when s3 vault prefix is empty (#50352)
add 5da1025adef [fix](compaction) fix time series compaction time threshold (#50306)
add 9ccfab24d8a [fix](nereids) fix AND extract uniform slots (#50265)
add 5f0b89f06ac [improvement](statistics)Agg table set preagg on when doing sample analyzing. (#49918)
add bd90fc6f70b [feat](Nereids) support copy into command (#47194)
add 182cde5a668 [Chore](function) add ut for array_agg/collect_list/collect_set (#50181)
add 56b3ffef27a [enhancement](statistics) Add segment footer open stats to profile (#50326)
add 52333f60ecd [improve](sample) add s3 load by split file list (#50366)
add 8f2669f8943 [fix](cloud) batch process ttl cache block gc to limit lock held time once in a time (#50387)
add 535070f21c9 [chore](binlog) Record rollup index info for alterJob binlog (#50337)
add 5f5b99138ac [opt](test) increase the value of flush_thread_num_per_store for p0 regression case (#50401)
add 21788103400 [chore] Fix unhandled exceptions thrown by stoi on streamload (#49714)
add 4949ec54c09 [chore](Field) Remove unused code in field.cpp (#50338)
add 21686b88da6 [Chore](gutil) remove gutil substitute and use absl::substitute to replace it (#50334)
add dedef0b4cf8 [fix](s3client) Avoild dead loop when storage not support `ListObjectsV2` (#50252)
add 0f164502f3b [test](beut) Add cases for agg_utils (#50327)
add 2d5fd6d458b [fix](stacktrace) Speed up BE UT stacktrace (#50340)
add 0742e9e5657 [opt](nereids) if stats for any side of join children is null, do not prune runtime filter (#50298)
add fbd514c100f [enhancement](nereids)remove subqueryExpr member from LogicalApply (#50378)
add 456ab4051f3 [Bug](profile) fix wrong profile stat about RowsExprPredFiltered (#50370)
add 0a05e375aac [feat](debugpoint) add a backup block debug point for ccr test (#50380)
add 8d1ddea4fad [fix](create-resource) fix potential concurrent modification exception when creating resource (#50356)
add 647e13eae07 [enhancement](image): load image supports reading in batches (#50183)
add 0b71fe14667 [Enhancement] (nereids) implement CreateDataSyncJobCommand in nereids (#49118)
add 5037ee29f8c [test](beut) add AggOperator group by limit opt beut (#50295)
add 488a10ec608 [fix](ut) fix unstable FE ut case for schema change job (#50350)
add 63024e641c2 [test](beut) add StreamingAggOperator beut (#50307)
add eb03c940d6f [Improvement](function) make datev2/datetimev2's comparison use numric compare (#50406)
add 3f1f5d74d07 [Improvement](function) change from_unixtime's intermedia type from vdatetime to datetimev2 (#50171)
add 1e40221a159 [fix](array-index) Fix array nested type patch (#50382)
add 258727b3a61 [fix](json) Json Path supports the $.[0] format (#50427)
add 2dcf23736a3 [fix](hudi) Remove spark hudi jni scanner (#50394)
add 0949a77f49b [fix](catalog) do cache load when cache value is not present (#50188)
add 0e92232f537 [fix](audit) fix potential audit log missing issue (#50357)
add 080ead19fd8 [feat](refactor-param) add file format configuration (#50225)
add 5c92452c348 [fix](bdbje) avoid remove empty frontends (#46424)
add 9686997ea3d [chore](compaction) Remove useless debug info (#50433)
add 74310310400 [enhacement](cloud) Make config::custom_conf_path default to use conf_path's value specified when started (#50381)
add ad32279f5cd [Fix](functions) fix precision lost when a function accepts datetime and generates array (#49543)
add a6ebfe7a680 [fix](doc) make cases for docs on sc same as docs (#46851)
add cfd4b764c2e [statistics](regression)Add utf-8 encoding regression test. (#50466)
add 093dbbfda2e [fix](memory) Fix MemoryTracker reserve memory (#50292)
add bbc3f18349b [fix]result is empty when execute 'show resources where name like' (#50408)
add 6c3c34b933c [chore](nereids)Make the drop function info more readable (#50426)
add 5dc969837a9 [opt](nereids) remove const join condition (#49730)
add 86b491294e8 [feat](func) any function supports json (#50311)
add bf92f67b460 [Fix](function) Fix unexpected result of unix_timestamp when input is out of bound (#49430)
add 1a790c2fb37 [Chore](gutil) remove some gutil/strings file (#50445)
add c4a60910b71 [fix](memory) Fix `ThreadMemTrackerMgr::limiter_mem_tracker()` performance (#50462)
add 8d5f286e096 [fix](serde)Fixed the issue that serde may cause be core when reading schema changed text table. (#50105)
add 4e9f14071e0 [fix](path gc) Fix path gc race with publish task (#50343)
add db80956f929 [fix](regression test) fix case variant_github_events_nonConcurrent_p2 (#50437)
add eb7ac1688ad [Opt](mow) Calc delete bitmaps between segments concurrently in commit phase (#50106)
add b0dfba08c58 [Enhancement] (nereids) implement Stop/Resume/PauseDataSyncJobCommand in nereids (#49126)
add 81d9042dba2 [chore](codeowner)Set a CodeOwner for the FS module (#50485)
add 29dbce7456d [fix](docker hive3) hive server oom and not auto-restart (#50456)
add 4abda4773a5 [Feat](refactor-param)filesystem adaptation layer (#50320)
add 3ebec0a2e91 [bugfix](cloud) Fix ms crash when set the custom config path (#50246)
add c930877eb25 [Fix](CloudStorageEngine) Fix `CloudStorageEngine::~CloudStorageEngine` coredump (#50486)
add 5d5f1ff2e14 [fix](load) disable fetching meta request to disable_load or decommissioned BE node (#50421)
add 4abf4b45189 [test](partial update) Ensure the correct order of concurrency (#50398)
add c3897dedcf5 [fix](cloud) FDCache nullptr when doris exit (#50397)
add 9ca7690b8e9 [improvement](mow) don't submit calc delete bitmap task if rowset is empty (#50500)
add 3c44f18ddd5 [Feature]bind workload group to compute group (#49884)
add bff7c6a87f0 [feat](cloud) Add a config for cloud txn lazy commit fuzzy test (#50314)
add 7b882308a17 [chore](load) adjust load_task_high_priority_threshold_second default value (#50478)
add d22a8592f9d [Fix](cloud-mow) Fix correctness problem when there exists other interleaved txn between a txn's retries (#50417)
add 39186fafe11 [Chore](build) remove libmysql libodbc link (#50494)
add a1c9335eaf8 [test](beut) Add cases for set_utils and distinct_agg_utils (#50420)
add 16c692dfda7 [opt](nereids) extract single table expession from join run recursively (#49851)
add e41ffc7cb51 [Refactor](Exec) Support one rpc send muti blocks (#50113)
add dd981d166c0 [enhancement](cloud) optimize warm up local IO and performance (#50275)
add 7bc98a63a0a [chore](scan) Remove unused code in ScanLocalState (#50461)
add 347148e8360 [feat](refactor-param) refactor tvf's code about fileformat (#50463)
add 850d7aebddd [fix](parquet-writer) Fix logging crash during exception handling in parquet-writer. (#50465)
add 02306b475bb [fix](iceberg)Use the correct schema for query (#50376)
add 588bfa28587 [feat](refactor-param) refactor outfile's code about fileformat (#50471)
add ef61f7b5298 [fix](partition)fix default partitionkey not persistent and keep default on some operator (#50489)
add a8418ccd2c4 [fix](iceberg)The manifest file needs to read the "exists" type. (#50434)
add 9261c8b3853 [fix](nereids) logical apply don't include right child's data trait (#50528)
add 27c6dc725fd [fix](constant fold)Make sure FE cast double to varchar generate identical result with BE. (#50425)
add b5bb57aa5f7 [improve](docker) docker base image add perf and pprof for CPU profile (#50536)
add f4d49856c61 [test](beut) Add unit test cases for Block (#50480)
add 2de1e4fd341 [regression-test](framework) fix bug when getErrorInfo throw exception (#50482)
add 4df549a7824 [enhance](mtmv)Exclude trigger table support db and catalog (#49961)
add 6c7cab57b00 [feature](nereids)support stream load, routine load and broker load in nereids (#49116)
add 4e4f3613a6d [opt](cloud) Set thread name for all background thread workers to improve observability (#49366)
add 9ce55d1a0de [Enhancement] (nereids) implement cleanQueryStatsCommand in nereids (#49120)
add 0056b11b2f8 [Bug](function) fix date_floor default value not 0001-01-01 00:00:00 (#50479)
add 30b7f20f1f1 [improve](function) support regexp_replace function with ignore flag options (#50245)
add 93ffdbf8659 [Enhancement](audit) Add fields related to file cache hits in the audit log table (#48041)
add 77d75e24418 [test](case) add some test case about partition sort hash types (#50318)
add 559b1837a3f [refactor](type) Use DataType to replace TypeDescriptor (#50290)
add 909a95d6b39 [fix](geo) Fix ST_Contains behavior (#50115)
add a68c8df37fb [Bug](agg-state) fix agg state inner type not conversioned (#50418)
add 75d68f6ad64 [fix](core) Fix core caused by VDataStreamMgr::transmit_block (#50560)
add 94ede109c21 [opt](cloud) Add config to control sync_rowsets parallelism when init scanners (#49420)
add 8340c7d93e5 [fix](compaction)init _cumulative_compaction_policies to avoid out_of_range (#49767)
add 12d5da146d9 [Feature](dictionary) Support Dictionary Table (#45926)
add 2e34bee48bb [Exec](vec) speed update date_floor (#50392)
add c0f8c85db56 [Fix](case) fix unstable dictionary cases (#50591)
add 79a01b9878b [fix](inverted index) Fix for test_clean_stale_rs_index_file_cache case issue (#50289)
add 2b1b25c40ce [feat](community) add some collaborators (#50539)
add 1c4356afc93 [test](beut) add all sorter type beut (#50384)
add e6e8286c3f7 [fix](view)fix reset view def for restore wrong replace (#50567)
add 1053853694b [fix](restapi) Unify Permission Requirements for Executing SHOW FRONTENDS/BACKENDS And NODE RestAPI (#50140)
add e036629f2c3 [Enhancement] (nereids) implement Stop/Resume/PauseRoutineLoadCommand in nereids (#49134)
add a1d9af3264c [refactor](vault) Refine create storage vault process on FE and fix missing S3 vault root path (#50395)
add 9f4802c7a8a [fix](nereids) fix bug of MergePercentileToArray (#49773)
add a7e68b5d989 [fix](ci) tmp cancel time check of streamload (#50601)
add f7437380ca3 [Fix] some fix for workload group (#50543)
add eee5e6290d1 [bugfix](be) exchange sink buffer may use wrong runtime state (#50588)
add db6125b9321 [Fix](docker-compose) Fix wrong docker file of docker compose (#50604)
add f84b9084f93 [fix](nereids)fix MustFallbackException is not properly caught in NereidsPlanner (#48146)
add f5d25ba1423 [opt](cloud) Support cached cloud partition version for high frequency query (#50439)
add 1d17446e6a3 [Chore](gutil) remove gutil split/strip/util/stringpiece (#50572)
add 4fc6ca701cc [fix](mtmv)The change to the max_persistence_task_count configuration applies retroactively to existing MTMV (#50537)
add 3acb325c037 [fix](mtmv)before mtmv refresh,check column type if change (#49041)
add f2eafe5ba7d [enhance]support alter table storage_medium (#50198)
add 63af2cfe871 [fix](file cache) Fix BlockFileCache::get_stats (#50584)
add 61569ac65f2 [improvement](test) if run cloud mode, give user usage priv on comput… (#50613)
add 1fe5276a70c [opt](ci) add vault_p0 to required check (#50614)
add 210b960bf41 [fix](vault) fix UnsupportedOperationException if no `use_path_style` in CreateStorageVaultStmt (#50615)
add fdd2a7dd744 [ci](coverage) stop doris grace to generate converage file (#50497)
add af38c2be6c6 [fix](test) fix unstable test_query_sys_tables (#50593)
add 0a8b9786b7b [fix](orc-reader) Fixed issue with top level struct column having present stream failing to access repeatedly when late materialization occurs. (#50358)
add c5ecfaff2c5 [fix](iceberg)Fix the inconsistency between the data in pg and the data in MinIO. (#50578)
add 65d1e61cc40 [chore](dependency)bump tomcat 8.5.86 to 9.0.104 (#50622)
add 3eaa3ac1187 [fix](stream loader) do not redirect to https for stream load (#50009)
add 1a2900a47a7 [Enhancement] (nereids)implement CreateStageCommand and DropStageComm… (#48478)
add 0d578694cdc [fix](jdbc catalog) Improve conjunct expression handling in JdbcScanNode (#50542)
add 59bcaa467c7 [test](beut) add function cast to boolean beut (#50243)
add 87d754b40b0 [Enhancement] (nereids) implement showCreateRoutineLoadCommand in nereids (#49172)
add e956872d426 [Improvement](join) support all match one logic at join lazy materialize (#50375)
add db4810b966a [fix](function) fix error result when input utf8 in url_encode, strright, append_trailing_char_if_absent (#49127)
add 18bcc24c93b [Refactor] Routine load Job using workload name instead of id in property. (#50563)
add b7e705b2aa6 [feat](s3client) Add role-based authorization for s3client (#49541)
add 0abb52148b0 [feat](catalog) refactor and support iceberg sys table (#50294)
add c742b80cacf [fix](ubsan) fix ubsan error in DataTypeHLL::serialize (#50628)
add 51842c69c5c [refactor](type) Use `PrimitiveType` to replace `TypeIndex` (PART I) (#50621)
add 5648560ead3 [improve](cloud-mow)Add checker for compaction key (#50062)
add e97dc1196ee [Fix](result) Fix the duplicated query result caused by query retry (#50260)
add 99d4294a16d [feature](index change)Support light index change for ngram bf index (#48461)
add c462d3cbbea [fix](build) Unify `ThreadContext` use and compile in Linux, Mac, and UT (#47515)
add 395b0956ee4 [Fix](iot-auto-detect) Fix insert overwrite auto detect transaction concurrent conflict (#50658)
add 5794f322361 [chore](cloud) Remove set -eo pipefail when start ms (#50679)
add b1ef59caf96 [fix](ci) cloud_p0 stop be first before stop ms (#50681)
add 0e58df1e5a4 [Enhancement] (nereids) implement adminCopyTabletCommand in nereids (#49179)
add ba493a5e526 [fix](binlog) Acquire migration lock before ingesting binlog (#50663)
add ed19dc152e3 [Fix](field) Fix potential memory leak and wrong binary reading about JsonbField (#50174)
add e06d3520306 [improvement](test) cloud mode not allowe to set light_schema_change (#50657)
add 80776ef5c78 [Opt](profile) More profile for `OlapScanLocalState::hold_tablets` (#50564)
add 83eb8054b93 [fix](case) fix some unstable p2 cases (#50697)
add d77e5a802ef [improvement](regression)Add log to print jdbc url in prepare stmt test (#50711)
add 5fb228fb0ec [fix](regression)Fix test analyze mv case. (#50701)
add f864a9caadf [Fix] Some fix for workload group (#50577)
add b8cda27aa06 [opt](AgentTask) Fix `failedWithMsg` (#50686)
add 6e8a21dc2c5 [Refactor]refactor ConnectContext.getUserIdentity() (#50634)
add 6f817a74a3d [fix](information_schema) fix backend_active_tasks table only return one backend's data (#50721)
add 1cdbf08b645 [fix](regress) fix join_condition (#50719)
add 232b6c6f899 [improvement](jdbc catalog) Enhance JDBC driver ClassLoader cache handling and validity checks (#50353)
add 490fee74e72 [Chore](gutil) remove memutil/gscoped_ptr/move/stl_util/charset/charmap/utf (#50664)
add a44ea634036 [improve](udf) support list/map basic class for array/map type (#50684)
add 125e8ec4142 [opt](inverted index) Refactoring Phrase Query Implementation Algorithms with Inverted Index Optimization (#42932)
add 89035d7cedd [refactor](type) Use PrimitiveType to replace TypeIndex (PART II) (#50700)
add d3613dc5d5f [chore](udf) when udf throw exception return RUNTIME_ERROR (#50687)
add 35742c5db6d [Bug](runtime-filter) remove RuntimeFilterProducer::collect_realtime_profile (#50712)
add 1bebb90d71f [enhancement](metrics) add some table metrics (#49930)
add 3d6aaab81a2 [fix](test)Fix the unstable test. (#50691)
add 00f5f5813f5 [feat](hive) add catalog level partition cache property (#50724)
add 58504491c0e [fix](orc-reader)Fix orc complex type late materialization. (#50744)
add 353954b912a [fix](ut) fix unstable FE ut case for schema change job (#50694)
add 92569969102 [fix](iceberg) fix iceberg hadoop type kerbros issue. (#50623)
add 0efe6c6d8c6 [fix](logstash) fix ruby array to json array format (#50570)
add e839ec4ff21 [fix](test) fix regression test same table name in one database (#50737)
add 123c649328c [fix](memory) Fix `PODArray::add_num_element` (#50756)
add f58e18a34b3 [opt](memtracker) Optimize `PODArray` memory tracking accuracy (#50549)
add 5e3e77f6d78 [Refactor](type&case) Remove TypeIndex, add Cast cases, rename some Date utils (#50772)
add c554b53d021 [Enhancement](nereids)implement TruncateTableCommand in nereids (#50196)
add 6b2fe74612c [fix](cooldown) add mem tracker for Tablet::cooldown (#50763)
add b6d0208be74 [fix](ci) stop grace with timeout 30m (#50704)
add 543609eab3b [refactor](minor) Rename `DataTypeObject` and `ColumnObject` (#50796)
add 351c376f2b1 [fix](case) adjust remote_fragment_exec_timeout_ms to avoid unstable … (#50801)
add 0715a612b95 [Fix](regression-test) fix test_export_max_file_size case (#50795)
add c0e93fcf861 [Fix](group commit) Fix group commit null map (#50713)
add 671a85e204d [Fix](recycler) Fix transaction label recycling to prevent key cleanup failures and 'key not found' errors (#50766)
add 94ee9ba5859 [fix](http) remove file before downloading (#50754)
add d0731c8a309 [opt](nereids) support prune partitions by specified tablet ids (#50424)
add 4ce95d325e4 [refactor](fe) Merge MasterOpExecutor and FEOpExecutor (#50776)
add d2612d4c16b [bugfix](nerids) align locate function behavior with BE side (#50797)
add f0b3527be0f [chore](odbc) remove the ODBC code in BE part (#50625)
add d6f7e50cfa5 [Fix](cloud-mow) Rollup task should retry when encouter TXN_CONFILCT in cloud mode (#50705)
add c7122622ac3 [test](trino connector) add trino connector query jdbc datasource test (#50351)
add 47983462915 [improve](cloud-mow)Add some metrics aboout delete bitmap update lock (#47988)
add 6c91a804dbf [feature](restore) introduce AgentBoundedBatchTask to manage concurrent restore tasks (#50740)
add b2c46419f79 [chore](binlog) allow reading binlogs from follower (#50714)
add 6f53090d833 [fix](regression)remove unstable case (#50750)
add da1749fcdad [fix](cooldown) allow cooldown_ttl = 0 when altering storage policy (#50830)
add 1167b74b645 [fix](external table)Optimize the queue to prevent Out of Memory (OOM). (#50649)
add 7bce8d91f37 [refactor](be) delete unused code (#50834)
add 8606104de67 [debug](mtmv) add debug log for insert into plan (#50842)
add dd088eb9e37 [opt](nereids)use SetPreAggStatus rule instead of AdjustPreAggStatus with join limited (#48502)
add e010d5c1f76 [fix](cloud-mow) Commit transaction should fail when partition has been droped (#49205)
add a02ddbeb3ae [fix](s3Client) Add `ca_cert_file_paths` conf for stsClient` and recycler (#50837)
add 246634c2d2a [refactor](fe) make timeout unit more clear (#50808)
add de8dbbcbc04 [fix](storage vault) Fix two storage vault regression cases (#50703)
add d77b0a81657 [fix](regression)unstable case test_map_select_with_limit (#50620)
add 17d996768ba [fix](binlog) Fix AlterJobRecord.baseIndexId spelling (#50850)
add f24507766ec [fix](inverted index) fix query error (#50860)
add b3abfaba6d8 [feat](refactor-param) refactor routineLoad's code about fileformat (#50552)
add 522e7cef55a [Fix](JsonPath) return null when meet unknown escape sequence, example '$.name\\k' (#50859)
add 0b58eb54713 [Enhancement] (nereids) implement AdminRepairTableCommand,AdminCancelRepairTableCommand,AdminSetReplicaStatusCommand in nereids (#49194)
add d22728c3d5c [Fix](external catalog) where tables in the information_schema could not be displayed (#49607)
add 732d8c6184f [Fix](compaction) Fix nullptr in CloudStorageEngine due to concurrent access to compaction maps (#50819)
add c70f0875572 [enhancement](plugin) logstash: support multi-table (#48040)
add 30bce874839 [enhancement](plugin) filebeat: support multi-table (#47691)
add bcc2ea07489 Bump golang.org/x/net in /extension/beats
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (3cb1dee0ecd)
\
N -- N -- N refs/heads/dependabot/go_modules/extension/beats/golang.org/x/net-0.38.0 (bcc2ea07489)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 8 +-
.github/CODEOWNERS | 2 +
.github/workflows/build-thirdparty.yml | 21 +-
LICENSE.txt | 12 -
be/CMakeLists.txt | 21 -
be/cmake/thirdparty.cmake | 6 +-
be/src/agent/agent_server.cpp | 1 -
be/src/agent/task_worker_pool.cpp | 7 +
be/src/apache-orc | 2 +-
be/src/cloud/cloud_base_compaction.cpp | 49 +-
be/src/cloud/cloud_base_compaction.h | 1 +
be/src/cloud/cloud_compaction_action.cpp | 11 +-
be/src/cloud/cloud_cumulative_compaction.cpp | 84 +-
be/src/cloud/cloud_cumulative_compaction.h | 1 +
.../cloud/cloud_engine_calc_delete_bitmap_task.cpp | 10 +
be/src/cloud/cloud_full_compaction.cpp | 37 +-
be/src/cloud/cloud_full_compaction.h | 1 +
be/src/cloud/cloud_meta_mgr.cpp | 14 +-
be/src/cloud/cloud_rowset_builder.cpp | 4 +-
be/src/cloud/cloud_schema_change_job.cpp | 17 +-
be/src/cloud/cloud_schema_change_job.h | 1 +
be/src/cloud/cloud_storage_engine.cpp | 138 +-
be/src/cloud/cloud_storage_engine.h | 11 +
be/src/cloud/cloud_tablet.cpp | 35 +-
be/src/cloud/cloud_tablet.h | 11 +-
be/src/cloud/cloud_tablet_mgr.cpp | 15 +-
be/src/cloud/cloud_tablets_channel.cpp | 4 +-
be/src/cloud/cloud_warm_up_manager.cpp | 38 +-
be/src/cloud/config.cpp | 1 +
be/src/cloud/config.h | 2 +
be/src/common/config.cpp | 38 +-
be/src/common/config.h | 33 +-
be/src/common/daemon.cpp | 93 +-
be/src/common/daemon.h | 2 -
be/src/common/exception.cpp | 9 +-
be/src/common/status.h | 6 +
be/src/common/utils.h | 8 +
be/src/exec/decompressor.cpp | 1 -
be/src/exec/es/es_scroll_parser.cpp | 16 +-
be/src/exec/odbc_connector.cpp | 326 ----
be/src/exec/odbc_connector.h | 116 --
be/src/exec/rowid_fetcher.cpp | 40 +-
be/src/exec/schema_scanner.cpp | 4 +-
.../schema_active_queries_scanner.cpp | 4 +-
.../schema_scanner/schema_backend_active_tasks.cpp | 5 +-
.../schema_backend_kerberos_ticket_cache.cpp | 5 +-
.../schema_catalog_meta_cache_stats_scanner.cpp | 4 +-
.../schema_file_cache_statistics.cpp | 5 +-
.../schema_scanner/schema_partitions_scanner.cpp | 4 +-
.../exec/schema_scanner/schema_routine_scanner.cpp | 4 +-
.../schema_table_options_scanner.cpp | 4 +-
.../schema_table_properties_scanner.cpp | 4 +-
.../schema_workload_group_privileges.cpp | 4 +-
...chema_workload_group_resource_usage_scanner.cpp | 5 +-
.../schema_workload_groups_scanner.cpp | 6 +-
.../schema_workload_sched_policy_scanner.cpp | 4 +-
be/src/exec/table_connector.cpp | 18 +-
be/src/exec/table_connector.h | 9 +-
be/src/exec/tablet_info.cpp | 12 +-
be/src/exec/tablet_info.h | 3 +-
be/src/exprs/string_functions.cpp | 16 +-
be/src/exprs/string_functions.h | 3 +-
be/src/geo/geo_types.cpp | 43 +-
be/src/gutil/CMakeLists.txt | 14 +-
be/src/gutil/arm_instruction_set_select.h | 35 -
be/src/gutil/atomic_refcount.h | 2 -
be/src/gutil/charmap.h | 71 -
be/src/gutil/gscoped_ptr.h | 808 --------
be/src/gutil/hash/builtin_type_hash.h | 1 -
be/src/gutil/hash/jenkins.cc | 254 ---
be/src/gutil/hash/jenkins.h | 36 -
be/src/gutil/hash/jenkins_lookup2.h | 90 -
be/src/gutil/logging-inl.h | 50 -
be/src/gutil/move.h | 217 ---
be/src/gutil/stl_util.h | 852 ---------
be/src/gutil/strings/charset.cc | 24 -
be/src/gutil/strings/charset.h | 68 -
be/src/gutil/strings/escaping.cc | 2005 --------------------
be/src/gutil/strings/escaping.h | 651 -------
be/src/gutil/strings/join.cc | 189 --
be/src/gutil/strings/join.h | 321 ----
be/src/gutil/strings/memutil.cc | 126 --
be/src/gutil/strings/memutil.h | 135 --
be/src/gutil/strings/numbers.cc | 660 -------
be/src/gutil/strings/numbers.h | 224 ---
be/src/gutil/strings/split.cc | 985 ----------
be/src/gutil/strings/split.h | 1149 -----------
be/src/gutil/strings/split_internal.h | 407 ----
be/src/gutil/strings/strcat.cc | 235 ---
be/src/gutil/strings/strcat.h | 337 ----
be/src/gutil/strings/stringpiece.cc | 213 ---
be/src/gutil/strings/stringpiece.h | 328 ----
be/src/gutil/strings/strip.cc | 376 ----
be/src/gutil/strings/strip.h | 259 ---
be/src/gutil/strings/substitute.cc | 129 --
be/src/gutil/strings/substitute.h | 180 --
be/src/gutil/strings/util.cc | 1205 ------------
be/src/gutil/strings/util.h | 483 -----
be/src/gutil/utf/LICENSE | 13 -
be/src/gutil/utf/rune.c | 348 ----
be/src/gutil/utf/utf.h | 213 ---
be/src/gutil/utf/utfdef.h | 14 -
be/src/http/action/adjust_log_level.cpp | 33 +-
be/src/http/action/batch_download_action.cpp | 5 +-
be/src/http/action/compaction_action.cpp | 17 +-
be/src/http/action/config_action.cpp | 5 +-
be/src/http/action/delete_bitmap_action.cpp | 1 -
...mem_action.cpp => dictionary_status_action.cpp} | 36 +-
.../http/action/dictionary_status_action.h} | 21 +-
be/src/http/action/http_stream.cpp | 4 +-
be/src/http/action/shrink_mem_action.cpp | 4 +-
be/src/http/action/stream_load.cpp | 29 +-
be/src/http/action/tablets_distribution_action.cpp | 4 +-
be/src/http/http_channel.cpp | 9 +-
be/src/http/http_client.cpp | 11 +-
be/src/http/utils.cpp | 4 +-
be/src/http/web_page_handler.cpp | 20 +-
be/src/index-tools/index_tool.cpp | 1 -
be/src/io/cache/block_file_cache.cpp | 18 +-
be/src/io/cache/block_file_cache.h | 1 +
be/src/io/cache/block_file_cache_downloader.cpp | 2 +
be/src/io/cache/cached_remote_file_reader.cpp | 23 +-
be/src/io/cache/fs_file_cache_storage.cpp | 3 +-
be/src/io/file_factory.cpp | 32 +-
be/src/io/file_factory.h | 3 +
be/src/io/fs/s3_file_system.cpp | 4 +
be/src/io/fs/s3_file_writer.cpp | 61 +
be/src/io/fs/s3_obj_storage_client.cpp | 6 +
be/src/io/io_common.h | 3 +
be/src/olap/CMakeLists.txt | 2 +-
be/src/olap/calc_delete_bitmap_executor.cpp | 23 +
be/src/olap/calc_delete_bitmap_executor.h | 6 +
be/src/olap/compaction.cpp | 3 +-
be/src/olap/cumulative_compaction.cpp | 7 +
.../cumulative_compaction_time_series_policy.cpp | 62 +-
be/src/olap/data_dir.cpp | 8 +
be/src/olap/delta_writer.cpp | 11 +-
be/src/olap/delta_writer_v2.cpp | 8 +-
be/src/olap/iterators.h | 2 +-
be/src/olap/key_coder.h | 14 +-
be/src/olap/match_predicate.cpp | 31 +-
be/src/olap/memtable.cpp | 36 +-
be/src/olap/memtable.h | 7 +-
be/src/olap/memtable_flush_executor.cpp | 20 +-
be/src/olap/memtable_writer.cpp | 5 +-
be/src/olap/olap_server.cpp | 15 +-
be/src/olap/options.cpp | 23 +-
be/src/olap/page_cache.cpp | 3 +-
be/src/olap/push_handler.cpp | 56 +-
be/src/olap/push_handler.h | 4 +-
be/src/olap/rowid_conversion.h | 5 +-
be/src/olap/rowset/beta_rowset.cpp | 7 +-
be/src/olap/rowset/beta_rowset.h | 4 +-
be/src/olap/rowset/beta_rowset_reader.cpp | 27 +-
be/src/olap/rowset/beta_rowset_writer_v2.cpp | 1 -
be/src/olap/rowset/rowset_reader_context.h | 2 +-
be/src/olap/rowset/rowset_writer.h | 1 -
be/src/olap/rowset/segcompaction.cpp | 16 +-
be/src/olap/rowset/segment_creator.cpp | 2 +-
be/src/olap/rowset/segment_v2/binary_dict_page.cpp | 4 -
be/src/olap/rowset/segment_v2/binary_plain_page.h | 1 -
.../olap/rowset/segment_v2/binary_prefix_page.cpp | 4 -
be/src/olap/rowset/segment_v2/bitshuffle_page.h | 1 -
be/src/olap/rowset/segment_v2/column_reader.cpp | 18 +-
be/src/olap/rowset/segment_v2/column_writer.cpp | 3 +-
.../rowset/segment_v2/hierarchical_data_reader.cpp | 10 +-
.../rowset/segment_v2/hierarchical_data_reader.h | 25 +-
.../rowset/segment_v2/indexed_column_reader.cpp | 3 -
.../inverted_index/query/conjunction_query.cpp | 53 +-
.../inverted_index/query/conjunction_query.h | 8 +-
.../inverted_index/query/disjunction_query.cpp | 19 +-
.../inverted_index/query/disjunction_query.h | 3 +-
.../inverted_index/query/phrase_edge_query.cpp | 8 +-
.../inverted_index/query/phrase_edge_query.h | 3 +-
.../inverted_index/query/phrase_prefix_query.cpp | 54 +-
.../inverted_index/query/phrase_prefix_query.h | 14 +-
.../inverted_index/query/phrase_query.cpp | 338 ++--
.../segment_v2/inverted_index/query/phrase_query.h | 86 +-
.../query/phrase_query/exact_phrase_matcher.cpp | 92 +
.../query/phrase_query/exact_phrase_matcher.h} | 22 +-
.../phrase_query/ordered_sloppy_phrase_matcher.cpp | 79 +
.../phrase_query/ordered_sloppy_phrase_matcher.h} | 27 +-
.../query/phrase_query/phrase_matcher.h | 66 +
.../query/phrase_query/phrase_positions.h | 54 +
.../query/phrase_query/phrase_queue.h} | 30 +-
.../query/phrase_query/sloppy_phrase_matcher.cpp | 317 ++++
.../query/phrase_query/sloppy_phrase_matcher.h | 73 +
.../inverted_index/query/prefix_query.cpp | 30 +-
.../segment_v2/inverted_index/query/prefix_query.h | 24 +-
.../rowset/segment_v2/inverted_index/query/query.h | 11 +-
.../inverted_index/query/regexp_query.cpp | 11 +-
.../segment_v2/inverted_index/query/regexp_query.h | 2 +-
.../segment_v2/inverted_index/query_v2/query.h | 4 +-
.../inverted_index/query_v2/term_query.h | 6 +-
.../inverted_index/util/docid_set_iterator.h | 81 +
.../segment_v2/inverted_index/util/fixed_bit_set.h | 193 ++
.../inverted_index/util/linked_hash_map.h | 80 +
.../segment_v2/inverted_index/util/mock_iterator.h | 122 ++
.../inverted_index/util/priority_queue.h | 158 ++
.../segment_v2/inverted_index/util/term_iterator.h | 90 +
.../inverted_index/util/term_position_iterator.h | 54 +
.../inverted_index/util/union_term_iterator.h | 147 ++
.../olap/rowset/segment_v2/inverted_index_desc.cpp | 1 -
.../olap/rowset/segment_v2/inverted_index_reader.h | 4 +-
.../rowset/segment_v2/inverted_index_writer.cpp | 1 -
.../olap/rowset/segment_v2/inverted_index_writer.h | 1 -
.../segment_v2/lazy_init_segment_iterator.cpp | 9 +-
.../olap/rowset/segment_v2/ngram_bloom_filter.cpp | 6 +-
be/src/olap/rowset/segment_v2/page_io.cpp | 3 -
be/src/olap/rowset/segment_v2/row_ranges.h | 4 +-
be/src/olap/rowset/segment_v2/segment.cpp | 33 +-
be/src/olap/rowset/segment_v2/segment.h | 20 +-
be/src/olap/rowset/segment_v2/segment_iterator.cpp | 7 +-
be/src/olap/rowset/segment_v2/segment_writer.cpp | 3 +-
be/src/olap/rowset/segment_v2/segment_writer.h | 1 -
.../rowset/segment_v2/vertical_segment_writer.cpp | 3 +-
.../rowset/segment_v2/vertical_segment_writer.h | 1 -
be/src/olap/rowset_builder.cpp | 12 +-
be/src/olap/schema_change.cpp | 1 -
be/src/olap/segment_loader.cpp | 2 +-
be/src/olap/short_key_index.cpp | 3 -
be/src/olap/single_replica_compaction.cpp | 4 +-
be/src/olap/storage_engine.cpp | 3 +-
be/src/olap/storage_engine.h | 1 -
be/src/olap/tablet.cpp | 21 +-
be/src/olap/tablet_manager.cpp | 18 +-
be/src/olap/tablet_meta.cpp | 5 +
be/src/olap/tablet_meta.h | 3 +-
be/src/olap/tablet_meta_manager.h | 1 -
be/src/olap/tablet_reader.cpp | 4 +-
be/src/olap/tablet_reader.h | 3 +-
be/src/olap/tablet_schema.cpp | 2 +-
be/src/olap/tablet_schema.h | 19 +-
be/src/olap/task/engine_clone_task.cpp | 7 +-
be/src/olap/task/engine_publish_version_task.cpp | 87 +-
be/src/olap/task/engine_storage_migration_task.cpp | 1 -
be/src/olap/txn_manager.cpp | 10 +-
be/src/olap/txn_manager.h | 6 +-
be/src/olap/types.h | 1 -
be/src/olap/wal/wal_manager.cpp | 4 +-
be/src/olap/wal/wal_manager.h | 1 -
be/src/olap/wal/wal_table.cpp | 4 +-
be/src/pipeline/CMakeLists.txt | 4 -
be/src/pipeline/common/partition_sort_utils.cpp | 5 -
be/src/pipeline/common/partition_sort_utils.h | 9 +-
be/src/pipeline/dependency.cpp | 13 +
be/src/pipeline/dependency.h | 3 +-
.../pipeline/exec/aggregation_source_operator.cpp | 108 +-
be/src/pipeline/exec/aggregation_source_operator.h | 5 +-
be/src/pipeline/exec/analytic_sink_operator.cpp | 17 +-
be/src/pipeline/exec/dict_sink_operator.cpp | 184 ++
be/src/pipeline/exec/dict_sink_operator.h | 93 +
be/src/pipeline/exec/exchange_sink_buffer.cpp | 256 ++-
be/src/pipeline/exec/exchange_sink_buffer.h | 18 +-
be/src/pipeline/exec/exchange_sink_operator.cpp | 14 +-
be/src/pipeline/exec/exchange_sink_operator.h | 11 +-
be/src/pipeline/exec/hashjoin_build_sink.cpp | 3 +-
be/src/pipeline/exec/hashjoin_probe_operator.cpp | 11 +-
be/src/pipeline/exec/hashjoin_probe_operator.h | 4 +-
.../pipeline/exec/join/process_hash_table_probe.h | 7 +-
.../exec/join/process_hash_table_probe_impl.h | 98 +-
be/src/pipeline/exec/join_probe_operator.cpp | 2 +
be/src/pipeline/exec/join_probe_operator.h | 1 +
be/src/pipeline/exec/multi_cast_data_streamer.h | 1 -
.../exec/nested_loop_join_probe_operator.cpp | 1 +
be/src/pipeline/exec/olap_scan_operator.cpp | 139 +-
be/src/pipeline/exec/olap_scan_operator.h | 4 +
be/src/pipeline/exec/operator.cpp | 2 +
.../pipeline/exec/partition_sort_sink_operator.h | 7 +-
.../exec/partitioned_aggregation_sink_operator.cpp | 9 +-
.../partitioned_aggregation_source_operator.cpp | 2 +-
.../exec/partitioned_hash_join_sink_operator.cpp | 2 +-
be/src/pipeline/exec/result_sink_operator.cpp | 2 +
be/src/pipeline/exec/scan_operator.cpp | 112 +-
be/src/pipeline/exec/scan_operator.h | 5 +-
be/src/pipeline/exec/schema_scan_operator.cpp | 15 +-
be/src/pipeline/exec/set_probe_sink_operator.cpp | 42 +-
be/src/pipeline/exec/set_sink_operator.cpp | 30 +-
be/src/pipeline/exec/set_source_operator.cpp | 35 +-
be/src/pipeline/exec/set_source_operator.h | 5 +-
be/src/pipeline/exec/sort_sink_operator.h | 2 +-
be/src/pipeline/exec/spill_sort_sink_operator.cpp | 7 +-
.../pipeline/exec/spill_sort_source_operator.cpp | 2 +-
.../exec/streaming_aggregation_operator.cpp | 743 ++------
.../pipeline/exec/streaming_aggregation_operator.h | 87 +-
be/src/pipeline/pipeline_fragment_context.cpp | 10 +
be/src/pipeline/pipeline_fragment_context.h | 2 -
be/src/pipeline/pipeline_task.cpp | 17 +-
be/src/pipeline/pipeline_task.h | 22 +-
be/src/pipeline/task_scheduler.cpp | 6 +-
be/src/pipeline/task_scheduler.h | 1 -
be/src/runtime/CMakeLists.txt | 2 +-
be/src/runtime/cache/cache_utils.h | 9 +-
be/src/runtime/cache/result_cache.h | 2 +-
be/src/runtime/cache/result_node.h | 8 +-
be/src/runtime/define_primitive_type.h | 22 +-
be/src/runtime/descriptors.cpp | 76 +-
be/src/runtime/descriptors.h | 42 +-
be/src/runtime/exec_env.h | 7 +-
be/src/runtime/exec_env_init.cpp | 14 +-
be/src/runtime/fold_constant_executor.cpp | 34 +-
be/src/runtime/fold_constant_executor.h | 2 +-
be/src/runtime/fragment_mgr.cpp | 7 +-
be/src/runtime/jsonb_value.h | 8 +-
be/src/runtime/load_channel.cpp | 5 +-
be/src/runtime/load_channel_mgr.h | 1 -
be/src/runtime/load_stream.cpp | 13 +-
be/src/runtime/load_stream_mgr.cpp | 1 -
be/src/runtime/load_stream_writer.cpp | 31 +-
be/src/runtime/memory/cache_manager.cpp | 2 +
be/src/runtime/memory/cache_manager.h | 2 +
be/src/runtime/memory/cache_policy.cpp | 2 +
be/src/runtime/memory/cache_policy.h | 2 +
be/src/runtime/memory/global_memory_arbitrator.cpp | 18 +-
be/src/runtime/memory/global_memory_arbitrator.h | 23 +-
be/src/runtime/memory/heap_profiler.cpp | 2 +
be/src/runtime/memory/heap_profiler.h | 2 +
be/src/runtime/memory/jemalloc_control.cpp | 2 +
be/src/runtime/memory/jemalloc_control.h | 2 +
be/src/runtime/memory/jemalloc_hook.cpp | 2 +-
be/src/runtime/memory/lru_cache_policy.h | 5 +-
be/src/runtime/memory/lru_cache_value_base.h | 2 +
be/src/runtime/memory/mem_counter.h | 7 +-
be/src/runtime/memory/mem_tracker.h | 6 +-
be/src/runtime/memory/mem_tracker_limiter.cpp | 285 +--
be/src/runtime/memory/mem_tracker_limiter.h | 112 +-
be/src/runtime/memory/memory_profile.cpp | 2 +
be/src/runtime/memory/memory_profile.h | 2 +
be/src/runtime/memory/memory_reclamation.cpp | 399 ++--
be/src/runtime/memory/memory_reclamation.h | 134 +-
be/src/runtime/memory/tcmalloc_hook.h | 12 +-
be/src/runtime/memory/thread_mem_tracker_mgr.cpp | 12 +-
be/src/runtime/memory/thread_mem_tracker_mgr.h | 109 +-
be/src/runtime/primitive_type.cpp | 127 --
be/src/runtime/primitive_type.h | 145 +-
be/src/runtime/query_context.cpp | 193 +-
be/src/runtime/query_context.h | 142 +-
be/src/runtime/result_buffer_mgr.cpp | 35 +-
be/src/runtime/result_buffer_mgr.h | 17 +-
be/src/runtime/routine_load/data_consumer.cpp | 4 +-
be/src/runtime/routine_load/data_consumer_pool.h | 1 -
.../routine_load/routine_load_task_executor.cpp | 6 +
be/src/runtime/runtime_predicate.h | 2 +-
be/src/runtime/runtime_query_statistics_mgr.cpp | 8 +
be/src/runtime/runtime_query_statistics_mgr.h | 3 +
be/src/runtime/runtime_state.cpp | 26 +-
be/src/runtime/small_file_mgr.cpp | 4 +-
be/src/runtime/snapshot_loader.cpp | 16 +-
be/src/runtime/snapshot_loader.h | 4 +
be/src/runtime/stream_load/stream_load_context.cpp | 21 +-
be/src/runtime/thread_context.cpp | 30 +-
be/src/runtime/thread_context.h | 132 +-
be/src/runtime/types.cpp | 329 ----
be/src/runtime/types.h | 239 ---
be/src/runtime/user_function_cache.cpp | 1 -
be/src/runtime/workload_group/workload_group.cpp | 310 +--
be/src/runtime/workload_group/workload_group.h | 31 +-
.../workload_group/workload_group_manager.cpp | 365 ++--
.../workload_group/workload_group_manager.h | 31 +-
be/src/runtime/workload_management/cpu_context.cpp | 2 +
be/src/runtime/workload_management/cpu_context.h | 2 +
be/src/runtime/workload_management/io_context.h | 2 +
.../{cpu_context.cpp => memory_context.cpp} | 17 +-
.../runtime/workload_management/memory_context.h | 34 +-
.../workload_management/query_task_controller.cpp | 208 ++
.../workload_management/query_task_controller.h | 56 +
.../workload_management/resource_context.cpp | 2 +
.../runtime/workload_management/resource_context.h | 4 +
.../workload_management/task_controller.cpp | 53 +
.../runtime/workload_management/task_controller.h | 127 +-
be/src/runtime_filter/runtime_filter.cpp | 15 +-
be/src/runtime_filter/runtime_filter.h | 8 +-
be/src/runtime_filter/runtime_filter_consumer.cpp | 27 +-
be/src/runtime_filter/runtime_filter_consumer.h | 7 +-
be/src/runtime_filter/runtime_filter_merger.h | 8 +-
be/src/runtime_filter/runtime_filter_producer.cpp | 8 +-
be/src/runtime_filter/runtime_filter_producer.h | 36 +-
.../runtime_filter_producer_helper.cpp | 4 -
be/src/runtime_filter/utils.cpp | 18 +-
be/src/runtime_filter/utils.h | 6 +-
be/src/service/arrow_flight/flight_sql_service.cpp | 4 +-
be/src/service/backend_options.cpp | 5 +-
be/src/service/backend_service.cpp | 42 +-
be/src/service/backend_service.h | 3 +
be/src/service/doris_main.cpp | 5 +-
be/src/service/http_service.cpp | 6 +
be/src/service/internal_service.cpp | 49 +-
be/src/service/internal_service.h | 14 +
be/src/tools/meta_tool.cpp | 5 +-
be/src/udf/CMakeLists.txt | 30 +-
be/src/udf/udf.cpp | 11 +-
be/src/udf/udf.h | 25 +-
be/src/util/arrow/block_convertor.cpp | 2 +-
be/src/util/arrow/row_batch.cpp | 51 +-
be/src/util/arrow/row_batch.h | 4 +-
be/src/util/arrow/utils.cpp | 2 -
be/src/util/bit_stream_utils.h | 1 -
be/src/util/bitmap.h | 1 -
be/src/util/block_compression.cpp | 12 +-
be/src/util/byte_buffer.h | 3 +-
be/src/util/byte_stream_split.cpp | 6 +-
be/src/util/cgroup_util.cpp | 22 +-
be/src/util/cpu_info.cpp | 17 +-
be/src/util/datetype_cast.hpp | 6 +-
be/src/util/debug/leak_annotations.h | 6 +-
be/src/util/debug/leakcheck_disabler.h | 1 -
be/src/util/debug/sanitizer_scopes.h | 1 -
be/src/util/disk_info.cpp | 4 +-
be/src/util/faststring.h | 7 +-
be/src/util/interval_tree-inl.h | 440 -----
be/src/util/interval_tree.h | 159 --
be/src/util/jni-util.cpp | 10 +-
be/src/util/jsonb_document.h | 20 +-
be/src/util/mem_info.cpp | 5 +-
be/src/util/memcpy_inlined.h | 1 -
be/src/util/os_util.cpp | 6 +-
be/src/util/path_util.cpp | 9 +-
be/src/util/perf_counters.cpp | 4 +-
be/src/util/pprof_utils.cpp | 5 +-
be/src/util/pretty_printer.h | 3 +-
be/src/util/quantile_state.h | 6 +
be/src/util/rle_encoding.h | 1 -
be/src/util/runtime_profile.cpp | 25 +
be/src/util/runtime_profile.h | 47 +
be/src/util/s3_uri.cpp | 19 +-
be/src/util/s3_util.cpp | 169 +-
be/src/util/s3_util.h | 20 +-
be/src/util/simd/vstring_function.h | 2 -
be/src/util/stack_util.cpp | 5 +-
be/src/util/string_util.cpp | 16 +-
be/src/util/string_util.h | 2 +-
be/src/util/system_metrics.cpp | 22 +-
be/src/util/thread.cpp | 11 +-
be/src/util/threadpool.cpp | 12 +-
be/src/util/thrift_client.cpp | 6 +-
be/src/util/time_lut.cpp | 29 -
be/src/util/time_lut.h | 2 -
be/src/util/url_coding.cpp | 4 +-
be/src/vec/CMakeLists.txt | 4 -
.../vec/aggregate_functions/aggregate_function.h | 10 +-
.../aggregate_function_approx_count_distinct.cpp | 97 +-
.../aggregate_function_approx_top.h | 13 +-
.../aggregate_function_array_agg.cpp | 95 +
.../aggregate_function_array_agg.h | 431 +++++
.../aggregate_function_binary.h | 77 +-
.../aggregate_function_bitmap.cpp | 32 +-
.../aggregate_function_bitmap_agg.cpp | 27 +-
.../aggregate_function_collect.cpp | 165 +-
.../aggregate_function_collect.h | 505 +----
.../aggregate_function_corr.cpp | 93 +-
...function_corr.cpp => aggregate_function_corr.h} | 90 +-
.../aggregate_function_count_by_enum.cpp | 4 +-
.../aggregate_function_covar.cpp | 36 +-
.../aggregate_function_group_array_intersect.cpp | 51 +-
.../aggregate_function_group_array_intersect.h | 2 +-
.../aggregate_function_histogram.cpp | 58 +-
.../aggregate_function_java_udaf.h | 4 +-
.../aggregate_function_kurtosis.cpp | 40 +-
.../aggregate_function_linear_histogram.cpp | 45 +-
.../aggregate_functions/aggregate_function_map.cpp | 59 +-
.../aggregate_function_min_max.cpp | 32 +-
.../aggregate_function_min_max_by.h | 170 +-
.../aggregate_function_orthogonal_bitmap.cpp | 4 +-
.../aggregate_function_percentile.cpp | 6 +-
.../aggregate_function_reader_first_last.h | 152 +-
.../aggregate_function_regr_union.cpp | 47 +-
.../aggregate_functions/aggregate_function_rpc.h | 29 +-
.../aggregate_function_sequence_match.cpp | 10 +-
.../aggregate_function_sequence_match.h | 10 +-
.../aggregate_function_simple_factory.cpp | 4 +
.../aggregate_function_skew.cpp | 40 +-
.../aggregate_function_stddev.cpp | 39 +-
.../aggregate_function_topn.cpp | 87 +-
.../aggregate_function_uniq.cpp | 48 +-
.../aggregate_function_uniq_distribute_key.cpp | 50 +-
.../aggregate_function_window.cpp | 317 +++-
.../aggregate_function_window_funnel.cpp | 12 +-
.../aggregate_function_window_funnel.h | 244 ++-
be/src/vec/aggregate_functions/helpers.h | 85 +-
be/src/vec/columns/column.h | 12 +
be/src/vec/columns/column_array.cpp | 20 +-
be/src/vec/columns/column_array.h | 3 +-
be/src/vec/columns/column_complex.h | 21 +-
be/src/vec/columns/column_const.h | 10 +-
be/src/vec/columns/column_decimal.h | 10 +
be/src/vec/columns/column_map.cpp | 32 +-
be/src/vec/columns/column_map.h | 5 +-
be/src/vec/columns/column_nullable.cpp | 16 +-
be/src/vec/columns/column_nullable.h | 7 +-
be/src/vec/columns/column_object.cpp | 429 ++---
be/src/vec/columns/column_object.h | 34 +-
be/src/vec/columns/column_string.cpp | 52 +
be/src/vec/columns/column_string.h | 30 +-
be/src/vec/columns/column_struct.cpp | 2 +-
be/src/vec/columns/column_struct.h | 16 +-
be/src/vec/columns/column_vector.h | 23 +-
be/src/vec/common/allocator.cpp | 394 ++--
be/src/vec/common/allocator.h | 208 +-
be/src/vec/common/allocator_fwd.h | 4 +
be/src/vec/common/arena.h | 4 -
be/src/vec/common/field_visitors.h | 36 +-
be/src/vec/common/hash_table/hash_key_type.h | 2 +-
be/src/vec/common/hash_table/hash_map.h | 3 +-
be/src/vec/common/hash_table/hash_table.h | 1 -
.../vec/common/hash_table/hash_table_allocator.h | 31 -
be/src/vec/common/hash_table/join_hash_table.h | 1 -
be/src/vec/common/hash_table/string_hash_map.h | 2 +-
be/src/vec/common/pod_array.h | 119 +-
be/src/vec/common/pod_array_fwd.h | 13 +-
be/src/vec/common/schema_util.cpp | 73 +-
be/src/vec/common/schema_util.h | 8 +-
be/src/vec/common/sort/heap_sorter.cpp | 3 +-
be/src/vec/common/sort/sorter.h | 2 +-
be/src/vec/common/string_buffer.hpp | 3 +
be/src/vec/common/string_utils/string_utils.cpp | 34 -
be/src/vec/common/string_utils/string_utils.h | 100 -
be/src/vec/common/uint128.h | 4 -
be/src/vec/core/block.cpp | 89 +-
be/src/vec/core/block.h | 28 +-
be/src/vec/core/call_on_type_index.h | 170 +-
be/src/vec/core/decimal_comparison.h | 8 +-
be/src/vec/core/field.cpp | 303 ++-
be/src/vec/core/field.h | 616 ++----
be/src/vec/core/types.h | 280 +--
be/src/vec/data_types/convert_field_to_type.cpp | 83 +-
be/src/vec/data_types/data_type.cpp | 90 +-
be/src/vec/data_types/data_type.h | 237 +--
be/src/vec/data_types/data_type_agg_state.h | 7 +-
be/src/vec/data_types/data_type_array.cpp | 6 +-
be/src/vec/data_types/data_type_array.h | 22 +-
be/src/vec/data_types/data_type_bitmap.h | 7 +-
be/src/vec/data_types/data_type_date.h | 5 +-
...me_v2.cpp => data_type_date_or_datetime_v2.cpp} | 2 +-
...e_time_v2.h => data_type_date_or_datetime_v2.h} | 17 +-
be/src/vec/data_types/data_type_date_time.h | 18 +-
be/src/vec/data_types/data_type_decimal.cpp | 53 +
be/src/vec/data_types/data_type_decimal.h | 51 +-
be/src/vec/data_types/data_type_factory.cpp | 587 +++---
be/src/vec/data_types/data_type_factory.hpp | 27 +-
.../vec/data_types/data_type_fixed_length_object.h | 7 +-
be/src/vec/data_types/data_type_hll.cpp | 8 +
be/src/vec/data_types/data_type_hll.h | 3 +-
be/src/vec/data_types/data_type_ipv4.h | 3 +-
be/src/vec/data_types/data_type_ipv6.h | 5 +-
be/src/vec/data_types/data_type_jsonb.h | 24 +-
be/src/vec/data_types/data_type_map.cpp | 4 +-
be/src/vec/data_types/data_type_map.h | 26 +-
be/src/vec/data_types/data_type_nothing.h | 7 +-
be/src/vec/data_types/data_type_nullable.h | 19 +-
be/src/vec/data_types/data_type_number.cpp | 1 -
be/src/vec/data_types/data_type_number_base.cpp | 16 +-
be/src/vec/data_types/data_type_number_base.h | 73 +-
be/src/vec/data_types/data_type_object.cpp | 38 +-
be/src/vec/data_types/data_type_object.h | 16 +-
be/src/vec/data_types/data_type_quantilestate.h | 6 +-
be/src/vec/data_types/data_type_string.h | 35 +-
be/src/vec/data_types/data_type_struct.h | 38 +-
be/src/vec/data_types/data_type_time.h | 14 +-
be/src/vec/data_types/get_least_supertype.cpp | 90 +-
be/src/vec/data_types/get_least_supertype.h | 8 +-
.../vec/data_types/serde/data_type_decimal_serde.h | 10 +-
.../data_types/serde/data_type_object_serde.cpp | 76 +-
.../vec/data_types/serde/data_type_object_serde.h | 9 +-
be/src/vec/data_types/serde/data_type_serde.cpp | 16 +-
.../data_types/serde/data_type_struct_serde.cpp | 6 +
.../vec/exec/format/arrow/arrow_stream_reader.cpp | 4 +-
be/src/vec/exec/format/arrow/arrow_stream_reader.h | 2 +-
be/src/vec/exec/format/avro/avro_jni_reader.cpp | 41 +-
be/src/vec/exec/format/avro/avro_jni_reader.h | 11 +-
be/src/vec/exec/format/column_type_convert.cpp | 85 +-
be/src/vec/exec/format/column_type_convert.h | 15 +-
be/src/vec/exec/format/csv/csv_reader.cpp | 47 +-
be/src/vec/exec/format/csv/csv_reader.h | 8 +-
be/src/vec/exec/format/generic_reader.h | 6 +-
be/src/vec/exec/format/jni_reader.cpp | 6 +-
be/src/vec/exec/format/jni_reader.h | 7 +-
be/src/vec/exec/format/json/new_json_reader.cpp | 124 +-
be/src/vec/exec/format/json/new_json_reader.h | 17 +-
be/src/vec/exec/format/orc/orc_memory_pool.h | 6 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 226 ++-
be/src/vec/exec/format/orc/vorc_reader.h | 12 +-
.../vec/exec/format/parquet/bool_plain_decoder.cpp | 2 +-
.../vec/exec/format/parquet/bool_rle_decoder.cpp | 2 +-
.../exec/format/parquet/delta_bit_pack_decoder.h | 1 -
.../exec/format/parquet/parquet_column_convert.cpp | 47 +-
.../exec/format/parquet/parquet_column_convert.h | 28 +-
be/src/vec/exec/format/parquet/parquet_pred_cmp.h | 4 +-
be/src/vec/exec/format/parquet/schema_desc.cpp | 186 +-
be/src/vec/exec/format/parquet/schema_desc.h | 19 +-
.../exec/format/parquet/vparquet_column_reader.cpp | 78 +-
.../exec/format/parquet/vparquet_group_reader.cpp | 5 +-
.../exec/format/parquet/vparquet_page_index.cpp | 2 +-
.../vec/exec/format/parquet/vparquet_page_index.h | 2 +-
be/src/vec/exec/format/parquet/vparquet_reader.cpp | 37 +-
be/src/vec/exec/format/parquet/vparquet_reader.h | 14 +-
be/src/vec/exec/format/table/equality_delete.cpp | 14 +-
be/src/vec/exec/format/table/hudi_jni_reader.cpp | 15 +-
be/src/vec/exec/format/table/hudi_jni_reader.h | 7 +-
be/src/vec/exec/format/table/hudi_reader.cpp | 4 +-
be/src/vec/exec/format/table/hudi_reader.h | 6 +-
be/src/vec/exec/format/table/iceberg_reader.cpp | 14 +-
be/src/vec/exec/format/table/iceberg_reader.h | 14 +-
.../vec/exec/format/table/lakesoul_jni_reader.cpp | 4 +-
be/src/vec/exec/format/table/lakesoul_jni_reader.h | 7 +-
.../exec/format/table/max_compute_jni_reader.cpp | 9 +-
.../vec/exec/format/table/max_compute_jni_reader.h | 7 +-
be/src/vec/exec/format/table/paimon_jni_reader.cpp | 9 +-
be/src/vec/exec/format/table/paimon_jni_reader.h | 7 +-
be/src/vec/exec/format/table/paimon_reader.h | 6 +-
be/src/vec/exec/format/table/table_format_reader.h | 5 +-
.../format/table/transactional_hive_reader.cpp | 6 +-
.../exec/format/table/transactional_hive_reader.h | 3 +-
.../format/table/trino_connector_jni_reader.cpp | 6 +-
.../exec/format/table/trino_connector_jni_reader.h | 5 +-
be/src/vec/exec/format/wal/wal_reader.cpp | 7 +-
be/src/vec/exec/format/wal/wal_reader.h | 2 +-
be/src/vec/exec/jni_connector.cpp | 163 +-
be/src/vec/exec/jni_connector.h | 26 +-
be/src/vec/exec/scan/file_scanner.cpp | 51 +-
be/src/vec/exec/scan/file_scanner.h | 11 +-
be/src/vec/exec/scan/meta_scanner.cpp | 28 +-
be/src/vec/exec/scan/mysql_scanner.cpp | 197 --
be/src/vec/exec/scan/mysql_scanner.h | 75 -
be/src/vec/exec/scan/olap_scanner.cpp | 16 +-
be/src/vec/exec/scan/scanner_context.cpp | 2 -
be/src/vec/exec/scan/scanner_scheduler.cpp | 13 +-
be/src/vec/exec/scan/scanner_scheduler.h | 4 -
be/src/vec/exec/vjdbc_connector.cpp | 23 +-
.../exprs/table_function/udf_table_function.cpp | 3 +-
be/src/vec/exprs/table_function/vexplode.cpp | 5 +-
.../exprs/table_function/vexplode_json_array.cpp | 2 +-
be/src/vec/exprs/table_function/vexplode_v2.cpp | 5 +-
be/src/vec/exprs/varray_literal.cpp | 2 -
be/src/vec/exprs/vectorized_agg_fn.cpp | 15 +-
be/src/vec/exprs/vectorized_agg_fn.h | 2 -
be/src/vec/exprs/vectorized_fn_call.cpp | 18 +-
be/src/vec/exprs/vexpr.cpp | 42 +-
be/src/vec/exprs/vexpr.h | 7 +-
be/src/vec/exprs/vexpr_context.cpp | 4 +-
be/src/vec/exprs/vexpr_context.h | 4 +-
be/src/vec/exprs/vin_predicate.cpp | 2 +-
be/src/vec/exprs/vinfo_func.cpp | 4 +-
be/src/vec/exprs/vmap_literal.cpp | 2 -
be/src/vec/exprs/vslot_ref.cpp | 5 +-
.../vec/functions/array/function_array_apply.cpp | 58 +-
be/src/vec/functions/array/function_array_binary.h | 4 +-
.../vec/functions/array/function_array_compact.h | 2 +-
.../vec/functions/array/function_array_concat.cpp | 5 +-
.../array/function_array_contains_all.cpp | 64 +-
.../vec/functions/array/function_array_cum_sum.cpp | 90 +-
.../functions/array/function_array_difference.h | 73 +-
.../vec/functions/array/function_array_distance.h | 4 +-
.../vec/functions/array/function_array_distinct.h | 86 +-
.../vec/functions/array/function_array_element.h | 96 +-
.../array/function_array_enumerate_uniq.cpp | 67 +-
.../vec/functions/array/function_array_exists.cpp | 2 +-
.../vec/functions/array/function_array_filter.cpp | 2 +-
.../vec/functions/array/function_array_flatten.cpp | 4 +-
be/src/vec/functions/array/function_array_index.h | 73 +-
be/src/vec/functions/array/function_array_join.h | 66 +-
be/src/vec/functions/array/function_array_nary.h | 4 +-
be/src/vec/functions/array/function_array_pop.cpp | 2 +-
.../vec/functions/array/function_array_range.cpp | 8 +-
be/src/vec/functions/array/function_array_remove.h | 67 +-
.../vec/functions/array/function_array_shuffle.cpp | 2 +-
be/src/vec/functions/array/function_array_slice.h | 6 +-
be/src/vec/functions/array/function_array_sort.h | 2 +-
.../vec/functions/array/function_array_sortby.cpp | 2 +-
.../vec/functions/array/function_array_utils.cpp | 4 +-
be/src/vec/functions/array/function_array_zip.cpp | 3 +-
.../vec/functions/array/function_arrays_overlap.h | 69 +-
be/src/vec/functions/complex_dict_hash_map.h | 105 +
.../vec/functions/complex_hash_map_dictionary.cpp | 230 +++
be/src/vec/functions/complex_hash_map_dictionary.h | 104 +
be/src/vec/functions/date_time_transforms.h | 58 +-
be/src/vec/functions/dictionary.cpp | 148 ++
be/src/vec/functions/dictionary.h | 212 +++
be/src/vec/functions/dictionary_factory.cpp | 64 +
be/src/vec/functions/dictionary_factory.h | 151 ++
be/src/vec/functions/dictionary_util.h | 78 +
be/src/vec/functions/function.cpp | 49 +-
be/src/vec/functions/function.h | 87 +-
.../vec/functions/function_always_not_nullable.h | 13 +-
be/src/vec/functions/function_binary_arithmetic.h | 144 +-
be/src/vec/functions/function_bit.cpp | 2 +-
be/src/vec/functions/function_bitmap.cpp | 45 +-
be/src/vec/functions/function_case.h | 99 +-
be/src/vec/functions/function_cast.h | 248 +--
be/src/vec/functions/function_coalesce.cpp | 69 +-
be/src/vec/functions/function_collection_in.h | 3 +-
be/src/vec/functions/function_convert_tz.h | 2 +-
.../function_date_or_datetime_computation.h | 57 +-
.../function_date_or_datetime_computation_v2.cpp | 2 +-
.../function_date_or_datetime_to_something.h | 12 +-
.../function_date_or_datetime_to_string.cpp | 2 +-
.../vec/functions/function_datetime_floor_ceil.cpp | 80 +-
.../function_datetime_string_to_string.cpp | 5 +-
.../functions/function_datetime_string_to_string.h | 7 +-
be/src/vec/functions/function_dict_get.cpp | 114 ++
be/src/vec/functions/function_dict_get_many.cpp | 132 ++
be/src/vec/functions/function_encryption.cpp | 2 +-
be/src/vec/functions/function_fake.cpp | 18 +-
be/src/vec/functions/function_hex.cpp | 2 +-
be/src/vec/functions/function_hll.cpp | 2 +-
be/src/vec/functions/function_ip.h | 38 +-
be/src/vec/functions/function_json.cpp | 25 +-
be/src/vec/functions/function_jsonb.cpp | 1 +
be/src/vec/functions/function_map.cpp | 8 +-
be/src/vec/functions/function_multi_match.cpp | 2 +-
be/src/vec/functions/function_multi_match.h | 8 -
be/src/vec/functions/function_quantile_state.cpp | 6 +-
be/src/vec/functions/function_regexp.cpp | 178 +-
be/src/vec/functions/function_reverse.h | 3 +-
be/src/vec/functions/function_size.cpp | 10 +-
be/src/vec/functions/function_split_by_regexp.cpp | 4 +-
be/src/vec/functions/function_string.cpp | 85 +-
be/src/vec/functions/function_string.h | 319 +---
be/src/vec/functions/function_string_to_string.h | 2 +-
be/src/vec/functions/function_struct_element.cpp | 9 +-
.../vec/functions/function_time_value_to_field.cpp | 2 +-
be/src/vec/functions/function_timestamp.cpp | 42 +-
be/src/vec/functions/function_tokenize.h | 12 +-
be/src/vec/functions/function_totype.h | 6 +-
be/src/vec/functions/function_variant_element.cpp | 48 +-
be/src/vec/functions/function_width_bucket.cpp | 53 +-
be/src/vec/functions/functions_comparison.h | 40 +-
be/src/vec/functions/functions_geo.cpp | 71 +-
be/src/vec/functions/functions_geo.h | 23 +-
be/src/vec/functions/functions_logical.cpp | 11 +-
.../functions/functions_multi_string_position.cpp | 2 +-
be/src/vec/functions/if.cpp | 13 +-
be/src/vec/functions/in.h | 22 +-
be/src/vec/functions/ip_address_dictionary.cpp | 331 ++++
be/src/vec/functions/ip_address_dictionary.h | 98 +
be/src/vec/functions/least_greast.cpp | 469 ++++-
be/src/vec/functions/like.cpp | 5 -
be/src/vec/functions/like.h | 2 -
be/src/vec/functions/match.cpp | 2 +-
be/src/vec/functions/math.cpp | 14 +-
be/src/vec/functions/random.cpp | 4 -
be/src/vec/functions/round.h | 4 +-
be/src/vec/functions/simple_function_factory.h | 4 +
be/src/vec/functions/time_of_function.cpp | 2 +-
be/src/vec/functions/to_time_function.cpp | 2 +-
be/src/vec/io/io_helper.h | 12 +-
be/src/vec/io/var_int.h | 35 +-
be/src/vec/json/json_parser.cpp | 2 +-
be/src/vec/json/parse2column.cpp | 6 +-
be/src/vec/olap/olap_data_convertor.cpp | 14 +-
be/src/vec/olap/olap_data_convertor.h | 2 +-
be/src/vec/runtime/ip_address_cidr.h | 19 +-
be/src/vec/runtime/ipv4_value.h | 13 +
be/src/vec/runtime/partitioner.cpp | 5 +-
be/src/vec/runtime/time_value.h | 16 +-
be/src/vec/runtime/vcsv_transformer.cpp | 2 +-
be/src/vec/runtime/vdata_stream_mgr.cpp | 26 +
be/src/vec/runtime/vdata_stream_mgr.h | 8 +-
be/src/vec/runtime/vdata_stream_recvr.cpp | 4 +-
be/src/vec/runtime/vdata_stream_recvr.h | 2 +-
be/src/vec/runtime/vdatetime_value.cpp | 27 +-
be/src/vec/runtime/vdatetime_value.h | 157 +-
be/src/vec/runtime/vorc_transformer.cpp | 58 +-
be/src/vec/runtime/vorc_transformer.h | 2 +-
be/src/vec/runtime/vparquet_transformer.cpp | 2 +-
be/src/vec/runtime/vparquet_transformer.h | 4 -
be/src/vec/sink/load_stream_map_pool.h | 1 -
be/src/vec/sink/load_stream_stub.h | 1 -
be/src/vec/sink/vdata_stream_sender.cpp | 4 +-
be/src/vec/sink/vmysql_result_writer.cpp | 5 +-
be/src/vec/sink/vtablet_block_convertor.cpp | 116 +-
be/src/vec/sink/vtablet_block_convertor.h | 17 +-
.../sink/writer/iceberg/partition_transformers.cpp | 48 +-
.../sink/writer/iceberg/partition_transformers.h | 308 ++-
.../sink/writer/iceberg/viceberg_table_writer.cpp | 35 +-
.../sink/writer/iceberg/viceberg_table_writer.h | 9 +-
be/src/vec/sink/writer/vfile_result_writer.cpp | 13 +-
be/src/vec/sink/writer/vhive_partition_writer.cpp | 13 -
be/src/vec/sink/writer/vhive_table_writer.cpp | 24 +-
be/src/vec/sink/writer/vhive_table_writer.h | 3 +-
be/src/vec/sink/writer/vmysql_table_writer.cpp | 9 +-
be/src/vec/sink/writer/vodbc_table_writer.cpp | 70 -
be/src/vec/sink/writer/vodbc_table_writer.h | 56 -
be/src/vec/sink/writer/vtablet_writer.cpp | 2 +-
be/src/vec/sink/writer/vtablet_writer_v2.h | 1 -
be/src/vec/utils/stringop_substring.h | 282 +++
.../kerberos/kerberos_ticket_cache_auth_test.cpp | 1 -
be/test/exprs/string_functions_test.cpp | 124 ++
be/test/geo/geo_types_test.cpp | 2 +-
be/test/http/http_client_test.cpp | 3 +-
be/test/io/cache/block_file_cache_test.cpp | 161 +-
be/test/io/fs/s3_file_writer_test.cpp | 6 +-
be/test/io/fs/s3_obj_storage_client_role_test.cpp | 188 ++
be/test/io/fs/s3_obj_storage_client_test.cpp | 2 +
be/test/io/fs/s3_obj_stroage_client_mock_test.cpp | 128 ++
...mulative_compaction_time_series_policy_test.cpp | 11 +-
be/test/olap/date_bloom_filter_test.cpp | 8 +-
be/test/olap/delta_writer_cluster_key_test.cpp | 11 +-
be/test/olap/delta_writer_test.cpp | 33 +-
.../olap/engine_storage_migration_task_test.cpp | 7 +-
be/test/olap/memtable_memory_limiter_test.cpp | 3 +-
be/test/olap/rowset/beta_rowset_test.cpp | 2 +
.../index_compaction_write_index_test.cpp | 1 -
.../phrase_query/exact_phrase_matcher_test.cpp | 136 ++
.../ordered_sloppy_phrase_matcher_test.cpp | 165 ++
.../query/phrase_query/phrase_matcher_test.cpp | 113 ++
.../query/phrase_query/phrase_positions_test.cpp | 144 ++
.../query/phrase_query/phrase_queue_test.cpp | 130 ++
.../phrase_query/sloppy_phrase_matcher_test.cpp | 206 ++
.../inverted_index/query_v2/query_test.cpp | 332 ++--
.../inverted_index/util/fixed_bit_set_test.cpp | 141 ++
.../inverted_index/util/linked_hash_map_test.cpp | 135 ++
.../inverted_index/util/mock_iterator_test.cpp | 113 ++
.../inverted_index/util/priority_queue_test.cpp | 155 ++
.../util/union_term_iterator_test.cpp | 223 +++
be/test/olap/segment_cache_test.cpp | 11 +-
be/test/olap/segment_footer_cache_test.cpp | 8 +-
be/test/olap/tablet_cooldown_test.cpp | 10 +-
be/test/olap/timestamped_version_tracker_test.cpp | 4 +-
be/test/olap/txn_manager_test.cpp | 14 +-
be/test/pipeline/common/agg_utils_test.cpp | 334 ++++
.../pipeline/common/distinct_agg_utils_test.cpp | 218 +++
be/test/pipeline/common/set_utils_test.cpp | 149 ++
be/test/pipeline/exec/data_queue_test.cpp | 8 +
.../exec/multi_cast_data_streamer_test.cpp | 177 +-
be/test/pipeline/exec/vdata_stream_recvr_test.cpp | 56 +-
.../agg_operator_group_by_limit_opt_test.cpp | 762 ++++++++
be/test/pipeline/operator/agg_operator_test.cpp | 253 +++
.../operator/analytic_sink_operator_test.cpp | 647 ++++++-
.../operator/exchange_sink_operator_test.cpp | 2 +-
.../operator/hashjoin_probe_operator_test.cpp | 8 +-
.../operator/partition_sort_sink_operator_test.cpp | 195 +-
be/test/pipeline/operator/repeat_operator_test.cpp | 3 -
.../operator/scan_normalize_predicate_test.cpp | 29 +
.../operator/spillable_operator_test_helper.h | 11 -
.../operator/streaming_agg_operator_test.cpp | 318 ++++
be/test/pipeline/pipeline_task_test.cpp | 36 +-
be/test/pipeline/pipeline_test.cpp | 20 +-
be/test/runtime/memory/mem_tracker_test.cpp | 2 +-
be/test/runtime/memory/memory_reclamation_test.cpp | 372 ++++
.../runtime/memory/thread_mem_tracker_mgr_test.cpp | 108 +-
be/test/runtime/result_buffer_mgr_test.cpp | 7 +-
be/test/runtime/snapshot_loader_test.cpp | 7 +-
be/test/runtime/thread_context_test.cpp | 3 +-
.../workload_group/dummy_workload_group_test.cpp | 4 +-
.../workload_group/workload_group_manager_test.cpp | 152 +-
.../runtime_filter_consumer_helper_test.cpp | 3 +
...=> runtime_filter_producer_helper_set_test.cpp} | 57 +-
.../runtime_filter_producer_test.cpp | 16 +
be/test/runtime_filter/utils_test.cpp | 13 +-
be/test/scan/scanner_context_test.cpp | 11 +-
be/test/testutil/any_type.h | 11 +-
be/test/testutil/desc_tbl_builder.cpp | 33 +-
be/test/testutil/desc_tbl_builder.h | 10 +-
be/test/testutil/function_utils.cpp | 9 +-
be/test/testutil/function_utils.h | 5 +-
be/test/testutil/mock/mock_descriptors.h | 14 +-
be/test/testutil/mock/mock_query_context.h | 23 +-
..._tracker_mgr.h => mock_query_task_controller.h} | 23 +-
be/test/testutil/mock/mock_runtime_state.h | 15 +-
.../testutil/mock/mock_thread_mem_tracker_mgr.h | 5 +-
be/test/testutil/mock/mock_workload_group_mgr.h | 4 +-
be/test/testutil/run_all_tests.cpp | 4 +-
be/test/testutil/test_util.cpp | 7 +-
be/test/testutil/test_util.h | 29 +-
be/test/util/interval_tree_test.cpp | 395 ----
.../runtime_profile_counter_tree_node_test.cpp | 23 +
be/test/util/threadpool_test.cpp | 20 +-
.../vec/aggregate_functions/agg_array_agg_test.cpp | 197 ++
.../vec/aggregate_functions/agg_collect_test.cpp | 113 +-
be/test/vec/aggregate_functions/agg_corr_test.cpp | 146 ++
.../vec/aggregate_functions/agg_function_test.h | 6 -
.../agg_group_array_intersect_test.cpp | 22 +-
.../vec/aggregate_functions/agg_histogram_test.cpp | 2 +-
.../vec/aggregate_functions/agg_min_max_test.cpp | 29 +
be/test/vec/columns/column_array_test.cpp | 388 ++--
be/test/vec/columns/column_decimal_test.cpp | 38 +
be/test/vec/columns/column_map_test.cpp | 224 +++
be/test/vec/columns/column_nullable_test.cpp | 92 +-
be/test/vec/columns/column_object_test.cpp | 36 +-
be/test/vec/columns/column_string_test.cpp | 61 +-
be/test/vec/columns/column_struct_test.cpp | 117 ++
be/test/vec/columns/column_vector_test.cpp | 115 +-
be/test/vec/common/pod_array_test.cpp | 317 +++-
be/test/vec/common/string_utils_test.cpp | 218 +++
be/test/vec/core/block_test.cpp | 537 +++++-
be/test/vec/core/column_complex_test.cpp | 30 +-
be/test/vec/core/column_map_test.cpp | 4 +-
be/test/vec/core/column_struct_test.cpp | 2 +-
be/test/vec/core/field_test.cpp | 138 +-
be/test/vec/core/get_common_type_test.cpp | 6 +-
be/test/vec/data_types/common_data_type_test.h | 39 +-
be/test/vec/data_types/complex_type_test.cpp | 6 +-
.../vec/data_types/data_type_agg_state_test.cpp | 18 +-
be/test/vec/data_types/data_type_array_test.cpp | 233 +--
be/test/vec/data_types/data_type_bitmap_test.cpp | 7 +-
be/test/vec/data_types/data_type_decimal_test.cpp | 57 +-
.../data_type_fixed_length_object_test.cpp | 7 +-
be/test/vec/data_types/data_type_hll_test.cpp | 7 +-
be/test/vec/data_types/data_type_ip_test.cpp | 50 +-
be/test/vec/data_types/data_type_map_test.cpp | 262 +--
be/test/vec/data_types/data_type_number_test.cpp | 30 +-
.../data_types/data_type_quantile_state_test.cpp | 8 +-
be/test/vec/data_types/data_type_string_test.cpp | 14 +-
be/test/vec/data_types/data_type_struct_test.cpp | 181 +-
be/test/vec/data_types/data_type_time_v2_test.cpp | 3 +-
be/test/vec/data_types/datetime_round_test.cpp | 5 +-
.../serde/data_type_serde_arrow_test.cpp | 334 ++--
.../data_types/serde/data_type_serde_csv_test.cpp | 232 +++
.../serde/data_type_serde_decimal_test.cpp | 3 +-
.../serde/data_type_serde_mysql_test.cpp | 65 +-
.../data_types/serde/data_type_serde_pb_test.cpp | 2 +-
.../data_types/serde/data_type_to_string_test.cpp | 18 +-
be/test/vec/exec/column_type_convert_test.cpp | 168 +-
.../dictionary/dictionary_get_nullable_test.cpp | 293 +++
.../exec/dictionary/dictionary_ip_trie_test.cpp | 76 +
.../vec/exec/dictionary/dictionary_status_test.cpp | 109 ++
.../vec/exec/dictionary/dictionary_util_test.cpp | 159 ++
.../exec/dictionary/dictionary_version_test.cpp | 161 ++
be/test/vec/exec/exchange_sink_test.h | 8 +-
.../exec/format/parquet/parquet_reader_test.cpp | 193 +-
.../exec/format/parquet/parquet_thrift_test.cpp | 37 +-
be/test/vec/exec/orc_reader_test.cpp | 28 +-
be/test/vec/exec/sort/full_sort_test.cpp | 125 ++
be/test/vec/exec/sort/heap_sorter_test.cpp | 131 ++
be/test/vec/exec/sort/merge_sorter_state.cpp | 105 +
be/test/vec/exec/sort/partition_sorter_test.cpp | 197 ++
be/test/vec/exec/sort/sort_test.cpp | 36 +
be/test/vec/exec/sort/topn_sort_test.cpp | 108 ++
.../exprs/vexpr_evalute_inverted_index_test.cpp | 175 ++
be/test/vec/exprs/vexpr_test.cpp | 23 +-
be/test/vec/function/cast/cast_test.h | 52 +
be/test/vec/function/cast/cast_to_boolean_test.cpp | 187 ++
be/test/vec/function/cast/cast_to_date_test.cpp | 201 ++
.../vec/function/cast/cast_to_datetime_test.cpp | 203 ++
be/test/vec/function/cast/cast_to_time_test.cpp | 109 ++
be/test/vec/function/function_arithmetic_test.cpp | 14 +-
.../function/function_array_aggregation_test.cpp | 250 ++-
.../vec/function/function_array_element_test.cpp | 71 +-
be/test/vec/function/function_array_index_test.cpp | 97 +-
be/test/vec/function/function_array_size_test.cpp | 69 +-
.../vec/function/function_arrays_overlap_test.cpp | 120 +-
be/test/vec/function/function_bitmap_test.cpp | 70 +-
.../function_complex_hash_map_dict_test.cpp | 135 ++
be/test/vec/function/function_convert_tz_test.cpp | 2 +-
.../vec/function/function_dict_get_many_test.cpp | 89 +
be/test/vec/function/function_dict_get_test.cpp | 89 +
be/test/vec/function/function_geo_test.cpp | 60 +-
.../vec/function/function_hash_map_dict_test.cpp | 68 +
be/test/vec/function/function_hash_map_dict_test.h | 122 ++
be/test/vec/function/function_hash_test.cpp | 28 +-
be/test/vec/function/function_hll_test.cpp | 16 +-
be/test/vec/function/function_ifnull_test.cpp | 18 +-
be/test/vec/function/function_ip_dict_test.cpp | 131 ++
be/test/vec/function/function_ip_dict_test.h | 251 +++
be/test/vec/function/function_ip_test.cpp | 13 +-
be/test/vec/function/function_json_test.cpp | 10 +-
be/test/vec/function/function_jsonb_test.cpp | 292 +--
be/test/vec/function/function_like_test.cpp | 29 +-
be/test/vec/function/function_math_test.cpp | 175 +-
.../vec/function/function_money_format_test.cpp | 11 +-
be/test/vec/function/function_nullif_test.cpp | 11 +-
be/test/vec/function/function_string_test.cpp | 229 ++-
be/test/vec/function/function_test_template.cpp | 5 +-
be/test/vec/function/function_test_util.cpp | 510 ++---
be/test/vec/function/function_test_util.h | 468 ++---
.../function/function_time_cast_to_date_test.cpp | 2 +-
be/test/vec/function/function_time_test.cpp | 1009 +++++-----
be/test/vec/function/function_url_test.cpp | 6 +-
be/test/vec/function/table_function_test.cpp | 196 +-
be/test/vec/jsonb/serialize_test.cpp | 62 +-
be/test/vec/runtime/vdatetime_value_test.cpp | 203 ++
.../writer/iceberg/partition_transformers_test.cpp | 52 +-
.../utils/arrow_column_to_doris_column_test.cpp | 8 +-
be/test/vec/utils/stringop_substring_test.cpp | 285 +++
build.sh | 20 +-
cloud/cmake/thirdparty.cmake | 3 +
cloud/script/start.sh | 2 -
cloud/src/common/bvars.cpp | 12 +
cloud/src/common/bvars.h | 10 +
cloud/src/common/config.h | 30 +-
cloud/src/common/metric.cpp | 1 +
cloud/src/common/simple_thread_pool.h | 10 +-
cloud/src/main.cpp | 8 +-
cloud/src/meta-service/keys.cpp | 20 +-
cloud/src/meta-service/keys.h | 1 +
cloud/src/meta-service/meta_server.cpp | 1 +
cloud/src/meta-service/meta_service.cpp | 353 +++-
cloud/src/meta-service/meta_service.h | 20 +
cloud/src/meta-service/meta_service_job.cpp | 100 +-
cloud/src/meta-service/meta_service_resource.cpp | 168 +-
cloud/src/meta-service/meta_service_txn.cpp | 49 +-
cloud/src/meta-service/txn_kv.cpp | 1 +
cloud/src/meta-service/txn_lazy_committer.cpp | 5 +-
cloud/src/recycler/checker.cpp | 78 +
cloud/src/recycler/checker.h | 2 +
cloud/src/recycler/recycler.cpp | 72 +-
cloud/src/recycler/recycler_service.cpp | 1 +
cloud/src/recycler/s3_accessor.cpp | 92 +-
cloud/src/recycler/s3_accessor.h | 10 +
cloud/src/recycler/s3_obj_client.cpp | 11 +
cloud/src/resource-manager/resource_manager.cpp | 7 +-
cloud/src/resource-manager/resource_manager.h | 22 +-
cloud/test/CMakeLists.txt | 4 +
cloud/test/meta_service_http_test.cpp | 89 +
cloud/test/meta_service_job_test.cpp | 928 +++++++++
cloud/test/meta_service_test.cpp | 264 +++
cloud/test/recycler_test.cpp | 457 +++++
cloud/test/s3_accessor_mock_test.cpp | 43 +-
cloud/test/s3_accessor_test.cpp | 102 +-
cloud/test/txn_lazy_commit_test.cpp | 35 +
cloud/test/util_test.cpp | 7 +
common/cpp/aws_common.cpp | 48 +
.../cpp/aws_common.h | 21 +-
common/cpp/aws_logger.h | 2 +
dist/LICENSE-dist.txt | 12 -
docker/runtime/base-image/Dockerfile_base | 8 +-
docker/runtime/be/Dockerfile | 2 +-
.../be/resource/be_disaggregated_entrypoint.sh | 37 +
docker/runtime/be/resource/be_entrypoint.sh | 8 +-
docker/runtime/broker/Dockerfile | 2 +-
docker/runtime/doris-compose/Dockerfile | 3 +-
docker/runtime/doris-compose/Readme.md | 80 +-
docker/runtime/doris-compose/command.py | 13 +-
docker/runtime/doris-compose/requirements.txt | 5 +-
docker/runtime/fe/Dockerfile | 2 +-
docker/runtime/ms/Dockerfile | 2 +-
.../docker-compose/hive/hive-3x.yaml.tpl | 2 +
.../hive/scripts/auxlib/json-serde-1.3.9.tar.gz | Bin 0 -> 78992 bytes
.../create_hive_orc_tables.hql | 11 +
.../scripts/create_preinstalled_scripts/run76.hql | 59 +-
.../test_special_orc_formats/create_table.hql | 19 +
.../test_special_orc_formats/data.tar.gz | Bin 0 -> 43434 bytes
.../data_gen_scripts/generate_data.py | 24 +
.../run.sh | 0
.../docker-compose/hive/scripts/hive-metastore.sh | 9 +
.../json/openx_json/json_data_arrays_tb/1 | 2 +
.../json/openx_json/json_one_column_table/1 | 5 +
.../preinstalled_data/json/openx_json/json_table/1 | 2 +
.../preinstalled_data/json/openx_json/json_table/2 | 11 +
.../json/openx_json/scalar_to_array_tb/1 | 1 +
.../orc/complex_data_orc/000000_0 | Bin 0 -> 561 bytes
.../docker-compose/iceberg/iceberg.yaml.tpl | 15 +-
.../create_preinstalled_scripts/iceberg/run09.sql | 37 +
extension/beats/doris/client.go | 361 +++-
extension/beats/doris/common_test.go | 323 ++++
extension/beats/doris/config.go | 28 +-
extension/beats/doris/doris.go | 61 +-
extension/beats/go.mod | 4 +-
extension/beats/go.sum | 10 +
extension/logstash/.gitignore | 8 +
extension/logstash/lib/logstash/outputs/doris.rb | 269 ++-
.../logstash/lib/logstash/util/delay_event.rb | 18 +-
extension/logstash/lib/logstash/util/formater.rb | 4 +-
extension/logstash/logstash-output-doris.gemspec | 8 +-
fe/be-java-extensions/hudi-scanner/pom.xml | 275 ---
.../org/apache/doris/hudi/HudiColumnValue.java | 187 --
.../java/org/apache/doris/hudi/HudiJniScanner.java | 229 ---
.../src/main/java/org/apache/doris/hudi/Utils.java | 89 -
.../hudi-scanner/src/main/resources/package.xml | 41 -
.../org/apache/doris/hudi/BaseSplitReader.scala | 734 -------
.../apache/doris/hudi/HoodieRecordIterator.scala | 178 --
.../doris/hudi/MORIncrementalSplitReader.scala | 86 -
.../apache/doris/hudi/MORSnapshotSplitReader.scala | 184 --
.../org/apache/doris/common/jni/JniScanner.java | 12 +
.../doris/common/jni/utils/JavaUdfDataType.java | 4 +-
.../org/apache/doris/jdbc/BaseJdbcExecutor.java | 23 +-
.../org/apache/doris/paimon/PaimonJniScanner.java | 2 +
fe/be-java-extensions/pom.xml | 1 -
fe/fe-common/pom.xml | 5 +
.../main/java/org/apache/doris/catalog/Type.java | 8 +-
.../doris/common/CatalogConfigFileUtils.java | 103 +
.../main/java/org/apache/doris/common/Config.java | 146 +-
.../main/java/org/apache/doris/common/io/Text.java | 109 +-
.../authentication/HadoopAuthenticator.java | 6 +
.../java/org/apache/doris/common/io/TextTest.java | 65 +
.../antlr4/org/apache/doris/nereids/DorisLexer.g4 | 5 +
.../antlr4/org/apache/doris/nereids/DorisParser.g4 | 109 +-
fe/fe-core/src/main/cup/sql_parser.cup | 10 +-
.../main/java/org/apache/doris/alter/Alter.java | 23 +-
.../doris/alter/AlterLightSchChangeHelper.java | 2 +-
.../org/apache/doris/alter/AlterUserOpType.java} | 19 +-
.../java/org/apache/doris/alter/RollupJobV2.java | 29 +-
.../apache/doris/alter/SchemaChangeHandler.java | 124 +-
.../org/apache/doris/alter/SchemaChangeJobV2.java | 35 +-
.../doris/analysis/AlterRoutineLoadStmt.java | 15 +-
.../org/apache/doris/analysis/AlterUserStmt.java | 25 +-
.../apache/doris/analysis/BuildIndexClause.java | 63 +-
.../java/org/apache/doris/analysis/CastExpr.java | 3 +
.../java/org/apache/doris/analysis/ColumnDef.java | 1 +
.../org/apache/doris/analysis/CopyFromParam.java | 10 +
.../apache/doris/analysis/CopyIntoProperties.java | 2 +-
.../org/apache/doris/analysis/CopyProperties.java | 7 +-
.../java/org/apache/doris/analysis/CopyStmt.java | 35 +-
.../apache/doris/analysis/CreateResourceStmt.java | 13 +-
.../doris/analysis/CreateRoutineLoadStmt.java | 129 +-
.../doris/analysis/CreateStorageVaultStmt.java | 28 +-
.../org/apache/doris/analysis/CreateTableStmt.java | 6 +-
.../org/apache/doris/analysis/DataDescription.java | 5 +-
.../org/apache/doris/analysis/DescribeStmt.java | 15 +-
.../main/java/org/apache/doris/analysis/Expr.java | 4 +
.../java/org/apache/doris/analysis/IndexDef.java | 27 +-
.../apache/doris/analysis/InformationFunction.java | 2 +-
.../doris/analysis/LambdaFunctionCallExpr.java | 3 +
.../apache/doris/analysis/NativeInsertStmt.java | 2 +-
.../org/apache/doris/analysis/OutFileClause.java | 292 +--
.../org/apache/doris/analysis/RedirectStatus.java | 2 +-
.../apache/doris/analysis/ShowBackendsStmt.java | 10 +-
.../apache/doris/analysis/ShowFrontendsStmt.java | 10 +-
.../apache/doris/analysis/ShowTableStatsStmt.java | 5 -
.../java/org/apache/doris/analysis/TableName.java | 25 +
.../org/apache/doris/backup/BackupHandler.java | 9 +
.../java/org/apache/doris/backup/RestoreJob.java | 42 +-
.../apache/doris/binlog/AddPartitionRecord.java | 8 +-
.../org/apache/doris/binlog/AlterJobRecord.java | 17 +
.../org/apache/doris/binlog/BinlogManager.java | 11 +
.../org/apache/doris/catalog/AzureResource.java | 25 +-
.../doris/catalog/BuiltinAggregateFunctions.java | 2 +
.../doris/catalog/BuiltinScalarFunctions.java | 4 +
.../apache/doris/catalog/CloudTabletStatMgr.java | 71 +-
.../main/java/org/apache/doris/catalog/Column.java | 2 +-
.../java/org/apache/doris/catalog/Database.java | 37 +-
.../main/java/org/apache/doris/catalog/Env.java | 78 +-
.../java/org/apache/doris/catalog/EsResource.java | 3 +-
.../apache/doris/catalog/GlobalFunctionMgr.java | 2 +-
.../java/org/apache/doris/catalog/HMSResource.java | 3 +-
.../org/apache/doris/catalog/HdfsResource.java | 7 +-
.../org/apache/doris/catalog/HdfsStorageVault.java | 77 +-
.../main/java/org/apache/doris/catalog/Index.java | 12 +-
.../doris/catalog/InternalSchemaInitializer.java | 56 +-
.../org/apache/doris/catalog/JdbcResource.java | 7 +-
.../apache/doris/catalog/ListPartitionInfo.java | 18 +-
.../apache/doris/catalog/ListPartitionItem.java | 3 +
.../main/java/org/apache/doris/catalog/MTMV.java | 14 +-
.../apache/doris/catalog/OdbcCatalogResource.java | 5 +-
.../java/org/apache/doris/catalog/OlapTable.java | 50 +-
.../java/org/apache/doris/catalog/Partition.java | 2 +-
.../org/apache/doris/catalog/PartitionKey.java | 26 +-
.../java/org/apache/doris/catalog/Resource.java | 12 +-
.../java/org/apache/doris/catalog/ResourceMgr.java | 14 +
.../java/org/apache/doris/catalog/S3Resource.java | 8 +-
.../org/apache/doris/catalog/S3StorageVault.java | 38 +-
.../org/apache/doris/catalog/ScalarFunction.java | 10 +
.../java/org/apache/doris/catalog/SchemaTable.java | 4 +-
.../org/apache/doris/catalog/SparkResource.java | 3 +-
.../org/apache/doris/catalog/StorageVault.java | 31 +-
.../org/apache/doris/catalog/StorageVaultMgr.java | 10 +-
.../main/java/org/apache/doris/catalog/Table.java | 1 +
.../java/org/apache/doris/catalog/TableIf.java | 60 +-
.../main/java/org/apache/doris/catalog/Tablet.java | 10 +-
.../org/apache/doris/catalog/TabletStatMgr.java | 67 +-
.../main/java/org/apache/doris/catalog/View.java | 3 +-
.../java/org/apache/doris/clone/TabletChecker.java | 22 +-
.../cloud/alter/CloudSchemaChangeHandler.java | 5 +
.../org/apache/doris/cloud/catalog/CloudEnv.java | 19 +
.../apache/doris/cloud/catalog/CloudPartition.java | 89 +-
.../doris/cloud/load/CloudBrokerLoadJob.java | 6 +
.../apache/doris/cloud/load/CloudLoadManager.java | 2 +-
.../doris/cloud/system/CloudSystemInfoService.java | 2 +-
.../transaction/CloudGlobalTransactionMgr.java | 596 ++++--
.../java/org/apache/doris/common/FeConstants.java | 3 +-
.../java/org/apache/doris/common/FeNameFormat.java | 8 +
.../apache/doris/common/profile/AggCounter.java | 16 +
.../org/apache/doris/common/profile/Profile.java | 130 ++
.../doris/common/profile/RuntimeProfile.java | 177 ++
.../doris/common/profile/SummaryProfile.java | 35 +-
.../doris/common/publish/TopicPublisherThread.java | 6 +-
.../org/apache/doris/common/util/DebugUtil.java | 33 +
.../doris/common/util/FileFormatConstants.java | 4 -
.../apache/doris/common/util/PropertyAnalyzer.java | 6 +-
.../java/org/apache/doris/common/util/S3Util.java | 98 +-
.../java/org/apache/doris/common/util/Util.java | 6 +-
.../org/apache/doris/datasource/CatalogIf.java | 24 +-
.../apache/doris/datasource/ExternalCatalog.java | 31 +-
.../apache/doris/datasource/ExternalDatabase.java | 12 +-
.../doris/datasource/ExternalMetaCacheMgr.java | 3 +-
.../doris/datasource/ExternalSchemaCache.java | 8 +-
.../org/apache/doris/datasource/ExternalTable.java | 2 +-
.../apache/doris/datasource/FileQueryScanNode.java | 26 +-
.../org/apache/doris/datasource/FileScanNode.java | 2 +-
.../org/apache/doris/datasource/FileSplit.java | 4 +
.../apache/doris/datasource/InternalCatalog.java | 257 ++-
.../apache/doris/datasource/SplitAssignment.java | 6 +-
.../doris/datasource/TablePartitionValues.java | 32 +-
.../apache/doris/datasource/hive/HMSDlaTable.java | 90 +
.../doris/datasource/hive/HMSExternalCatalog.java | 133 +-
.../doris/datasource/hive/HMSExternalTable.java | 238 ++-
.../apache/doris/datasource/hive/HiveDlaTable.java | 146 ++
.../doris/datasource/hive/HiveMetaStoreCache.java | 17 +-
.../datasource/hive/HiveMetaStoreClientHelper.java | 6 +-
.../doris/datasource/hive/HiveMetadataOps.java | 2 +-
.../doris/datasource/hive/HiveProperties.java | 10 +
.../apache/doris/datasource/hive/HudiDlaTable.java | 128 ++
.../doris/datasource/hive/IcebergDlaTable.java | 156 ++
.../doris/datasource/hive/source/HiveScanNode.java | 51 +-
.../doris/datasource/hudi/HudiMvccSnapshot.java | 74 +
.../doris/datasource/hudi/HudiSchemaCacheKey.java | 82 +
.../apache/doris/datasource/hudi/HudiUtils.java | 14 +-
.../hudi/source/HudiCachedPartitionProcessor.java | 30 +-
.../doris/datasource/hudi/source/HudiScanNode.java | 21 +-
.../doris/datasource/hudi/source/HudiSplit.java | 1 -
.../datasource/iceberg/IcebergExternalCatalog.java | 1 -
.../datasource/iceberg/IcebergExternalTable.java | 371 +---
.../iceberg/IcebergHadoopExternalCatalog.java | 31 +-
.../datasource/iceberg/IcebergMetadataCache.java | 17 +-
.../doris/datasource/iceberg/IcebergUtils.java | 375 +++-
.../datasource/iceberg/source/IcebergScanNode.java | 30 +-
.../doris/datasource/jdbc/client/JdbcClient.java | 22 +-
.../doris/datasource/jdbc/source/JdbcScanNode.java | 78 +-
.../apache/doris/datasource/kafka/KafkaUtil.java | 8 +-
.../maxcompute/MaxComputeExternalTable.java | 2 +-
.../doris/datasource/metacache/MetaCache.java | 13 +-
.../doris/datasource/mvcc/EmptyMvccSnapshot.java} | 14 +-
.../apache/doris/datasource/mvcc/MvccTable.java | 5 +-
.../datasource/paimon/PaimonExternalTable.java | 21 +-
.../datasource/paimon/source/PaimonScanNode.java | 56 +-
.../datasource/paimon/source/PaimonSource.java | 8 +
.../datasource/property/ConnectionProperties.java | 123 ++
.../datasource/property/ConnectorProperty.java} | 19 +-
.../doris/datasource/property/PropertyUtils.java | 46 +
.../datasource/property/S3ClientBEProperties.java | 8 +
.../property/constants/S3Properties.java | 35 +
.../fileformat/AvroFileFormatProperties.java | 49 +
.../fileformat/CsvFileFormatProperties.java | 209 ++
.../property/fileformat/FileFormatProperties.java | 128 ++
.../fileformat/JsonFileFormatProperties.java | 117 ++
.../fileformat/OrcFileFormatProperties.java | 83 +
.../fileformat/ParquetFileFormatProperties.java | 129 ++
.../fileformat/WalFileFormatProperties.java | 49 +
.../property/metastore/AWSGlueProperties.java | 131 ++
.../property/metastore/AliyunDLFProperties.java | 116 ++
.../property/metastore/DataProcProperties.java} | 21 +-
.../metastore/FileMetastoreProperties.java} | 28 +-
.../property/metastore/HMSProperties.java | 140 ++
.../property/metastore/IcebergRestProperties.java | 56 +
.../property/metastore/MetastoreProperties.java | 181 ++
.../storage/AbstractS3CompatibleProperties.java | 213 +++
.../property/storage/AzureProperties.java | 157 ++
.../datasource/property/storage/COSProperties.java | 91 +
.../property/storage/HdfsCompatibleProperties.java | 56 +
.../property/storage/HdfsProperties.java | 197 ++
.../property/storage/HdfsPropertiesUtils.java | 142 ++
.../datasource/property/storage/OBSProperties.java | 97 +
.../property/storage/OSSHdfsProperties.java | 155 ++
.../datasource/property/storage/OSSProperties.java | 94 +
.../property/storage/ObjectStorageProperties.java} | 26 +-
.../datasource/property/storage/S3Properties.java | 194 ++
.../property/storage/S3PropertyUtils.java | 134 ++
.../property/storage/StorageProperties.java | 178 ++
.../systable/IcebergSnapshotsSysTable.java | 65 +
.../datasource/systable/PartitionsSysTable.java | 62 +
.../datasource/systable/SupportedSysTables.java | 42 +
.../apache/doris/datasource/systable/SysTable.java | 68 +
.../TrinoConnectorExternalTable.java | 8 +-
.../org/apache/doris/dictionary/Dictionary.java | 438 +++++
.../DictionaryDistribution.java} | 27 +-
.../apache/doris/dictionary/DictionaryManager.java | 800 ++++++++
.../org/apache/doris/dictionary/LayoutType.java} | 15 +-
.../java/org/apache/doris/fs/obj/S3ObjStorage.java | 12 +-
.../java/org/apache/doris/fsv2/FileSystem.java | 97 +
.../FileSystemFactory.java} | 19 +-
.../apache/doris/fsv2/PersistentFileSystem.java | 95 +
.../org/apache/doris/fsv2/StorageTypeMapper.java | 61 +
.../org/apache/doris/fsv2/obj/AzureObjStorage.java | 381 ++++
.../java/org/apache/doris/fsv2/obj/ObjStorage.java | 65 +
.../obj/RemoteObject.java} | 38 +-
.../org/apache/doris/fsv2/obj/RemoteObjects.java | 52 +
.../doris/{fs => fsv2}/obj/S3ObjStorage.java | 195 +-
.../apache/doris/fsv2/remote/AzureFileSystem.java | 48 +
.../apache/doris/fsv2/remote/BrokerFileSystem.java | 701 +++++++
.../apache/doris/fsv2/remote/ObjFileSystem.java | 165 ++
.../doris/fsv2/remote/RemoteFSPhantomManager.java | 126 ++
.../org/apache/doris/fsv2/remote/RemoteFile.java | 106 ++
.../apache/doris/fsv2/remote/RemoteFileSystem.java | 141 ++
.../remote/RemoteFileSystemPhantomReference.java | 44 +
.../org/apache/doris/fsv2/remote/S3FileSystem.java | 91 +
.../doris/fsv2/remote/dfs/DFSFileSystem.java | 497 +++++
.../doris/fsv2/remote/dfs/JFSFileSystem.java} | 16 +-
.../doris/fsv2/remote/dfs/OFSFileSystem.java} | 16 +-
.../doris/fsv2/remote/dfs/OSSHdfsFileSystem.java} | 16 +-
.../apache/doris/httpv2/rest/BackendsAction.java | 9 +-
.../org/apache/doris/httpv2/rest/LoadAction.java | 23 -
.../apache/doris/httpv2/rest/SetConfigAction.java | 2 +-
.../doris/httpv2/rest/manager/NodeAction.java | 15 +-
.../org/apache/doris/job/base/AbstractJob.java | 3 +
.../java/org/apache/doris/job/common/JobType.java | 1 +
.../apache/doris/job/executor/TaskProcessor.java | 2 +-
.../doris/job/extensions/insert/InsertTask.java | 31 +-
.../apache/doris/job/extensions/mtmv/MTMVTask.java | 53 +-
.../job/manager/TaskDisruptorGroupManager.java | 11 +-
.../apache/doris/job/scheduler/JobScheduler.java | 7 +-
.../org/apache/doris/job/task/AbstractTask.java | 8 +
.../org/apache/doris/journal/JournalEntity.java | 24 +
.../apache/doris/journal/bdbje/BDBEnvironment.java | 2 +
.../org/apache/doris/load/BrokerFileGroup.java | 33 +
.../main/java/org/apache/doris/load/DeleteJob.java | 4 +-
.../main/java/org/apache/doris/load/ExportJob.java | 1 -
.../org/apache/doris/load/GroupCommitManager.java | 4 +-
.../org/apache/doris/load/StreamLoadHandler.java | 34 +-
.../apache/doris/load/loadv2/BrokerLoadJob.java | 3 +
.../java/org/apache/doris/load/loadv2/LoadJob.java | 2 +-
.../apache/doris/load/loadv2/LoadLoadingTask.java | 19 +-
.../org/apache/doris/load/loadv2/LoadManager.java | 9 +-
.../doris/load/loadv2/LoadingTaskPlanner.java | 2 +-
.../apache/doris/load/loadv2/MysqlLoadManager.java | 2 +-
.../load/routineload/KafkaRoutineLoadJob.java | 58 +
.../doris/load/routineload/KafkaTaskInfo.java | 58 +-
.../doris/load/routineload/RoutineLoadJob.java | 123 +-
.../doris/load/routineload/RoutineLoadManager.java | 105 +
.../load/routineload/RoutineLoadTaskInfo.java | 7 +
.../java/org/apache/doris/load/sync/SyncJob.java | 21 +
.../org/apache/doris/load/sync/SyncJobManager.java | 122 ++
.../java/org/apache/doris/master/MasterImpl.java | 4 +
.../java/org/apache/doris/metric/MetricRepo.java | 60 +
.../main/java/org/apache/doris/mtmv/MTMVCache.java | 3 +-
.../org/apache/doris/mtmv/MTMVHookService.java | 10 +-
.../java/org/apache/doris/mtmv/MTMVJobInfo.java | 2 +-
.../java/org/apache/doris/mtmv/MTMVJobManager.java | 5 +-
.../doris/mtmv/MTMVMaxTimestampSnapshot.java | 5 +
.../org/apache/doris/mtmv/MTMVPartitionUtil.java | 51 +-
.../java/org/apache/doris/mtmv/MTMVPlanUtil.java | 173 ++
.../org/apache/doris/mtmv/MTMVRelatedTableIf.java | 19 +-
.../org/apache/doris/mtmv/MTMVRelationManager.java | 17 +-
.../java/org/apache/doris/mtmv/MTMVService.java | 58 +-
.../apache/doris/mtmv/MTMVSnapshotIdSnapshot.java | 5 +
.../java/org/apache/doris/mtmv/MTMVSnapshotIf.java | 5 +
.../apache/doris/mtmv/MTMVTimestampSnapshot.java | 5 +
.../org/apache/doris/mtmv/MTMVVersionSnapshot.java | 5 +
.../org/apache/doris/mysql/AcceptListener.java | 139 +-
.../org/apache/doris/mysql/privilege/Auth.java | 25 +-
.../org/apache/doris/nereids/NereidsPlanner.java | 55 +-
.../org/apache/doris/nereids/StatementContext.java | 43 +-
.../nereids/analyzer/UnboundDictionarySink.java | 134 ++
.../nereids/analyzer/UnboundTableSinkCreator.java | 9 +
.../org/apache/doris/nereids/cost/CostModelV1.java | 50 +-
.../glue/translator/ExpressionTranslator.java | 69 +
.../glue/translator/PhysicalPlanTranslator.java | 150 +-
.../glue/translator/PlanTranslatorContext.java | 6 +
.../nereids/jobs/cascades/DeriveStatsJob.java | 26 +-
.../doris/nereids/jobs/executor/Analyzer.java | 4 +-
.../doris/nereids/jobs/executor/Rewriter.java | 17 +-
.../load/NereidsBrokerFileGroup.java} | 177 +-
.../doris/nereids/load/NereidsBrokerLoadTask.java | 228 +++
.../load/NereidsCloudStreamLoadPlanner.java | 59 +
.../load/NereidsDataDescription.java} | 331 ++--
.../doris/nereids/load/NereidsFileGroupInfo.java | 441 +++++
.../nereids/load/NereidsImportColumnDesc.java | 79 +
.../nereids/load/NereidsLoadPlanInfoCollector.java | 557 ++++++
.../nereids/load/NereidsLoadScanProvider.java | 609 ++++++
.../doris/nereids/load/NereidsLoadTaskInfo.java | 178 ++
.../doris/nereids/load/NereidsLoadUtils.java | 277 +++
.../load/NereidsLoadingTaskPlanner.java} | 199 +-
.../load/NereidsParamCreateContext.java} | 29 +-
.../nereids/load/NereidsRoutineLoadTaskInfo.java | 307 +++
.../load/NereidsStreamLoadPlanner.java} | 229 +--
.../doris/nereids/load/NereidsStreamLoadTask.java | 545 ++++++
.../doris/nereids/parser/LogicalPlanBuilder.java | 802 +++++++-
.../apache/doris/nereids/parser/ParserUtils.java | 14 +
.../processor/post/RuntimeFilterPruner.java | 3 +
.../properties/DistributionSpecAllSingleton.java} | 22 +-
.../nereids/properties/PhysicalProperties.java | 5 +-
.../nereids/properties/RequestPropertyDeriver.java | 8 +
.../org/apache/doris/nereids/rules/RuleSet.java | 2 +
.../org/apache/doris/nereids/rules/RuleType.java | 31 +-
.../nereids/rules/analysis/BindExpression.java | 92 +
.../doris/nereids/rules/analysis/BindRelation.java | 16 +-
.../doris/nereids/rules/analysis/BindSink.java | 99 +-
.../nereids/rules/analysis/CollectRelation.java | 9 +-
.../analysis/EliminateLogicalPreAggOnHint.java} | 29 +-
.../nereids/rules/analysis/SubqueryToApply.java | 18 +-
.../mv/AbstractMaterializedViewRule.java | 3 +-
.../mv/AsyncMaterializationContext.java | 3 +-
.../rules/expression/ExpressionOptimization.java | 13 +-
.../rules/expression/rules/FoldConstantRule.java | 9 +-
.../expression/rules/FoldConstantRuleOnFE.java | 56 +-
.../rules/SimplifyConditionalFunction.java | 51 +-
...icalDictionarySinkToPhysicalDictionarySink.java | 47 +
.../nereids/rules/rewrite/AdjustPreAggStatus.java | 751 --------
.../rules/rewrite/CollectPredicateOnScan.java | 80 +
.../rewrite/EliminateConstHashJoinCondition.java | 94 +
.../nereids/rules/rewrite/EliminateFilter.java | 34 +-
.../nereids/rules/rewrite/ExistsApplyToJoin.java | 5 +-
.../nereids/rules/rewrite/ExprIdRewriter.java | 9 +
...xtractSingleTableExpressionFromDisjunction.java | 48 +-
.../doris/nereids/rules/rewrite/InApplyToJoin.java | 21 +-
.../rules/rewrite/MergePercentileToArray.java | 34 +-
.../rules/rewrite/PruneOlapScanPartition.java | 187 +-
.../nereids/rules/rewrite/PullUpCteAnchor.java | 24 +-
.../rules/rewrite/PullUpProjectUnderApply.java | 3 +-
.../nereids/rules/rewrite/ScalarApplyToJoin.java | 2 +-
.../nereids/rules/rewrite/SetPreAggStatus.java | 592 ++++++
.../rewrite/UnCorrelatedApplyAggregateFilter.java | 3 +-
.../rules/rewrite/UnCorrelatedApplyFilter.java | 3 +-
.../rewrite/UnCorrelatedApplyProjectFilter.java | 3 +-
.../doris/nereids/stats/FilterEstimation.java | 2 +-
.../doris/nereids/stats/HboPlanInfoProvider.java | 181 ++
.../stats/HboPlanStatisticsManager.java} | 43 +-
.../stats/HboPlanStatisticsProvider.java} | 39 +-
.../doris/nereids/stats/HboStatsCalculator.java | 109 ++
.../org/apache/doris/nereids/stats/HboUtils.java | 537 ++++++
.../stats/MemoryHboPlanStatisticsProvider.java | 176 ++
.../doris/nereids/stats/StatsCalculator.java | 64 +-
.../trees/copier/LogicalPlanDeepCopier.java | 10 +-
.../nereids/trees/expressions/BinaryOperator.java | 21 +
.../trees/expressions/CompoundPredicate.java | 8 +
.../nereids/trees/expressions/Expression.java | 4 +
.../nereids/trees/expressions/InPredicate.java | 7 +
.../functions/ComputeSignatureHelper.java | 5 +
.../trees/expressions/functions/agg/Avg.java | 26 +-
.../RegexpReplaceOne.java => agg/CorrWelford.java} | 50 +-
.../trees/expressions/functions/agg/Sum.java | 29 +-
.../trees/expressions/functions/agg/Sum0.java | 29 +-
.../functions/executable/StringArithmetic.java | 23 +-
.../functions/executable/TimeRoundSeries.java | 7 +-
.../generator/ExplodeJsonArrayJsonOuter.java | 4 +-
.../expressions/functions/scalar/DictGet.java | 138 ++
.../expressions/functions/scalar/DictGetMany.java | 163 ++
.../expressions/functions/scalar/JsonArray.java | 33 +-
.../expressions/functions/scalar/JsonInsert.java | 33 +-
.../expressions/functions/scalar/JsonReplace.java | 33 +-
.../expressions/functions/scalar/JsonSet.java | 33 +-
.../functions/scalar/RegexpReplace.java | 45 +-
.../functions/scalar/RegexpReplaceOne.java | 45 +-
.../functions/scalar/SubstringIndex.java | 11 -
.../expressions/functions/table/IcebergMeta.java | 11 +
.../trees/expressions/literal/DoubleLiteral.java | 30 +
.../nereids/trees/expressions/literal/Literal.java | 5 +
.../expressions/literal/StringLikeLiteral.java | 3 +-
.../visitor/AggregateFunctionVisitor.java | 5 +
.../expressions/visitor/ScalarFunctionVisitor.java | 10 +
.../doris/nereids/trees/plans/AbstractPlan.java | 71 +
.../doris/nereids/trees/plans/GroupPlan.java | 24 +
.../trees/plans/PlanNodeAndHash.java} | 38 +-
.../apache/doris/nereids/trees/plans/PlanType.java | 38 +-
.../commands/AdminCancelRepairTableCommand.java | 112 ++
.../plans/commands/AdminCopyTabletCommand.java | 265 +++
.../plans/commands/AdminRepairTableCommand.java | 117 ++
.../commands/AdminSetReplicaStatusCommand.java | 137 ++
.../plans/commands/AlterStorageVaultCommand.java | 4 +-
...loadGroupCommand.java => AlterUserCommand.java} | 46 +-
.../plans/commands/AlterWorkloadGroupCommand.java | 36 +-
.../plans/commands/CleanQueryStatsCommand.java | 176 ++
...kloadGroupCommand.java => CopyIntoCommand.java} | 42 +-
.../plans/commands/CreateDictionaryCommand.java | 78 +
...roupCommand.java => CreateResourceCommand.java} | 51 +-
.../trees/plans/commands/CreateStageCommand.java | 220 +++
.../plans/commands/CreateWorkloadGroupCommand.java | 46 +-
.../trees/plans/commands/DescribeCommand.java | 15 +-
.../plans/commands/DropDictionaryCommand.java | 72 +
.../trees/plans/commands/DropFunctionCommand.java | 5 +-
...loadGroupCommand.java => DropStageCommand.java} | 47 +-
.../plans/commands/DropWorkloadGroupCommand.java | 27 +-
.../plans/commands/ExplainDictionaryCommand.java | 88 +
.../trees/plans/commands/ShowBackendsCommand.java | 10 +-
.../plans/commands/ShowDictionariesCommand.java | 108 ++
.../trees/plans/commands/ShowFrontendsCommand.java | 10 +-
.../trees/plans/commands/ShowFunctionsCommand.java | 12 +
.../trees/plans/commands/ShowGrantsCommand.java | 4 +
.../trees/plans/commands/ShowResourcesCommand.java | 286 +++
.../trees/plans/commands/ShowSnapshotCommand.java | 42 +-
.../plans/commands/ShowStorageEnginesCommand.java | 2 +-
.../plans/commands/ShowTableStatsCommand.java | 6 -
.../trees/plans/commands/TruncateTableCommand.java | 119 ++
.../trees/plans/commands/info/AddBackendOp.java | 3 +-
.../plans/commands/info/AlterMTMVRenameInfo.java | 6 +-
.../plans/commands/info/AlterMTMVReplaceInfo.java | 11 +-
.../trees/plans/commands/info/AlterUserInfo.java} | 98 +-
.../trees/plans/commands/info/BaseViewInfo.java | 4 +-
.../trees/plans/commands/info/BuildIndexOp.java | 68 +-
.../plans/commands/info/ColumnDefinition.java | 1 +
.../trees/plans/commands/info/CopyFromDesc.java} | 139 +-
.../trees/plans/commands/info/CopyIntoInfo.java | 358 ++++
.../plans/commands/info/CreateDictionaryInfo.java | 287 +++
.../trees/plans/commands/info/CreateMTMVInfo.java | 104 +-
.../plans/commands/info/CreateResourceInfo.java} | 102 +-
.../plans/commands/info/CreateRoutineLoadInfo.java | 109 +-
.../trees/plans/commands/info/CreateTableInfo.java | 31 +-
.../commands/info/DictionaryColumnDefinition.java | 104 +
.../commands/info/DistributionDescriptor.java | 4 +
.../trees/plans/commands/info/IndexDefinition.java | 32 +-
.../commands/info/ModifyTablePropertiesOp.java | 3 +
.../trees/plans/commands/info/TableNameInfo.java | 13 +
.../commands/insert/AbstractInsertExecutor.java | 2 +-
.../commands/insert/DictionaryInsertExecutor.java | 94 +
.../insert/InsertIntoDictionaryCommand.java | 80 +
.../commands/insert/InsertIntoTableCommand.java | 62 +-
.../insert/InsertOverwriteTableCommand.java | 7 +-
.../trees/plans/commands/insert/InsertUtils.java | 11 +-
.../plans/commands/insert/OlapInsertExecutor.java | 4 +-
.../commands/load/CreateDataSyncJobCommand.java | 182 ++
.../commands/load/PauseDataSyncJobCommand.java | 69 +
.../commands/load/PauseRoutineLoadCommand.java | 99 +
.../commands/load/ResumeDataSyncJobCommand.java | 69 +
.../commands/load/ResumeRoutineLoadCommand.java | 99 +
.../load/ShowCreateRoutineLoadCommand.java | 154 ++
.../commands/load/StopDataSyncJobCommand.java | 69 +
.../commands/load/StopRoutineLoadCommand.java | 72 +
.../trees/plans/commands/load/SyncJobName.java | 64 +
.../commands/refresh/RefreshDictionaryCommand.java | 61 +
.../trees/plans/distribute/DistributePlanner.java | 18 +
.../BackendDistributedPlanWorkerManager.java | 23 +
.../worker/DistributedPlanWorkerManager.java | 6 +
.../plans/distribute/worker/job/AssignedJob.java | 2 +
.../distribute/worker/job/StaticAssignedJob.java | 10 +-
.../distribute/worker/job/UnassignedAllBEJob.java | 154 ++
.../worker/job/UnassignedJobBuilder.java | 7 +
.../trees/plans/logical/LogicalAggregate.java | 30 +
.../nereids/trees/plans/logical/LogicalApply.java | 128 +-
.../trees/plans/logical/LogicalDictionarySink.java | 153 ++
.../nereids/trees/plans/logical/LogicalFilter.java | 7 +
.../nereids/trees/plans/logical/LogicalJoin.java | 17 +
.../trees/plans/logical/LogicalLoadProject.java | 289 +++
.../trees/plans/logical/LogicalOlapScan.java | 31 +-
.../LogicalPreAggOnHint.java} | 73 +-
.../{LogicalFilter.java => LogicalPreFilter.java} | 39 +-
.../trees/plans/physical/AbstractPhysicalJoin.java | 10 +
.../plans/physical/PhysicalDictionarySink.java | 160 ++
.../trees/plans/physical/PhysicalDistribute.java | 5 +-
.../trees/plans/physical/PhysicalFilter.java | 7 +
.../plans/physical/PhysicalHashAggregate.java | 28 +
.../trees/plans/physical/PhysicalOlapScan.java | 20 +
.../plans/physical/PhysicalOlapTableSink.java | 2 +
.../trees/plans/physical/PhysicalTableSink.java | 2 +-
.../trees/plans/visitor/CommandVisitor.java | 126 ++
.../nereids/trees/plans/visitor/PlanVisitor.java | 15 +
.../nereids/trees/plans/visitor/SinkVisitor.java | 15 +
.../apache/doris/nereids/types/AggStateType.java | 6 +
.../apache/doris/nereids/types/DateTimeV2Type.java | 4 +-
.../apache/doris/nereids/util/ExpressionUtils.java | 3 +-
.../apache/doris/nereids/util/RelationUtil.java | 20 +-
.../doris/nereids/util/TypeCoercionUtils.java | 22 +
.../java/org/apache/doris/nereids/util/Utils.java | 2 +-
.../doris/persist/AlterUserOperationLog.java | 11 +-
.../CreateDictionaryPersistInfo.java} | 25 +-
.../DictionaryDecreaseVersionInfo.java} | 25 +-
.../DictionaryIncreaseVersionInfo.java} | 25 +-
.../doris/persist/DictionaryPersistInfo.java | 43 +-
.../doris/persist/DropDictionaryPersistInfo.java | 60 +
.../java/org/apache/doris/persist/EditLog.java | 42 +-
.../org/apache/doris/persist/OperationType.java | 6 +
.../org/apache/doris/persist/gson/GsonUtils.java | 4 +-
.../doris/persist/meta/MetaPersistMethod.java | 6 +
.../doris/persist/meta/PersistMetaModules.java | 2 +-
.../planner/BackendPartitionedSchemaScanNode.java | 12 +-
.../org/apache/doris/planner/DictionarySink.java | 125 ++
.../org/apache/doris/planner/FileLoadScanNode.java | 44 +
.../org/apache/doris/planner/HiveTableSink.java | 2 +-
.../org/apache/doris/planner/OlapScanNode.java | 13 +-
.../org/apache/doris/planner/OlapTableSink.java | 40 +-
.../org/apache/doris/planner/PlanFragment.java | 16 +-
.../org/apache/doris/planner/ResultFileSink.java | 11 +-
.../java/org/apache/doris/planner/ScanNode.java | 15 +-
.../apache/doris/planner/SingleNodePlanner.java | 4 +-
.../apache/doris/planner/StreamLoadPlanner.java | 2 +-
.../apache/doris/plugin/audit/AuditLogBuilder.java | 4 +-
.../plugin/dialect/HttpDialectConverterPlugin.java | 2 +-
.../org/apache/doris/policy/StoragePolicy.java | 4 +-
.../org/apache/doris/qe/AuditEventProcessor.java | 27 +-
.../java/org/apache/doris/qe/AuditLogHelper.java | 7 +-
.../java/org/apache/doris/qe/ConnectContext.java | 37 +-
.../java/org/apache/doris/qe/ConnectProcessor.java | 1 -
.../main/java/org/apache/doris/qe/Coordinator.java | 71 +-
.../org/apache/doris/qe/CoordinatorContext.java | 4 +-
.../main/java/org/apache/doris/qe/DdlExecutor.java | 8 +-
.../java/org/apache/doris/qe/FEOpExecutor.java | 141 +-
.../java/org/apache/doris/qe/MasterOpExecutor.java | 324 +---
.../org/apache/doris/qe/MasterTxnExecutor.java | 4 +-
.../org/apache/doris/qe/MysqlConnectProcessor.java | 2 +-
.../org/apache/doris/qe/NereidsCoordinator.java | 11 +-
.../java/org/apache/doris/qe/ResultReceiver.java | 18 +-
.../java/org/apache/doris/qe/SessionVariable.java | 123 +-
.../java/org/apache/doris/qe/ShowExecutor.java | 16 +-
.../java/org/apache/doris/qe/StmtExecutor.java | 25 +-
.../org/apache/doris/qe/cache/CacheAnalyzer.java | 2 +-
.../doris/qe/runtime/PipelineExecutionTask.java | 3 +-
.../apache/doris/qe/runtime/QueryProcessor.java | 4 +
.../computegroup/AllBackendComputeGroup.java | 14 +
.../resource/computegroup/CloudComputeGroup.java | 8 +
.../doris/resource/computegroup/ComputeGroup.java | 6 +
.../resource/computegroup/ComputeGroupMgr.java | 22 +-
.../resource/computegroup/MergedComputeGroup.java | 10 +-
.../workloadgroup/BindWgToComputeGroupThread.java | 122 ++
.../resource/workloadgroup/WorkloadGroup.java | 66 +-
.../resource/workloadgroup/WorkloadGroupKey.java | 78 +
.../resource/workloadgroup/WorkloadGroupMgr.java | 485 ++---
.../WorkloadRuntimeStatusMgr.java | 21 +-
.../WorkloadSchedPolicyMgr.java | 21 +-
.../org/apache/doris/rpc/BackendServiceClient.java | 15 +
.../org/apache/doris/rpc/BackendServiceProxy.java | 32 +
.../apache/doris/service/FrontendServiceImpl.java | 82 +-
.../src/main/java/org/apache/doris/spi/Split.java | 2 +
.../org/apache/doris/statistics/AnalysisJob.java | 6 +-
.../apache/doris/statistics/AnalysisManager.java | 16 +-
.../apache/doris/statistics/BaseAnalysisTask.java | 6 +-
.../doris/statistics/ExternalAnalysisTask.java | 1 +
.../apache/doris/statistics/OlapAnalysisTask.java | 15 +-
.../org/apache/doris/statistics/Statistics.java | 37 +-
.../doris/statistics/StatisticsAutoCollector.java | 23 +-
.../apache/doris/statistics/StatisticsBuilder.java | 9 +-
.../hbo/InputTableStatisticsInfo.java} | 42 +-
.../doris/statistics/hbo/PlanStatistics.java | 181 ++
.../hbo/PlanStatisticsMatchStrategy.java | 92 +
.../hbo/PlanStatisticsWithInputInfo.java | 65 +
.../hbo/RecentRunsPlanStatistics.java} | 45 +-
.../hbo/RecentRunsPlanStatisticsEntry.java | 64 +
.../doris/statistics/hbo/ScanPlanStatistics.java | 113 ++
.../doris/statistics/query/QueryStatsUtil.java | 2 +-
.../doris/statistics/util/StatisticsUtil.java | 30 +
.../main/java/org/apache/doris/system/Backend.java | 39 +-
.../org/apache/doris/system/SystemInfoService.java | 17 +
.../tablefunction/BackendsTableValuedFunction.java | 10 +-
.../ExternalFileTableValuedFunction.java | 159 +-
.../FrontendsDisksTableValuedFunction.java | 10 +-
.../FrontendsTableValuedFunction.java | 10 +-
.../GroupCommitTableValuedFunction.java | 6 +
.../HttpStreamTableValuedFunction.java | 6 +-
.../tablefunction/IcebergTableValuedFunction.java | 4 +-
.../doris/tablefunction/MetadataGenerator.java | 7 +-
.../doris/tablefunction/S3TableValuedFunction.java | 8 +
.../java/org/apache/doris/task/AgentBatchTask.java | 42 +-
.../apache/doris/task/AgentBoundedBatchTask.java | 281 +++
.../main/java/org/apache/doris/task/AgentTask.java | 1 +
.../apache/doris/task/CalcDeleteBitmapTask.java | 4 +-
.../doris/transaction/GlobalTransactionMgr.java | 5 +
.../transaction/GlobalTransactionMgrIface.java | 2 +
.../apache/doris/transaction/TransactionEntry.java | 2 +-
.../apache/doris/transaction/TransactionState.java | 1 +
.../java/org/apache/doris/alter/AlterTest.java | 127 --
.../org/apache/doris/alter/IndexChangeJobTest.java | 156 +-
.../doris/alter/SchemaChangeHandlerTest.java | 9 +-
.../doris/analysis/CreateResourceStmtTest.java | 12 -
.../org/apache/doris/analysis/IndexDefTest.java | 71 +
.../doris/analysis/ShowBackendsStmtTest.java | 2 +-
...ndsStmtTest.java => ShowFrontendsStmtTest.java} | 24 +-
.../apache/doris/catalog/CreateEncryptKeyTest.java | 1 +
.../apache/doris/catalog/CreateTableLikeTest.java | 11 +-
.../org/apache/doris/catalog/CreateViewTest.java | 10 +
.../org/apache/doris/catalog/EnvOperationTest.java | 37 -
.../catalog/InternalSchemaInitializerTest.java | 228 +++
.../apache/doris/catalog/MetadataTableTest.java | 61 +
.../doris/catalog/OdbcCatalogResourceTest.java | 158 --
.../org/apache/doris/catalog/PartitionKeyTest.java | 15 +-
.../org/apache/doris/catalog/S3ResourceTest.java | 83 +-
.../doris/cloud/catalog/CloudPartitionTest.java | 162 ++
.../doris/cloud/catalog/HdfsStorageVaultTest.java | 35 +-
.../org/apache/doris/common/GenericPoolTest.java | 6 +
.../org/apache/doris/datasource/MetaCacheTest.java | 157 ++
.../doris/datasource/hudi/HudiUtilsTest.java | 4 +-
.../iceberg/IcebergExternalTableTest.java | 38 +-
.../iceberg/source/IcebergScanNodeTest.java | 181 ++
.../datasource/jdbc/source/JdbcScanNodeTest.java | 496 +++++
...bleNameComparedLowercaseMetaCacheFalseTest.java | 9 +
.../paimon/source/PaimonScanNodeTest.java | 129 ++
.../fileformat/AvroFileFormatPropertiesTest.java} | 25 +-
.../fileformat/CsvFileFormatPropertiesTest.java | 224 +++
.../fileformat/FileFormatPropertiesTest.java} | 17 +-
.../fileformat/JsonFileFormatPropertiesTest.java | 199 ++
.../fileformat/OrcFileFormatPropertiesTest.java | 97 +
.../ParquetFileFormatPropertiesTest.java | 139 ++
.../fileformat/WalFileFormatPropertiesTest.java} | 24 +-
.../property/metastore/AWSGluePropertiesTest.java | 172 ++
.../datasource/property/metastore/AWSTest.java | 101 +
.../metastore/AliyunDLFPropertiesTest.java | 130 ++
.../property/metastore/GlueCatalogTest.java | 110 ++
.../property/metastore/HMSIntegrationTest.java | 222 +++
.../property/metastore/HMSPropertiesTest.java | 122 ++
.../property/storage/AzurePropertiesTest.java | 194 ++
.../property/storage/COSPropertiesTest.java | 145 ++
.../property/storage/HdfsPropertiesTest.java | 179 ++
.../property/storage/HdfsPropertiesUtilsTest.java | 147 ++
.../property/storage/OBSPropertyTest.java | 128 ++
.../property/storage/OSSHdfsPropertiesTest.java | 123 ++
.../property/storage/OSSPropertiesTest.java | 128 ++
.../property/storage/S3PropertiesTest.java | 180 ++
.../property/storage/S3PropertyUtilsTest.java | 110 ++
.../doris/datasource/systable/SysTableTest.java | 102 +
.../apache/doris/external/hms/HmsCatalogTest.java | 13 +-
.../doris/load/loadv2/BrokerLoadJobTest.java | 3 +-
.../org/apache/doris/mtmv/MTMVJobInfoTest.java | 45 +
.../apache/doris/mtmv/MTMVPartitionUtilTest.java | 78 +
.../org/apache/doris/mtmv/MTMVPlanUtilTest.java | 282 +++
.../org/apache/doris/mtmv/MTMVRewriteUtilTest.java | 11 +-
.../java/org/apache/doris/mtmv/MTMVTaskTest.java | 7 +-
.../test/java/org/apache/doris/mtmv/MTMVTest.java | 31 +
.../apache/doris/mysql/ConnectionExceedTest.java | 170 ++
.../org/apache/doris/mysql/privilege/AuthTest.java | 3 +
.../joinorder/hypergraph/PullupExpressionTest.java | 10 +-
.../analysis/CheckExpressionLegalityTest.java | 2 +-
.../exploration/mv/MaterializedViewUtilsTest.java | 2 +-
.../nereids/rules/expression/FoldConstantTest.java | 20 +-
.../expression/rules/ExpressionRewriteSqlTest.java | 86 +
.../rules/SimplifyConditionalFunctionTest.java | 35 +
.../EliminateConstHashJoinConditionTest.java} | 43 +-
.../nereids/rules/rewrite/EliminateFilterTest.java | 105 +
.../rules/rewrite/ExistsApplyToJoinTest.java | 17 +-
...ctSingleTableExpressionFromDisjunctionTest.java | 50 +
.../rules/rewrite/MergePercentileToArrayTest.java | 13 +
.../rules/rewrite/PruneOlapScanPartitionTest.java | 47 +-
.../nereids/rules/rewrite/RewriteSqlTest.java | 49 +
.../rules/rewrite/mv/SelectRollupIndexTest.java | 38 +-
.../doris/nereids/stats/FilterEstimationTest.java | 34 +-
.../nereids/trees/expressions/GetDataTypeTest.java | 54 +-
.../doris/nereids/trees/expressions/UdfTest.java | 10 +-
.../expressions/literal/DoubleLiteralTest.java | 49 +
.../expressions/literal/StringLikeLiteralTest.java | 7 +
.../AdminCancelRepairTableCommandTest.java | 126 ++
.../plans/commands/AdminCopyTabletCommandTest.java | 110 ++
.../commands/AdminRepairTableCommandTest.java | 126 ++
.../commands/AdminSetReplicaStatusCommandTest.java | 77 +
.../plans/commands/AlterSystemCommandTest.java | 6 +
.../trees/plans/commands/AlterUserCommandTest.java | 91 +
.../plans/commands/CleanQueryStatsCommandTest.java | 108 ++
.../commands/CreateDataSyncJobCommandTest.java | 235 +++
.../plans/commands/CreateResourceCommandTest.java | 110 ++
.../plans/commands/CreateStageCommandTest.java | 318 ++++
.../trees/plans/commands/IndexDefinitionTest.java | 73 +
.../commands/PauseDataSyncJobCommandTest.java | 50 +
.../commands/PauseRoutineLoadCommandTest.java | 45 +
.../commands/ResumeDataSyncJobCommandTest.java | 50 +
.../commands/ResumeRoutineLoadCommandTest.java | 45 +
.../plans/commands/ShowBackendsCommandTest.java | 118 ++
.../ShowCreateRoutineLoadCommandTest.java} | 22 +-
.../plans/commands/ShowFrontendsCommandTest.java | 118 ++
.../commands/ShowGlobalFunctionsCommandTest.java | 97 +
.../plans/commands/ShowGrantsCommandTest.java | 104 +
.../plans/commands/ShowResourcesCommandTest.java | 119 ++
.../plans/commands/StopDataSyncJobCommandTest.java | 51 +
.../plans/commands/StopRoutineLoadCommandTest.java | 51 +
.../plans/commands/TruncateTableCommandTest.java | 289 +++
.../doris/nereids/util/ExpressionUtilsTest.java | 25 +
.../apache/doris/planner/ResourceTagQueryTest.java | 6 +-
.../apache/doris/planner/StatisticDeriveTest.java | 47 -
.../org/apache/doris/qe/ConnectContextTest.java | 4 +-
.../org/apache/doris/qe/HmsQueryCacheTest.java | 27 +-
.../doris/qe/StmtExecutorInternalQueryTest.java} | 30 +-
.../java/org/apache/doris/qe/StmtExecutorTest.java | 904 ++-------
.../apache/doris/resource/ComputeGroupTest.java | 14 +-
.../workloadgroup/WorkloadGroupMgrTest.java | 681 ++++---
.../resource/workloadgroup/WorkloadGroupTest.java | 47 +-
.../apache/doris/statistics/AnalysisJobTest.java | 27 +
.../doris/statistics/OlapAnalysisTaskTest.java | 62 +-
.../statistics/StatisticsAutoCollectorTest.java | 5 +-
.../doris/statistics/util/StatisticsUtilTest.java | 57 +
.../apache/doris/utframe/MockedBackendFactory.java | 6 +
.../apache/doris/utframe/TestWithFeService.java | 6 +-
.../plugins/hadoop_conf/hadoop1/core-site.xml | 40 +
.../plugins/hadoop_conf/hadoop1/hdfs-site.xml | 50 +
.../plugins/hadoop_conf/osshdfs1/core-site.xml | 26 +
.../plugins/hive-conf/hive1/hive-site.xml | 26 +
fe/pom.xml | 6 +-
gensrc/proto/cloud.proto | 11 +
gensrc/proto/internal_service.proto | 30 +
gensrc/thrift/AgentService.thrift | 11 +
gensrc/thrift/BackendService.thrift | 13 +
gensrc/thrift/DataSinks.thrift | 19 +
gensrc/thrift/Descriptors.thrift | 4 +
gensrc/thrift/FrontendService.thrift | 30 +-
gensrc/thrift/PaloInternalService.thrift | 2 +
gensrc/thrift/PlanNodes.thrift | 6 +-
gensrc/thrift/Types.thrift | 9 +-
.../data/alter_p0/test_alter_column_comment.out | Bin 0 -> 635 bytes
regression-test/data/cast_p0/cast_to_datetime.out | Bin 0 -> 5202 bytes
regression-test/data/cast_p0/cast_to_time.out | Bin 0 -> 1738 bytes
.../test_single_compaction_fault_injection.out | Bin 163 -> 187 bytes
.../data/correctness_p0/test_time_round.out | Bin 5047 -> 5047 bytes
.../agg_state/decimal_sum/test_decimal_sum.out} | Bin 163 -> 130 bytes
.../data/datatype_p0/complex_types/test.json | 3 +
.../test_dict_load_and_get_hash_map.out | Bin 0 -> 2620 bytes
.../test_dict_load_and_get_ip_trie.out} | Bin 163 -> 159 bytes
.../test_dict_nullable_key.out} | Bin 163 -> 152 bytes
regression-test/data/dictionary_p0/test_ddl.out | Bin 0 -> 225 bytes
.../data/dictionary_p0/test_dict_get_many.out | Bin 0 -> 263 bytes
.../data/dictionary_p0/test_dict_get_nullable.out | Bin 0 -> 404 bytes
.../test_dictionary_fe_failover.out} | Bin 163 -> 173 bytes
.../data/dictionary_p0/test_refresh_dict.out | Bin 0 -> 717 bytes
.../data/dictionary_p0/test_trade_demo.out | Bin 0 -> 5381 bytes
.../upgrade/test_dictionary_restart.out} | Bin 163 -> 115 bytes
.../hive/test_hive_get_schema_from_table.out | Bin 0 -> 6103 bytes
.../hive/test_hive_meta_cache.out | Bin 0 -> 858 bytes
.../hive/test_hive_openx_json.out | Bin 0 -> 709 bytes
.../hive/test_hive_orc_predicate.out | Bin 585 -> 2553 bytes
.../hive/test_hive_use_meta_cache.out | Bin 2041 -> 2089 bytes
.../hive/test_special_orc_formats.out | Bin 0 -> 355 bytes
.../test_iceberg_schema_change_with_timetravel.out | Bin 0 -> 691 bytes
.../iceberg/test_iceberg_sys_table.out | Bin 0 -> 1028 bytes
.../iceberg/write/test_iceberg_write_insert.out | Bin 142167 -> 162889 bytes
.../jdbc/test_oracle_jdbc_catalog.out | Bin 7894 -> 10560 bytes
.../trino_connector/jdbc/test_trino_clickhouse.out | Bin 0 -> 2971 bytes
.../trino_connector/jdbc/test_trino_mysql.out | Bin 0 -> 93532 bytes
.../trino_connector/jdbc/test_trino_oracle.out | Bin 0 -> 6046 bytes
.../trino_connector/jdbc/test_trino_pg.out | Bin 0 -> 1934 bytes
.../trino_connector/jdbc/test_trino_sqlserver.out | Bin 0 -> 3560 bytes
.../hive/test_orc_merge_io_input_streams.out} | Bin 163 -> 123 bytes
.../hudi/hudi_mtmv/test_hudi_mtmv.out | Bin 0 -> 8110 bytes
.../hudi/hudi_mtmv/test_hudi_olap_rewrite_mtmv.out | Bin 0 -> 5610 bytes
.../hudi/hudi_mtmv/test_hudi_rewrite_mtmv.out | Bin 0 -> 250 bytes
.../cloud/test_cloud_mow_retry_txn_interleave.out} | Bin 163 -> 213 bytes
.../cloud/test_cloud_mow_sync_mv.out | Bin 0 -> 454 bytes
.../data/function_p0/test_agg_foreach.out | Bin 1164 -> 1276 bytes
.../data/function_p0/test_substring_index.out | Bin 0 -> 2304 bytes
.../function_p0/test_substring_index_columns.out | Bin 0 -> 1124 bytes
.../function_p0/test_substring_index_simple.out | Bin 0 -> 725 bytes
.../test_ngram_bloomfilter_index_change.out | Bin 0 -> 3569 bytes
.../insert_group_commit_into_max_filter_ratio.out | Bin 293 -> 297 bytes
.../data/inverted_index_p0/test_array_index2.out | Bin 0 -> 277 bytes
.../test_expr_in_null.out} | Bin 163 -> 151 bytes
.../data/javaudf_p0/test_javaudf_array.out | Bin 1725 -> 1891 bytes
.../data/javaudf_p0/test_javaudf_map.out | Bin 279 -> 402 bytes
.../data/json_p0/test_json_load_and_function.out | Bin 261467 -> 261689 bytes
.../data/jsonb_p0/test_jsonb_any_aggregate.out | Bin 0 -> 539 bytes
.../data/load_p0/stream_load/large_test_file.csv | 5 +
.../data/load_p0/stream_load/test_stream_load.out | Bin 4860 -> 4857 bytes
.../stream_load/test_stream_load_move_memtable.out | Bin 4091 -> 4088 bytes
.../mtmv_p0/test_base_add_col_multi_level_mtmv.out | Bin 0 -> 403 bytes
...est_base_alter_col_comment_multi_level_mtmv.out | Bin 0 -> 443 bytes
.../test_base_alter_col_type_multi_level_mtmv.out | Bin 0 -> 452 bytes
.../mtmv_p0/test_base_comment_multi_level_mtmv.out | Bin 0 -> 403 bytes
.../test_base_drop_col_multi_level_mtmv.out | Bin 0 -> 428 bytes
.../mtmv_p0/test_base_drop_multi_level_mtmv.out | Bin 0 -> 400 bytes
.../mtmv_p0/test_base_recreate_on_commit_mtmv.out | Bin 0 -> 288 bytes
.../test_base_rename_col_multi_level_mtmv.out | Bin 0 -> 436 bytes
.../mtmv_p0/test_base_rename_multi_level_mtmv.out | Bin 0 -> 408 bytes
.../test_base_rename_mv_multi_level_mtmv.out | Bin 0 -> 421 bytes
.../mtmv_p0/test_base_rename_on_commit_mtmv.out | Bin 0 -> 445 bytes
.../test_base_rename_p_mv_multi_level_mtmv.out | Bin 0 -> 429 bytes
.../mtmv_p0/test_base_replace_multi_level_mtmv.out | Bin 0 -> 1075 bytes
.../test_base_replace_mv_multi_level_mtmv.out | Bin 0 -> 910 bytes
.../mtmv_p0/test_base_replace_on_commit_mtmv.out | Bin 0 -> 342 bytes
.../data/mtmv_p0/test_column_type_mtmv.out | Bin 0 -> 291 bytes
.../test_env_db_dropped_mtmv.out} | Bin 163 -> 127 bytes
.../mtmv_p0/test_excluded_trigger_table_mtmv.out | Bin 0 -> 333 bytes
.../testAggQuqeryOnAggMV6.out | Bin 217 -> 511 bytes
.../agg_function/test_corr_welford.out | Bin 0 -> 343 bytes
.../data/nereids_function_p0/scalar_function/D.out | Bin 34248 -> 34248 bytes
.../data/nereids_function_p0/scalar_function/H.out | Bin 17180 -> 17180 bytes
.../data/nereids_function_p0/scalar_function/M.out | Bin 41160 -> 41160 bytes
.../data/nereids_function_p0/scalar_function/S.out | Bin 53624 -> 53624 bytes
.../data/nereids_function_p0/scalar_function/W.out | Bin 23595 -> 23595 bytes
.../data/nereids_function_p0/scalar_function/Y.out | Bin 18467 -> 18467 bytes
.../compress_materialize/compress_materialize.out | Bin 2506 -> 2509 bytes
.../nereids_p0/ddl/test_truncate_table_nereids.out | Bin 0 -> 351 bytes
.../data/nereids_p0/hint/fix_leading.out | Bin 11579 -> 3721 bytes
.../nereids_p0/runtime_filter/runtime_filter.out | Bin 868 -> 742 bytes
.../nereids_p0/show/test_show_commands_nereids.out | Bin 917 -> 919 bytes
.../datetime_functions/test_date_function.out | Bin 10110 -> 10207 bytes
.../datetime_functions/test_date_function_v2.out | Bin 0 -> 430 bytes
.../spatial_functions/test_gis_function.out | Bin 6772 -> 7926 bytes
.../test_cte_subquery_many.out} | Bin 163 -> 117 bytes
.../extend_infer_equal_predicate.out | Bin 30317 -> 30195 bytes
.../infer_predicate/pull_up_predicate_literal.out | Bin 82024 -> 78088 bytes
.../infer_predicate/pull_up_predicate_set_op.out | Bin 19703 -> 19681 bytes
.../merge_percentile_to_array.out | Bin 723 -> 2204 bytes
.../mv/external_table/single_external_table.out | Bin 205 -> 487 bytes
.../null_aware_anti/null_aware_left_anti_join.out | Bin 0 -> 1128 bytes
.../data/nereids_rules_p0/pkfk/eliminate_inner.out | Bin 7333 -> 6965 bytes
.../data/nereids_syntax_p0/test_regexp_replace.out | Bin 266 -> 598 bytes
.../join/eliminate_const_join_condition.out | Bin 0 -> 2374 bytes
.../array_functions/test_array_functions.out | Bin 28028 -> 28355 bytes
.../datetime_functions/test_date_floor_ceil.out | Bin 748 -> 886 bytes
.../json_function/test_query_json_array.out | Bin 485 -> 1395 bytes
.../json_function/test_query_json_insert.out | Bin 423 -> 1785 bytes
.../json_function/test_query_json_replace.out | Bin 543 -> 1752 bytes
.../json_function/test_query_json_set.out | Bin 385 -> 1594 bytes
.../json_functions/test_json_function.out | Bin 1428 -> 1476 bytes
.../table_function/explode_json_array.out | Bin 6692 -> 6751 bytes
.../query_p0/test_partition_sort_hash_types.out | Bin 0 -> 2361 bytes
regression-test/data/variant_p0/cast.out | Bin 0 -> 247 bytes
.../data/workload_manager_p0/test_curd_wlg.out | Bin 3661 -> 3479 bytes
.../org/apache/doris/regression/Config.groovy | 34 +
.../doris/regression/action/ExplainAction.groovy | 65 +-
.../regression/action/StreamLoadAction.groovy | 20 +-
.../org/apache/doris/regression/suite/Suite.groovy | 53 +-
.../apache/doris/regression/suite/Syncer.groovy | 23 +
.../doris/regression/util/LoggerUtils.groovy | 32 +-
.../java/org/apache/doris/udf/ArrayListTest.java | 15 +-
.../main/java/org/apache/doris/udf/MapsiTest.java | 15 +-
regression-test/pipeline/cloud_p0/clean.sh | 2 +-
.../pipeline/cloud_p0/conf/fe_custom.conf | 3 +-
.../pipeline/cloud_p0/conf/ms_custom.conf | 1 +
regression-test/pipeline/cloud_p0/deploy.sh | 2 +
regression-test/pipeline/cloud_p0/run.sh | 2 +-
.../pipeline/cloud_p1/conf/fe_custom.conf | 1 -
.../pipeline/cloud_p1/conf/ms_custom.conf | 1 +
regression-test/pipeline/common/doris-utils.sh | 24 +-
.../pipeline/external/conf/regression-conf.groovy | 3 +
regression-test/pipeline/p0/conf/be.conf | 3 +
regression-test/pipeline/p0/conf/fe.conf | 2 +-
regression-test/pipeline/vault_p0/clean.sh | 2 +-
.../pipeline/vault_p0/conf/fe_custom.conf | 1 -
regression-test/pipeline/vault_p0/deploy.sh | 2 +
regression-test/pipeline/vault_p0/run.sh | 2 +-
.../account_p0/test_grant_priv_workload.groovy | 13 +
.../suites/account_p0/test_property_session.groovy | 4 +-
.../alter_p0/test_alter_column_comment.groovy | 105 +
.../alter_p2/test_alter_table_property.groovy | 9 +
.../auth_call/test_dml_stream_load_auth.groovy | 3 +-
.../suites/auth_call/test_show_backend_auth.groovy | 14 +-
.../auth_call/test_show_frontend_auth.groovy | 13 +-
.../suites/auth_p0/test_backends_auth.groovy | 8 +-
.../suites/auth_p0/test_catalogs_auth.groovy | 4 +-
.../suites/auth_p0/test_frontends_auth.groovy | 8 +-
.../auth_p0/test_frontends_disks_auth.groovy | 8 +-
.../test_master_slave_consistency_auth.groovy | 16 +-
.../suites/auth_p0/test_mtmv_auth.groovy | 4 +-
.../suites/auth_p0/test_partitions_auth.groovy | 4 +-
.../suites/auth_p0/test_query_tvf_auth.groovy | 4 +-
.../suites/auth_p0/test_select_count_auth.groovy | 6 +-
regression-test/suites/auth_up_down_p0/load.groovy | 18 +-
.../test_backup_restore_with_role.groovy | 97 +
.../aws_iam_role_p0/test_export_with_role.groovy | 117 ++
.../test_external_catalog_with_role.groovy | 86 +
.../aws_iam_role_p0/test_resource_with_role.groovy | 144 ++
.../aws_iam_role_p0/test_s3_load_with_role.groovy | 146 ++
.../aws_iam_role_p0/test_s3_vault_with_role.groovy | 73 +
.../test_select_into_outfile_with_role.groovy | 70 +
.../aws_iam_role_p0/test_tvf_with_role.groovy | 49 +
.../test_backup_restore_colocate.groovy | 4 +-
.../test_backup_restore_with_view.groovy | 2 +
.../suites/cast_p0/cast_to_datetime.groovy | 233 +++
regression-test/suites/cast_p0/cast_to_time.groovy | 122 ++
.../check_before_quit/check_before_quit.groovy | 27 +-
.../test_warm_up_same_table_multi_times.groovy | 268 +++
.../node_mgr/test_sql_mode_node_mgr.groovy | 12 +-
.../test_clean_stale_rs_index_file_cache.groovy | 1 -
.../test_fe_cached_partition_version.groovy | 160 ++
.../test_single_compaction_fault_injection.groovy | 26 +-
.../test_single_replica_compaction.groovy | 3 +-
.../test_time_series_compaction_policy.groovy | 30 +
.../agg_state/decimal_sum/test_decimal_sum.groovy | 22 +-
.../complex_types/test_load_with_functions.groovy | 81 +
.../decimalv3/test_decimalv3_overflow.groovy | 1 -
.../test_dict_load_and_get_hash_map.groovy | 249 +++
.../test_dict_load_and_get_ip_trie.groovy | 100 +
.../test_dict_nullable_key.groovy | 112 ++
.../dictionary_p0/test_create_drop_sync.groovy | 108 ++
.../suites/dictionary_p0/test_ddl.groovy | 318 ++++
.../suites/dictionary_p0/test_dict_get.groovy | 85 +
.../suites/dictionary_p0/test_dict_get_many.groovy | 63 +
.../dictionary_p0/test_dict_get_nullable.groovy | 93 +
.../test_dictionary_fe_failover.groovy | 157 ++
.../suites/dictionary_p0/test_refresh_dict.groovy | 256 +++
.../suites/dictionary_p0/test_trade_demo.groovy | 310 +++
.../suites/dictionary_p0/upgrade/load.groovy | 129 ++
.../upgrade/test_dictionary_restart.groovy | 37 +
.../doc/table-design/schema-change.md.groovy | 129 +-
.../export_p2/test_export_max_file_size.groovy | 24 +-
.../export/hive_read/orc/test_hive_read_orc.groovy | 2 +-
.../hive/ddl/test_hive_truncate_table.groovy | 87 +-
.../hive/test_hive_get_schema_from_table.groovy | 62 +
.../hive/test_hive_meta_cache.groovy | 235 +++
.../hive/test_hive_openx_json.groovy | 84 +
.../hive/test_hive_orc_predicate.groovy | 15 +
.../hive/test_hive_partition_values_tvf.groovy | 4 +-
.../hive/test_hive_star_qualifier.groovy | 2 +-
.../hive/test_hive_use_meta_cache.groovy | 24 +-
.../hive/test_special_orc_formats.groovy | 48 +
.../iceberg/iceberg_drop_rest_table.groovy | 8 +
...st_iceberg_schema_change_with_timetravel.groovy | 87 +
.../iceberg/test_iceberg_sys_table.groovy | 183 ++
.../iceberg/test_iceberg_time_travel.groovy | 24 +-
...ceberg_insert_overwrite_with_empty_table.groovy | 10 +-
.../iceberg/write/test_iceberg_write_insert.groovy | 23 +-
.../jdbc/test_oracle_jdbc_catalog.groovy | 64 +
.../jdbc/test_trino_clickhouse.groovy | 57 +
.../trino_connector/jdbc/test_trino_mysql.groovy | 64 +
.../trino_connector/jdbc/test_trino_oracle.groovy | 57 +
.../trino_connector/jdbc/test_trino_pg.groovy | 87 +
.../jdbc/test_trino_sqlserver.groovy | 57 +
.../tvf/test_hdfs_parquet_group4.groovy | 4 +-
.../tvf/test_hdfs_parquet_group5.groovy | 4 +-
.../tvf/test_hdfs_parquet_group6.groovy | 6 +-
.../hive/test_orc_merge_io_input_streams.groovy | 52 +
.../hudi/hudi_mtmv/test_hudi_mtmv.groovy | 256 +++
.../hudi_mtmv/test_hudi_olap_rewrite_mtmv.groovy | 108 ++
.../hudi/hudi_mtmv/test_hudi_rewrite_mtmv.groovy | 91 +
.../hudi/test_hudi_incremental.groovy | 1 -
.../hudi/test_hudi_schema_evolution.groovy | 1 -
.../hudi/test_hudi_snapshot.groovy | 1 -
.../hudi/test_hudi_timetravel.groovy | 1 -
.../iceberg/test_s3tables_write_insert.groovy | 2 +-
.../cloud/test_cloud_compaction_global_lock.groovy | 135 ++
.../test_cloud_mow_retry_txn_interleave.groovy | 153 ++
.../cloud/test_cloud_mow_sync_mv.groovy | 115 ++
.../test_sc_fail_release_delete_bitmap_lock.groovy | 136 ++
.../test_partial_update_publish_seq.groovy | 16 +-
.../suites/function_p0/test_agg_foreach.groovy | 66 +-
.../suites/function_p0/test_substring_index.groovy | 137 ++
.../test_substring_index_columns.groovy | 114 ++
.../function_p0/test_substring_index_simple.groovy | 89 +
.../test_ngram_bloomfilter_index_change.groovy | 286 +++
...nsert_group_commit_into_max_filter_ratio.groovy | 2 +-
.../mow_insert_with_partition_drop.groovy | 67 +
.../inverted_index_p0/test_array_index2.groovy | 160 ++
.../inverted_index_p0/test_expr_in_null.groovy | 68 +
.../test_dup_table_inverted_index.groovy | 1 -
.../suites/javaudf_p0/test_javaudf_array.groovy | 9 +
.../suites/javaudf_p0/test_javaudf_map.groovy | 25 +
.../json_p0/test_json_load_and_function.groovy | 20 +
.../jsonb_p0/test_jsonb_any_aggregate.groovy | 109 ++
.../suites/load_p0/broker_load/test_s3_load.groovy | 13 +-
.../suites/load_p0/copy_into/test_copy_into.groovy | 15 +-
..._routine_load_udf.csv => test_disable_load.csv} | 0
.../data/test_routine_load_progress.csv | 4 +
.../load_p0/routine_load/test_disable_load.groovy | 106 ++
.../load_p0/routine_load/test_routine_load.groovy | 18 +-
.../routine_load/test_routine_load_eof.groovy | 29 +-
.../routine_load/test_routine_load_progress.groovy | 130 ++
.../load_p0/stream_load/test_stream_load.groovy | 13 +-
.../test_stream_load_illegal_skip_lines.groovy | 62 +
.../test_stream_load_illegal_timeout.groovy | 61 +
.../test_stream_load_move_memtable.groovy | 7 +-
.../broker_load/test_s3_load_properties.groovy | 13 +-
.../load_p2/routine_load/test_routine_load.groovy | 14 +-
.../metrics_p0/test_delete_bitmap_metrics.groovy | 12 +-
.../test_base_add_col_multi_level_mtmv.groovy | 140 ++
..._base_alter_col_comment_multi_level_mtmv.groovy | 140 ++
...est_base_alter_col_type_multi_level_mtmv.groovy | 140 ++
.../test_base_comment_multi_level_mtmv.groovy | 139 ++
.../test_base_drop_col_multi_level_mtmv.groovy | 141 ++
.../mtmv_p0/test_base_drop_multi_level_mtmv.groovy | 152 ++
.../test_base_recreate_on_commit_mtmv.groovy | 86 +
.../test_base_rename_col_multi_level_mtmv.groovy | 140 ++
.../test_base_rename_multi_level_mtmv.groovy | 141 ++
.../test_base_rename_mv_multi_level_mtmv.groovy | 148 ++
.../mtmv_p0/test_base_rename_on_commit_mtmv.groovy | 105 +
.../test_base_rename_p_mv_multi_level_mtmv.groovy | 154 ++
.../test_base_replace_multi_level_mtmv.groovy | 180 ++
.../test_base_replace_mv_multi_level_mtmv.groovy | 194 ++
.../test_base_replace_on_commit_mtmv.groovy | 100 +
.../suites/mtmv_p0/test_column_type_mtmv.groovy | 61 +
.../suites/mtmv_p0/test_env_db_dropped_mtmv.groovy | 4 +
.../test_excluded_trigger_table_mtmv.groovy | 135 ++
.../suites/mtmv_p0/test_recreate_table_mtmv.groovy | 3 +
.../mv_p0/test_dup_mv_div/test_dup_mv_div.groovy | 14 +-
.../mv_p0/test_dup_mv_json/test_dup_mv_json.groovy | 24 +-
.../suites/mv_p0/test_tcu/test_tcu.groovy | 19 +-
.../testAggQuqeryOnAggMV6.groovy | 16 +-
.../nereids_function_p0/agg_function/agg.groovy | 28 +
.../agg_function/test_corr_welford.groovy | 92 +
.../compress_materialize.groovy | 4 +-
.../nereids_p0/cte/test_cte_filter_pushdown.groovy | 2 +
.../ddl/alter/test_alter_user_nereids.groovy | 25 +-
.../ddl/test_truncate_table_nereids.groovy | 192 ++
.../fold_constant_date_arithmatic.groovy | 1 -
.../fold_constant_string_arithmatic.groovy | 124 +-
.../nereids_p0/hbo/hbo_agg_stage_opt_test.groovy | 74 +
.../nereids_p0/hbo/hbo_cache_usability_test.groovy | 420 ++++
.../nereids_p0/hbo/hbo_data_maintain_test.groovy | 150 ++
.../nereids_p0/hbo/hbo_join_side_opt_test.groovy | 91 +
.../hbo/hbo_parameterization_test.groovy | 282 +++
.../suites/nereids_p0/hbo/hbo_rf_safe_test.groovy | 94 +
.../hbo/hbo_skew_shuffle_to_bc_test.groovy | 95 +
.../nereids_p0/hbo/hbo_slow_query_test.groovy | 74 +
.../show/test_nereids_show_global_functions.groovy | 43 +
.../show/test_nereids_show_grants.groovy | 23 +-
.../show/test_nereids_show_resources.groovy | 130 ++
.../datetime_functions/test_date_function.groovy | 4 +
.../test_date_function_v2.groovy | 31 +-
.../spatial_functions/test_gis_function.groovy | 61 +-
.../nereids_p0/test_cte_subquery_many.groovy | 756 ++++++++
.../cte/test_cte_filter_pushdown.groovy | 2 +-
.../test_datetimev2_precision_promotion.groovy | 53 +
.../eliminate_constant_gby_key.groovy | 26 +-
.../filter_push_down/push_filter_through.groovy | 2 +-
.../infer_predicate/infer_intersect_except.groovy | 2 +-
.../pull_up_predicate_literal.groovy | 2 +-
.../pull_up_predicate_set_op.groovy | 2 +-
.../merge_percentile_to_array.groovy | 21 +
.../agg_optimize_when_uniform.groovy | 10 +-
.../agg_with_roll_up/aggregate_with_roll_up.groovy | 1 +
.../aggregate_without_roll_up.groovy | 3 +-
.../mv/availability/grace_period.groovy | 2 +-
.../mv/dimension/dimension_1.groovy | 1 +
.../mv/dimension/dimension_2_full_join.groovy | 1 +
.../mv/dimension/dimension_2_inner_join.groovy | 1 +
.../mv/dimension/dimension_2_left_join.groovy | 1 +
.../mv/dimension/dimension_2_right_join.groovy | 1 +
.../dimension_2_join_agg.groovy | 2 +-
.../dimension_join_agg_negative.groovy | 2 +-
.../mv/external_table/single_external_table.groovy | 80 +
.../cross_join_list_str_increment_create.groovy | 2 +-
.../cross_join_range_date_increment_create.groovy | 2 +-
...cross_join_range_number_increment_create.groovy | 2 +-
.../full_join_list_str_increment_create.groovy | 2 +-
.../full_join_range_date_increment_create.groovy | 2 +-
.../full_join_range_number_increment_create.groovy | 2 +-
.../inner_join_list_str_increment_create.groovy | 2 +-
.../inner_join_range_date_increment_create.groovy | 2 +-
...inner_join_range_number_increment_create.groovy | 2 +-
...left_anti_join_list_str_increment_create.groovy | 2 +-
...ft_anti_join_range_date_increment_create.groovy | 2 +-
..._anti_join_range_number_increment_create.groovy | 2 +-
.../left_join_list_str_increment_create.groovy | 2 +-
.../left_join_range_date_increment_create.groovy | 2 +-
.../left_join_range_number_increment_create.groovy | 2 +-
...left_semi_join_list_str_increment_create.groovy | 2 +-
...ft_semi_join_range_date_increment_create.groovy | 2 +-
..._semi_join_range_number_increment_create.groovy | 2 +-
...ight_anti_join_list_str_increment_create.groovy | 2 +-
...ht_anti_join_range_date_increment_create.groovy | 2 +-
..._anti_join_range_number_increment_create.groovy | 2 +-
.../right_join_list_str_increment_create.groovy | 2 +-
.../right_join_range_date_increment_create.groovy | 2 +-
...right_join_range_number_increment_create.groovy | 2 +-
...ight_semi_join_list_str_increment_create.groovy | 2 +-
...ht_semi_join_range_date_increment_create.groovy | 2 +-
..._semi_join_range_number_increment_create.groovy | 2 +-
.../self_conn_list_str_increment_create.groovy | 2 +-
.../self_conn_range_date_increment_create.groovy | 2 +-
.../self_conn_range_number_increment_create.groovy | 2 +-
.../mv/join/dphyp_inner/inner_join_dphyp.groovy | 1 +
.../mv/join/dphyp_outer/outer_join_dphyp.groovy | 2 +
.../mv/join/inner/inner_join.groovy | 1 +
.../mv/join/left_outer/outer_join.groovy | 1 +
.../null_aware_left_anti_join.groovy | 668 +++++++
.../inner_join_infer_and_derive.groovy | 1 +
.../mv/nested/nested_materialized_view.groovy | 1 +
.../mv/partition_mv_rewrite.groovy | 2 +-
.../partition_curd_union_rewrite.groovy | 2 +-
.../test_binary_search_prune.groovy | 6 +-
.../predicate_infer/infer_predicate.groovy | 2 +-
.../nereids_rules_p0/set_preagg/set_preagg.groovy | 312 +++
.../nereids_syntax_p0/information_schema.groovy | 44 +-
.../suites/nereids_syntax_p0/join_condition.groovy | 36 +-
.../suites/nereids_syntax_p0/runtime_filter.groovy | 42 +-
.../nereids_syntax_p0/test_regexp_replace.groovy | 20 +
.../test_list_default_partition_show_create.groovy | 28 +-
.../test_path_gc_with_publish_version.groovy | 77 +
.../pipeline_p1/test_task_out_of_sync.groovy | 39 +
.../suites/prepared_stmt_p0/prepared_stmt.groovy | 1 +
.../join/eliminate_const_join_condition.groovy | 110 ++
.../limit/test_map_select_with_limit.groovy | 3 +-
.../array_functions/test_array_functions.groovy | 5 +-
.../datetime_functions/test_date_floor_ceil.groovy | 13 +-
.../json_function/test_query_json_array.groovy | 51 +
.../json_function/test_query_json_insert.groovy | 55 +
.../json_function/test_query_json_replace.groovy | 55 +
.../json_function/test_query_json_set.groovy | 55 +
.../json_functions/test_json_function.groovy | 5 +
.../table_function/explode_json_array.groovy | 29 +-
.../query_p0/system/test_query_sys_tables.groovy | 12 +-
.../query_p0/test_partition_sort_hash_types.groovy | 65 +
.../query_profile/test_execute_by_frontend.groovy | 2 +-
.../test_schema_change_with_group_commit.groovy | 112 ++
.../suites/statistics/analyze_stats.groovy | 3 +-
.../suites/statistics/test_analyze_mtmv.groovy | 2 +-
.../suites/statistics/test_analyze_mv.groovy | 73 +-
.../suites/statistics/test_drop_analyze_job.groovy | 2 +-
.../test_skip_agg_table_value_column.groovy | 228 +++
.../suites/statistics/test_utf_encoding.groovy | 54 +
.../suites/temp_table_p0/test_temp_table.groovy | 4 +-
.../test_temp_table_with_restart.groovy | 2 +-
.../partial_update/test_partial_update.groovy | 2 +-
.../test_mow_time_series_compaction.groovy | 81 +
.../load.groovy | 13 +-
regression-test/suites/variant_p0/cast.groovy | 60 +
.../vault_p0/create/test_create_vault.groovy | 67 +-
.../create/test_minio_storage_vault.groovy | 34 +-
.../workload_manager_p0/test_curd_wlg.groovy | 442 ++---
.../test_workload_sched_policy.groovy | 44 +-
run-be-ut.sh | 10 -
samples/load/shell/s3_load_demo.sh | 246 +++
samples/load/shell/s3_load_file_demo.sh | 270 +++
thirdparty/CHANGELOG.md | 4 +
thirdparty/download-thirdparty.sh | 15 +
.../patches/re2-2021-02-02-ignore-replace.patch | 63 +
2165 files changed, 92766 insertions(+), 41876 deletions(-)
delete mode 100644 be/src/exec/odbc_connector.cpp
delete mode 100644 be/src/exec/odbc_connector.h
delete mode 100644 be/src/gutil/arm_instruction_set_select.h
delete mode 100644 be/src/gutil/charmap.h
delete mode 100644 be/src/gutil/gscoped_ptr.h
delete mode 100644 be/src/gutil/hash/jenkins.cc
delete mode 100644 be/src/gutil/hash/jenkins.h
delete mode 100644 be/src/gutil/logging-inl.h
delete mode 100644 be/src/gutil/move.h
delete mode 100644 be/src/gutil/stl_util.h
delete mode 100644 be/src/gutil/strings/charset.cc
delete mode 100644 be/src/gutil/strings/charset.h
delete mode 100644 be/src/gutil/strings/escaping.cc
delete mode 100644 be/src/gutil/strings/escaping.h
delete mode 100644 be/src/gutil/strings/join.cc
delete mode 100644 be/src/gutil/strings/join.h
delete mode 100644 be/src/gutil/strings/memutil.cc
delete mode 100644 be/src/gutil/strings/memutil.h
delete mode 100644 be/src/gutil/strings/split.cc
delete mode 100644 be/src/gutil/strings/split.h
delete mode 100644 be/src/gutil/strings/split_internal.h
delete mode 100644 be/src/gutil/strings/strcat.cc
delete mode 100644 be/src/gutil/strings/strcat.h
delete mode 100644 be/src/gutil/strings/stringpiece.cc
delete mode 100644 be/src/gutil/strings/stringpiece.h
delete mode 100644 be/src/gutil/strings/strip.cc
delete mode 100644 be/src/gutil/strings/strip.h
delete mode 100644 be/src/gutil/strings/substitute.cc
delete mode 100644 be/src/gutil/strings/substitute.h
delete mode 100644 be/src/gutil/strings/util.cc
delete mode 100644 be/src/gutil/strings/util.h
delete mode 100644 be/src/gutil/utf/LICENSE
delete mode 100644 be/src/gutil/utf/rune.c
delete mode 100644 be/src/gutil/utf/utf.h
delete mode 100644 be/src/gutil/utf/utfdef.h
copy be/src/http/action/{shrink_mem_action.cpp => dictionary_status_action.cpp} (52%)
copy be/{test/testutil/mock/mock_workload_group_mgr.h => src/http/action/dictionary_status_action.h} (67%)
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query/phrase_query/exact_phrase_matcher.cpp
copy be/{test/testutil/mock/mock_workload_group_mgr.h => src/olap/rowset/segment_v2/inverted_index/query/phrase_query/exact_phrase_matcher.h} (62%)
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query/phrase_query/ordered_sloppy_phrase_matcher.cpp
copy be/src/{runtime/memory/heap_profiler.h => olap/rowset/segment_v2/inverted_index/query/phrase_query/ordered_sloppy_phrase_matcher.h} (56%)
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query/phrase_query/phrase_matcher.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query/phrase_query/phrase_positions.h
copy be/{test/testutil/mock/mock_thread_mem_tracker_mgr.h => src/olap/rowset/segment_v2/inverted_index/query/phrase_query/phrase_queue.h} (50%)
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query/phrase_query/sloppy_phrase_matcher.cpp
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/query/phrase_query/sloppy_phrase_matcher.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/docid_set_iterator.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/fixed_bit_set.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/linked_hash_map.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/mock_iterator.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/priority_queue.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/term_iterator.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/term_position_iterator.h
create mode 100644 be/src/olap/rowset/segment_v2/inverted_index/util/union_term_iterator.h
create mode 100644 be/src/pipeline/exec/dict_sink_operator.cpp
create mode 100644 be/src/pipeline/exec/dict_sink_operator.h
copy be/src/runtime/workload_management/{cpu_context.cpp => memory_context.cpp} (62%)
create mode 100644 be/src/runtime/workload_management/query_task_controller.cpp
create mode 100644 be/src/runtime/workload_management/query_task_controller.h
create mode 100644 be/src/runtime/workload_management/task_controller.cpp
delete mode 100644 be/src/util/interval_tree-inl.h
delete mode 100644 be/src/util/interval_tree.h
create mode 100644 be/src/vec/aggregate_functions/aggregate_function_array_agg.cpp
create mode 100644 be/src/vec/aggregate_functions/aggregate_function_array_agg.h
copy be/src/vec/aggregate_functions/{aggregate_function_corr.cpp => aggregate_function_corr.h} (53%)
delete mode 100644 be/src/vec/common/hash_table/hash_table_allocator.h
delete mode 100644 be/src/vec/common/string_utils/string_utils.cpp
rename be/src/vec/data_types/{data_type_time_v2.cpp => data_type_date_or_datetime_v2.cpp} (99%)
rename be/src/vec/data_types/{data_type_time_v2.h => data_type_date_or_datetime_v2.h} (93%)
delete mode 100644 be/src/vec/exec/scan/mysql_scanner.cpp
delete mode 100644 be/src/vec/exec/scan/mysql_scanner.h
create mode 100644 be/src/vec/functions/complex_dict_hash_map.h
create mode 100644 be/src/vec/functions/complex_hash_map_dictionary.cpp
create mode 100644 be/src/vec/functions/complex_hash_map_dictionary.h
create mode 100644 be/src/vec/functions/dictionary.cpp
create mode 100644 be/src/vec/functions/dictionary.h
create mode 100644 be/src/vec/functions/dictionary_factory.cpp
create mode 100644 be/src/vec/functions/dictionary_factory.h
create mode 100644 be/src/vec/functions/dictionary_util.h
create mode 100644 be/src/vec/functions/function_dict_get.cpp
create mode 100644 be/src/vec/functions/function_dict_get_many.cpp
create mode 100644 be/src/vec/functions/ip_address_dictionary.cpp
create mode 100644 be/src/vec/functions/ip_address_dictionary.h
delete mode 100644 be/src/vec/sink/writer/vodbc_table_writer.cpp
delete mode 100644 be/src/vec/sink/writer/vodbc_table_writer.h
create mode 100644 be/src/vec/utils/stringop_substring.h
create mode 100644 be/test/exprs/string_functions_test.cpp
create mode 100644 be/test/io/fs/s3_obj_storage_client_role_test.cpp
create mode 100644 be/test/io/fs/s3_obj_stroage_client_mock_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/query/phrase_query/exact_phrase_matcher_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/query/phrase_query/ordered_sloppy_phrase_matcher_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/query/phrase_query/phrase_matcher_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/query/phrase_query/phrase_positions_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/query/phrase_query/phrase_queue_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/query/phrase_query/sloppy_phrase_matcher_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/util/fixed_bit_set_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/util/linked_hash_map_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/util/mock_iterator_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/util/priority_queue_test.cpp
create mode 100644 be/test/olap/rowset/segment_v2/inverted_index/util/union_term_iterator_test.cpp
create mode 100644 be/test/pipeline/common/agg_utils_test.cpp
create mode 100644 be/test/pipeline/common/distinct_agg_utils_test.cpp
create mode 100644 be/test/pipeline/common/set_utils_test.cpp
create mode 100644 be/test/pipeline/operator/agg_operator_group_by_limit_opt_test.cpp
create mode 100644 be/test/pipeline/operator/streaming_agg_operator_test.cpp
create mode 100644 be/test/runtime/memory/memory_reclamation_test.cpp
copy be/test/runtime_filter/{runtime_filter_consumer_helper_test.cpp => runtime_filter_producer_helper_set_test.cpp} (53%)
copy be/test/testutil/mock/{mock_thread_mem_tracker_mgr.h => mock_query_task_controller.h} (54%)
delete mode 100644 be/test/util/interval_tree_test.cpp
create mode 100644 be/test/vec/aggregate_functions/agg_array_agg_test.cpp
create mode 100644 be/test/vec/aggregate_functions/agg_corr_test.cpp
create mode 100644 be/test/vec/columns/column_map_test.cpp
create mode 100644 be/test/vec/columns/column_struct_test.cpp
create mode 100644 be/test/vec/common/string_utils_test.cpp
create mode 100644 be/test/vec/exec/dictionary/dictionary_get_nullable_test.cpp
create mode 100644 be/test/vec/exec/dictionary/dictionary_ip_trie_test.cpp
create mode 100644 be/test/vec/exec/dictionary/dictionary_status_test.cpp
create mode 100644 be/test/vec/exec/dictionary/dictionary_util_test.cpp
create mode 100644 be/test/vec/exec/dictionary/dictionary_version_test.cpp
create mode 100644 be/test/vec/exec/sort/full_sort_test.cpp
create mode 100644 be/test/vec/exec/sort/heap_sorter_test.cpp
create mode 100644 be/test/vec/exec/sort/merge_sorter_state.cpp
create mode 100644 be/test/vec/exec/sort/partition_sorter_test.cpp
create mode 100644 be/test/vec/exec/sort/topn_sort_test.cpp
create mode 100644 be/test/vec/exprs/vexpr_evalute_inverted_index_test.cpp
create mode 100644 be/test/vec/function/cast/cast_test.h
create mode 100644 be/test/vec/function/cast/cast_to_boolean_test.cpp
create mode 100644 be/test/vec/function/cast/cast_to_date_test.cpp
create mode 100644 be/test/vec/function/cast/cast_to_datetime_test.cpp
create mode 100644 be/test/vec/function/cast/cast_to_time_test.cpp
create mode 100644 be/test/vec/function/function_complex_hash_map_dict_test.cpp
create mode 100644 be/test/vec/function/function_dict_get_many_test.cpp
create mode 100644 be/test/vec/function/function_dict_get_test.cpp
create mode 100644 be/test/vec/function/function_hash_map_dict_test.cpp
create mode 100644 be/test/vec/function/function_hash_map_dict_test.h
create mode 100644 be/test/vec/function/function_ip_dict_test.cpp
create mode 100644 be/test/vec/function/function_ip_dict_test.h
create mode 100644 be/test/vec/utils/stringop_substring_test.cpp
create mode 100644 common/cpp/aws_common.cpp
copy be/test/testutil/mock/mock_workload_group_mgr.h => common/cpp/aws_common.h (66%)
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/auxlib/json-serde-1.3.9.tar.gz
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/create_preinstalled_scripts/create_hive_orc_tables.hql
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/test_special_orc_formats/create_table.hql
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/test_special_orc_formats/data.tar.gz
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/test_special_orc_formats/data_gen_scripts/generate_data.py
copy docker/thirdparties/docker-compose/hive/scripts/data/multi_catalog/{hive_text_complex_type => test_special_orc_formats}/run.sh (100%)
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/openx_json/json_data_arrays_tb/1
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/openx_json/json_one_column_table/1
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/openx_json/json_table/1
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/openx_json/json_table/2
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/json/openx_json/scalar_to_array_tb/1
create mode 100644 docker/thirdparties/docker-compose/hive/scripts/preinstalled_data/orc/complex_data_orc/000000_0
create mode 100644 docker/thirdparties/docker-compose/iceberg/scripts/create_preinstalled_scripts/iceberg/run09.sql
create mode 100644 extension/beats/doris/common_test.go
create mode 100644 extension/logstash/.gitignore
delete mode 100644 fe/be-java-extensions/hudi-scanner/pom.xml
delete mode 100644 fe/be-java-extensions/hudi-scanner/src/main/java/org/apache/doris/hudi/HudiColumnValue.java
delete mode 100644 fe/be-java-extensions/hudi-scanner/src/main/java/org/apache/doris/hudi/HudiJniScanner.java
delete mode 100644 fe/be-java-extensions/hudi-scanner/src/main/java/org/apache/doris/hudi/Utils.java
delete mode 100644 fe/be-java-extensions/hudi-scanner/src/main/resources/package.xml
delete mode 100644 fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/BaseSplitReader.scala
delete mode 100644 fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/HoodieRecordIterator.scala
delete mode 100644 fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/MORIncrementalSplitReader.scala
delete mode 100644 fe/be-java-extensions/hudi-scanner/src/main/scala/org/apache/doris/hudi/MORSnapshotSplitReader.scala
create mode 100644 fe/fe-common/src/main/java/org/apache/doris/common/CatalogConfigFileUtils.java
create mode 100644 fe/fe-common/src/test/java/org/apache/doris/common/io/TextTest.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/main/java/org/apache/doris/alter/AlterUserOpType.java} (82%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HMSDlaTable.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HiveDlaTable.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/hive/HudiDlaTable.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/hive/IcebergDlaTable.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/hudi/HudiMvccSnapshot.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/hudi/HudiSchemaCacheKey.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/main/java/org/apache/doris/datasource/mvcc/EmptyMvccSnapshot.java} (82%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/ConnectionProperties.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/main/java/org/apache/doris/datasource/property/ConnectorProperty.java} (69%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/PropertyUtils.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/fileformat/AvroFileFormatProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/fileformat/CsvFileFormatProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/fileformat/FileFormatProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/fileformat/JsonFileFormatProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/fileformat/OrcFileFormatProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/fileformat/ParquetFileFormatProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/fileformat/WalFileFormatProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/metastore/AWSGlueProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/metastore/AliyunDLFProperties.java
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => datasource/property/metastore/DataProcProperties.java} (61%)
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => datasource/property/metastore/FileMetastoreProperties.java} (53%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/metastore/HMSProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/metastore/IcebergRestProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/metastore/MetastoreProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/AbstractS3CompatibleProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/AzureProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/COSProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/HdfsCompatibleProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/HdfsProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/HdfsPropertiesUtils.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/OBSProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/OSSHdfsProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/OSSProperties.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/main/java/org/apache/doris/datasource/property/storage/ObjectStorageProperties.java} (60%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/S3Properties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/S3PropertyUtils.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/property/storage/StorageProperties.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/systable/IcebergSnapshotsSysTable.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/systable/PartitionsSysTable.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/systable/SupportedSysTables.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/datasource/systable/SysTable.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/dictionary/Dictionary.java
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => dictionary/DictionaryDistribution.java} (57%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/dictionary/DictionaryManager.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/main/java/org/apache/doris/dictionary/LayoutType.java} (81%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/FileSystem.java
copy fe/fe-core/src/main/java/org/apache/doris/{nereids/trees/plans/distribute/worker/DistributedPlanWorkerManager.java => fsv2/FileSystemFactory.java} (57%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/PersistentFileSystem.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/StorageTypeMapper.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/obj/AzureObjStorage.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/obj/ObjStorage.java
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => fsv2/obj/RemoteObject.java} (50%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/obj/RemoteObjects.java
copy fe/fe-core/src/main/java/org/apache/doris/{fs => fsv2}/obj/S3ObjStorage.java (67%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/AzureFileSystem.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/BrokerFileSystem.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/ObjFileSystem.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/RemoteFSPhantomManager.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/RemoteFile.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/RemoteFileSystem.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/RemoteFileSystemPhantomReference.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/S3FileSystem.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/fsv2/remote/dfs/DFSFileSystem.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/main/java/org/apache/doris/fsv2/remote/dfs/JFSFileSystem.java} (69%)
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/main/java/org/apache/doris/fsv2/remote/dfs/OFSFileSystem.java} (70%)
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/main/java/org/apache/doris/fsv2/remote/dfs/OSSHdfsFileSystem.java} (70%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/analyzer/UnboundDictionarySink.java
copy fe/fe-core/src/main/java/org/apache/doris/{load/BrokerFileGroup.java => nereids/load/NereidsBrokerFileGroup.java} (76%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsBrokerLoadTask.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsCloudStreamLoadPlanner.java
copy fe/fe-core/src/main/java/org/apache/doris/{analysis/DataDescription.java => nereids/load/NereidsDataDescription.java} (82%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsFileGroupInfo.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsImportColumnDesc.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsLoadPlanInfoCollector.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsLoadScanProvider.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsLoadTaskInfo.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsLoadUtils.java
copy fe/fe-core/src/main/java/org/apache/doris/{load/loadv2/LoadingTaskPlanner.java => nereids/load/NereidsLoadingTaskPlanner.java} (52%)
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => nereids/load/NereidsParamCreateContext.java} (57%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsRoutineLoadTaskInfo.java
copy fe/fe-core/src/main/java/org/apache/doris/{planner/StreamLoadPlanner.java => nereids/load/NereidsStreamLoadPlanner.java} (59%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/load/NereidsStreamLoadTask.java
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => nereids/properties/DistributionSpecAllSingleton.java} (61%)
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => nereids/rules/analysis/EliminateLogicalPreAggOnHint.java} (51%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/implementation/LogicalDictionarySinkToPhysicalDictionarySink.java
delete mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/AdjustPreAggStatus.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/CollectPredicateOnScan.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/EliminateConstHashJoinCondition.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/rules/rewrite/SetPreAggStatus.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/stats/HboPlanInfoProvider.java
copy fe/fe-core/src/main/java/org/apache/doris/{spi/Split.java => nereids/stats/HboPlanStatisticsManager.java} (51%)
copy fe/fe-core/src/main/java/org/apache/doris/{spi/Split.java => nereids/stats/HboPlanStatisticsProvider.java} (55%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/stats/HboStatsCalculator.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/stats/HboUtils.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/stats/MemoryHboPlanStatisticsProvider.java
copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/{scalar/RegexpReplaceOne.java => agg/CorrWelford.java} (52%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DictGet.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/expressions/functions/scalar/DictGetMany.java
copy fe/fe-core/src/main/java/org/apache/doris/{mtmv/MTMVSnapshotIdSnapshot.java => nereids/trees/plans/PlanNodeAndHash.java} (56%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AdminCancelRepairTableCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AdminCopyTabletCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AdminRepairTableCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/AdminSetReplicaStatusCommand.java
copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{DropWorkloadGroupCommand.java => AlterUserCommand.java} (57%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/CleanQueryStatsCommand.java
copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{DropWorkloadGroupCommand.java => CopyIntoCommand.java} (51%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/CreateDictionaryCommand.java
copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{DropWorkloadGroupCommand.java => CreateResourceCommand.java} (53%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/CreateStageCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/DropDictionaryCommand.java
copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/{DropWorkloadGroupCommand.java => DropStageCommand.java} (56%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ExplainDictionaryCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowDictionariesCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/ShowResourcesCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/TruncateTableCommand.java
copy fe/fe-core/src/main/java/org/apache/doris/{analysis/AlterUserStmt.java => nereids/trees/plans/commands/info/AlterUserInfo.java} (57%)
copy fe/fe-core/src/main/java/org/apache/doris/{analysis/CopyFromParam.java => nereids/trees/plans/commands/info/CopyFromDesc.java} (70%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/CopyIntoInfo.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/CreateDictionaryInfo.java
copy fe/fe-core/src/main/java/org/apache/doris/{analysis/CreateResourceStmt.java => nereids/trees/plans/commands/info/CreateResourceInfo.java} (72%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/info/DictionaryColumnDefinition.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/DictionaryInsertExecutor.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/insert/InsertIntoDictionaryCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/CreateDataSyncJobCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/PauseDataSyncJobCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/PauseRoutineLoadCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/ResumeDataSyncJobCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/ResumeRoutineLoadCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/ShowCreateRoutineLoadCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/StopDataSyncJobCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/StopRoutineLoadCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/load/SyncJobName.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/commands/refresh/RefreshDictionaryCommand.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/distribute/worker/job/UnassignedAllBEJob.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/LogicalDictionarySink.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/LogicalLoadProject.java
copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/{GroupPlan.java => logical/LogicalPreAggOnHint.java} (51%)
copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/logical/{LogicalFilter.java => LogicalPreFilter.java} (77%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/physical/PhysicalDictionarySink.java
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => persist/CreateDictionaryPersistInfo.java} (55%)
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => persist/DictionaryDecreaseVersionInfo.java} (55%)
copy fe/fe-core/src/main/java/org/apache/doris/{resource/computegroup/CloudComputeGroup.java => persist/DictionaryIncreaseVersionInfo.java} (55%)
copy cloud/test/s3_accessor_mock_test.cpp => fe/fe-core/src/main/java/org/apache/doris/persist/DictionaryPersistInfo.java (54%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/persist/DropDictionaryPersistInfo.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/planner/DictionarySink.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/BindWgToComputeGroupThread.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/resource/workloadgroup/WorkloadGroupKey.java
copy fe/fe-core/src/main/java/org/apache/doris/{mtmv/MTMVSnapshotIdSnapshot.java => statistics/hbo/InputTableStatisticsInfo.java} (50%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/statistics/hbo/PlanStatistics.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/statistics/hbo/PlanStatisticsMatchStrategy.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/statistics/hbo/PlanStatisticsWithInputInfo.java
copy fe/fe-core/src/main/java/org/apache/doris/{mtmv/MTMVTimestampSnapshot.java => statistics/hbo/RecentRunsPlanStatistics.java} (51%)
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/statistics/hbo/RecentRunsPlanStatisticsEntry.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/statistics/hbo/ScanPlanStatistics.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/task/AgentBoundedBatchTask.java
copy fe/fe-core/src/test/java/org/apache/doris/analysis/{ShowBackendsStmtTest.java => ShowFrontendsStmtTest.java} (68%)
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/catalog/MetadataTableTest.java
delete mode 100644 fe/fe-core/src/test/java/org/apache/doris/catalog/OdbcCatalogResourceTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/cloud/catalog/CloudPartitionTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/iceberg/source/IcebergScanNodeTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/jdbc/source/JdbcScanNodeTest.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/test/java/org/apache/doris/datasource/property/fileformat/AvroFileFormatPropertiesTest.java} (59%)
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/fileformat/CsvFileFormatPropertiesTest.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/test/java/org/apache/doris/datasource/property/fileformat/FileFormatPropertiesTest.java} (67%)
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/fileformat/JsonFileFormatPropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/fileformat/OrcFileFormatPropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/fileformat/ParquetFileFormatPropertiesTest.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/test/java/org/apache/doris/datasource/property/fileformat/WalFileFormatPropertiesTest.java} (59%)
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/AWSGluePropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/AWSTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/AliyunDLFPropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/GlueCatalogTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/HMSIntegrationTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/metastore/HMSPropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/AzurePropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/COSPropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/HdfsPropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/HdfsPropertiesUtilsTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/OBSPropertyTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/OSSHdfsPropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/OSSPropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/S3PropertiesTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/property/storage/S3PropertyUtilsTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/datasource/systable/SysTableTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/mtmv/MTMVJobInfoTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/mtmv/MTMVPlanUtilTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/mysql/ConnectionExceedTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/expression/rules/ExpressionRewriteSqlTest.java
rename fe/fe-core/src/test/java/org/apache/doris/nereids/rules/{expression/rules/InPredicateExtractNonConstantTest.java => rewrite/EliminateConstHashJoinConditionTest.java} (50%)
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/rules/rewrite/RewriteSqlTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/expressions/literal/DoubleLiteralTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/AdminCancelRepairTableCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/AdminCopyTabletCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/AdminRepairTableCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/AdminSetReplicaStatusCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/AlterUserCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/CleanQueryStatsCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/CreateDataSyncJobCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/CreateResourceCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/CreateStageCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/PauseDataSyncJobCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/PauseRoutineLoadCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ResumeDataSyncJobCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ResumeRoutineLoadCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ShowBackendsCommandTest.java
copy fe/fe-core/src/test/java/org/apache/doris/nereids/trees/{expressions/literal/StringLikeLiteralTest.java => plans/commands/ShowCreateRoutineLoadCommandTest.java} (58%)
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ShowFrontendsCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ShowGlobalFunctionsCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ShowGrantsCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/ShowResourcesCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/StopDataSyncJobCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/StopRoutineLoadCommandTest.java
create mode 100644 fe/fe-core/src/test/java/org/apache/doris/nereids/trees/plans/commands/TruncateTableCommandTest.java
copy fe/{be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => fe-core/src/test/java/org/apache/doris/qe/StmtExecutorInternalQueryTest.java} (50%)
create mode 100644 fe/fe-core/src/test/resources/plugins/hadoop_conf/hadoop1/core-site.xml
create mode 100644 fe/fe-core/src/test/resources/plugins/hadoop_conf/hadoop1/hdfs-site.xml
create mode 100644 fe/fe-core/src/test/resources/plugins/hadoop_conf/osshdfs1/core-site.xml
create mode 100644 fe/fe-core/src/test/resources/plugins/hive-conf/hive1/hive-site.xml
create mode 100644 regression-test/data/alter_p0/test_alter_column_comment.out
create mode 100644 regression-test/data/cast_p0/cast_to_datetime.out
create mode 100644 regression-test/data/cast_p0/cast_to_time.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => datatype_p0/agg_state/decimal_sum/test_decimal_sum.out} (58%)
create mode 100644 regression-test/data/datatype_p0/complex_types/test.json
create mode 100644 regression-test/data/dictionary_p0/dictionary_load_and_get/test_dict_load_and_get_hash_map.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => dictionary_p0/dictionary_load_and_get/test_dict_load_and_get_ip_trie.out} (65%)
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => dictionary_p0/dictionary_load_and_get/test_dict_nullable_key.out} (58%)
create mode 100644 regression-test/data/dictionary_p0/test_ddl.out
create mode 100644 regression-test/data/dictionary_p0/test_dict_get_many.out
create mode 100644 regression-test/data/dictionary_p0/test_dict_get_nullable.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => dictionary_p0/test_dictionary_fe_failover.out} (55%)
create mode 100644 regression-test/data/dictionary_p0/test_refresh_dict.out
create mode 100644 regression-test/data/dictionary_p0/test_trade_demo.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => dictionary_p0/upgrade/test_dictionary_restart.out} (65%)
create mode 100644 regression-test/data/external_table_p0/hive/test_hive_get_schema_from_table.out
create mode 100644 regression-test/data/external_table_p0/hive/test_hive_meta_cache.out
create mode 100644 regression-test/data/external_table_p0/hive/test_hive_openx_json.out
create mode 100644 regression-test/data/external_table_p0/hive/test_special_orc_formats.out
create mode 100644 regression-test/data/external_table_p0/iceberg/test_iceberg_schema_change_with_timetravel.out
create mode 100644 regression-test/data/external_table_p0/iceberg/test_iceberg_sys_table.out
create mode 100644 regression-test/data/external_table_p0/trino_connector/jdbc/test_trino_clickhouse.out
create mode 100644 regression-test/data/external_table_p0/trino_connector/jdbc/test_trino_mysql.out
create mode 100644 regression-test/data/external_table_p0/trino_connector/jdbc/test_trino_oracle.out
create mode 100644 regression-test/data/external_table_p0/trino_connector/jdbc/test_trino_pg.out
create mode 100644 regression-test/data/external_table_p0/trino_connector/jdbc/test_trino_sqlserver.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => external_table_p2/hive/test_orc_merge_io_input_streams.out} (58%)
create mode 100644 regression-test/data/external_table_p2/hudi/hudi_mtmv/test_hudi_mtmv.out
create mode 100644 regression-test/data/external_table_p2/hudi/hudi_mtmv/test_hudi_olap_rewrite_mtmv.out
create mode 100644 regression-test/data/external_table_p2/hudi/hudi_mtmv/test_hudi_rewrite_mtmv.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => fault_injection_p0/cloud/test_cloud_mow_retry_txn_interleave.out} (50%)
create mode 100644 regression-test/data/fault_injection_p0/cloud/test_cloud_mow_sync_mv.out
create mode 100644 regression-test/data/function_p0/test_substring_index.out
create mode 100644 regression-test/data/function_p0/test_substring_index_columns.out
create mode 100644 regression-test/data/function_p0/test_substring_index_simple.out
create mode 100644 regression-test/data/index_p0/test_ngram_bloomfilter_index_change.out
create mode 100644 regression-test/data/inverted_index_p0/test_array_index2.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => inverted_index_p0/test_expr_in_null.out} (65%)
create mode 100644 regression-test/data/jsonb_p0/test_jsonb_any_aggregate.out
create mode 100644 regression-test/data/load_p0/stream_load/large_test_file.csv
create mode 100644 regression-test/data/mtmv_p0/test_base_add_col_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_alter_col_comment_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_alter_col_type_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_comment_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_drop_col_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_drop_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_recreate_on_commit_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_rename_col_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_rename_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_rename_mv_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_rename_on_commit_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_rename_p_mv_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_replace_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_replace_mv_multi_level_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_base_replace_on_commit_mtmv.out
create mode 100644 regression-test/data/mtmv_p0/test_column_type_mtmv.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => mtmv_p0/test_env_db_dropped_mtmv.out} (58%)
create mode 100644 regression-test/data/mtmv_p0/test_excluded_trigger_table_mtmv.out
create mode 100644 regression-test/data/nereids_function_p0/agg_function/test_corr_welford.out
create mode 100644 regression-test/data/nereids_p0/ddl/test_truncate_table_nereids.out
create mode 100644 regression-test/data/nereids_p0/sql_functions/datetime_functions/test_date_function_v2.out
copy regression-test/data/{compaction/test_single_compaction_fault_injection.out => nereids_p0/test_cte_subquery_many.out} (65%)
create mode 100644 regression-test/data/nereids_rules_p0/mv/join/null_aware_anti/null_aware_left_anti_join.out
create mode 100644 regression-test/data/query_p0/join/eliminate_const_join_condition.out
create mode 100644 regression-test/data/query_p0/test_partition_sort_hash_types.out
create mode 100644 regression-test/data/variant_p0/cast.out
copy fe/be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => regression-test/java-udf-src/src/main/java/org/apache/doris/udf/ArrayListTest.java (79%)
rename fe/be-java-extensions/hudi-scanner/src/test/java/org/apache/doris/hudi/HudiJniScannerTest.java => regression-test/java-udf-src/src/main/java/org/apache/doris/udf/MapsiTest.java (78%)
create mode 100644 regression-test/suites/alter_p0/test_alter_column_comment.groovy
create mode 100644 regression-test/suites/aws_iam_role_p0/test_backup_restore_with_role.groovy
create mode 100644 regression-test/suites/aws_iam_role_p0/test_export_with_role.groovy
create mode 100644 regression-test/suites/aws_iam_role_p0/test_external_catalog_with_role.groovy
create mode 100644 regression-test/suites/aws_iam_role_p0/test_resource_with_role.groovy
create mode 100644 regression-test/suites/aws_iam_role_p0/test_s3_load_with_role.groovy
create mode 100644 regression-test/suites/aws_iam_role_p0/test_s3_vault_with_role.groovy
create mode 100644 regression-test/suites/aws_iam_role_p0/test_select_into_outfile_with_role.groovy
create mode 100644 regression-test/suites/aws_iam_role_p0/test_tvf_with_role.groovy
create mode 100644 regression-test/suites/cast_p0/cast_to_datetime.groovy
create mode 100644 regression-test/suites/cast_p0/cast_to_time.groovy
create mode 100644 regression-test/suites/cloud_p0/cache/multi_cluster/warm_up/table/test_warm_up_same_table_multi_times.groovy
create mode 100644 regression-test/suites/cloud_p0/version/test_fe_cached_partition_version.groovy
copy be/src/runtime/workload_management/cpu_context.cpp => regression-test/suites/datatype_p0/agg_state/decimal_sum/test_decimal_sum.groovy (62%)
create mode 100644 regression-test/suites/datatype_p0/complex_types/test_load_with_functions.groovy
create mode 100644 regression-test/suites/dictionary_p0/dictionary_load_and_get/test_dict_load_and_get_hash_map.groovy
create mode 100644 regression-test/suites/dictionary_p0/dictionary_load_and_get/test_dict_load_and_get_ip_trie.groovy
create mode 100644 regression-test/suites/dictionary_p0/dictionary_load_and_get/test_dict_nullable_key.groovy
create mode 100644 regression-test/suites/dictionary_p0/test_create_drop_sync.groovy
create mode 100644 regression-test/suites/dictionary_p0/test_ddl.groovy
create mode 100644 regression-test/suites/dictionary_p0/test_dict_get.groovy
create mode 100644 regression-test/suites/dictionary_p0/test_dict_get_many.groovy
create mode 100644 regression-test/suites/dictionary_p0/test_dict_get_nullable.groovy
create mode 100644 regression-test/suites/dictionary_p0/test_dictionary_fe_failover.groovy
create mode 100644 regression-test/suites/dictionary_p0/test_refresh_dict.groovy
create mode 100644 regression-test/suites/dictionary_p0/test_trade_demo.groovy
create mode 100644 regression-test/suites/dictionary_p0/upgrade/load.groovy
create mode 100644 regression-test/suites/dictionary_p0/upgrade/test_dictionary_restart.groovy
create mode 100644 regression-test/suites/external_table_p0/hive/test_hive_get_schema_from_table.groovy
create mode 100644 regression-test/suites/external_table_p0/hive/test_hive_meta_cache.groovy
create mode 100644 regression-test/suites/external_table_p0/hive/test_hive_openx_json.groovy
create mode 100644 regression-test/suites/external_table_p0/hive/test_special_orc_formats.groovy
create mode 100644 regression-test/suites/external_table_p0/iceberg/test_iceberg_schema_change_with_timetravel.groovy
create mode 100644 regression-test/suites/external_table_p0/iceberg/test_iceberg_sys_table.groovy
create mode 100644 regression-test/suites/external_table_p0/trino_connector/jdbc/test_trino_clickhouse.groovy
create mode 100644 regression-test/suites/external_table_p0/trino_connector/jdbc/test_trino_mysql.groovy
create mode 100644 regression-test/suites/external_table_p0/trino_connector/jdbc/test_trino_oracle.groovy
create mode 100644 regression-test/suites/external_table_p0/trino_connector/jdbc/test_trino_pg.groovy
create mode 100644 regression-test/suites/external_table_p0/trino_connector/jdbc/test_trino_sqlserver.groovy
create mode 100644 regression-test/suites/external_table_p2/hive/test_orc_merge_io_input_streams.groovy
create mode 100644 regression-test/suites/external_table_p2/hudi/hudi_mtmv/test_hudi_mtmv.groovy
create mode 100644 regression-test/suites/external_table_p2/hudi/hudi_mtmv/test_hudi_olap_rewrite_mtmv.groovy
create mode 100644 regression-test/suites/external_table_p2/hudi/hudi_mtmv/test_hudi_rewrite_mtmv.groovy
create mode 100644 regression-test/suites/fault_injection_p0/cloud/test_cloud_compaction_global_lock.groovy
create mode 100644 regression-test/suites/fault_injection_p0/cloud/test_cloud_mow_retry_txn_interleave.groovy
create mode 100644 regression-test/suites/fault_injection_p0/cloud/test_cloud_mow_sync_mv.groovy
create mode 100644 regression-test/suites/fault_injection_p0/cloud/test_sc_fail_release_delete_bitmap_lock.groovy
create mode 100644 regression-test/suites/function_p0/test_substring_index.groovy
create mode 100644 regression-test/suites/function_p0/test_substring_index_columns.groovy
create mode 100644 regression-test/suites/function_p0/test_substring_index_simple.groovy
create mode 100644 regression-test/suites/index_p0/test_ngram_bloomfilter_index_change.groovy
create mode 100644 regression-test/suites/insert_p0/mow_insert_with_partition_drop.groovy
create mode 100644 regression-test/suites/inverted_index_p0/test_array_index2.groovy
create mode 100644 regression-test/suites/inverted_index_p0/test_expr_in_null.groovy
create mode 100644 regression-test/suites/jsonb_p0/test_jsonb_any_aggregate.groovy
copy regression-test/suites/load_p0/routine_load/data/{test_routine_load_udf.csv => test_disable_load.csv} (100%)
create mode 100644 regression-test/suites/load_p0/routine_load/data/test_routine_load_progress.csv
create mode 100644 regression-test/suites/load_p0/routine_load/test_disable_load.groovy
create mode 100644 regression-test/suites/load_p0/routine_load/test_routine_load_progress.groovy
create mode 100644 regression-test/suites/load_p0/stream_load/test_stream_load_illegal_skip_lines.groovy
create mode 100644 regression-test/suites/load_p0/stream_load/test_stream_load_illegal_timeout.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_add_col_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_alter_col_comment_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_alter_col_type_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_comment_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_drop_col_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_drop_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_recreate_on_commit_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_rename_col_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_rename_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_rename_mv_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_rename_on_commit_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_rename_p_mv_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_replace_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_replace_mv_multi_level_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_base_replace_on_commit_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_column_type_mtmv.groovy
create mode 100644 regression-test/suites/mtmv_p0/test_excluded_trigger_table_mtmv.groovy
create mode 100644 regression-test/suites/nereids_function_p0/agg_function/test_corr_welford.groovy
copy fe/fe-core/src/main/java/org/apache/doris/nereids/trees/plans/distribute/worker/DistributedPlanWorkerManager.java => regression-test/suites/nereids_p0/ddl/alter/test_alter_user_nereids.groovy (64%)
create mode 100644 regression-test/suites/nereids_p0/ddl/test_truncate_table_nereids.groovy
create mode 100644 regression-test/suites/nereids_p0/hbo/hbo_agg_stage_opt_test.groovy
create mode 100644 regression-test/suites/nereids_p0/hbo/hbo_cache_usability_test.groovy
create mode 100644 regression-test/suites/nereids_p0/hbo/hbo_data_maintain_test.groovy
create mode 100644 regression-test/suites/nereids_p0/hbo/hbo_join_side_opt_test.groovy
create mode 100644 regression-test/suites/nereids_p0/hbo/hbo_parameterization_test.groovy
create mode 100644 regression-test/suites/nereids_p0/hbo/hbo_rf_safe_test.groovy
create mode 100644 regression-test/suites/nereids_p0/hbo/hbo_skew_shuffle_to_bc_test.groovy
create mode 100644 regression-test/suites/nereids_p0/hbo/hbo_slow_query_test.groovy
create mode 100644 regression-test/suites/nereids_p0/show/test_nereids_show_global_functions.groovy
copy be/src/runtime/workload_management/cpu_context.cpp => regression-test/suites/nereids_p0/show/test_nereids_show_grants.groovy (61%)
create mode 100644 regression-test/suites/nereids_p0/show/test_nereids_show_resources.groovy
create mode 100644 regression-test/suites/nereids_p0/test_cte_subquery_many.groovy
create mode 100644 regression-test/suites/nereids_rules_p0/date_function_rewrite/test_datetimev2_precision_promotion.groovy
create mode 100644 regression-test/suites/nereids_rules_p0/mv/join/null_aware_anti/null_aware_left_anti_join.groovy
create mode 100644 regression-test/suites/nereids_rules_p0/set_preagg/set_preagg.groovy
copy be/src/runtime/workload_management/cpu_context.cpp => regression-test/suites/partition_p0/list_partition/test_list_default_partition_show_create.groovy (60%)
create mode 100644 regression-test/suites/path_gc_p0/test_path_gc_with_publish_version.groovy
create mode 100644 regression-test/suites/pipeline_p1/test_task_out_of_sync.groovy
create mode 100644 regression-test/suites/query_p0/join/eliminate_const_join_condition.groovy
create mode 100644 regression-test/suites/query_p0/test_partition_sort_hash_types.groovy
create mode 100644 regression-test/suites/schema_change_p0/test_schema_change_with_group_commit.groovy
create mode 100644 regression-test/suites/statistics/test_skip_agg_table_value_column.groovy
create mode 100644 regression-test/suites/statistics/test_utf_encoding.groovy
create mode 100644 regression-test/suites/unique_with_mow_p0/test_mow_time_series_compaction.groovy
create mode 100644 regression-test/suites/variant_p0/cast.groovy
create mode 100644 samples/load/shell/s3_load_demo.sh
create mode 100644 samples/load/shell/s3_load_file_demo.sh
create mode 100644 thirdparty/patches/re2-2021-02-02-ignore-replace.patch
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org