You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by kx...@apache.org on 2023/06/16 11:42:35 UTC
[doris] branch branch-2.0 updated (35816cdbd4 -> 6cde7bc8ad)
This is an automated email from the ASF dual-hosted git repository.
kxiao pushed a change to branch branch-2.0
in repository https://gitbox.apache.org/repos/asf/doris.git
discard 35816cdbd4 [test](regression) update some case in p2 (#20683) (#20882)
add 21bb7fea07 [minor](Nereids): convert if condition into a check (#20855)
add e4e4f11b14 [typo](docs) Optimize the JDBC Catalog document (#20861)
add f1af09ef87 [Enhancement](merge-on-write) parallel calculate delete bitmap when tablet has multi segments (#20706)
add b38417358b [chore](compile) Remove fs/benchmark/fs_benchmark_tool.cpp in IO_FILES (#20845)
add 6d4c16b497 [typo](doc) Fix formatting errors in CREATE-TABLE documents due to line indentation (#20839)
add 835a1e8af9 [typo](doc)delete document optimization (#20748)
add 71aba93e19 [typo](doc) spark connector add new param and a way to write bitmap and hll col (#20850)
add 9daa277b0d [typo](doc) Fix the description of the alter-table-partition document (#20800)
add 40050a46ca [fix](java-udf)Fix cannot download pentaho-aggdesigner-algorithm jar in java udf and format it (#20013)
add c3e6db827c [typo][docs] remove unuse config `mysql_service_nio_enabled` (#20862)
add 179b933ccc [test](regression) update some case in p2 (#20683)
add 420603317b [improve](match) Improve performance for match query without inverted index (#20815)
add 7f413f13c4 [fix](nereids)use "analyze table XXX with sync" in regression cases #20856
add db1da6b787 [Chore](pipeline) add some profile log when pipeline canceled (#20825)
add a52fc3eb33 [chore](workflow) Improve the cache hit ratio in BE UT (Clang) (#20871)
add 9d41edd9eb [Feature](binlog) Add binlog gc && Auth master_token (#20854)
add 05e5ebfdeb [typo][docs] Fix a parameter error (#20841)
add 1ec7f0e50a [fix](memory) memory management thread exits gracefully
add 722839e118 [Fix](multi-catalog) Fix hive transaction table regression test by adding hive-docker missing configurations. (#20832)
add b7a50a09fe [Opt](orc-reader) Optimize orc reader by dict filtering. (#20806)
add f80bf3c1bc [fix](compaction) fix time series compaction policy (#20837)
add 1a62c79970 [fix](replica) do not delete the only one replica (#20872)
add 731ce5802e [Test][Framework] add enableCacheData option for test framework (#20874)
add f741129ffe [Fix](regression-test) fix incorrect explain requirement when globally enable nereids (#20809)
add ccfd6f1d23 [fix](nereids) only setHasColocatePlanNode when currentFragment's data partition is not RANDOM (#20885)
add 97135a1cbb [Feature] (json)add json_contains function (#20824)
add c3b9e99350 [fix](regress-test)update config for disable_nested_complex_type (#20735)
add 5573858cb4 [Enhance](regression-test) use another db than test_query_db for nereids_p0 (#19467)
add 0bd9aecfcc [Fix](planner&Nereids) fold constant invalid yyyy-mm-31 to the last day of month incorrectly (#20685)
add e63739e729 [fix](nereids) add regression test for stats analyze and fix some bugs (#20865)
add 22aee21208 [fix](nereids)disable tpcds query59 plan shape check #20886
add 2e295a1ee9 [Enhancement](http) unify http auth config (#20864)
add 536bf56a35 [fix](planner) strip trailing zeros when cast string literal to decimal literal (#20743)
add baed26acc6 [fix](merge-on-write) fix publish timeout (#20891)
add 6cde7bc8ad [feature](Nereids) just reserve logical expression in memo after do dphyp (#20843)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (35816cdbd4)
\
N -- N -- N refs/heads/branch-2.0 (6cde7bc8ad)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
be/src/agent/agent_server.cpp | 9 +
be/src/agent/agent_server.h | 1 +
be/src/agent/task_worker_pool.cpp | 39 +
be/src/agent/task_worker_pool.h | 4 +
be/src/apache-orc | 2 +-
be/src/common/config.cpp | 4 +-
be/src/common/config.h | 4 +-
be/src/common/daemon.cpp | 12 +-
be/src/http/http_handler_with_auth.cpp | 2 +-
be/src/io/CMakeLists.txt | 1 +
be/src/olap/binlog.h | 8 +-
.../cumulative_compaction_time_series_policy.cpp | 2 +
be/src/olap/delta_writer.cpp | 8 +-
be/src/olap/olap_server.cpp | 5 +
be/src/olap/rowset/rowset_meta_manager.cpp | 1 +
.../rowset/segment_v2/inverted_index_reader.cpp | 6 +-
.../olap/rowset/segment_v2/inverted_index_reader.h | 3 +-
be/src/olap/rowset/segment_v2/segment_writer.cpp | 5 +-
be/src/olap/storage_engine.cpp | 144 +-
be/src/olap/storage_engine.h | 9 +-
be/src/olap/tablet.cpp | 379 ++--
be/src/olap/tablet.h | 15 +-
be/src/pipeline/exec/data_queue.cpp | 10 +-
be/src/pipeline/exec/empty_source_operator.h | 4 +
.../exec/multi_cast_data_stream_source.cpp | 4 +
.../pipeline/exec/multi_cast_data_stream_source.h | 2 +
be/src/pipeline/exec/operator.cpp | 2 +-
be/src/pipeline/exec/operator.h | 8 +
be/src/pipeline/pipeline_task.cpp | 24 +-
be/src/pipeline/pipeline_task.h | 1 +
be/src/service/point_query_executor.cpp | 3 +-
be/src/vec/exec/format/orc/vorc_reader.cpp | 698 ++++++-
be/src/vec/exec/format/orc/vorc_reader.h | 81 +-
.../format/table/transactional_hive_reader.cpp | 14 +-
.../exec/format/table/transactional_hive_reader.h | 5 +-
be/src/vec/exec/scan/vfile_scanner.cpp | 12 +-
be/src/vec/functions/function_json.cpp | 127 ++
be/src/vec/functions/match.cpp | 5 +-
be/test/http/http_auth_test.cpp | 6 +-
be/test/olap/tablet_test.cpp | 36 +-
conf/fe.conf | 1 -
docker/runtime/k8s/doris_follower.yml | 3 +-
.../docker-compose/hive/hadoop-hive.env.tpl.tpl | 2 +
docs/en/community/developer-guide/fe-idea-dev.md | 1 -
docs/en/docs/admin-manual/config/fe-config.md | 2 +-
docs/en/docs/ecosystem/spark-doris-connector.md | 153 +-
docs/en/docs/lakehouse/multi-catalog/jdbc.md | 774 +++----
.../join-optimization/runtime-filter.md | 2 +-
.../sql-functions/json-functions/json_contains.md | 69 +
.../Alter/ALTER-TABLE-PARTITION.md | 2 +-
.../Create/CREATE-TABLE.md | 533 ++---
.../zh-CN/community/developer-guide/fe-idea-dev.md | 1 -
docs/zh-CN/docs/ecosystem/spark-doris-connector.md | 141 +-
docs/zh-CN/docs/lakehouse/multi-catalog/jdbc.md | 727 ++++---
.../join-optimization/runtime-filter.md | 2 +-
.../sql-functions/json-functions/json_contains.md | 69 +
.../Alter/ALTER-TABLE-PARTITION.md | 2 +-
.../Create/CREATE-TABLE.md | 538 +++--
.../Manipulation/DELETE.md | 6 +-
env.sh | 1 +
.../main/java/org/apache/doris/common/Config.java | 5 +-
.../org/apache/doris/analysis/AnalyzeTblStmt.java | 9 +
.../org/apache/doris/analysis/DateLiteral.java | 27 +-
.../org/apache/doris/analysis/DropStatsStmt.java | 4 +-
.../org/apache/doris/analysis/StringLiteral.java | 2 +-
.../java/org/apache/doris/binlog/BinlogGcer.java | 179 ++
.../org/apache/doris/binlog/BinlogManager.java | 94 +-
.../org/apache/doris/binlog/BinlogTombstone.java | 103 +
.../java/org/apache/doris/binlog/DBBinlog.java | 204 +-
.../java/org/apache/doris/binlog/TableBinlog.java | 114 ++
.../java/org/apache/doris/binlog/UpsertRecord.java | 16 +-
.../main/java/org/apache/doris/catalog/Env.java | 12 +
.../doris/catalog/InternalSchemaInitializer.java | 6 +-
.../org/apache/doris/clone/TabletScheduler.java | 26 +-
.../org/apache/doris/journal/JournalEntity.java | 6 +
.../org/apache/doris/master/ReportHandler.java | 10 +-
.../org/apache/doris/nereids/StatementContext.java | 9 +
.../glue/translator/PhysicalPlanTranslator.java | 3 +-
.../jobs/cascades/OptimizeGroupExpressionJob.java | 7 +-
.../doris/nereids/jobs/executor/Optimizer.java | 30 +-
.../hypergraph/receiver/PlanReceiver.java | 7 +-
.../java/org/apache/doris/nereids/memo/Group.java | 9 +
.../apache/doris/nereids/memo/GroupExpression.java | 4 +
.../java/org/apache/doris/nereids/memo/Memo.java | 20 +-
.../org/apache/doris/nereids/rules/RuleSet.java | 2 +-
.../trees/expressions/literal/DateLiteral.java | 13 +-
.../trees/expressions/literal/DateTimeLiteral.java | 32 +-
.../org/apache/doris/persist/BinlogGcInfo.java | 67 +
.../java/org/apache/doris/persist/EditLog.java | 10 +
.../org/apache/doris/persist/OperationType.java | 2 +
.../apache/doris/service/FrontendServiceImpl.java | 38 +-
.../apache/doris/statistics/ColumnStatistic.java | 10 +-
.../apache/doris/statistics/StatisticsCleaner.java | 36 -
.../doris/statistics/util/InternalQueryResult.java | 5 +
.../java/org/apache/doris/task/AgentBatchTask.java | 10 +
.../java/org/apache/doris/task/BinlogGcTask.java | 46 +
gensrc/proto/olap_file.proto | 5 +-
gensrc/script/doris_builtins_functions.py | 1 +
gensrc/thrift/AgentService.thrift | 10 +
gensrc/thrift/FrontendService.thrift | 13 +
gensrc/thrift/Types.thrift | 3 +-
regression-test/data/nereids_p0/join/test_join.out | 1731 ----------------
.../data/nereids_p0/join/test_join_11.out | 301 +++
.../data/nereids_p0/join/test_join_12.out | 55 +
.../data/nereids_p0/join/test_join_13.out | 113 ++
.../join/{test_join.out => test_join_14.out} | 2103 --------------------
.../data/nereids_p0/join/test_join_15.out | 435 ++++
.../json_functions/test_json_function.out | 21 +
.../org/apache/doris/regression/Config.groovy | 24 +-
.../regression/action/StreamLoadAction.groovy | 2 +-
regression-test/pipeline/p0/conf/fe.conf | 1 -
regression-test/pipeline/p1/conf/fe.conf | 1 -
.../test_string_to_decimal.groovy} | 31 +-
.../suites/nereids_p0/aggregate/aggregate.groovy | 2 +-
.../nereids_p0/except/test_query_except.groovy | 6 +-
.../explain/test_pushdown_explain.groovy | 2 +-
.../group_concat/test_group_concat.groovy | 14 +-
.../grouping_sets/test_grouping_sets.groovy | 18 +-
.../nereids_p0/intersect/test_intersect.groovy | 4 +-
.../nereids_p0/join/bucket_shuffle_join.groovy | 6 +-
.../nereids_p0/join/test_bitmap_filter.groovy | 4 +-
.../suites/nereids_p0/join/test_join.groovy | 1007 +---------
.../suites/nereids_p0/join/test_join_11.groovy | 271 +++
.../suites/nereids_p0/join/test_join_12.groovy | 210 ++
.../suites/nereids_p0/join/test_join_13.groovy | 245 +++
.../suites/nereids_p0/join/test_join_14.groovy | 209 ++
.../suites/nereids_p0/join/test_join_15.groovy | 212 ++
.../suites/nereids_p0/keyword/order_group.groovy | 2 +-
.../suites/nereids_p0/keyword/test_keyword.groovy | 2 +-
regression-test/suites/nereids_p0/load.groovy | 9 +-
.../operator/test_arithmetic_operators.groovy | 2 +-
.../operator/test_logical_operators.groovy | 2 +-
.../test_aggregate_all_functions.groovy | 2 +-
.../test_approx_count_distinct.groovy | 4 +-
.../sql_functions/array_functions/sql/q03.sql | 2 +-
.../case_function/test_case_function.groovy | 2 +-
.../conditional_functions/test_coalesce.groovy | 2 +-
.../conditional_functions/test_nullif.groovy | 4 +-
.../conditional_functions/test_nvl.groovy | 2 +-
.../test_query_between.groovy | 2 +-
.../conditional_functions/test_query_in.groovy | 2 +-
.../conditional_functions/test_query_like.groovy | 2 +-
.../conditional_functions/test_query_limit.groovy | 2 +-
.../conditional_functions/test_query_where.groovy | 2 +-
.../datetime_functions/test_date_function.groovy | 11 +-
.../datetime_functions/test_dayofweek.groovy | 2 +-
.../encryption_digest/test_md5.groovy | 2 +-
.../string_functions/test_reverse.groovy | 2 +-
.../string_functions/test_split_part.groovy | 2 +-
.../test_string_function_regexp.groovy | 2 +-
.../sql_functions/test_arith_functions.groovy | 2 +-
.../sql_functions/window_functions/test_sum.groovy | 2 +-
.../window_functions/test_window_function.groovy | 2 +-
.../nereids_p0/subquery/test_subquery.groovy | 10 +-
.../suites/nereids_p0/system/test_query_sys.groovy | 6 +-
.../system/test_query_sys_data_type.groovy | 2 +-
.../nereids_p0/system/test_runtime_filter.groovy | 2 +-
.../suites/nereids_p0/union/test_union.groovy | 2 +-
.../suites/nereids_p0/with/test_with.groovy | 2 +-
.../suites/nereids_syntax_p0/join.groovy | 4 +-
.../shape/query59.groovy | 88 +-
.../datetime_functions/test_date_function.groovy | 19 +-
.../json_functions/test_json_function.groovy | 9 +
.../suites/statistics/analyze_stats.groovy | 323 +--
.../suites/statistics/manage_stats.groovy | 271 ---
regression-test/suites/statistics/test_ddl.groovy | 80 +
samples/doris-demo/java-udf-aes-demo/pom.xml | 6 +
.../org.apache.doris.java.udf.demo/AESDecrypt.java | 4 +-
.../org.apache.doris.java.udf.demo/AESEncrypt.java | 4 +-
.../org.apache.doris.java.udf.demo/AESUtil.java | 31 +-
samples/doris-demo/java-udf-demo/pom.xml | 6 +
.../src/main/java/org/apache/doris/udf/AddOne.java | 2 +-
.../java/org/apache/doris/udf/DateCaseTest.java | 9 +-
samples/doris-demo/pom.xml | 1 +
tools/single-node-cluster/multi-fe | 1 -
175 files changed, 6647 insertions(+), 7278 deletions(-)
create mode 100644 docs/en/docs/sql-manual/sql-functions/json-functions/json_contains.md
create mode 100644 docs/zh-CN/docs/sql-manual/sql-functions/json-functions/json_contains.md
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/binlog/BinlogGcer.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/binlog/BinlogTombstone.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/persist/BinlogGcInfo.java
create mode 100644 fe/fe-core/src/main/java/org/apache/doris/task/BinlogGcTask.java
create mode 100644 regression-test/data/nereids_p0/join/test_join_11.out
create mode 100644 regression-test/data/nereids_p0/join/test_join_12.out
create mode 100644 regression-test/data/nereids_p0/join/test_join_13.out
copy regression-test/data/nereids_p0/join/{test_join.out => test_join_14.out} (56%)
create mode 100644 regression-test/data/nereids_p0/join/test_join_15.out
copy regression-test/suites/{nereids_p0/sql_functions/string_functions/test_split_part.groovy => correctness_p0/test_string_to_decimal.groovy} (58%)
create mode 100644 regression-test/suites/nereids_p0/join/test_join_11.groovy
create mode 100644 regression-test/suites/nereids_p0/join/test_join_12.groovy
create mode 100644 regression-test/suites/nereids_p0/join/test_join_13.groovy
create mode 100644 regression-test/suites/nereids_p0/join/test_join_14.groovy
create mode 100644 regression-test/suites/nereids_p0/join/test_join_15.groovy
delete mode 100644 regression-test/suites/statistics/manage_stats.groovy
create mode 100644 regression-test/suites/statistics/test_ddl.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org