[Doris Weekly] 2020-09-07 ~ 2020-09-13

[陈明雨 <mo...@163.com>]

1. Statistics

A total of 14 authors submitted 25 Commits. Thanks to the contributions of the following authors:




Zhengguo Yang, HuangWei, zhaojintaozhao, ZhangYu0123, Mingyu Chen, EmmyMiao87, xy720, xueyan.li, xinghuayu007, wutiangan, wangbo, caiconghui, Lijia Liu, HappenLee




This week, modify the new code line 1890 and delete the code line 951.




2. Main progress

2.1 New Features (Merged)




https://github.com/apache/incubator-doris/pull/4425

Improve Batch delete function, improve and optimize the related compaction process.




https://github.com/apache/incubator-doris/pull/4580

The BE front-end page supports displaying all memtracker information.




2.2 New Features (WIP)

https://github.com/apache/incubator-doris/pull/4583

UI front and back end separation: add SpringBoot related dependencies




2.3 Bug fix

https://github.com/apache/incubator-doris/pull/4577

Fix the problem that the batch delete function does not work when using broker load.




https://github.com/apache/incubator-doris/pull/4547

Fix the problem that the parallel_gragment_exec_instance_num setting cannot be applied correctly by colocation join.




https://github.com/apache/incubator-doris/pull/4561

Fix the problem of incorrect handling of installation failure when installing the FE plug-in.




https://github.com/apache/incubator-doris/pull/4575

Fix the issue that the BE process may crash during the streaming import execution process.




https://github.com/apache/incubator-doris/pull/4585

Fix the problem that the Json parsing function handles empty strings incorrectly.




https://github.com/apache/incubator-doris/pull/4567

Fix the issue that show tablet statement may cause FE OOM.




https://github.com/apache/incubator-doris/pull/4570

Fix the problem that when a query plan fragment contains 3 or more leaf nodes, the incorrect planning of the aggregation node leads to the wrong data result.




https://github.com/apache/incubator-doris/pull/4590

Fix the problem that incorrect statistics of Boolean type selection degree cause query plan error.




https://github.com/apache/incubator-doris/pull/4587

Fix the problem that the created rollup is not further aggregated according to the specified key column in some cases.




2.4 Functional improvements

https://github.com/apache/incubator-doris/pull/4542

The performance_schema variable is added to be compatible with some mysql clients.




https://github.com/apache/incubator-doris/pull/4550

Increase the FE configuration item default_db_data_quota_bytes to support setting the default database-level data quota.




https://github.com/apache/incubator-doris/pull/4524

Spark Load supports decimal and largeint types, and supports aggregation operations of decimal, date, and datetime types.




https://github.com/apache/incubator-doris/pull/4553

Add the FE configuration item default_max_filter_ratio to support setting the default import data filtering threshold.




https://github.com/apache/incubator-doris/pull/4591

Support converting integer values of type yyyyMMdd into date types in the filter conditions to speed up the query.




3. List of main features under development




https://github.com/apache/incubator-doris/pull/3025

The storage layer supports the Array data type.




https://github.com/apache/incubator-doris/issues/4376

Support to access external tables through ODBC protocol.




https://github.com/apache/incubator-doris/issues/4308

Support the separation of the front-end UI and back-end structure of the FE module, providing a more powerful UI interface




https://github.com/apache/incubator-doris/issues/3926

Support large query spill to disk



--

此致！Best Regards
陈明雨 Mingyu Chen

Email:
chenmingyu@apache.org