[Doris Weekly] 2020-08-31 ~ 2020-09-06

[陈明雨 <mo...@163.com>]

1. Statistics




A total of 12 authors submitted 30 Commits. Thanks to the contributions of the following authors:




caoyang10, HaiBo Li, HappenLee, Lijia Liu, Mingyu Chen, xinghuayu007, xueyan.li, xy720, Yingchun Lai, Youngwb, ZhangYu0123, Zhengguo Yang




4 new features were added this week, 11 bugs were fixed, and 7 features were improved.




2. Main progress

2.1 New Features (Merged)




https://github.com/apache/incubator-doris/pull/4428

BE added tablet-level monitoring indicators, including the amount of scanned data and the number of rows, and the amount of written data and the number of rows. Help locate hot tablet.




https://github.com/apache/incubator-doris/pull/4330

Support SQL level and Partition level result Cache.




https://github.com/apache/incubator-doris/pull/4256

For tables of the UniqueKey model, the Sequence column can be specified when importing. Doris will judge the order of the data according to the value of the Sequence column to ensure the order of the data when it is imported.




https://github.com/apache/incubator-doris/pull/4504

Support to add Optimizer Hints of type SET_VAR in the Select statement to set session variables.




2.2 New Features (WIP)




https://github.com/apache/incubator-doris/pull/4430

Implementation of related functions of ODBC external table building statement.




2.3 Bug fix




https://github.com/apache/incubator-doris/pull/4486

Fix the problem that BE crashes when using Load Error Hub function when WITH_MYSQL compilation option is not added.




https://github.com/apache/incubator-doris/pull/4484

Fix the problem of error reporting when using @@sql_mode environment variable in SQL




https://github.com/apache/incubator-doris/pull/4491

Fix the problem of inconsistent splitting behavior in Spark Load and Broker Load that split the same column.




https://github.com/apache/incubator-doris/pull/4511

Fix the problem of BE downtime caused by querying the information_schema.columns table.




https://github.com/apache/incubator-doris/pull/4513

Fix some problems in the persistence of rowset metadata in historical versions.




https://github.com/apache/incubator-doris/pull/4495

Fix the problem that the str_do_date() function has inconsistent behavior on the FE side and the BE side.




https://github.com/apache/incubator-doris/pull/4526

Fix the issue of BE downtime caused by some historical data conversion when performing linked schema change.




https://github.com/apache/incubator-doris/pull/4528

Fix the problem that Spark Load stays in the ETL stage after FE restart.




https://github.com/apache/incubator-doris/pull/4531

Fixed an issue that caused unreadable data when the delete condition contained "\n".




https://github.com/apache/incubator-doris/pull/4536

Fix the problem that the Spark Load job in PENDING state cannot be cancelled.

https://github.com/apache/incubator-doris/pull/4536

Fix the problem of inconsistent behavior when splitting columns between Spark Load and other import methods.




2.4 Functional improvements




https://github.com/apache/incubator-doris/pull/4482

Optimize query execution plan: When the bucket column of the table is a subset of the GroupBy column in SQL, reduce the data shuffle step.




https://github.com/apache/incubator-doris/pull/4439

Optimize the checking process and error message of the rand() function in the query analysis stage.




https://github.com/apache/incubator-doris/pull/4497

When SQL execution specifies the execution mode of join (Join Hint), the Colocation Join function will be disabled by default.




https://github.com/apache/incubator-doris/pull/4429

Enhance the function of parse_url(), support lowercase, support parsing port.




https://github.com/apache/incubator-doris/pull/4440

Optimized the use of threads on the BE side.




https://github.com/apache/incubator-doris/pull/4514

Dynamic partition supports hour level.




https://github.com/apache/incubator-doris/pull/4533

HTTP interface on BE side supports gzip compression




3. List of main features under development




https://github.com/apache/incubator-doris/issues/4376

Support to access external tables through ODBC protocol.




https://github.com/apache/incubator-doris/issues/4308

Support the separation of the front-end UI and back-end structure of the FE module, providing a more powerful UI interface




https://github.com/apache/incubator-doris/issues/3926

Support large query order placement




https://github.com/apache/incubator-doris/issues/4283

Support Result Cache function







--

此致！Best Regards
陈明雨 Mingyu Chen

Email:
chenmingyu@apache.org