You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by yi...@apache.org on 2023/05/18 11:19:21 UTC
[doris] branch master updated (ef0657c072 -> 481e9aebdb)
This is an automated email from the ASF dual-hosted git repository.
yiguolei pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from ef0657c072 [Bug](pipeline) RegressionTest failed release resouce cause DCHECK failed (#19783)
add 481e9aebdb [Refactor](spark load) remove parquet scanner (#19251)
No new revisions were added by this update.
Summary of changes:
be/src/exec/CMakeLists.txt | 3 -
be/src/exec/arrow/arrow_reader.cpp | 262 -------------
be/src/exec/arrow/arrow_reader.h | 144 -------
be/src/exec/arrow/parquet_reader.cpp | 211 ----------
be/src/exec/arrow/parquet_reader.h | 79 ----
be/src/exec/base_scanner.cpp | 429 ---------------------
be/src/exec/base_scanner.h | 152 --------
be/src/olap/push_handler.cpp | 360 +++++++++++++++--
be/src/olap/push_handler.h | 71 +++-
be/src/vec/CMakeLists.txt | 2 -
be/src/vec/exec/varrow_scanner.cpp | 343 ----------------
be/src/vec/exec/varrow_scanner.h | 109 ------
be/src/vec/exec/vparquet_scanner.cpp | 53 ---
be/src/vec/exec/vparquet_scanner.h | 59 ---
fe/pom.xml | 2 +-
.../data/load_p0/spark_load/all_types1.txt | 11 +
.../data/load_p0/spark_load/all_types2.txt | 11 +
.../data/load_p0/spark_load/test_spark_load.out | 37 ++
.../pipeline/p0/conf/regression-conf.groovy | 2 +-
.../load_p0/spark_load/test_spark_load.groovy | 149 +++++++
20 files changed, 598 insertions(+), 1891 deletions(-)
delete mode 100644 be/src/exec/arrow/arrow_reader.cpp
delete mode 100644 be/src/exec/arrow/arrow_reader.h
delete mode 100644 be/src/exec/arrow/parquet_reader.cpp
delete mode 100644 be/src/exec/arrow/parquet_reader.h
delete mode 100644 be/src/exec/base_scanner.cpp
delete mode 100644 be/src/exec/base_scanner.h
delete mode 100644 be/src/vec/exec/varrow_scanner.cpp
delete mode 100644 be/src/vec/exec/varrow_scanner.h
delete mode 100644 be/src/vec/exec/vparquet_scanner.cpp
delete mode 100644 be/src/vec/exec/vparquet_scanner.h
create mode 100644 regression-test/data/load_p0/spark_load/all_types1.txt
create mode 100644 regression-test/data/load_p0/spark_load/all_types2.txt
create mode 100644 regression-test/data/load_p0/spark_load/test_spark_load.out
create mode 100644 regression-test/suites/load_p0/spark_load/test_spark_load.groovy
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org