You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by mo...@apache.org on 2022/12/09 05:22:08 UTC
[doris] branch master updated (20f2abb3d4 -> 00f44257e2)
This is an automated email from the ASF dual-hosted git repository.
morningman pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/doris.git
from 20f2abb3d4 [vectorized](pipeline) support assert num rows operator (#14923)
add 00f44257e2 [feature-wip](file-reader) Merge hdfs reader to the new file reader (#14875)
No new revisions were added by this update.
Summary of changes:
be/src/io/CMakeLists.txt | 2 +
be/src/io/fs/file_system.h | 1 +
be/src/io/fs/hdfs_file_reader.cpp | 92 +++++++
.../fs/{local_file_reader.h => hdfs_file_reader.h} | 17 +-
be/src/io/fs/hdfs_file_system.cpp | 302 +++++++++++++++++++++
be/src/io/fs/hdfs_file_system.h | 128 +++++++++
be/src/io/fs/s3_file_reader.cpp | 2 +-
be/src/io/hdfs_file_reader.cpp | 4 +-
be/src/io/hdfs_file_reader.h | 38 ++-
be/src/io/hdfs_reader_writer.cpp | 1 -
be/src/io/hdfs_reader_writer.h | 8 +-
be/src/util/doris_metrics.cpp | 4 +
be/src/util/doris_metrics.h | 2 +
be/src/util/s3_util.cpp | 38 ++-
be/src/util/s3_util.h | 11 +-
be/src/vec/CMakeLists.txt | 5 +-
.../exec/format/file_reader/new_file_factory.cpp | 182 +++++++++++++
.../exec/format/file_reader/new_file_factory.h} | 46 +++-
.../file_reader/new_plain_text_line_reader.cpp} | 37 +--
.../file_reader/new_plain_text_line_reader.h} | 21 +-
20 files changed, 866 insertions(+), 75 deletions(-)
create mode 100644 be/src/io/fs/hdfs_file_reader.cpp
copy be/src/io/fs/{local_file_reader.h => hdfs_file_reader.h} (80%)
create mode 100644 be/src/io/fs/hdfs_file_system.cpp
create mode 100644 be/src/io/fs/hdfs_file_system.h
create mode 100644 be/src/vec/exec/format/file_reader/new_file_factory.cpp
copy be/src/{io/file_factory.h => vec/exec/format/file_reader/new_file_factory.h} (63%)
copy be/src/{exec/plain_text_line_reader.cpp => vec/exec/format/file_reader/new_plain_text_line_reader.cpp} (91%)
copy be/src/{exec/plain_text_line_reader.h => vec/exec/format/file_reader/new_plain_text_line_reader.h} (85%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org