You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by fa...@apache.org on 2022/10/08 02:48:44 UTC
[incubator-seatunnel] branch dev updated (6016100f1 -> 8fd966394)
This is an automated email from the ASF dual-hosted git repository.
fanjia pushed a change to branch dev
in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git
from 6016100f1 [Improve][all] change Log to @Slf4j (#3001)
add 8fd966394 [Improve][Connector] Improve write parquet (#2943)
No new revisions were added by this update.
Summary of changes:
.../connector-file-base-hadoop/pom.xml | 6 +
.../connector-file/connector-file-base/pom.xml | 11 +
.../file/sink/writer/AbstractWriteStrategy.java | 9 +
.../file/sink/writer/ParquetWriteStrategy.java | 222 +++++++++++++++++----
.../file/source/reader/AbstractReadStrategy.java | 8 +-
.../file/source/reader/ParquetReadStrategy.java | 86 ++++----
.../connector-file/connector-file-ftp/pom.xml | 6 +
.../connector-file/connector-file-hadoop/pom.xml | 11 +
.../connector-file/connector-file-local/pom.xml | 7 +
.../connector-file/connector-file-oss/pom.xml | 12 +-
.../e2e/spark/v2/file/FakeSourceToFileIT.java | 14 ++
.../resources/file/fakesource_to_local_json.conf | 40 +++-
.../resources/file/fakesource_to_local_orc.conf | 22 +-
.../file/fakesource_to_local_parquet.conf | 47 +++--
.../resources/file/fakesource_to_local_text.conf | 2 +-
.../file/local_orc_source_to_console.conf | 2 +-
...e.conf => local_parquet_source_to_console.conf} | 4 +-
seatunnel-engine/seatunnel-engine-client/pom.xml | 5 +
seatunnel-engine/seatunnel-engine-server/pom.xml | 6 +-
19 files changed, 408 insertions(+), 112 deletions(-)
copy seatunnel-e2e/seatunnel-spark-connector-v2-e2e/connector-file-spark-e2e/src/test/resources/file/{local_orc_source_to_console.conf => local_parquet_source_to_console.conf} (97%)