You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by fa...@apache.org on 2022/09/20 10:20:43 UTC
[incubator-seatunnel] branch dev updated: [Fix] Fix hive source doc (#2804)
This is an automated email from the ASF dual-hosted git repository.
fanjia pushed a commit to branch dev
in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git
The following commit(s) were added to refs/heads/dev by this push:
new 6d9c71469 [Fix] Fix hive source doc (#2804)
6d9c71469 is described below
commit 6d9c71469f6ba9c256fb4dca3290c9ba6200a04c
Author: Eric <ga...@gmail.com>
AuthorDate: Tue Sep 20 18:20:37 2022 +0800
[Fix] Fix hive source doc (#2804)
* Fix hive source doc
* add key features in hive,local,hdfs,oss file source connector
---
docs/en/connector-v2/source/HdfsFile.md | 15 +++++++++------
docs/en/connector-v2/source/Hive.md | 10 ++++++++--
docs/en/connector-v2/source/LocalFile.md | 15 +++++++++------
docs/en/connector-v2/source/OssFile.md | 18 ++++++++++--------
4 files changed, 36 insertions(+), 22 deletions(-)
diff --git a/docs/en/connector-v2/source/HdfsFile.md b/docs/en/connector-v2/source/HdfsFile.md
index e6b3fc90c..e7c355d3a 100644
--- a/docs/en/connector-v2/source/HdfsFile.md
+++ b/docs/en/connector-v2/source/HdfsFile.md
@@ -10,16 +10,19 @@ Read data from hdfs file system.
- [x] [batch](../../concept/connector-v2-features.md)
- [ ] [stream](../../concept/connector-v2-features.md)
-- [ ] [exactly-once](../../concept/connector-v2-features.md)
+- [x] [exactly-once](../../concept/connector-v2-features.md)
+
+Read all the data in a split in a pollNext call. What splits are read will be saved in snapshot.
+
- [x] [schema projection](../../concept/connector-v2-features.md)
- [x] [parallelism](../../concept/connector-v2-features.md)
- [ ] [support user-defined split](../../concept/connector-v2-features.md)
- [x] file format
- - [x] text
- - [x] csv
- - [x] parquet
- - [x] orc
- - [x] json
+ - [x] text
+ - [x] csv
+ - [x] parquet
+ - [x] orc
+ - [x] json
## Options
diff --git a/docs/en/connector-v2/source/Hive.md b/docs/en/connector-v2/source/Hive.md
index dcc4030f5..86ebfb2eb 100644
--- a/docs/en/connector-v2/source/Hive.md
+++ b/docs/en/connector-v2/source/Hive.md
@@ -10,15 +10,21 @@ In order to use this connector, You must ensure your spark/flink cluster already
## Key features
+- [x] [batch](../../concept/connector-v2-features.md)
+- [ ] [stream](../../concept/connector-v2-features.md)
- [x] [exactly-once](../../concept/connector-v2-features.md)
-By default, we use 2PC commit to ensure `exactly-once`
+Read all the data in a split in a pollNext call. What splits are read will be saved in snapshot.
-- [ ] [schema projection](../../concept/connector-v2-features.md)
+- [x] [schema projection](../../concept/connector-v2-features.md)
+- [x] [parallelism](../../concept/connector-v2-features.md)
+- [ ] [support user-defined split](../../concept/connector-v2-features.md)
- [x] file format
- [x] text
+ - [x] csv
- [x] parquet
- [x] orc
+ - [x] json
## Options
diff --git a/docs/en/connector-v2/source/LocalFile.md b/docs/en/connector-v2/source/LocalFile.md
index 1067f2079..358e5afe9 100644
--- a/docs/en/connector-v2/source/LocalFile.md
+++ b/docs/en/connector-v2/source/LocalFile.md
@@ -10,16 +10,19 @@ Read data from local file system.
- [x] [batch](../../concept/connector-v2-features.md)
- [ ] [stream](../../concept/connector-v2-features.md)
-- [ ] [exactly-once](../../concept/connector-v2-features.md)
+- [x] [exactly-once](../../concept/connector-v2-features.md)
+
+Read all the data in a split in a pollNext call. What splits are read will be saved in snapshot.
+
- [x] [schema projection](../../concept/connector-v2-features.md)
- [x] [parallelism](../../concept/connector-v2-features.md)
- [ ] [support user-defined split](../../concept/connector-v2-features.md)
- [x] file format
- - [x] text
- - [x] csv
- - [x] parquet
- - [x] orc
- - [x] json
+ - [x] text
+ - [x] csv
+ - [x] parquet
+ - [x] orc
+ - [x] json
## Options
diff --git a/docs/en/connector-v2/source/OssFile.md b/docs/en/connector-v2/source/OssFile.md
index 7e296bed0..69a0a9163 100644
--- a/docs/en/connector-v2/source/OssFile.md
+++ b/docs/en/connector-v2/source/OssFile.md
@@ -13,17 +13,19 @@ Read data from aliyun oss file system.
- [x] [batch](../../concept/connector-v2-features.md)
- [ ] [stream](../../concept/connector-v2-features.md)
-- [ ] [exactly-once](../../concept/connector-v2-features.md)
-- [x] [schema projection](../../concept/connector-v2-features.md)
-- [x] file format
- - [x] text
- - [x] csv
- - [x] parquet
- - [x] orc
- - [x] json
+- [x] [exactly-once](../../concept/connector-v2-features.md)
+
+Read all the data in a split in a pollNext call. What splits are read will be saved in snapshot.
+- [x] [schema projection](../../concept/connector-v2-features.md)
- [x] [parallelism](../../concept/connector-v2-features.md)
- [ ] [support user-defined split](../../concept/connector-v2-features.md)
+- [x] file format
+ - [x] text
+ - [x] csv
+ - [x] parquet
+ - [x] orc
+ - [x] json
## Options