You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by ga...@apache.org on 2023/05/12 03:38:50 UTC

[incubator-seatunnel] branch dev updated: [Feature] Bump SeaTunnel version to 2.3.2-SNAPSHOT & Update release-note (#4537)

This is an automated email from the ASF dual-hosted git repository.

gaojun2048 pushed a commit to branch dev
in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git


The following commit(s) were added to refs/heads/dev by this push:
     new cd9e34b19 [Feature] Bump SeaTunnel version to 2.3.2-SNAPSHOT & Update release-note (#4537)
cd9e34b19 is described below

commit cd9e34b19e6eff3afbde14429fd6d99291201626
Author: Tyrantlucifer <Ty...@gmail.com>
AuthorDate: Fri May 12 11:38:44 2023 +0800

    [Feature] Bump SeaTunnel version to 2.3.2-SNAPSHOT & Update release-note (#4537)
---
 pom.xml         |   2 +-
 release-note.md | 194 +++++++++++++++++++++++++++++++-------------------------
 2 files changed, 107 insertions(+), 89 deletions(-)

diff --git a/pom.xml b/pom.xml
index 7ba5379c7..84b16a88d 100644
--- a/pom.xml
+++ b/pom.xml
@@ -55,7 +55,7 @@
 
     <properties>
         <!--todo The classification is too confusing, reclassify by type-->
-        <revision>2.3.1-SNAPSHOT</revision>
+        <revision>2.3.2-SNAPSHOT</revision>
         <seatunnel.config.shade.version>2.1.1</seatunnel.config.shade.version>
         <project.build.sourceEncoding>UTF-8</project.build.sourceEncoding>
         <java.version>1.8</java.version>
diff --git a/release-note.md b/release-note.md
index b45ec728d..abdc5ac14 100644
--- a/release-note.md
+++ b/release-note.md
@@ -1,92 +1,110 @@
-# Next-release
-
-## New Feature
-### Zeta Engine
-- [Script]Add support close engine instance shell
-- [Client]Add Zeta Client ShutdownHook To Cancel Job
-- [Script]Add a jvm.properties file to define the SeaTunnel Zeta JVM Options
-- [Script] Run the server through daemon #4161
-### Core
-- [Starter][Flink]Support transform-v2 for flink #3396
-- [Flink] Support flink 1.14.x #3963
-### Transformer
-- [Spark] Support transform-v2 for spark (#3409)
-- [ALL]Add FieldMapper Transform #3781
-- [ALL]Add SQL Transform #4148 
-### Connectors
-- [Elasticsearch] Support https protocol & compatible with opensearch
-- [Elasticsearch] Support DSL
-- [Hbase] Add hbase sink connector #4049
-- [Github] Add Github source connector #4155
-- [CDC] Support export debezium-json format to kafka #4339
-- [GoogleFirestore] Support Google Firestore sink #4304
-- [RocketMQ] Add RocketMQ source and sink connector #4007
-- [Jdbc] Add vertica connector #4303
-
-### Formats
-- [Canal]Support read canal format message #3950
-
-## Improves
+# next-release
+
+## Bug fix
+
 ### Core
-- [Starter][Spark] Push transform operation from Spark Driver to Executors #4502
-### Connectors
-- [CDC]Add mysql-cdc source factory #3791
-- [JDBC]Fix the problem that the exception cannot be thrown normally #3796
-- [JDBC]Remove unused options for jdbc source factory #3794
-- [JDBC]Add exactly-once for JDBC source connector #3750
-- [JDBC]Fix JDBC source xa transaction commit failure on pipeline restore #3809
-- [JDBC]Improve option check rule
-- [JDBC]Support SAP HANA. (#3017)
-- [MongoDB]Add source query capability #3697
-- [IoTDB]Unified schema parameter, update IoTDB source fields to schema #3823
-- [InfluxDB]Unifie InfluxDB source fields to schema #3897
-- [File]Fix file source connector option rule bug #3804
-- [File]Add lzo compression way
-- [Kafka]Fix Source failed to parse offset format #3810
-- [Kafka]Fix source the default value of commit_on_checkpoint #3831
-- [Kafka & RabbitMQ & StarRocks & ClickHouse]Change Connector Custom Config Prefix To Map #3719
-- [Common]The log outputs detailed exception stack information #3805
-- [API]Add parallelism and column projection interface #3829
-- [API]Add get source method to all source connector #3846
-- [Hive] Support read user-defined partitions #3842
-- [SelectDB Cloud] Support SelectDB Cloud Sink Connector #3958
-- [File] add file excel sink and source #4164
-- [Hive] Support read text table & Column projection #4105
-- [File] Support column projection #4105
-- [Github] Add github source connector #4155
-- [Jdbc] Add database field to sink config #4199
-- [Doris] Refactor some Doris Sink code as well as support 2pc and cdc #4235
-- [SelectDB Cloud] Refactor some SelectDB Cloud Sink code as well as support copy into batch and async flush and cdc #4312
-### Zeta Engine
-- [Chore] Remove unnecessary dependencies #3795
-- [Core] Improve job restart of all node down #3784
-- [Checkpoint] Cancel CheckpointCoordinator First Before Cancel Task #3838
-- [Storage] Remove seatunnel-api from engine storage. #3834
-- [Core] change queue to disruptor. #3847
-- [Improve] Statistics server job and system resource usage. #3982
-## Bug Fixes
-### Connectors
-- [ClickHouse File] Fix ClickhouseFile Committer Serializable Problems #3803
-- [ClickHouse] Fix clickhouse write cdc changelog update event #3951
-- [ClickHouse] Fix connector source snapshot state NPE #4027
-- [Kudu] Fix connector source snapshot state NPE #4027
-- [Maxcompute] Fix some data type parse fail #3894
-- [Doris] Fix content-length header already present #4277
-- [Iceberg] Fix iceberg source stream mode init error #4638
-
-### Zeta Engine
-- [Checkpoint] Fix Checkpoint Continue Trigger After Job CANCELED #3808
-- [Checkpoint] Add savepoint and restore with savepoint #3930
-- [Core]Fix Local Mode can't deserialize split (#3817)
-- [Metrics] Fix Metrics will lose when Job be canceled or restart. #3797 #3977
-- [Restapi] add get running job info by jobId. #4140
-
-### Documents
-- [Doc] seatunnel run with flink operator error #3998
-- [Doc] Correct `transform sql` config on fqa.md #4493
-
-## Test
+
+- [Core] [API] Fixed generic class loss for lists (#4421)
+- [Core] [API] Fix parse nested row data type key changed upper (#4459)
+ 
+### Connector-V2
+
+- [Json-format] [Canal-Json] Fix json deserialize NPE (#4195)
+- [Connector-V2] [Jdbc] Field aliases are not supported in the query of jdbc source. (#4210)
+- [Connector-V2] [Jdbc] Fix connection failure caused by connection timeout. (#4322)
+- [Connector-V2] [Jdbc] Set default value to false of JdbcOption: generate_sink_sql (#4471)
+- [Connector-V2] [Pulsar] Fix the bug that can't consume messages all the time. (#4125)
+- [Connector-V2] [Eleasticsearch] Document description error (#4390)
+- [Connector-V2] [Eleasticsearch] Source deserializer error and inappropriate (#4233)
+- [Connector-V2] [Kafka] Fix KafkaProducer resources have never been released. (#4302)
+- [Connector-V2] [Kafka] Fix the permission problem caused by client.id. (#4246)
+- [Connector-V2] [Kafka] Fix KafkaConsumerThread exit caused by commit offset error. (#4379)
+
+### Zeta(ST-Engine)
+
+- [Zeta] Fix LogicalDagGeneratorTest testcase (#4401)
+- [Zeta] Fix MultipleTableJobConfigParser parse only one transform (#4412)
+- [Zeta] Fix missing common plugin jars (#4448)
+- [Zeta] Fix handleCheckpointError be called while checkpoint already complete (#4442)
+- [Zeta] Fix job error message is not right bug (#4463)
+- [Zeta] Fix finding TaskGroup deployment node bug (#4449)
+- [Zeta] Fix the bug of conf (#4488)
+- [Zeta] Fix Connector load logic from zeta (#4510)
+- [Zeta] Fix conflict dependency of hadoop-hdfs (#4509)
+
 ### E2E
-- [SqlServer CDC] fix SqlServerCDC IT failure #3807
+
+- [E2E] [Kafka] Fix kafka e2e testcase (#4520)
 - [Container Version] Fix risk of unreproducible test cases #4591
 
+## Improve
+
+### Core
+
+- [Core] [Spark] Push transform operation from Spark Driver to Executors (#4503)
+- [Core] [Starter] Optimize code structure & remove redundant code (#4525)
+- [Core] [Translation] [Flink] Optimize code structure & remove redundant code (#4527)
+
+### Connector-V2
+
+- [Connector-V2] [CDC] Improve startup.mode/stop.mode options (#4360)
+- [Connector-V2] [CDC] Optimize jdbc fetch-size options (#4352)
+- [Connector-V2] [SQLServer] Fix sqlserver catalog (#4441)
+- [Connector-V2] [StarRocks] Improve StarRocks Serialize Error Message (#4458)
+- [Connector-V2] [Jdbc] add the log for sql and update some style (#4475)
+- [Connector-V2] [Jdbc] Fix the table name is not automatically obtained when multiple tables (#4514)
+- [Connector-V2] [S3 & Kafka] Delete unavailable S3 & Kafka Catalogs (#4477)
+
+### CI
+
+### Zeta(ST-Engine)
+
+- [Zeta] Support run the server through daemon mode (#4161)
+- [Zeta] Change ClassLoader To Improve the SDK compatibility of the client (#4447)
+- [Zeta] Client Support Async Submit Job (#4456)
+- [Zeta] Add more detailed log output. (#4446)
+- [Zeta] Improve seatunnel-cluster.sh (#4435)
+- [Zeta] Reduce CPU Cost When Task Not Ready (#4479)
+- [Zeta] Add parser log (#4485)
+- [Zeta] Remove redundant code (#4489)
+- [Zeta] Remove redundancy code in validateSQL (#4506)
+- [Zeta] Improve JobMetrics fetch performance (#4467)
+
+## Feature
+
+### Core
+
+- [Core] [API] Support convert strings as List<T> option (#4362)
+- [Core] [API] Add copy method to Catalog codes (#4414)
+- [Core] [API] Add options check before create source and sink and transform in FactoryUtil (#4424)
+- [Core] [Shade] Add guava shade module (#4358)
+
+### Connector-V2
+
+- [Connector-V2] [CDC] [SQLServer] Support multi-table read (#4377)
+- [Connector-V2] [Kafka] Kafka source supports data deserialization failure skipping (#4364)
+- [Connector-V2] [Jdbc] [TiDB] Add TiDB catalog (#4438)
+- [Connector-V2] [File] Add file excel sink and source (#4164)
+- [Transform-V2] Add UDF SPI and an example implement for SQL Transform plugin (#4392)
+- [Transform-V2] Support copy field list (#4404)
+- [Transform-V2] Add support CatalogTable for FieldMapperTransform (#4423)
+- [Transform-V2] Add CatalogTable support for ReplaceTransform (#4411)
+- [Transform-V2] Add Catalog support for FilterRowKindTransform (#4420)
+- [Transform-V2] Add support CatalogTable for FilterFieldTransform (#4422)
+
+### Zeta(ST-Engine)
+
+- [Zeta] Support for mixing Factory and Plugin SPI (#4359)
+- [Zeta] Add get running job info by jobId rest api (#4140)
+- [Zeta] Add REST API To Get System Monitoring Information (#4315)
+- [Transform V2 & Zeta] Make SplitTransform Support CatalogTable And CatalogTable Evolution (#4396)
+
+## Docs 
+
+- [Docs] Optimizes part of the Doris and SelectDB connector documentation (#4365)
+- [Docs] Fix docs code style (#4368)
+- [Docs] Update jdbc doc and kafka doc (#4380)
+- [Docs] Fix max_retries default value is 0. (#4383)
+- [Docs] Fix markdown syntax (#4426)
+- [Docs] Fix Kafka Doc Error Config Key "kafka." (#4427)
+- [Docs] Add Transform to Quick Start v2 (#4436)
\ No newline at end of file