You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by fa...@apache.org on 2024/07/25 02:30:00 UTC

(seatunnel) branch 2.3.6-release updated (b42aa79c78 -> 85134cdfca)

This is an automated email from the ASF dual-hosted git repository.

fanjia pushed a change to branch 2.3.6-release
in repository https://gitbox.apache.org/repos/asf/seatunnel.git


 discard b42aa79c78 [Release][2.3.6][release-note] Add release-note
     add 0d08b20061 [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc (#7248)
     add 876d2f08d2 [Fix][Dist] Remove aws jar dependency in release package (#7257)
     new 85134cdfca [Release][2.3.6][release-note] Add release-note

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (b42aa79c78)
            \
             N -- N -- N   refs/heads/2.3.6-release (85134cdfca)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 docs/en/connector-v2/source/Jdbc.md                | 198 ++++++---------------
 docs/en/connector-v2/source/Oracle-CDC.md          |  40 +++++
 release-note.md                                    |   2 +
 .../cdc/oracle/config/OracleSourceConfig.java      |   9 +
 .../oracle/config/OracleSourceConfigFactory.java   |  16 ++
 .../cdc/oracle/source/OracleIncrementalSource.java |   2 +
 .../source/OracleIncrementalSourceFactory.java     |   2 +
 .../cdc/oracle/source/OracleSourceOptions.java     |  12 ++
 .../source/eumerator/OracleChunkSplitter.java      |   6 +-
 .../seatunnel/cdc/oracle/utils/OracleUtils.java    |  55 +++---
 .../seatunnel/jdbc/config/JdbcSourceOptions.java   |  12 ++
 .../jdbc/config/JdbcSourceTableConfig.java         |   8 +
 .../internal/dialect/oracle/OracleDialect.java     |  39 ++--
 .../seatunnel/jdbc/source/JdbcSourceFactory.java   |   4 +
 .../seatunnel/jdbc/source/JdbcSourceTable.java     |   2 +
 .../seatunnel/jdbc/utils/JdbcCatalogUtils.java     |   2 +
 seatunnel-dist/pom.xml                             |   8 +-
 .../seatunnel/cdc/oracle/OracleCDCIT.java          |  31 +++-
 ...dc_to_console.conf => oraclecdc_to_oracle.conf} |   0
 ...conf => oraclecdc_to_oracle_skip_analysis.conf} |   3 +-
 ...f => oraclecdc_to_oracle_use_select_count.conf} |   3 +-
 .../connectors/seatunnel/jdbc/JdbcOracleIT.java    |  28 ++-
 ...=> jdbc_oracle_source_to_sink_use_select1.conf} |   1 +
 ...=> jdbc_oracle_source_to_sink_use_select2.conf} |   3 +-
 ...=> jdbc_oracle_source_to_sink_use_select3.conf} |   4 +-
 25 files changed, 300 insertions(+), 190 deletions(-)
 copy seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-oracle-e2e/src/test/resources/{oraclecdc_to_console.conf => oraclecdc_to_oracle.conf} (100%)
 copy seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-oracle-e2e/src/test/resources/{oraclecdc_to_console.conf => oraclecdc_to_oracle_skip_analysis.conf} (98%)
 rename seatunnel-e2e/seatunnel-connector-v2-e2e/connector-cdc-oracle-e2e/src/test/resources/{oraclecdc_to_console.conf => oraclecdc_to_oracle_use_select_count.conf} (98%)
 copy seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-1/src/test/resources/{jdbc_oracle_source_to_sink.conf => jdbc_oracle_source_to_sink_use_select1.conf} (98%)
 copy seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-1/src/test/resources/{jdbc_oracle_source_to_sink.conf => jdbc_oracle_source_to_sink_use_select2.conf} (89%)
 copy seatunnel-e2e/seatunnel-connector-v2-e2e/connector-jdbc-e2e/connector-jdbc-e2e-part-1/src/test/resources/{jdbc_oracle_source_to_sink.conf => jdbc_oracle_source_to_sink_use_select3.conf} (89%)


(seatunnel) 01/01: [Release][2.3.6][release-note] Add release-note

Posted by fa...@apache.org.
This is an automated email from the ASF dual-hosted git repository.

fanjia pushed a commit to branch 2.3.6-release
in repository https://gitbox.apache.org/repos/asf/seatunnel.git

commit 85134cdfcab92987e19d3b5590c7bc639616a4cc
Author: Jia Fan <fa...@qq.com>
AuthorDate: Thu Jul 25 10:29:46 2024 +0800

    [Release][2.3.6][release-note] Add release-note
---
 release-note.md | 426 +++++++++++++++++++++++++++++---------------------------
 1 file changed, 219 insertions(+), 207 deletions(-)

diff --git a/release-note.md b/release-note.md
index 32067c22df..423a5a22cb 100644
--- a/release-note.md
+++ b/release-note.md
@@ -1,233 +1,245 @@
-# next-release
+# 2.3.6 Release Note
 
 ## Bug fix
 
 ### Core
-- [Core] [API] Fixed generic class loss for lists (#4421)
-- [Core] [API] Fix parse nested row data type key changed upper (#4459)
-- [Starter][Flink]Support transform-v2 for flink #3396
-- [Flink] Support flink 1.14.x #3963
-- [Core][Translation][Spark] Fix SeaTunnelRowConvertor fail to convert when schema contains row type (#5170)
+- [Fix][Flink]Hotfix flink checkpoint default value (#7040)
+- [Hotfix][Core] Fix the NullPointException for the json config of the job without pluginname (#6815)
+- [Fix][Dist] Remove aws jar dependency in release package (#7257)
 
-### Transformer
-- [Spark] Support transform-v2 for spark (#3409)
-- [ALL]Add FieldMapper Transform #3781
-- [All]Add JsonPath Transform #5633
 ### Connectors
-- [Elasticsearch] Support https protocol & compatible with opensearch
-- [Hbase] Add hbase sink connector #4049
-- [Clickhouse] Fix clickhouse old version compatibility #5326
-- [Easysearch] Support INFINI Easysearch #5933
-- [Web3j] add Web3j source connector #6598
-### Formats
-- [Canal]Support read canal format message #3950
-- [Debezium]Support debezium canal format message #3981
-
-### Connector-V2
-
-- [Json-format] [Canal-Json] Fix json deserialize NPE (#4195)
-- [Connector-V2] [Jdbc] Field aliases are not supported in the query of jdbc source. (#4210)
-- [Connector-V2] [Jdbc] Fix connection failure caused by connection timeout. (#4322)
-- [Connector-V2] [Jdbc] Set default value to false of JdbcOption: generate_sink_sql (#4471)
-- [Connector-V2] [JDBC] Fix TiDBCatalog without open (#4718)
-- [Connector-V2] [Jdbc] Fix XA DataSource crash(Oracle/Dameng/SqlServer) (#4866)
-- [Connector-V2] [Pulsar] Fix the bug that can't consume messages all the time. (#4125)
-- [Connector-V2] [Eleasticsearch] Document description error (#4390)
-- [Connector-V2] [Eleasticsearch] Source deserializer error and inappropriate (#4233)
-- [Connector-V2] [Kafka] Fix KafkaProducer resources have never been released. (#4302)
-- [Connector-V2] [Kafka] Fix the permission problem caused by client.id. (#4246)
-- [Connector-V2] [Kafka] Fix KafkaConsumerThread exit caused by commit offset error. (#4379)
-- [Connector-V2] [Mongodb] Mongodb support cdc sink. (#4833)
-- [Connector-V2] [kafka] Fix the problem that the partition information can not be obtained when kafka is restored (#4764)
-- [Connector-V2] [SFTP] Fix incorrect exception handling logic (#4720)
-- [Connector-V2] [File] Fix read temp file (#4876)
-- [Connector-V2] [CDC Base] Solving the ConcurrentModificationException caused by snapshotState being modified concurrently. (#4877)
-- [Connector-V2] [Doris] update last checkpoint id when doing snapshot (#4881)
-- [Connector-v2] [kafka] Fix the short interval of pull data settings and revise the format (#4875)
-- [Connector-v2] [RabbitMQ] Fix reduplicate ack msg bug and code style (#4842)
-- [Connector-V2] [Jdbc] Fix the error of extracting primary key column in sink (#4815)
-- [Connector-V2] [Jdbc] Fix reconnect throw close statement exception (#4801)
-- [Connector-V2] [Jdbc] Fix sqlserver system table case sensitivity (#4806)
-- [Connector-v2] [File] Fix configuration file format and error comments (#4762)
-- [Connector-v2] [Jdbc] Fix oracle sql table identifier (#4754)
-- [Connector-v2] [Clickhouse] fix get clickhouse local table name with closing bracket from distributed table engineFull (#4710)
-- [Connector-v2] [CDC] Fix jdbc connection leak for mysql (#5037)
-- [Connector-v2] [File] Fix WriteStrategy parallel writing thread unsafe issue #5546
-- [Connector-v2] [File] Inject FileSystem to OrcWriteStrategy
-- [Connector-v2] [File] Support assign encoding for file source/sink (#5973)
-- [Connector-v2] [Mongodb] Support to convert to double from numeric type that mongodb saved it as numeric internally (#6997)
-- [Connector-v2] [Redis] Using scan replace keys operation command,support batchWrite in single mode(#7030,#7085)
-- [Connector-V2] [Clickhouse] Add a new optional configuration `clickhouse.config` to the source connector of ClickHouse (#7143)
+- [Fix][Connector-V2] The isNullable attribute is true when the primary key field in the Paimon table converts the Column object. #7231 (#7242)
+- [Fix][Connector kafka]Fix Kafka consumer stop fetching after TM node restarted (#7233)
+- [Fix] Fix Hana type converter decimal scale is 0 convert to int error (#7167)
+- [BugFix][Connector-V2][Maxcompute]fix:Maxcompute sink can't map field(#7164) (#7168)
+- [Fix][Connector-V2] Fix kafka batch mode can not read all message (#7135)
+- [Fix][Connector-V2][Elasticsearch]Fix sink configuration for DROP_DATA (#7124)
+- [Fix][Connector-V2][CDC] SeaTunnelRowDebeziumDeserializationConverters NPE (#7119)
+- [Hotfix][Connector-V2] fix rabbit checkpoint exception in Flink mode (#7108)
+- [Fix][Connector-V2] Fix starrocks Content-Length header already present error (#7034)
+- [Hotfix][MySQL-CDC] Fix read gbk varchar chinese garbled characters (#7046)
+- [Hotfix][Hive Connector] Fix Hive hdfs-site.xml and hive-site.xml not be load error (#7069)
+- [Fix] hive load hive_site_path and hdfs_site_path too late (#7017)
+- [Fix] fix pgsql create table comment special string bug (#7022)
+- [Fix] Fix `plugin_config` (#7104)
+- [connector-jdbc][bugfix] fix sqlServer create table comment special string bug (#7024)
+- [connector-jdbc][bugfix] fix oracle create table comment special string bug (#7012)
+- [Hotfix][CDC] Fix split schema change stream (#7003)
+- [bugfix] fix mysql create table comment special string bug (#6998)
+- [Paimon]support projection for paimon source (#6343)
+- [bugfix][connector-mongodb] fix mongodb null value write (#6967)
+- [Hotfix][Connector-V2][kafka]Kafka consumer group automatically commits offset logic error fix (#6961)
+- [Bug] [connector-hive] Eanble login with kerberos for hive (#6893)
+- [Bug][Connector-Iceberg]fix create iceberg v2 table with pks (#6895)
+- [Fix] correct the typo of kudu kerberos config (#6905)
+- [Hotfix][Connector-V2] Close the tableWrite when task is close (#6897)
+- [Fix][Connector-V2] Field information lost during Paimon DataType and SeaTunnel Column conversion (#6767)
+- [Hotfix][Connector-V2] Fix the batch write with paimon (#6865)
+- [Hotfix][Jdbc] Fix oracle savemode create table (#6651)
+- [bugFix][Connector-V2][Doris] The multi-FE configuration is supported (#6341)
+- [Hotfix][Postgres-CDC/OpenGauss-CDC] Fix read data missing when restore (#6785)
+- [Fix] Fix HttpSource bug (#6824)
+- [Hotfix][Jdbc/CDC] Fix postgresql uuid type in jdbc read (#6684)
+- [Hotfix][Dist] Add oracle cdc (#6818)
+- [Fix] fix Debezium conf "key_convert_schemas.enable" set false lead to nullPointException (#6809)
+- [Fix][MySQL]: Fix MySqlTypeConverter could not be instantiated (#6781)
+- [Fix][Connector-V2] Remove Some Incorrect Comments and Properties in ElasticsearchCommitInfo
+- [Hotfix][Jdbc] Fix table/query columns order merge for jdbc catalog (#6771)
+- [Fix][KuduCatalogFactory]: Fix KuduCatalogFactory.optionRule() will throw an Exception (#6787)
+- [Bug Fix] Sink Doris error status(#6753) (#6755)
+- [Bug][Improve][Connector-v2][ElasticsearchSource] Fix behavior when source empty,Support SourceConfig.SOURCE field empty. (#6425)
+- [Fix] Fix Oracle type converter handle negative scale in number type (#6758)
+- [HiveSink]Fix the risk of resource leakage. (#6721)
+- [bigfix][S3 File]:Change the [SCHEMA] attribute of the [S3CONF class] to be non-static to avoid being reassigned after deserialization (#6717)
+- [Fix][Connector-v2] Fix the sql statement error of create table for doris and starrocks (#6679)
+- [Fix][connector-rocketmq] commit a correct offset to broker & reduce ThreadInterruptedException log (#6668)
 
-### Zeta(ST-Engine)
+### Transformer
+- [Fix][Transform] Fix sql transform lose source type and options (#6855)
 
-- [Zeta] Fix LogicalDagGeneratorTest testcase (#4401)
-- [Zeta] Fix MultipleTableJobConfigParser parse only one transform (#4412)
-- [Zeta] Fix missing common plugin jars (#4448)
-- [Zeta] Fix handleCheckpointError be called while checkpoint already complete (#4442)
-- [Zeta] Fix job error message is not right bug (#4463)
-- [Zeta] Fix finding TaskGroup deployment node bug (#4449)
-- [Zeta] Fix the bug of conf (#4488)
-- [Zeta] Fix Connector load logic from zeta (#4510)
-- [Zeta] Fix conflict dependency of hadoop-hdfs (#4509)
-- [Zeta] Fix TaskExecutionService synchronized lock will not release (#4886)
-- [Zeta] Fix TaskExecutionService will return not active ExecutionContext (#4869)
-- [Zeta] Fix deploy operation timeout but task already finished bug (#4867)
-- [Zeta] Fix restoreComplete Future can't be completed when cancel task (#4863)
-- [Zeta] Fix IMap operation timeout bug (#4859)
-- [Zeta] fix pipeline state not right bug (#4823)
-- [Zeta] Fix the incorrect setting of transform parallelism (#4814)
-- [Zeta] Fix master active bug (#4855)
-- [Zeta] Fix completePendingCheckpoint concurrent action (#4854)
-- [Zeta] Fix engine runtime error (#4850)
-- [Zeta] Fix TaskGroupContext always hold classloader so classloader can't recycle (#4849)
-- [Zeta] Fix task `notifyTaskStatusToMaster` failed when job not running or failed before run (#4847)
-- [Zeta] Fix cpu load problem (#4828)
-- [zeta] Fix the deadlock issue with JDBC driver loading (#4878)
-- [zeta] dynamically replace the value of the variable at runtime (#4950)
-- [Zeta] Add from_unixtime function (#5462)
-- [zeta] Fix CDC task restore throw NPE (#5507)
+### Zeta(ST-Engine)
+- [Hotfix][Zeta] Fix taskgroup failed log lost (#7241)
+- [Fix][Zeta] Fix release slot resource twice (#7236)
+- [Fix][Zeta] Fix hybrid deployment can not get worker when init (#7235)
+- [HotFix] [Remote Debug] Description When remote debug is enabled, the Seatunel Server 5801 port is not listening properly (#7206)
+- [Fix][RestApi] Fix hazelcast/rest/maps/submit-job return a wrong jobId (#7154)
+- [Hotfix][Zeta] Fix that batch tasks cannot be stopped after retrying (#7083)
+- [Fix][Zeta] Fix env jars not working on zeta (#7035)
+- [Fix] revert IMAP cache data field type to compatible with old version (#7001)
+- [Hotfix][Zeta] Fix `generate_client_protocol.sh` (#6991)
+- [Hotfix][Zeta] Fix job crash when schema changing on multiple parallel readers (#6977)
+- [Fix] Fix Metrics lost data bug (#6976)
+- [Hotfix][Zeta] Fix okhttp connection leak in event reporter (#6945)
+- [Fix] Fix job will never cancel success when JobMaster init not complete (#6885)
+- [Hotfix][Zeta] Fix savepoint execute result (#6850)
+- [Fix][Zeta] Increase the log level when waitForJobComplete fails (#6827)
+- [Fix] Fix MultiTableWriterRunnable can not catch Throwable error (#6734)
+- [HotFix][zeta]: Fix loss job (#6759) (#6807)
+- [fix][zeta] fix can't release resource issue (#6763)
+- [Fix][Script] Fix lose jvm option when jvm_options file not end with `\n` (#6693)
 
 ### E2E
-
-- [E2E] [Kafka] Fix kafka e2e testcase (#4520)
-- [Container Version] Fix risk of unreproducible test cases #4591
-- [E2e] [Mysql-cdc] Removing the excess MySqlIncrementalSourceIT e2e reduces the CI time (#4738)
-- [E2E] [Common] Update test container version of seatunnel engine (#5323)
-- [E2E] [Jdbc] Fix not remove docker image after test finish on jdbc suite (#5586)
+- [Fix][E2E] Fix classloader number (#7209)
+- [CI] Fix k8s engine it not runs when only test case changed (#7122)
+- [Fix] Fix iceberg e2e image tag (#7189)
+- [CI][Test] Fix engine-k8s-it failed (#7101)
+- [CI] connector-kafka-e2e , connector-rocketmq-e2e module runs repeatedly #7090 (#7091)
+- [E2E][HBase]Refactor hbase e2e (#6859)
+- [Fix] Fix ConnectorSpecificationCheckTest failed (#6828)
+- [CI] Fix FixSlotResourceTest testNotEnoughResource test error (#6820)
 
 ## Improve
 
-- [Improve][Connector-V2][Jdbc-Source] Support for Decimal types as splict keys (#4634)
-
 ### Core
+- [Improve][Core] Move MultiTableSink to seatunnel-api module (#7243)
+- [Improve] Bump org.xerial.snappy:snappy-java (#7144)
+- [Improve] delete log for protect user privacy (#6987)
+- [Improve][Log] Auto refresh log configuration (#6915)
+- [Improve] [shell] Set the env SEATUNNEL_HOME automatically (#6924)
+- [Improve] Optimize log display during startup command (#6816)
 
-- [Core] [Spark] Push transform operation from Spark Driver to Executors (#4503)
-- [Core] [Starter] Optimize code structure & remove redundant code (#4525)
-- [Core] [Translation] [Flink] Optimize code structure & remove redundant code (#4527)
-- [Core] [Starter] Add check of sink and source config to avoid null pointer exception. (#4734)
-- [Core] [Flink] Remove useless stage type related codes. (#5650)
-
-### Formats
-
-- [Json] Remove assert key word. (#5919)
-- [Formats] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED. (#5948)
-- [Formats] Refactor exception catch for `ignoreParseErrors`. (#6065)
-
-### Connector-V2
-
-- [Connector-V2] [CDC] Improve startup.mode/stop.mode options (#4360)
-- [Connector-V2] [CDC] Optimize jdbc fetch-size options (#4352)
-- [Connector-V2] [CDC] Fix chunk start/end parameter type error (#4777)
-- [Connector-V2] [SQLServer] Fix sqlserver catalog (#4441)
-- [Connector-V2] [StarRocks] Improve StarRocks Serialize Error Message (#4458)
-- [Connector-V2] [Jdbc] add the log for sql and update some style (#4475)
-- [Connector-V2] [Jdbc] Fix the table name is not automatically obtained when multiple tables (#4514)
-- [Connector-V2] [S3 & Kafka] Delete unavailable S3 & Kafka Catalogs (#4477)
-- [Connector-V2] [Pulsar] Support Canal Format
-- [Connector-V2] [CDC base] Implement Sample-based Sharding Strategy with Configurable Sampling Rate (#4856)
-- [Connector-V2] [SelectDB] Add a jobId to the selectDB label to distinguish between tasks (#4864)
-- [Connector-V2] [Doris] Add a jobId to the doris label to distinguish between tasks (#4839) (#4853)
-- [Connector-v2] [Mongodb]Refactor mongodb connector (#4620)
-- [Connector-v2] [Jdbc] Populate primary key when jdbc sink is created using CatalogTable (#4755)
-- [Connector-v2] [Neo4j] Supports neo4j sink batch write mode (#4835)
-- [Transform-V2] Optimize SQL Transform package and Fix Spark type conversion bug of transform (#4490)
-- [Connector-V2] [Common] Remove assert key word (#5915)
-- [Connector-V2] Replace CommonErrorCodeDeprecated.JSON_OPERATION_FAILED. (#5978)
-
-### CI
+### Connectors
+- [Improve][Doris Connector] Unified serialization method,Use RowToJsonConverter and TextSerializationSchema (#7229)
+- [Improve][Jdbc] Support write unicode text into sqlserver (#7159)
+- [Improve] Improve error message when can not parse datetime value (#7181)
+- [Improve][Hive] Close resources when exception occurs (#7205)
+- [Improve][Jdbc] Remove user info in catalog-table options (#7178)
+- [Improve][Connector-V2] Add support for MySQL 8.4 (#7151)
+- [Improve][hbase] The specified column is written to the specified column family (#5234)
+- [Improve] Change catalog table log to debug level (#7136)
+- [Improve][Connector-V2] Support schema evolution for mysql-cdc and mysql-jdbc (#6929)
+- [Improve][Redis] Redis reader use scan cammnd instead of keys, single mode reader/writer support batch (#7087)
+- [Improve][Connector-V2][MongoDB] Support to convert to double from any numeric type (#6997)
+- [Improve][[Jdbc]sink sql support custom field.(#6515) (#6525)
+- [Improve][Connector-V2][Iceberg] Add hadoop s3 catalog e2e testcase (#5745)
+- [Improve][Connector-V2] Clean key name in catalog table (#6942)
+- [Improve][File Connector]Improve xml read code & fix can not use true for a boolean option (#6930)
+- [Improve][Files] Support write fixed/timestamp as int96 of parquet (#6971)
+- [Improve][Paimon] Add check for the base type between source and sink before write. (#6953)
+- [Improve][Connector-V2] Improve the paimon source (#6887)
+- [Improve] Make ClickhouseFileSinker support tables containing materialized columns (#6956)
+- [Improve][Jdbc] Quotes the identifier for table path (#6951)
+- [Improve][CDC] Bump the version of debezium to 1.9.8.Final (#6740)
+- [Improve][Connector-V2] Support hive catalog for paimon sink (#6833)
+- [Improve][CDC] Close idle subtasks gorup(reader/writer) in increment phase (#6526)
+- [Improve][JDBC Source] Fix Split can not be cancel (#6825)
+- [Improve] Add conditional of start.mode with timestamp in mongo cdc option rule (#6770)
+- [Improve] Improve doris create table template default value (#6720)
+- [Improve] [Clickhouse] Remove check when set allow_experimental_lightweight_delete false(#6727) (#6728)
+- [Improve] Improve read table schema in cdc connector (#6702)
+- [Improve][mysql-cdc] Fallback to desc table when show create table failed (#6701)
+- [Improve][Connector-v2] The hive connector support multiple filesystem (#6648)
+- [Improve][Hive] udpate hive3 version (#6699)
+- [Improve][mysql-cdc] Support mysql 5.5 versions (#6710)
+- [Improve] Update aws-java-sdk-budle version to fix job can not run bug
+- [Improve] Improve doris stream load client side error message (#6688)
+- [Improve][Connector] Add some sqlserver IDENTITY type for catalog (#6822)
+- [Improve][Connector-v2] Optimize the count table rows for jdbc-oracle and oracle-cdc (#7248)
 
-- [CI] Fix error repository name in ci config files (#4795)
-- [CI][E2E][Zeta] Increase Zeta checkpoint timeout to avoid connector-file-sftp-e2e failed frequently (#5339)
+### Transformer
+- [Improve][Transform-V2] Remove SQL query validation on table name (#7020)
 
 ### Zeta(ST-Engine)
+- [Improve][Restapi] Add ip and port to monitoring information (#7203)
+- [Improve][Zeta] Add check for submit duplicate job id (#7021)
+- [Improve][Zeta] Add retry when request slot on resource manager (#7049)
+- [Improve][Zeta] Fix JobMaster reset app classloader twice (#7063)
+- [Improve][Engine] Support custom job id for rest-api named submit-job (#7053)
+- [Improve][Zeta] Clean checkpoint file when job FINISHED/CANCELED (#6938)
+- [Improve][Zeta] Support close idle task for multiple sinks (#6864)
+- [Improve][Zeta] Move SaveMode behavior to master (#6843)
+- [Improve] Add custom job id arg in client (#6943)
+- [Improve][Zeta] when job finished, the checkpoint won't write to file (#6674)
+
+### CI
+- [Improve][CI] Add milvus to label (#7186)
+- [Improve][CI] Add auto label action (#7174)
+- [Improve][E2E][Doris] Add no schema test case for connector-doris-e2e (#7076)
+- [Improve] enable iceberg schema change test (#6711)
 
-- [Zeta] Support run the server through daemon mode (#4161)
-- [Zeta] Change ClassLoader To Improve the SDK compatibility of the client (#4447)
-- [Zeta] Client Support Async Submit Job (#4456)
-- [Zeta] Add more detailed log output. (#4446)
-- [Zeta] Improve seatunnel-cluster.sh (#4435)
-- [Zeta] Reduce CPU Cost When Task Not Ready (#4479)
-- [Zeta] Add parser log (#4485)
-- [Zeta] Remove redundant code (#4489)
-- [Zeta] Remove redundancy code in validateSQL (#4506)
-- [Zeta] Improve JobMetrics fetch performance (#4467)
-- [Zeta] Reduce the operation count of imap_running_job_metrics (#4861)
-- [Zeta] Speed up listAllJob function (#4852)
-- [Zeta] async execute checkpoint trigger and other block method (#4846)
-- [Zeta] Reduce the number of IMAPs used by checkpointIdCounter (#4832)
-- [Zeta] Cancel pipeline add retry to avoid cancel failed. (#4792)
-- [Zeta] Improve Zeta operation max count and ignore NPE (#4787)
-- [Zeta] Remove serialize(deserialize) cost when use shuffle action (#4722)
-- [zeta] Checkpoint exception status messages exclude state data (#5547)
-- [Zeta] Remove assert key words (#5947)
+### OTHER
+- [Chore] remove useless codes (#7110)
+- [Typo] typo the hint of savemode execution location (#7100)
+- [Chore] remove useless interface (#6746)
 
 ## Feature
 
 ### Core
+- [Feature][Core] Support using upstream table placeholders in sink options and auto replacement (#7131)
+- [Feature][Core] Add a test case for  dynamic custom parameters (#7128)
+- [Feature][SQL Config] Add SQL config adapter (#6757)
+- [Feature][starter] support user define parameter on spark/flink engine (#6387)
 
-- [Core] [API] Support convert strings as List<T> option (#4362)
-- [Core] [API] Add copy method to Catalog codes (#4414)
-- [Core] [API] Add options check before create source and sink and transform in FactoryUtil (#4424)
-- [Core] [Shade] Add guava shade module (#4358)
-- [Core] [Spark] Support SeaTunnel Time Type (#5188)
-- [Core] [Flink] Support Decimal Type with configurable precision and scale (#5419)
-- [Core] [API] Support hocon style declare row type in generic type (#6187)
-
-### Connector-V2
-
-- [Connector-V2] [CDC] [SQLServer] Support multi-table read (#4377)
-- [Connector-V2] [Kafka] Kafka source supports data deserialization failure skipping (#4364)
-- [Connector-V2] [Jdbc] [TiDB] Add TiDB catalog (#4438)
-- [Connector-V2] [File] Add file excel sink and source (#4164)
-- [Connector-V2] [FILE-OBS] Add Huawei Cloud OBS connector (#4577)
-- [Connector-v2] [Snowflake] Add Snowflake Source&Sink connector (#4470)
-- [Connector-V2] [Pular] support read format for pulsar (#4111)
-- [Connector-V2] [Paimon] Introduce paimon connector (#4178)
-- [Connector V2] [Cassandra] Expose configurable options in Cassandra (#3681)
-- [Connector V2] [Jdbc] Supports GEOMETRY data type for PostgreSQL (#4673)
-- [Connector V2] [Jdbc] Supports Kingbase database (#4803)
-- [Transform-V2] Add UDF SPI and an example implement for SQL Transform plugin (#4392)
-- [Transform-V2] Support copy field list (#4404)
-- [Transform-V2] Add support CatalogTable for FieldMapperTransform (#4423)
-- [Transform-V2] Add CatalogTable support for ReplaceTransform (#4411)
-- [Transform-V2] Add Catalog support for FilterRowKindTransform (#4420)
-- [Transform-V2] Add support CatalogTable for FilterFieldTransform (#4422)
-- [Transform-V2] Add catalog support for SQL Transform plugin (#4819)
-- [Connector-V2] [Assert] Support check the precision and scale of Decimal type (#6110)
-- [Connector-V2] [Assert] Support field type assert and field value equality assert for full data types (#6275)
-- [Connector-V2] [Iceberg] Support iceberg sink #6198
-- [Connector-V2] [FILE-OBS] Add Huawei Cloud OBS connector #4578
+### Connectors
+- [Feature][Connector-V2][Milvus] Support Milvus source & sink (#7158)
+- [Feature][Connector-V2] [Hudi]Add hudi sink connector (#4405)
+- [Feature][Connector-V2] Support jdbc hana catalog and type convertor (#6950)
+- [Feature][Connector-V2][Clickhouse] Add clickhouse.config to the source connector (#7143)
+- [feature][Connector-file-local] add save mode function for localfile (#7080)
+- [feature][connector-v2-hbase-sink] Support Connector v2 HBase sink TTL data writing (#7116)
+- [Feature][connector][kafka] Support read Maxwell format message from kafka #4415 (#4428)
+- [Feature][Elasticsearch] Support multi-table sink write #7041 (#7052)
+- [Feature][Druid]Support multi table for druid sink (#7023)
+- [Feature][Connector] Add druid sink connector (#6346)
+- [Feature][Connector-V2] Add Huawei Cloud OBS connector (#4578)
+- [Feature][Jdbc] Support redshift catalog (#6992)
+- [Feature][Connector-V2] Supports the transfer of any file (#6826)
+- [Feature][Kafka] Support multi-table source read  (#5992)
+- [Feature][S3 File] Make S3 File Connector support multiple table write (#6698)
+- [Feature][Doris] Add Doris type converter (#6354)
+- [Feature][Jdbc] Support the jdbc connector for InterSystems IRIS (#6797)
+- [Feature][Connector-V2] Iceberg-sink supports writing data to branches (#6697)
+- [Feature][Connector-V2] Add web3j source connector (#6598)
+- [Feature][Connector-V2]Support StarRocks Fe Node HA
+- [Feature] Hive Source/Sink support multiple table (#5929)
+- [Connector]Add hbase source connector (#6348)
 
-### Zeta(ST-Engine)
+### Transformer
+- [Feature][Transform] DynamicCompile add transform  (#7170)
+- [Feature][Transform-V2 Filter] support exclude columns in the filter transform (#6960)
+- [Feature][Transforms] Support is_date function of sql (#6966)
 
-- [Zeta] Support for mixing Factory and Plugin SPI (#4359)
-- [Zeta] Add get running job info by jobId rest api (#4140)
-- [Zeta] Add REST API To Get System Monitoring Information (#4315)
-- [Transform V2 & Zeta] Make SplitTransform Support CatalogTable And CatalogTable Evolution (#4396)
-- [Zeta] Move driver into lib directory and change operation count (#4845)
-- [Zeta] Add Metaspace size default value to config file (#4848)
-- [Zeta] Reduce the frequency of fetching data from imap (#4851)
-- [Zeta] Add OSS support for Imap storage to cluster-mode type (#4683)
-- [Zeta] Improve local mode startup request ports (#4660)
-
-## Docs 
-
-- [Docs] Optimizes part of the Doris and SelectDB connector documentation (#4365)
-- [Docs] Fix docs code style (#4368)
-- [Docs] Update jdbc doc and kafka doc (#4380)
-- [Docs] Fix max_retries default value is 0. (#4383)
-- [Docs] Fix markdown syntax (#4426)
-- [Docs] Fix Kafka Doc Error Config Key "kafka." (#4427)
-- [Docs] Add Transform to Quick Start v2 (#4436)
-- [Docs] Fix Dockerfile and seatunnel-flink.yaml in Set Up with Kubernetes (#4788)
-- [Docs] Fix Mysql sink format doc (#4800)
-- [Docs] Add the generate sink sql parameter for the jdbc sink document (#4797)
-- [Docs] Add the generate sink sql parameter And example (#4769)
-- [Docs] Redshift add defaultRowFetchSize (#4616)
-- [Docs] Refactor connector-v2 docs using unified format Mysql (#4590)
-- [Docs] Add Value types in Java to Schema features (#5087)
-- [Docs] Replace username by user in the options of FtpFile (#5421)
-- [Docs] Add how to configure logging related parameters of SeaTunnel-E2E Test (#5589)
-- [Docs] Remove redundant double quotation mark from an example code (#5845)
-- [Docs] Add Hive JDBC reference value (#5882)
+### Zeta(ST-Engine)
+- [Feature][RestAPI] overview support tag filter (#7173)
+- [Feature][Zeta] Add Master and Worker split mode deployment (#6947)
+- [Feature][Zeta] Add tag to node used to filter worker when submit job (#7045)
+- [Feature][RestAPI] Add overview api (#6883)
+- [Feature][Engine] Change the name of the rest-api interface for returning job info (#6813)
+- [feature][CheckPoint-stroage]:Added Disable cache configuration. (#6718)
+
+## Docs
+- [Improve][Doc] Add IMap OSS config jars into document (#7029)
+- [Chore][NOTICE] Correct year in NOTICE file (#7232)
+- [Docs] Update engine related docs info (#7228)
+- [Doc] hdfs file doc correct (#7216)
+- [Docs] Update contribution and readme related docs info (#7188)
+- [Docs] Update transform about and faq related docs info (#7187)
+- [Docs]translate clickhousefile,phoenix,rabbitmq,starrocks sink doc into chinese (#7015)
+- [Docs] Update concept related docs info (#7184)
+- [Docs] Update quick start v2 related docs info (#7161)
+- [Docs][connector-sink] add Docs connector v2 sink (#7097)
+- [Docs] update rest-api doc (#7111)
+- [Doc] correct the document (#7099)
+- [Doc] Add engine start parameter explanation (#7062)
+- [Doc] Fix sink jdbc doc (#6459)
+- [Doc] fix HdfsFile demo config (#6921)
+- [Doc][Improve] connector-v2 clickhouse/hbase/pulsar sink support chinese (#6811)
+- [Doc][Improve] doris sink support chinese (#6803)
+- [Doc][improve] update Connector-v2-release-state (#6801)
+- [ci][doc] Update node version (#6796)
+- [Doc][Improve] Support chinese for sinks (#6663)
+- [Doc][Improve] Remove unnecessary commas to make sentences smoother (#6783)
+- [Doc][Improvement] Add Support Chinese for Config-Encryption-Decryption.md (#6715)
+- [Doc][Improve] Intro the multi-line text feature in document (#6713)
+- [Improve][Document] Fix Postgre to PostgreSQL in Postgre-CDC.md file (#7112)
+- [Improve][Doc] Improve DingTalk doc (#7075)
+- [Improve][Doc] Fix snowflake jdbc url with emoji (#7061)
+- [Hotfix][DOC] Fix invalid links (#7018)
+- [Feature][doc][Connector-V2][Common] Add Common connector documentation (#5453)
+- [Document] fix starrocks doc demo config (#6918)
+- [Hotfix][Docs] Unified debezium document addresses point to debezium github to prevent dead links (#6892)
+- [Fix][DOC] Fix doc tip and caution (#6839)
+- [Improve][Doc] Add sql-config doc into sidebars.js (#6836)
+- [Improve] Update doris sink template default value in doc (#6810)
+- [fix][doc] fix dead link (#6764)
+- [Improve][Zeta] add document for Minio as checkpoint storage for zeta tasks (#6732)