You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by we...@apache.org on 2022/04/18 04:40:10 UTC
[incubator-seatunnel] branch 2.1.1-release updated (7e08584e -> 0e731052)
This is an automated email from the ASF dual-hosted git repository.
wenjun pushed a change to branch 2.1.1-release
in repository https://gitbox.apache.org/repos/asf/incubator-seatunnel.git
discard 7e08584e [hotfix][examples] Add flink-runtime-web to flink example (#1706)
discard fd5425f5 [Improve][Core] Remove unused return value. (#1703)
discard 8b0568c5 [Doc][Improve]add ClickhouseFile connector doc link on README (#1698)
discard 4544c91a [Improve][Connectors] enhancement spark-email-sink (#1692)
discard 0d9178bc [doc] Add doc about how to contribute a plugin (#1690)
discard eb368757 [doc] Rename development to contribution to avoid confusion (#1689)
discard e756d818 [WIP]code cleanup (#1684)
discard 3eda771e [Feature#1270][Connectors] add source plugin: seatunnel-connector-spark-http (#1678)
discard a3fdaecd [Improvement][connector-spark-socket] Refactored config arguments and default values (#1687)
discard 0721fc92 [CI]Add Sonar Check (#1656)
discard 689c4019 [Feature][e2e] Add spark e2e module (#1681)
discard 98749439 [Improvement][connector] Build different version of elasticsearch connector by property (#1675)
discard db0fd145 [Feature][Connector] Re-add support for elasticsearch 6.x in source code. (#1663)
discard 4132f9bf [Bug] [connetor] When outputting data to doris, a ClassCastException was encountered. (#1674)
discard a33d4243 [Feature][connector][#1652] Get data from Feishu sheet (#1653)
discard 5d65ea87 Use maven revision to manage project version (#1672)
discard c2cc3e59 [Improve][Connector] clickhouse configuration extraction (#1671)
discard 1c7dc69f Update version to 2.1.1-SNAPSHOT (#1665)
discard 3bba27a7 [Bug] [core] Cannot load plugin due to plugin name is not class name (#1664)
discard c7efb4d6 [Bug] [UT] CompleteTest#testVariables failed due to system property not set (#1668)
discard 0b15a0ca [hotfix][doc] Add escape description of split (#1666)
discard 6f38f69f ignore .attach_pid files caused by a java bug (#1657)
discard c28511e3 [docs][connector-clickhouse][docs] Updated bulk size desc (#1658)
discard 79f775b7 [Feature][Flink] Rewrite start-seatunnel-flink script with starter (#1636)
discard 24f64917 [Bug] [core] Fix the resource leak for SparkStarter (#1655)
discard e321660d [hotfix][directory] recover plugins directory (#1651)
discard e93c5778 [DOCS]Update spark dependency version notes (#1627)
discard 09db1320 [Dependency]Upgrade log4j-core to 2.17.1 (#1646)
discard 809ad2f1 [License]Redeclare dual license to avoid ambiguity (#1644)
discard 08751926 [Improve][Dependency]Unified version management (#1642)
discard 8f9d124c [ci] Run auto license only if commit message contains keyword (#1643)
discard b41407f5 [Feature][Connector] update flink elasticsearch sink version (#1631)
discard 57ce74c6 [Improve][core] add Override on getDeployMode(#1637) (#1638)
discard 21abb8ab [Chore]Modify irregular code (#1633)
discard c20677c4 [hotfix][connector-redis][docs] Updated required value in source and sink attribute tables for those with default values (#1629)
discard f9fdac0f [Hotfix][ci] Sort dependencies to pass the ci in known-dependencies.txt (#1453)
discard 6860cc0b [ci] Migrate check-license into license.yml (#1621)
discard 3ce32759 [hotfix][seatunnel-spark-examples][#1614] lose default deploy mode value issue (#1615)
discard 786ea0b4 [Improvement][flink-connector-file] Updated default rollover interval constant name (#1616)
discard a03c2070 [doc] Add hint only spark supported for Mesos cluster (#1617)
discard 37e7edf5 [doc] Fix dead link to start (#1618)
discard 3e2a5565 add kafka source doc (#1624)
discard 52fe0818 [Feature][Connector] Change ClickhouseFile read temp data method to local file (#1567)
discard 50654816 [Imporvement][directory] Remove plugins directory (#1613)
discard e761f59e [Improvement][build] optimize package name (#1610)
discard 0fc20168 [doc] Change docs structure and make it more suitable (#1611)
discard 1ed37bfd [Feature] [transform] To quickly locate the wrong SQL statement in flink sql transform (#1603)
discard 7d3f697a [Improvement][core] Rename seatunnel-core-sql to seatunnel-core-flink-sql (#1609)
discard f68586c5 [Improvement][flink-connector-kafka] rename kafkasink/add semantic/simplify code (#1607)
discard 34926b7f [Bug][seatunnel-connector-flink-KafkaSink] Use JsonRowSerializationSchema and dataStream to solve the problem that kafkaSink cannot output data.And successfully compiled locally (#1598)
discard d339fc43 [SeaTunnel#1218] rewrite spark start script with java (#1486)
discard a3447532 [Feature][core] Optimize the plugin load, rename plugin package name (#1592)
discard 2364f360 [Bug] [seatunnel-connector-spark-file] fix file source and sink default params (#1590)
discard 184ffdaa [Improve]Some code block optimizations (#1600)
discard dd0c127a [Improve][Connectors]Refactor es config class (#1594)
discard 7dc7484a [Feature] Support JDK 11 compiling (#1559)
discard 2e222792 [hotfix][hbase][docs] Corrected staging_dir attribute (#1588)
discard 829c24c2 [Feature][Core]implament StructuredStreamingExecution (#1400)
discard 78688ddd [Improve][Connector]Exceptions should be either logged or rethrown but not both (#1587)
discard ef86a263 [doc] Move sidebars.js from website repo (#1586)
discard c4de8649 [Bug] [core] Arbitrary file write during archive extraction ("Zip Slip") (#1583)
discard b6d3dbf7 [Improve][Connectors]Remove DBI related operations (#1582)
discard 44dc3f22 [Docs][Readme]Add compile link and remove old docs (#1580)
discard 381cefc9 [Chore]remove unused configuration (#1579)
discard 600a3b3e [Improve][core] Add PluginClosedException type for the Plugin's close method to make the exception more clearly and elegant (#1572)
discard 2824015a [Chore] add log4j config file, when e2e test failure, print error log. (#1577)
discard dbd376fa Revert "[Improve] [core] Must throw exception while creating plugin instances (#1419)" (#1574)
discard ff5579b9 [Improve] [core] Must throw exception while creating plugin instances (#1419)
discard c9ae3ede [docs]Answer the question about issue #844 add jdbc connector settings in source config for easy used (#1447)
discard 28a71a6a [Chore]Update .licenserc.yaml(ignore .svg checker) (#1565)
discard b90ab80f [Improve]Modify Doris sink default parameter value (#1561)
discard 266cd4ef [doc] Move introduction.md from website (#1563)
discard 2553c734 [Chore] Modify some wrong or non-standard code (#1562)
discard fb0b3f8f [Doc][Connector] Add ClickhouseFile document (#1558)
discard 358e4d65 [Improve] [core] Using right exit code instead of -1 (#1539)
discard 355f237c [Bug] [core] Fix the resource leak for unGzip (#1555)
discard 559e3b1b [Improve][Config] Refactor StringTemplate to unify variables substitute util (#1442)
discard 30243435 [Feature][Connector] JDBC source support partition (#1544)
discard 829417ad [Feature][Connector] Add clickhouse-file sink support clickhouse bullk load (#1501)
discard 5187421f [Feature][e2e] Add Flink E2E (#1536)
discard e15897eb [Feature][core] Add close method in plugin. (#1530)
discard dbed76b6 [SeaTunnel#1546] complete the hive sink document (#1547)
discard 926a7d7f [Refactor][connector-spark][hbase] Conn spark hbase refactor (#1541)
discard 4e8e0cef [fix][Connector] fix sql parse table name error (#1520)
discard e9f723be fix FileSink cannot work in flink stream mode (#1528)
discard 8433efcf Fix config param issues of spark redis sink (#1524)
discard aec1468c [hotfix][email][docs] - Updated limit explanation (#1525)
discard 80082591 [Bug] [core] Fix the resource leak for core module (#1532)
discard 4c3ba978 [bug][seatunnel-api-flink] - fix tableexits not contain TemporaryTable #1498 (#1526)
discard ee95b532 [fix][Connector] fix datetime/date string can't convert to timestamp/date (#1521)
discard 96f04fec [Chore]Fix quick start deadlink (#1519)
discard 89ad0f9b [Improve] [doc] Using Neo4j instead of neo4j for README docs (#1515)
discard d4298e4d [Docs]Update quick start download link (#1518)
discard da0f0e7d [Chore]remove waterdrop code legacy (#1517)
discard 32b7a7ed [Improve][Core] remove Plugin implementation default override method (#1510)
discard c848d5a8 [Refactor][connector-spark][console] Refactored config literal params and default values (#1499)
discard 53682c3d [Feature][Connector] add console limit and batch flink fake source (#1507)
discard a01e2b1c [Bug][Spark] When have empty data source, transform not execute (#1509)
discard 07e46ab1 [Bug][Config] Support json format config file (#1500)
discard 1a59d726 [Docs]Update README download link (#1516)
discard 832db49f [Improve][Config] Remove useless config path condition (#1379)
discard 1443c34b [doc] Add how to set up dev env (#1496)
discard 89811805 [Improvement][core] Optimize generic type (#1489)
discard edc6fdaf [Refactor][connector-spark][elastic] Refactored embedded config params and default values (#1492)
discard c6cf2e17 [hotfix][spark][config-examples] Corrected duplicate wording (#1493)
discard 65f129d4 [Improve] [core] Remove useless job name from JobInfo (#1405)
discard b12b5640 [Improve] [core] Split define and assign (#1485)
discard b8526836 [Improvement][Config] Print config in origin order (#1484)
discard 3eb69bb2 [Improve][checkstyle]Fix checkstyle incompatible upgrades (#1490)
discard 6c7ab4a8 [hotfix][influxdb][docs] Corrected database attribute (#1488)
discard d4083f9d [Improve][hive] Automatic identify spark hive plugin, add enableHiveSupport (#1475)
discard 9e52026e [Feature #1421][core] Use different command to execute task (#1422)
discard ecc4b192 [Feature][Scripts] Throw exception in start scripts when config file not exist (#1469)
discard 36ef9db3 [Improve] [spark-source-kudu] Remove repeated format function call in spark-source-kudu (#1459)
discard 5864748a [Bug] [flink-connector-jdbc] change jdbc related dependency scope from provided to default scope (#1464)
discard 30e3d6e0 [fix] [flink-connector-jdbc] various jdbc type of dialect compatibility between JdbcSource and JdbcSink update first piece (#1472)
discard a63fa068 [Refactor][flink-connector][elastic] - Refactored code to extract constants from embedded literals (#1481)
discard 1da6965a [Fix][Doc] Fix the wrong link of Hive sink in Spark Connector Plugins on READDE. (#1479)
discard 7c424ba5 [hotfix][doris][docs] Fixed name of sink plugin (#1477)
discard 38bf6a70 [improve]Format file license header, remove unused blank line. (#1476)
discard d1d1aaa9 [Bug][Connector] Fix Flink ConsoleSink not printing results (#1417)
discard 3fa12b0e [Feature][Refactor] ISSUE-1465 - Refactored code to remove embedded config literals (#1466)
omit 1de6ed7a [maven-release-plugin] prepare for next development iteration
omit e166028a [maven-release-plugin] prepare release 2.1.0
omit 2c88acb5 Ignore license-py tools, since I changed and renamed some license declarations
omit 82658890 Redeclare dual license to avoid ambiguity
add 5b0a07b7 [Feature][Refactor] ISSUE-1465 - Refactored code to remove embedded config literals (#1466)
add 93749721 [Bug][Connector] Fix Flink ConsoleSink not printing results (#1417)
add 581b275c [improve]Format file license header, remove unused blank line. (#1476)
add fe4aaaa1 [hotfix][doris][docs] Fixed name of sink plugin (#1477)
add f329d079 [Fix][Doc] Fix the wrong link of Hive sink in Spark Connector Plugins on READDE. (#1479)
add f2482c0e [Refactor][flink-connector][elastic] - Refactored code to extract constants from embedded literals (#1481)
add 23ed11f0 [fix] [flink-connector-jdbc] various jdbc type of dialect compatibility between JdbcSource and JdbcSink update first piece (#1472)
add e6e1b7b5 [Bug] [flink-connector-jdbc] change jdbc related dependency scope from provided to default scope (#1464)
add 2b6c5c47 [Improve] [spark-source-kudu] Remove repeated format function call in spark-source-kudu (#1459)
add d6011799 [Feature][Scripts] Throw exception in start scripts when config file not exist (#1469)
add 2ff61311 [Feature #1421][core] Use different command to execute task (#1422)
add b8e59c87 [Improve][hive] Automatic identify spark hive plugin, add enableHiveSupport (#1475)
add c437c94a [hotfix][influxdb][docs] Corrected database attribute (#1488)
add 159eb842 [Improve][checkstyle]Fix checkstyle incompatible upgrades (#1490)
add a65d081c [Improvement][Config] Print config in origin order (#1484)
add 7d5ed267 [Improve] [core] Split define and assign (#1485)
add f277a432 [Improve] [core] Remove useless job name from JobInfo (#1405)
add d5638701 [hotfix][spark][config-examples] Corrected duplicate wording (#1493)
add a7ff0f88 [Refactor][connector-spark][elastic] Refactored embedded config params and default values (#1492)
add 625db5f1 [Improvement][core] Optimize generic type (#1489)
add 175b7b57 [doc] Add how to set up dev env (#1496)
add b9643ede [Improve][Config] Remove useless config path condition (#1379)
add af568c3b [Docs]Update README download link (#1516)
add f97ca442 [Bug][Config] Support json format config file (#1500)
add c65067d9 [Bug][Spark] When have empty data source, transform not execute (#1509)
add 660d7158 [Feature][Connector] add console limit and batch flink fake source (#1507)
add 402ead2a [Refactor][connector-spark][console] Refactored config literal params and default values (#1499)
add 7d36706b [Improve][Core] remove Plugin implementation default override method (#1510)
add 612ddebe [Chore]remove waterdrop code legacy (#1517)
add baa4fee7 [Docs]Update quick start download link (#1518)
add 8dc0243a [Improve] [doc] Using Neo4j instead of neo4j for README docs (#1515)
add 53fbef74 [Chore]Fix quick start deadlink (#1519)
add 28beb531 [fix][Connector] fix datetime/date string can't convert to timestamp/date (#1521)
add e09a49e4 [bug][seatunnel-api-flink] - fix tableexits not contain TemporaryTable #1498 (#1526)
add 0d1078e0 [Bug] [core] Fix the resource leak for core module (#1532)
add 3f443c80 [hotfix][email][docs] - Updated limit explanation (#1525)
add c0b82506 Fix config param issues of spark redis sink (#1524)
add 72af94ee fix FileSink cannot work in flink stream mode (#1528)
add f321087a [fix][Connector] fix sql parse table name error (#1520)
add 5250c641 [Refactor][connector-spark][hbase] Conn spark hbase refactor (#1541)
add 6f1e7c8b [SeaTunnel#1546] complete the hive sink document (#1547)
add 379791dd [Feature][core] Add close method in plugin. (#1530)
add 39a09d91 [Feature][e2e] Add Flink E2E (#1536)
add 94864c07 [Feature][Connector] Add clickhouse-file sink support clickhouse bullk load (#1501)
add e61664f1 [Feature][Connector] JDBC source support partition (#1544)
add 8fabcdb4 [Improve][Config] Refactor StringTemplate to unify variables substitute util (#1442)
add 0295d0f5 [Bug] [core] Fix the resource leak for unGzip (#1555)
add 574d9c99 [Improve] [core] Using right exit code instead of -1 (#1539)
add 2e34311b [Doc][Connector] Add ClickhouseFile document (#1558)
add ddabbab5 [Chore] Modify some wrong or non-standard code (#1562)
add 2b849966 [doc] Move introduction.md from website (#1563)
add 7f10cbc6 [Improve]Modify Doris sink default parameter value (#1561)
add 8714052e [Chore]Update .licenserc.yaml(ignore .svg checker) (#1565)
add 99d0dfd9 [docs]Answer the question about issue #844 add jdbc connector settings in source config for easy used (#1447)
add 53a9227c [Improve] [core] Must throw exception while creating plugin instances (#1419)
add df958cf2 Revert "[Improve] [core] Must throw exception while creating plugin instances (#1419)" (#1574)
add 15e88905 [Chore] add log4j config file, when e2e test failure, print error log. (#1577)
add 7b44c012 [Improve][core] Add PluginClosedException type for the Plugin's close method to make the exception more clearly and elegant (#1572)
add 76c462df [Chore]remove unused configuration (#1579)
add b9eded36 [Docs][Readme]Add compile link and remove old docs (#1580)
add 2b560b70 [Improve][Connectors]Remove DBI related operations (#1582)
add 7eb19a97 [Bug] [core] Arbitrary file write during archive extraction ("Zip Slip") (#1583)
add a40c0a42 [doc] Move sidebars.js from website repo (#1586)
add d23155ef [Improve][Connector]Exceptions should be either logged or rethrown but not both (#1587)
add 5e7fc371 [Feature][Core]implament StructuredStreamingExecution (#1400)
add f440fbe0 [hotfix][hbase][docs] Corrected staging_dir attribute (#1588)
add d9eadc59 [Feature] Support JDK 11 compiling (#1559)
add 11b1d183 [Improve][Connectors]Refactor es config class (#1594)
add 1d445dca [Improve]Some code block optimizations (#1600)
add 1943af44 [Bug] [seatunnel-connector-spark-file] fix file source and sink default params (#1590)
add c8d04c3b [Feature][core] Optimize the plugin load, rename plugin package name (#1592)
add 5290c81b [SeaTunnel#1218] rewrite spark start script with java (#1486)
add 15377583 [Bug][seatunnel-connector-flink-KafkaSink] Use JsonRowSerializationSchema and dataStream to solve the problem that kafkaSink cannot output data.And successfully compiled locally (#1598)
add 7b47c349 [Improvement][flink-connector-kafka] rename kafkasink/add semantic/simplify code (#1607)
add 687d7d2d [Improvement][core] Rename seatunnel-core-sql to seatunnel-core-flink-sql (#1609)
add d672a305 [Feature] [transform] To quickly locate the wrong SQL statement in flink sql transform (#1603)
add f3c90256 [doc] Change docs structure and make it more suitable (#1611)
add 4dafdf6f [Improvement][build] optimize package name (#1610)
add fc0603a7 [Imporvement][directory] Remove plugins directory (#1613)
add d9936190 [Feature][Connector] Change ClickhouseFile read temp data method to local file (#1567)
add 9a4160e2 add kafka source doc (#1624)
add 1c031d16 [doc] Fix dead link to start (#1618)
add 7456a61d [doc] Add hint only spark supported for Mesos cluster (#1617)
add 3145c688 [Improvement][flink-connector-file] Updated default rollover interval constant name (#1616)
add b0c0fe68 [hotfix][seatunnel-spark-examples][#1614] lose default deploy mode value issue (#1615)
add 396db0dc [ci] Migrate check-license into license.yml (#1621)
add cedb76f9 [Hotfix][ci] Sort dependencies to pass the ci in known-dependencies.txt (#1453)
add e8cc1b88 [hotfix][connector-redis][docs] Updated required value in source and sink attribute tables for those with default values (#1629)
add a41d4a58 [Chore]Modify irregular code (#1633)
add 07643bc9 [Improve][core] add Override on getDeployMode(#1637) (#1638)
add 22c4242f [Feature][Connector] update flink elasticsearch sink version (#1631)
add a45e306b [ci] Run auto license only if commit message contains keyword (#1643)
add fb167ef1 [Improve][Dependency]Unified version management (#1642)
add 4f1dc0c6 [License]Redeclare dual license to avoid ambiguity (#1644)
add aacccdf4 [Dependency]Upgrade log4j-core to 2.17.1 (#1646)
add 6c475748 [DOCS]Update spark dependency version notes (#1627)
add a344085d [hotfix][directory] recover plugins directory (#1651)
add 71d098bc [Bug] [core] Fix the resource leak for SparkStarter (#1655)
add 4bdbbfdb [Feature][Flink] Rewrite start-seatunnel-flink script with starter (#1636)
add d364e403 [docs][connector-clickhouse][docs] Updated bulk size desc (#1658)
add b9e404b4 ignore .attach_pid files caused by a java bug (#1657)
add 24247138 [hotfix][doc] Add escape description of split (#1666)
add 1b0da1c7 [Bug] [UT] CompleteTest#testVariables failed due to system property not set (#1668)
add 705a2899 [Bug] [core] Cannot load plugin due to plugin name is not class name (#1664)
add bcc27bc8 Update version to 2.1.1-SNAPSHOT (#1665)
add b50de38f [Improve][Connector] clickhouse configuration extraction (#1671)
add 6d78f1be Use maven revision to manage project version (#1672)
add f1326446 [Feature][connector][#1652] Get data from Feishu sheet (#1653)
add ce041951 [Bug] [connetor] When outputting data to doris, a ClassCastException was encountered. (#1674)
add 3c10987e [Feature][Connector] Re-add support for elasticsearch 6.x in source code. (#1663)
add 220c0a61 [Improvement][connector] Build different version of elasticsearch connector by property (#1675)
add a0403b81 [Feature][e2e] Add spark e2e module (#1681)
add e0330433 [CI]Add Sonar Check (#1656)
add 1c6b7215 [Improvement][connector-spark-socket] Refactored config arguments and default values (#1687)
add 94da3cba [Feature#1270][Connectors] add source plugin: seatunnel-connector-spark-http (#1678)
add 8e90c5ed [WIP]code cleanup (#1684)
add d56388d2 [doc] Rename development to contribution to avoid confusion (#1689)
add 575dded6 [doc] Add doc about how to contribute a plugin (#1690)
add cdde367e [Improve][Connectors] enhancement spark-email-sink (#1692)
add c3d5f166 [Feature][Plugin] Add Plugin Flink Sink Clickhouse (#1688)
add 3a4ef4c6 [Doc][Improve]add ClickhouseFile connector doc link on README (#1698)
add 9153f28e [Improve][Core] Remove unused return value. (#1703)
add 313b3d67 [hotfix][examples] Add flink-runtime-web to flink example (#1706)
add 0e731052 [Feature][connector] Add Clickhouse file sink on Flink engine (#1700)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (7e08584e)
\
N -- N -- N refs/heads/2.1.1-release (0e731052)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
docs/en/connector/sink/Clickhouse.md | 2 +-
docs/en/connector/sink/ClickhouseFile.md | 6 +-
pom.xml | 7 +-
seatunnel-apis/pom.xml | 4 +-
seatunnel-apis/seatunnel-api-base/pom.xml | 5 +-
seatunnel-apis/seatunnel-api-flink/pom.xml | 6 +-
seatunnel-apis/seatunnel-api-spark/pom.xml | 5 +-
seatunnel-common/pom.xml | 4 +-
.../common/config/TypesafeConfigUtils.java | 7 +-
.../apache/seatunnel/common/utils/RetryUtils.java | 96 +++++++
seatunnel-config/pom.xml | 3 +-
seatunnel-config/seatunnel-config-base/pom.xml | 10 +-
seatunnel-config/seatunnel-config-shade/pom.xml | 3 +-
seatunnel-connectors/pom.xml | 4 +-
.../seatunnel-connectors-flink/pom.xml | 6 +-
.../pom.xml | 15 +-
.../seatunnel/flink/clickhouse/ConfigKey.java | 109 ++++++++
.../clickhouse/pojo/ClickhouseFileCopyMethod.java | 28 +-
.../flink/clickhouse/pojo/DistributedEngine.java | 57 ++++
.../seatunnel/flink/clickhouse/pojo/IntHolder.java | 19 +-
.../seatunnel/flink/clickhouse/pojo/Shard.java | 132 ++++++++++
.../flink/clickhouse/pojo/ShardMetadata.java | 135 ++++++++++
...BatchSink.java => ClickhouseFileBatchSink.java} | 112 +++++---
.../sink/ClickhouseFileOutputFormat.java | 262 +++++++++++++++++++
.../clickhouse/sink/ClickhouseOutputFormat.java | 231 +++++++++++++++++
.../sink/client/ClickhouseBatchStatement.java | 51 ++++
.../clickhouse/sink/client/ClickhouseClient.java | 215 ++++++++++++++++
.../flink/clickhouse/sink/client/ShardRouter.java | 102 ++++++++
.../clickhouse/sink/file/ClickhouseTable.java | 117 +++++++++
.../flink/clickhouse/sink/file/FileTransfer.java} | 13 +-
.../clickhouse/sink/file/ScpFileTransfer.java | 115 +++++++++
.../sink/inject/ArrayInjectFunction.java | 25 +-
.../sink/inject/BigDecimalInjectFunction.java | 18 +-
.../sink/inject/ClickhouseFieldInjectFunction.java | 46 ++++
.../clickhouse/sink/inject/DateInjectFunction.java | 30 +--
.../sink/inject/DateTimeInjectFunction.java | 30 +--
.../sink/inject/DoubleInjectFunction.java | 36 ++-
.../sink/inject/FloatInjectFunction.java | 30 +--
.../clickhouse/sink/inject/IntInjectFunction.java | 28 +-
.../clickhouse/sink/inject/LongInjectFunction.java | 21 +-
.../sink/inject/StringInjectFunction.java | 28 +-
.../org.apache.seatunnel.flink.BaseFlinkSink | 3 +-
.../seatunnel-connector-flink-console/pom.xml | 5 +-
.../seatunnel-connector-flink-doris/pom.xml | 5 +-
.../seatunnel-connector-flink-druid/pom.xml | 4 +-
.../pom.xml | 5 +-
.../seatunnel-connector-flink-fake/pom.xml | 5 +-
.../seatunnel-connector-flink-file/pom.xml | 5 +-
.../seatunnel-connector-flink-influxdb/pom.xml | 4 +-
.../seatunnel-connector-flink-jdbc/pom.xml | 5 +-
.../seatunnel-connector-flink-kafka/pom.xml | 5 +-
.../seatunnel-connector-flink-socket/pom.xml | 5 +-
.../seatunnel-connectors-spark/pom.xml | 5 +-
.../seatunnel-connector-spark-clickhouse/pom.xml | 5 +-
.../seatunnel-connector-spark-console/pom.xml | 5 +-
.../seatunnel-connector-spark-doris/pom.xml | 5 +-
.../pom.xml | 5 +-
.../seatunnel-connector-spark-email/pom.xml | 5 +-
.../seatunnel-connector-spark-fake/pom.xml | 5 +-
.../seatunnel-connector-spark-file/pom.xml | 5 +-
.../seatunnel-connector-spark-hbase/pom.xml | 5 +-
.../seatunnel-connector-spark-hive/pom.xml | 5 +-
.../seatunnel-connector-spark-hudi/pom.xml | 5 +-
.../seatunnel-connector-spark-iceberg/pom.xml | 5 +-
.../seatunnel-connector-spark-jdbc/pom.xml | 5 +-
.../seatunnel-connector-spark-kafka/pom.xml | 5 +-
.../seatunnel-connector-spark-kudu/pom.xml | 5 +-
.../seatunnel-connector-spark-mongodb/pom.xml | 5 +-
.../seatunnel-connector-spark-neo4j/pom.xml | 5 +-
.../seatunnel-connector-spark-phoenix/pom.xml | 5 +-
.../seatunnel-connector-spark-redis/pom.xml | 5 +-
.../seatunnel-connector-spark-socket/pom.xml | 5 +-
.../seatunnel-connector-spark-tidb/pom.xml | 5 +-
seatunnel-core/pom.xml | 4 +-
seatunnel-core/seatunnel-core-base/pom.xml | 5 +-
seatunnel-core/seatunnel-core-flink-sql/pom.xml | 4 +-
seatunnel-core/seatunnel-core-flink/pom.xml | 10 +-
seatunnel-core/seatunnel-core-spark/pom.xml | 4 +-
seatunnel-dist/pom.xml | 4 +-
seatunnel-e2e/seatunnel-flink-e2e/pom.xml | 7 +
.../apache/seatunnel/e2e/flink/FlinkContainer.java | 4 +-
.../flink/clickhouse/FakeSourceToClickhouseIT.java | 118 +++++++++
.../e2e/flink/fake/FakeSourceToConsoleIT.java | 2 +-
.../fakesource_to_clickhouse.conf} | 10 +-
seatunnel-examples/pom.xml | 4 +-
.../seatunnel-flink-examples/pom.xml | 5 +-
.../seatunnel-flink-sql-examples/pom.xml | 4 +-
.../seatunnel-spark-examples/pom.xml | 4 +-
seatunnel-transforms/pom.xml | 4 +-
.../seatunnel-transforms-flink/pom.xml | 5 +-
.../pom.xml | 5 +-
.../seatunnel-transform-flink-split/pom.xml | 5 +-
.../seatunnel-transform-flink-sql/pom.xml | 5 +-
.../pom.xml | 6 +-
.../seatunnel-transforms-spark/pom.xml | 5 +-
.../seatunnel-transform-spark-json/pom.xml | 6 +-
.../seatunnel-transform-spark-split/pom.xml | 5 +-
.../seatunnel-transform-spark-sql/pom.xml | 6 +-
.../dependencies/license.py | 286 ++++++++++++++-------
99 files changed, 2478 insertions(+), 378 deletions(-)
create mode 100644 seatunnel-common/src/main/java/org/apache/seatunnel/common/utils/RetryUtils.java
copy seatunnel-connectors/seatunnel-connectors-flink/{seatunnel-connector-flink-elasticsearch6 => seatunnel-connector-flink-clickhouse}/pom.xml (83%)
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/ConfigKey.java
copy seatunnel-common/src/main/java/org/apache/seatunnel/common/config/DeployMode.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/pojo/ClickhouseFileCopyMethod.java (62%)
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/pojo/DistributedEngine.java
copy seatunnel-core/seatunnel-core-base/src/main/java/org/apache/seatunnel/config/PluginType.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/pojo/IntHolder.java (71%)
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/pojo/Shard.java
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/pojo/ShardMetadata.java
copy seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/{ClickhouseBatchSink.java => ClickhouseFileBatchSink.java} (57%)
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/ClickhouseFileOutputFormat.java
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/ClickhouseOutputFormat.java
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/client/ClickhouseBatchStatement.java
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/client/ClickhouseClient.java
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/client/ShardRouter.java
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/file/ClickhouseTable.java
copy seatunnel-connectors/{seatunnel-connectors-spark/seatunnel-connector-spark-clickhouse/src/main/scala/org/apache/seatunnel/spark/clickhouse/sink/filetransfer/FileTransfer.scala => seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/file/FileTransfer.java} (74%)
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/file/ScpFileTransfer.java
copy seatunnel-apis/seatunnel-api-spark/src/main/java/org/apache/seatunnel/spark/BaseSparkSource.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/ArrayInjectFunction.java (57%)
copy seatunnel-core/seatunnel-core-base/src/main/java/org/apache/seatunnel/command/spark/SparkCommandBuilder.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/BigDecimalInjectFunction.java (60%)
create mode 100644 seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/ClickhouseFieldInjectFunction.java
copy seatunnel-apis/seatunnel-api-spark/src/main/java/org/apache/seatunnel/spark/BaseSparkSource.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/DateInjectFunction.java (56%)
copy seatunnel-apis/seatunnel-api-spark/src/main/java/org/apache/seatunnel/spark/BaseSparkSource.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/DateTimeInjectFunction.java (55%)
copy seatunnel-apis/seatunnel-api-spark/src/main/java/org/apache/seatunnel/spark/BaseSparkTransform.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/DoubleInjectFunction.java (51%)
copy seatunnel-apis/seatunnel-api-spark/src/main/java/org/apache/seatunnel/spark/BaseSparkSource.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/FloatInjectFunction.java (55%)
copy seatunnel-apis/seatunnel-api-spark/src/main/java/org/apache/seatunnel/spark/BaseSparkSource.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/IntInjectFunction.java (56%)
copy seatunnel-core/seatunnel-core-base/src/main/java/org/apache/seatunnel/command/spark/SparkCommandBuilder.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/LongInjectFunction.java (58%)
copy seatunnel-apis/seatunnel-api-spark/src/main/java/org/apache/seatunnel/spark/BaseSparkSink.java => seatunnel-connectors/seatunnel-connectors-flink/seatunnel-connector-flink-clickhouse/src/main/java/org/apache/seatunnel/flink/clickhouse/sink/inject/StringInjectFunction.java (55%)
copy seatunnel-connectors/seatunnel-connectors-flink/{seatunnel-connector-flink-druid => seatunnel-connector-flink-clickhouse}/src/main/resources/META-INF/services/org.apache.seatunnel.flink.BaseFlinkSink (85%)
create mode 100644 seatunnel-e2e/seatunnel-flink-e2e/src/test/java/org/apache/seatunnel/e2e/flink/clickhouse/FakeSourceToClickhouseIT.java
copy seatunnel-e2e/seatunnel-flink-e2e/src/test/resources/{file/fakesource_to_file.conf => clickhouse/fakesource_to_clickhouse.conf} (92%)
copy seatunnel-dist/release-docs/licenses/LICENSE-spark.txt => tools/dependencies/license.py (56%)
mode change 100644 => 100755