You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by lc...@apache.org on 2021/10/07 18:30:58 UTC
[beam] branch revert-15636-debezium-1.7.0 created (now 63ef869)
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a change to branch revert-15636-debezium-1.7.0
in repository https://gitbox.apache.org/repos/asf/beam.git.
at 63ef869 Revert "[BEAM-12993] Update to Debezium 1.7.0.Final (#15636)"
This branch includes the following new commits:
new 63ef869 Revert "[BEAM-12993] Update to Debezium 1.7.0.Final (#15636)"
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
[beam] 01/01: Revert "[BEAM-12993] Update to Debezium 1.7.0.Final
(#15636)"
Posted by lc...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
lcwik pushed a commit to branch revert-15636-debezium-1.7.0
in repository https://gitbox.apache.org/repos/asf/beam.git
commit 63ef869da81b04a98e5b688279f862fdc9044525
Author: Lukasz Cwik <lc...@google.com>
AuthorDate: Thu Oct 7 11:29:49 2021 -0700
Revert "[BEAM-12993] Update to Debezium 1.7.0.Final (#15636)"
This reverts commit 190e947273b78a9381695ee6580c4d292915f7fd.
---
CHANGES.md | 1 -
sdks/java/io/debezium/build.gradle | 4 ++--
sdks/java/io/debezium/expansion-service/build.gradle | 2 +-
sdks/java/io/debezium/src/README.md | 6 +++---
.../org/apache/beam/io/debezium/DebeziumIOMySqlConnectorIT.java | 2 +-
5 files changed, 7 insertions(+), 8 deletions(-)
diff --git a/CHANGES.md b/CHANGES.md
index 87c1c50..e3faaf1 100644
--- a/CHANGES.md
+++ b/CHANGES.md
@@ -142,7 +142,6 @@
## I/Os
-* `DebeziumIO` now uses Debezium 1.7.0.Final ([BEAM-12993](https://issues.apache.org/jira/browse/BEAM-12993)).
* Support for X source added (Java/Python) ([BEAM-X](https://issues.apache.org/jira/browse/BEAM-X)).
## New Features / Improvements
diff --git a/sdks/java/io/debezium/build.gradle b/sdks/java/io/debezium/build.gradle
index 692736b..722528f 100644
--- a/sdks/java/io/debezium/build.gradle
+++ b/sdks/java/io/debezium/build.gradle
@@ -54,8 +54,8 @@ dependencies {
permitUnusedDeclared "org.apache.kafka:connect-json:2.5.0" // BEAM-11761
// Debezium dependencies
- compile group: 'io.debezium', name: 'debezium-core', version: '1.7.0.Final'
- testCompile group: 'io.debezium', name: 'debezium-connector-mysql', version: '1.7.0.Final'
+ compile group: 'io.debezium', name: 'debezium-core', version: '1.3.1.Final'
+ testCompile group: 'io.debezium', name: 'debezium-connector-mysql', version: '1.3.1.Final'
}
test {
diff --git a/sdks/java/io/debezium/expansion-service/build.gradle b/sdks/java/io/debezium/expansion-service/build.gradle
index f3a0a30..a183c91 100644
--- a/sdks/java/io/debezium/expansion-service/build.gradle
+++ b/sdks/java/io/debezium/expansion-service/build.gradle
@@ -38,7 +38,7 @@ dependencies {
runtime library.java.slf4j_jdk14
// Debezium runtime dependencies
- def debezium_version = '1.7.0.Final'
+ def debezium_version = '1.3.1.Final'
runtimeOnly group: 'io.debezium', name: 'debezium-connector-mysql', version: debezium_version
runtimeOnly group: 'io.debezium', name: 'debezium-connector-postgres', version: debezium_version
runtimeOnly group: 'io.debezium', name: 'debezium-connector-sqlserver', version: debezium_version
diff --git a/sdks/java/io/debezium/src/README.md b/sdks/java/io/debezium/src/README.md
index 14356d6..4cf9be8 100644
--- a/sdks/java/io/debezium/src/README.md
+++ b/sdks/java/io/debezium/src/README.md
@@ -25,7 +25,7 @@ DebeziumIO is an Apache Beam connector that lets users connect their Events-Driv
### Getting Started
-DebeziumIO uses [Debezium Connectors v1.7](https://debezium.io/documentation/reference/1.7/connectors/) to connect to Apache Beam. All you need to do is choose the Debezium Connector that suits your Debezium setup and pick a [Serializable Function](https://beam.apache.org/releases/javadoc/2.23.0/org/apache/beam/sdk/transforms/SerializableFunction.html), then you will be able to connect to Apache Beam and start building your own Pipelines.
+DebeziumIO uses [Debezium Connectors v1.3](https://debezium.io/documentation/reference/1.3/connectors/) to connect to Apache Beam. All you need to do is choose the Debezium Connector that suits your Debezium setup and pick a [Serializable Function](https://beam.apache.org/releases/javadoc/2.23.0/org/apache/beam/sdk/transforms/SerializableFunction.html), then you will be able to connect to Apache Beam and start building your own Pipelines.
These connectors have been successfully tested and are known to work fine:
* MySQL Connector
@@ -65,7 +65,7 @@ You can also add more configuration, such as Connector-specific Properties with
|Method|Params|Description|
|-|-|-|
|`.withConnectionProperty(propName, propValue)`|_String_, _String_|Adds a custom property to the connector.|
-> **Note:** For more information on custom properties, see your [Debezium Connector](https://debezium.io/documentation/reference/1.7/connectors/) specific documentation.
+> **Note:** For more information on custom properties, see your [Debezium Connector](https://debezium.io/documentation/reference/1.3/connectors/) specific documentation.
Example of a MySQL Debezium Connector setup:
```
@@ -165,7 +165,7 @@ By default, DebeziumIO initializes it with the former, though user may choose th
### Requirements and Supported versions
- JDK v8
-- Debezium Connectors v1.7
+- Debezium Connectors v1.3
- Apache Beam 2.25
## Running Unit Tests
diff --git a/sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/DebeziumIOMySqlConnectorIT.java b/sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/DebeziumIOMySqlConnectorIT.java
index c9b1baf..6056ca0 100644
--- a/sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/DebeziumIOMySqlConnectorIT.java
+++ b/sdks/java/io/debezium/src/test/java/org/apache/beam/io/debezium/DebeziumIOMySqlConnectorIT.java
@@ -89,7 +89,7 @@ public class DebeziumIOMySqlConnectorIT {
.withMaxNumberOfRecords(30)
.withCoder(StringUtf8Coder.of()));
String expected =
- "{\"metadata\":{\"connector\":\"mysql\",\"version\":\"1.7.0.Final\",\"name\":\"dbserver1\","
+ "{\"metadata\":{\"connector\":\"mysql\",\"version\":\"1.3.1.Final\",\"name\":\"dbserver1\","
+ "\"database\":\"inventory\",\"schema\":\"mysql-bin.000003\",\"table\":\"addresses\"},\"before\":null,"
+ "\"after\":{\"fields\":{\"zip\":\"76036\",\"city\":\"Euless\","
+ "\"street\":\"3183 Moore Avenue\",\"id\":10,\"state\":\"Texas\",\"customer_id\":1001,"