You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/11/10 09:11:36 UTC

[GitHub] [pulsar] yeouchien opened a new issue #8502: Upgrade Debezium to a newer version

yeouchien opened a new issue #8502:
URL: https://github.com/apache/pulsar/issues/8502


   Pulsar currently use [1.0.0.Final](https://github.com/apache/pulsar/blob/0c9648b79ff92271536da07a884ec4854ca97027/pom.xml#L153) version of Debezium. 
   
   This version of Debezium causes issue when using it with Postgres as describe in [here](https://gitter.im/debezium/user?at=5e3d21556f9d3d3498275d2f)
   
   ```
   [debezium-postgresconnector-tiktok-change-event-source-coordinator] ERROR io.debezium.pipeline.ErrorHandler - Producer failure
   java.lang.IllegalArgumentException: Invalid identifier:
           at io.debezium.relational.TableIdParser$TableIdTokenizer.tokenize(TableIdParser.java:68) ~[debezium-core-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.text.TokenStream.start(TokenStream.java:447) ~[debezium-core-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.relational.TableIdParser.parse(TableIdParser.java:28) ~[debezium-core-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.relational.TableId.parse(TableId.java:39) ~[debezium-core-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.connector.postgresql.PostgresSchema.parse(PostgresSchema.java:236) ~[debezium-connector-postgres-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.lambda$execute$0(PostgresStreamingChangeEventSource.java:133) ~[debezium-connector-postgres-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.connector.postgresql.connection.pgproto.PgProtoMessageDecoder.processMessage(PgProtoMessageDecoder.java:53) ~[debezium-connector-postgres-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.deserializeMessages(PostgresReplicationConnection.java:412) ~[debezium-connector-postgres-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.connector.postgresql.connection.PostgresReplicationConnection$1.readPending(PostgresReplicationConnection.java:406) ~[debezium-connector-postgres-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.connector.postgresql.PostgresStreamingChangeEventSource.execute(PostgresStreamingChangeEventSource.java:119) ~[debezium-connector-postgres-1.0.0.Final.jar:1.0.0.Final]
           at io.debezium.pipeline.ChangeEventSourceCoordinator.lambda$start$0(ChangeEventSourceCoordinator.java:99) ~[debezium-core-1.0.0.Final.jar:1.0.0.Final]
           at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_265]
           at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_265]
           at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_265]
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_265]
           at java.lang.Thread.run(Thread.java:748) [?:1.8.0_265]
   ```


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] yeouchien commented on issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
yeouchien commented on issue #8502:
URL: https://github.com/apache/pulsar/issues/8502#issuecomment-755057714


   FYI there's a PR for this issue: https://github.com/apache/pulsar/pull/9036


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] sijie closed issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
sijie closed issue #8502:
URL: https://github.com/apache/pulsar/issues/8502


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pulsar.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] lxcid commented on issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
lxcid commented on issue #8502:
URL: https://github.com/apache/pulsar/issues/8502#issuecomment-744148721


   No problem! Hope to check back on this issue, any chance of dropping in next release?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] arumugamtp commented on issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
arumugamtp commented on issue #8502:
URL: https://github.com/apache/pulsar/issues/8502#issuecomment-751192356


   @hangc0276 => please assign the issue to me.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] hangc0276 commented on issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
hangc0276 commented on issue #8502:
URL: https://github.com/apache/pulsar/issues/8502#issuecomment-727100981


   @arumugamtp  Are you trying to fix it?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] arumugamtp commented on issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
arumugamtp commented on issue #8502:
URL: https://github.com/apache/pulsar/issues/8502#issuecomment-736989192


   @hangc0276  => Yup, I am trying to understand the issue and looking for a fix.
   
   @lxcid => Thanks for the lead..


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] arumugamtp commented on issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
arumugamtp commented on issue #8502:
URL: https://github.com/apache/pulsar/issues/8502#issuecomment-726228144


   I am trying to understand the problem here. Will update in few days. Thank you.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] arumugamtp commented on issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
arumugamtp commented on issue #8502:
URL: https://github.com/apache/pulsar/issues/8502#issuecomment-755874664


   Hi @yeouchien  => I reviewed the code changes of #9036, and looks good to me. Please assign this issue to code author. I will pick up another issue to work on. Thank you.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [pulsar] lxcid commented on issue #8502: Upgrade Debezium to a newer version

Posted by GitBox <gi...@apache.org>.
lxcid commented on issue #8502:
URL: https://github.com/apache/pulsar/issues/8502#issuecomment-735052040


   I think the issue is that debezium 1.0.0 final have a known connection bug with Postgres which is fix in the later version like 1.1.0.Beta1 or 1.0.1.Final. If we bump this version. It should resolve the issue.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org