You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "sangeetha1706 (via GitHub)" <gi...@apache.org> on 2023/03/19 17:24:32 UTC

[GitHub] [incubator-seatunnel] sangeetha1706 opened a new issue, #4371: Null Pointer Exception while synchronising data from mysql to mysql using mysql cdc connector.

sangeetha1706 opened a new issue, #4371:
URL: https://github.com/apache/incubator-seatunnel/issues/4371

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   Null Pointer Exception while synchronising data from mysql to mysql using mysql cdc connector.
   
   ### SeaTunnel Version
   
   apache-seatunnel-incubating-2.3.0
   
   ### SeaTunnel Config
   
   ```conf
   env {
      job.mode = "STREAMING"
     #jars = "/opt/RND/SANGEETHA/APACHE_SEATUNNEL/apache-seatunnel-incubating-2.3.0/connectors/seatunnel/connector-cdc-mysql-2.3.0.jar"
   }
   source {
     Mysql-CDC {
       result_table_name = "SINK_USER"
       parallelism = 1
       port = 3306
       server-id=5656
       hostname = "10.0.0.82"
       user = "hauser"
       password = "Hauser@7ujm"
       database-name = "test"
       #driver = "com.mysql.cj.jdbc.Driver"
       table-name = "SOURCE_USER"
       base-url = "jdbc:mysql://10.0.0.82:3306"
   }}
   
   transform {
   }
   sink {
   jdbc {
   
   url = "jdbc:mysql://10.0.0.82:3306/test?serverTimezone=GMT%2b8"
           driver = "com.mysql.cj.jdbc.Driver"
           user = "hauser"
           password = "Hauser@7ujm"
           primary_keys = ["ID"]
          table = SINK_USER
   }}
   ~
   ```
   
   
   ### Running Command
   
   ```shell
   /bin/seatunnel.sh -c ./config/MYSQL-CDC.conf -e LOCAL
   ```
   
   
   ### Error Exception
   
   ```log
   2023-03-19 22:49:37,086 ERROR org.apache.seatunnel.core.starter.Seatunnel - Reason:null 
   
   2023-03-19 22:49:37,090 ERROR org.apache.seatunnel.core.starter.Seatunnel - Exception StackTrace:java.lang.NullPointerException
   	at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:212)
   	at org.apache.seatunnel.connectors.seatunnel.cdc.mysql.config.MySqlSourceConfigFactory.create(MySqlSourceConfigFactory.java:61)
   	at org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.MySqlDialect.<init>(MySqlDialect.java:61)
   	at org.apache.seatunnel.connectors.seatunnel.cdc.mysql.source.MySqlIncrementalSource.createDataSourceDialect(MySqlIncrementalSource.java:80)
   	at org.apache.seatunnel.connectors.cdc.base.source.IncrementalSource.prepare(IncrementalSource.java:88)
   	at org.apache.seatunnel.engine.core.parse.ConnectorInstanceLoader.loadSourceInstance(ConnectorInstanceLoader.java:60)
   	at org.apache.seatunnel.engine.core.parse.JobConfigParser.sampleAnalyze(JobConfigParser.java:314)
   	at org.apache.seatunnel.engine.core.parse.JobConfigParser.parse(JobConfigParser.java:125)
   	at org.apache.seatunnel.engine.client.job.JobExecutionEnvironment.getLogicalDag(JobExecutionEnvironment.java:129)
   	at org.apache.seatunnel.engine.client.job.JobExecutionEnvironment.execute(JobExecutionEnvironment.java:121)
   	at org.apache.seatunnel.core.starter.seatunnel.command.ClientExecuteCommand.execute(ClientExecuteCommand.java:91)
   	at org.apache.seatunnel.core.starter.Seatunnel.run(Seatunnel.java:39)
   	at org.apache.seatunnel.core.starter.seatunnel.SeaTunnelClient.main(SeaTunnelClient.java:31)
   ```
   
   
   ### Flink or Spark Version
   
   _No response_
   
   ### Java or Scala Version
   
   _No response_
   
   ### Screenshots
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] lightzhao commented on issue #4371: Null Pointer Exception while synchronising data from mysql to mysql using mysql cdc connector.

Posted by "lightzhao (via GitHub)" <gi...@apache.org>.
lightzhao commented on issue #4371:
URL: https://github.com/apache/incubator-seatunnel/issues/4371#issuecomment-1482475848

   Your Mysql-CDC module configuration is missing the 'database.user' parameter


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] laglangyue commented on issue #4371: Null Pointer Exception while synchronising data from mysql to mysql using mysql cdc connector.

Posted by "laglangyue (via GitHub)" <gi...@apache.org>.
laglangyue commented on issue #4371:
URL: https://github.com/apache/incubator-seatunnel/issues/4371#issuecomment-1476296871

   you lost some conf,such as a query sql.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


[GitHub] [incubator-seatunnel] laglangyue commented on issue #4371: Null Pointer Exception while synchronising data from mysql to mysql using mysql cdc connector.

Posted by "laglangyue (via GitHub)" <gi...@apache.org>.
laglangyue commented on issue #4371:
URL: https://github.com/apache/incubator-seatunnel/issues/4371#issuecomment-1476298418

   please refer to the document to complete necessary configuration


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org