You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Martijn Visser (Jira)" <ji...@apache.org> on 2022/06/10 07:48:00 UTC

[jira] [Closed] (FLINK-27994) ERROR org.apache.flink.runtime.source.coordinator.SourceCoordinator

     [ https://issues.apache.org/jira/browse/FLINK-27994?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Martijn Visser closed FLINK-27994.
----------------------------------
    Resolution: Invalid

[~igniz] Please open ticket related to CDC connectors at https://github.com/ververica/flink-cdc-connectors

>  ERROR org.apache.flink.runtime.source.coordinator.SourceCoordinator
> --------------------------------------------------------------------
>
>                 Key: FLINK-27994
>                 URL: https://issues.apache.org/jira/browse/FLINK-27994
>             Project: Flink
>          Issue Type: Bug
>          Components: Runtime / Coordination
>    Affects Versions: 1.14.2, 1.14.3, 1.14.4
>         Environment: {color:#0e4a8e}<{color}{color:#458588}properties{color}{color:#0e4a8e}>
> {color}{color:#0e4a8e} {color}{color:#bcbf01}<{color}{color:#458588}flink.version{color}{color:#bcbf01}>{color}1.14.4{color:#bcbf01}</{color}{color:#458588}flink.version{color}{color:#bcbf01}>
> {color}{color:#bcbf01} <{color}{color:#458588}scala.binary.version{color}{color:#bcbf01}>{color}2.12{color:#bcbf01}</{color}{color:#458588}scala.binary.version{color}{color:#bcbf01}>
> {color}{color:#bcbf01} <{color}{color:#458588}hadoop.version{color}{color:#bcbf01}>{color}3.2.1{color:#bcbf01}</{color}{color:#458588}hadoop.version{color}{color:#bcbf01}>
> {color}{color:#bcbf01} <{color}{color:#458588}slf4j.version{color}{color:#bcbf01}>{color}1.7.36{color:#bcbf01}</{color}{color:#458588}slf4j.version{color}{color:#bcbf01}>
> {color}{color:#bcbf01} <{color}{color:#458588}project.build.sourceEncoding{color}{color:#bcbf01}>{color}UTF-8{color:#bcbf01}</{color}{color:#458588}project.build.sourceEncoding{color}{color:#bcbf01}>
> {color}{color:#0e4a8e}</{color}{color:#458588}properties{color}{color:#0e4a8e}>{color}
> {color:#bcbf01}<{color}{color:#458588}dependency{color}{color:#bcbf01}>
> {color}{color:#bcbf01} {color}{color:#bc0ba2}<{color}{color:#458588}groupId{color}{color:#bc0ba2}>{color}com.alibaba{color:#bc0ba2}</{color}{color:#458588}groupId{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}artifactId{color}{color:#bc0ba2}>{color}fastjson{color:#bc0ba2}</{color}{color:#458588}artifactId{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}version{color}{color:#bc0ba2}>{color}1.2.83{color:#bc0ba2}</{color}{color:#458588}version{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}scope{color}{color:#bc0ba2}>{color}provided{color:#bc0ba2}</{color}{color:#458588}scope{color}{color:#bc0ba2}>
> {color}{color:#bcbf01}</{color}{color:#458588}dependency{color}{color:#bcbf01}>
> {color}{color:#bcbf01}
> {color}{color:#bcbf01}<{color}{color:#458588}dependency{color}{color:#bcbf01}>
> {color}{color:#bcbf01} {color}{color:#bc0ba2}<{color}{color:#458588}groupId{color}{color:#bc0ba2}>{color}mysql{color:#bc0ba2}</{color}{color:#458588}groupId{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}artifactId{color}{color:#bc0ba2}>{color}mysql-connector-java{color:#bc0ba2}</{color}{color:#458588}artifactId{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}version{color}{color:#bc0ba2}>{color}8.0.21{color:#bc0ba2}</{color}{color:#458588}version{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}scope{color}{color:#bc0ba2}>{color}provided{color:#bc0ba2}</{color}{color:#458588}scope{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}exclusions{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} {color}{color:#61aa0d}<{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}protobuf-java{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}com.google.protobuf{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#bc0ba2}</{color}{color:#458588}exclusions{color}{color:#bc0ba2}>
> {color}{color:#bcbf01}</{color}{color:#458588}dependency{color}{color:#bcbf01}>{color}
> {color:#bcbf01}<{color}{color:#458588}dependency{color}{color:#bcbf01}>
> {color}{color:#bcbf01} {color}{color:#bc0ba2}<{color}{color:#458588}groupId{color}{color:#bc0ba2}>{color}com.ververica{color:#bc0ba2}</{color}{color:#458588}groupId{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}artifactId{color}{color:#bc0ba2}>{color}flink-connector-mysql-cdc{color:#bc0ba2}</{color}{color:#458588}artifactId{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}version{color}{color:#bc0ba2}>{color}2.2.1{color:#bc0ba2}</{color}{color:#458588}version{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}scope{color}{color:#bc0ba2}>{color}provided{color:#bc0ba2}</{color}{color:#458588}scope{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} <{color}{color:#458588}exclusions{color}{color:#bc0ba2}>
> {color}{color:#bc0ba2} {color}{color:#61aa0d}<{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}guava{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}com.google.guava{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}jackson-core{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}com.fasterxml.jackson.core{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}jackson-databind{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}com.fasterxml.jackson.core{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}slf4j-api{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}org.slf4j{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}kafka-clients{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}org.apache.kafka{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}jackson-jaxrs-json-provider{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}com.fasterxml.jackson.jaxrs{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}jaxb-api{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}javax.xml.bind{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}javassist{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}org.javassist{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}jetty-util{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}org.eclipse.jetty{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}jetty-servlet{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}org.eclipse.jetty{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}commons-lang3{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}org.apache.commons{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} <{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#3f9101}<{color}{color:#458588}artifactId{color}{color:#3f9101}>{color}flink-shaded-guava{color:#3f9101}</{color}{color:#458588}artifactId{color}{color:#3f9101}>
> {color}{color:#3f9101} <{color}{color:#458588}groupId{color}{color:#3f9101}>{color}org.apache.flink{color:#3f9101}</{color}{color:#458588}groupId{color}{color:#3f9101}>
> {color}{color:#3f9101} {color}{color:#61aa0d}</{color}{color:#458588}exclusion{color}{color:#61aa0d}>
> {color}{color:#61aa0d} {color}{color:#bc0ba2}</{color}{color:#458588}exclusions{color}{color:#bc0ba2}>
> {color}{color:#bcbf01}</{color}{color:#458588}dependency{color}{color:#bcbf01}>
> {color}
>  
>            Reporter: wangkang
>            Priority: Minor
>         Attachments: image-2022-06-10-14-50-05-003.png
>
>
> 使用flink cdc 2.2.0报错
> 2661 [jobmanager-io-thread-1] WARN  org.apache.flink.runtime.util.HadoopUtils  - Could not find Hadoop configuration via any of the supported methods (Flink configuration, environment variables).
> 6604 [SourceCoordinator-Source: MySQL Source] ERROR org.apache.flink.runtime.source.coordinator.SourceCoordinator  - Uncaught exception in the SplitEnumerator for Source Source: MySQL Source while starting the SplitEnumerator.. Triggering job failover.
> java.lang.NoClassDefFoundError: org/apache/flink/shaded/guava18/com/google/common/util/concurrent/ThreadFactoryBuilder
>     at com.ververica.cdc.connectors.mysql.source.assigners.MySqlSnapshotSplitAssigner.startAsynchronouslySplit(MySqlSnapshotSplitAssigner.java:195)
>     at com.ververica.cdc.connectors.mysql.source.assigners.MySqlSnapshotSplitAssigner.open(MySqlSnapshotSplitAssigner.java:163)
>     at com.ververica.cdc.connectors.mysql.source.assigners.MySqlHybridSplitAssigner.open(MySqlHybridSplitAssigner.java:95)
>     at com.ververica.cdc.connectors.mysql.source.enumerator.MySqlSourceEnumerator.start(MySqlSourceEnumerator.java:101)
>     at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$start$0(SourceCoordinator.java:136)
>     at org.apache.flink.runtime.source.coordinator.SourceCoordinator.lambda$runInEventLoop$8(SourceCoordinator.java:329)
>     at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
>     at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>     at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
>     at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
>     at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>     at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>     at java.lang.Thread.run(Thread.java:748)
> Caused by: java.lang.ClassNotFoundException: org.apache.flink.shaded.guava18.com.google.common.util.concurrent.ThreadFactoryBuilder
>     at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>     at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
>     at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>     ... 13 more 
> !image-2022-06-10-14-50-05-003.png!
>  



--
This message was sent by Atlassian Jira
(v8.20.7#820007)