You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@streampark.apache.org by "daiviy (via GitHub)" <gi...@apache.org> on 2025/04/03 06:34:46 UTC
[I] [Bug] Could not find any factory for identifier 'mysql-cdc' that implements 'org.apache.flink.table.factories.DynamicTableFactory' in the classpath. [streampark]
daiviy opened a new issue, #4228:
URL: https://github.com/apache/streampark/issues/4228
### Search before asking
- [x] I had searched in the [issues](https://github.com/apache/streampark/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### Java Version
_No response_
### Scala Version
2.12.x
### StreamPark Version
2.1.2
### Flink Version
1.18.0
### Deploy mode
None
### What happened
使用streampark提交flink cdc任务，命令行形式可以提交成功，使用streampark报错，flink cdc jar包放在flink_homede lib目录下
### Error Exception
```log
Caused by: org.apache.flink.table.api.ValidationException: Cannot discover a connector using option: 'connector'='mysql-cdc'
at org.apache.flink.table.factories.FactoryUtil.enrichNoMatchingConnectorError(FactoryUtil.java:798)
at org.apache.flink.table.factories.FactoryUtil.discoverTableFactory(FactoryUtil.java:772)
at org.apache.flink.table.factories.FactoryUtil.createDynamicTableSource(FactoryUtil.java:215)
... 58 more
Caused by: org.apache.flink.table.api.ValidationException: Could not find any factory for identifier 'mysql-cdc' that implements 'org.apache.flink.table.factories.DynamicTableFactory' in the classpath.
Available factory identifiers are:
ads-filestream
ads-filestream-v2
ads-tkio-filestream
blackhole
datagen
file2rds
file2rds-v2
file2rds-v3
filesystem
hbase-2.2.1
jdbc
kafka
paimon
print
redshift
scanner
starrocks
starrocks-v2
upsert-kafka
```
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!(您是否要贡献这个PR?)
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] Could not find any factory for identifier 'mysql-cdc' that implements 'org.apache.flink.table.factories.DynamicTableFactory' in the classpath. [streampark]
Posted by "daiviy (via GitHub)" <gi...@apache.org>.
daiviy commented on issue #4228:
URL: https://github.com/apache/streampark/issues/4228#issuecomment-2774641088
flink run \
-m yarn-cluster \
-ynm ddl_sql_xxxxxxx \
-p 3 \
-yjm 2g \
-ytm 2g \
-ys 1 \
-yD taskmanager.memory.managed.size=0 \
-yD state.backend.latency-track.keyed-state-enabled=true \
-yD taskmanager.memory.managed.fraction=0.5 \
-yD taskmanager.memory.network.fraction=0.04 \
-yD taskmanager.memory.network.min=128mb \
-yD taskmanager.memory.jvm-overhead.fraction=0.02 \
-yD taskmanager.memory.jvm-overhead.max=256mb \
-yD yarn.containers.vcores=1 \
-yD akka.ask.timeout=500s \
-yD web.timeout=6000000 \
-yD env.java.opts.all="-XX:+PrintGCDetails -XX:+PrintGCDateStamps -Dfile.encoding=UTF-8 -Dsun.jnu.encoding=UTF-8" \
-c com.reyun.adsdesk.data.rts.core.SqlJobApplication \
/data/code/jar/xmp_ads_data_rts.jar \
--sql /data/code/xxxxxxxx.sql \
--type 0 \
--checkpointDir "/flink-checkpoint/xxxxxxx" \
--stateBackendType 1 \
--checkpointInterval 60000 \
--checkpointTimeout 86400000 \
--checkpointingMode AT_LEAST_ONCE \
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] Could not find any factory for identifier 'mysql-cdc' that implements 'org.apache.flink.table.factories.DynamicTableFactory' in the classpath. [streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys closed issue #4228: [Bug] Could not find any factory for identifier 'mysql-cdc' that implements 'org.apache.flink.table.factories.DynamicTableFactory' in the classpath.
URL: https://github.com/apache/streampark/issues/4228
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug] Could not find any factory for identifier 'mysql-cdc' that implements 'org.apache.flink.table.factories.DynamicTableFactory' in the classpath. [streampark]
Posted by "wolfboys (via GitHub)" <gi...@apache.org>.
wolfboys commented on issue #4228:
URL: https://github.com/apache/streampark/issues/4228#issuecomment-5523030187
Thanks for your feedback. We are closing this issue because it is outdated.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@streampark.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org