You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/06/16 04:41:57 UTC
[GitHub] [incubator-seatunnel] ChenpiDog opened a new issue, #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
ChenpiDog opened a new issue, #2018:
URL: https://github.com/apache/incubator-seatunnel/issues/2018
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
Set Up with Kubernetes, JDBC as source, based on the Flink engine, the task failed.
Dockerfile：
`FROM flink:1.13
ENV SEATUNNEL_VERSION="2.1.0"
RUN wget https://archive.apache.org/dist/incubator/seatunnel/${SEATUNNEL_VERSION}/apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz
RUN tar -xzvf apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz
RUN mkdir -p $FLINK_HOME/usrlib
RUN cp apache-seatunnel-incubating-${SEATUNNEL_VERSION}/lib/seatunnel-core-flink.jar $FLINK_HOME/usrlib/seatunnel-core-flink.jar
RUN rm -fr apache-seatunnel-incubating-${SEATUNNEL_VERSION}*`
### SeaTunnel Version
2.1.0
### SeaTunnel Config
```conf
env {
execution.parallelism = 1
}
source {
JdbcSource {
driver = com.mysql.jdbc.Driver
url = "My Database Address"
username = "My Database Username"
password = "My Database Password"
query = "select column1, column2 from TABLE_NAME"
result_table_name = TABLE_NAME
}
}
transform {
sql {
sql = "select column1, column2 from TABLE_NAME"
}
}
sink {
ConsoleSink {}
}
```
### Running Command
```shell
docker build -t seatunnel:2.1.0-flink-1.13 -f Dockerfile .
kubectl create -f https://github.com/jetstack/cert-manager/releases/download/v1.7.1/cert-manager.yaml
helm repo add flink-operator-repo https://downloads.apache.org/flink/flink-kubernetes-operator-0.1.0/
helm install flink-kubernetes-operator flink-operator-repo/flink-kubernetes-operator
kubectl get pods
mkdir -p /mnt/data
mv flink.streaming.conf /mnt/data/
kubectl apply -f seatunnel-flink.yaml
kubectl logs -f deploy/seatunnel-flink-streaming-example
```
### Error Exception
```log
sed: couldn't open temporary file /opt/flink/conf/sed1i8RS3: Read-only file system
sed: couldn't open temporary file /opt/flink/conf/sedsVQITo: Read-only file system
/docker-entrypoint.sh: line 73: /opt/flink/conf/flink-conf.yaml: Read-only file system
sed: couldn't open temporary file /opt/flink/conf/sedD2KtW7: Read-only file system
/docker-entrypoint.sh: line 88: /opt/flink/conf/flink-conf.yaml.tmp: Read-only file system
Starting kubernetes-application as a console application on host seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.
2022-06-16 03:42:24,557 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
2022-06-16 03:42:24,559 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Preconfiguration:
2022-06-16 03:42:24,559 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] -
RESOURCE_PARAMS extraction logs:
jvm_params: -Xmx1530082096 -Xms1530082096 -XX:MaxMetaspaceSize=268435456
dynamic_configs: -D jobmanager.memory.off-heap.size=134217728b -D jobmanager.memory.jvm-overhead.min=214748368b -D jobmanager.memory.jvm-metaspace.size=268435456b -D jobmanager.memory.heap.size=1530082096b -D jobmanager.memory.jvm-overhead.max=214748368b
logs: INFO [] - Loading configuration property: blob.server.port, 6124
INFO [] - Loading configuration property: kubernetes.jobmanager.replicas, 1
INFO [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default
INFO [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0
INFO [] - Loading configuration property: kubernetes.service-account, flink
INFO [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example
INFO [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf
INFO [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13
INFO [] - Loading configuration property: parallelism.default, 2
INFO [] - Loading configuration property: kubernetes.namespace, default
INFO [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
INFO [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP
INFO [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink
INFO [] - Loading configuration property: taskmanager.memory.process.size, 2048m
INFO [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
INFO [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml
INFO [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml
INFO [] - Loading configuration property: execution.target, kubernetes-application
INFO [] - Loading configuration property: jobmanager.memory.process.size, 2048m
INFO [] - Loading configuration property: jobmanager.rpc.port, 6123
INFO [] - Loading configuration property: taskmanager.rpc.port, 6122
INFO [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
INFO [] - Loading configuration property: queryable-state.proxy.ports, 6125
INFO [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar
INFO [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0
INFO [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml
INFO [] - Final Master Memory configuration:
INFO [] - Total Process Memory: 2.000gb (2147483648 bytes)
INFO [] - Total Flink Memory: 1.550gb (1664299824 bytes)
INFO [] - JVM Heap: 1.425gb (1530082096 bytes)
INFO [] - Off-heap: 128.000mb (134217728 bytes)
INFO [] - JVM Metaspace: 256.000mb (268435456 bytes)
INFO [] - JVM Overhead: 204.800mb (214748368 bytes)
2022-06-16 03:42:24,559 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesApplicationClusterEntrypoint (Version: 1.13.6, Scala: 2.12, Rev:b2ca390, Date:2022-02-03T14:54:22+01:00)
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - OS current user: flink
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Current Hadoop/Kerberos user: <no hadoop dependency found>
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM: OpenJDK 64-Bit Server VM - Oracle Corporation - 1.8/25.332-b09
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Maximum heap size: 1411 MiBytes
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JAVA_HOME: /usr/local/openjdk-8
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - No Hadoop Dependency available
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - JVM Options:
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xmx1530082096
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Xms1530082096
2022-06-16 03:42:24,560 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -XX:MaxMetaspaceSize=268435456
2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog.file=/opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.log
2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configuration=file:/opt/flink/conf/log4j-console.properties
2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlog4j.configurationFile=file:/opt/flink/conf/log4j-console.properties
2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -Dlogback.configurationFile=file:/opt/flink/conf/logback-console.xml
2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Program Arguments:
2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-06-16 03:42:24,561 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.off-heap.size=134217728b
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.min=214748368b
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-metaspace.size=268435456b
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.heap.size=1530082096b
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - -D
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - jobmanager.memory.jvm-overhead.max=214748368b
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Classpath: /opt/flink/lib/flink-csv-1.13.6.jar:/opt/flink/lib/flink-json-1.13.6.jar:/opt/flink/lib/flink-shaded-zookeeper-3.4.14.jar:/opt/flink/lib/flink-table-blink_2.12-1.13.6.jar:/opt/flink/lib/flink-table_2.12-1.13.6.jar:/opt/flink/lib/log4j-1.2-api-2.17.1.jar:/opt/flink/lib/log4j-api-2.17.1.jar:/opt/flink/lib/log4j-core-2.17.1.jar:/opt/flink/lib/log4j-slf4j-impl-2.17.1.jar:/opt/flink/lib/flink-dist_2.12-1.13.6.jar:::
2022-06-16 03:42:24,562 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - --------------------------------------------------------------------------------
2022-06-16 03:42:24,563 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Registered UNIX signal handlers for [TERM, HUP, INT]
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.replicas, 1
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13
2022-06-16 03:42:24,571 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 2
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.namespace, default
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 2048m
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml
2022-06-16 03:42:24,572 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application
2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 2048m
2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122
2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: queryable-state.proxy.ports, 6125
2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar
2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0
2022-06-16 03:42:24,573 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml
2022-06-16 03:42:24,879 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Starting KubernetesApplicationClusterEntrypoint.
2022-06-16 03:42:24,885 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install default filesystem.
2022-06-16 03:42:24,888 INFO org.apache.flink.core.fs.FileSystem [] - Hadoop is not in the classpath/dependencies. The extended set of supported File Systems via Hadoop is not available.
2022-06-16 03:42:24,948 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Install security context.
2022-06-16 03:42:24,954 INFO org.apache.flink.runtime.security.modules.HadoopModuleFactory [] - Cannot create Hadoop Security Module because Hadoop cannot be found in the Classpath.
2022-06-16 03:42:24,956 INFO org.apache.flink.runtime.security.modules.JaasModule [] - Jaas file will be created as /tmp/jaas-7841622857492996650.conf.
2022-06-16 03:42:24,959 INFO org.apache.flink.runtime.security.contexts.HadoopSecurityContextFactory [] - Cannot install HadoopSecurityContext because Hadoop cannot be found in the Classpath.
2022-06-16 03:42:24,960 INFO org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Initializing cluster services.
2022-06-16 03:42:24,972 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address seatunnel-flink-streaming-example.default:6123, bind address 0.0.0.0:6123.
2022-06-16 03:42:25,875 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
2022-06-16 03:42:25,939 INFO akka.remote.Remoting [] - Starting remoting
2022-06-16 03:42:26,142 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink@seatunnel-flink-streaming-example.default:6123]
2022-06-16 03:42:26,336 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink@seatunnel-flink-streaming-example.default:6123
2022-06-16 03:42:26,353 INFO org.apache.flink.configuration.Configuration [] - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2022-06-16 03:42:26,360 INFO org.apache.flink.runtime.blob.BlobServer [] - Created BLOB server storage directory /tmp/blobStore-57d1cab5-5fdc-42e1-91d8-90e18692e21d
2022-06-16 03:42:26,362 INFO org.apache.flink.runtime.blob.BlobServer [] - Started BLOB server at 0.0.0.0:6124 - max concurrent requests: 50 - max backlog: 1000
2022-06-16 03:42:26,368 INFO org.apache.flink.runtime.metrics.MetricRegistryImpl [] - No metrics reporter configured, no metrics will be exposed/reported.
2022-06-16 03:42:26,370 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Trying to start actor system, external address seatunnel-flink-streaming-example.default:0, bind address 0.0.0.0:0.
2022-06-16 03:42:26,436 INFO akka.event.slf4j.Slf4jLogger [] - Slf4jLogger started
2022-06-16 03:42:26,441 INFO akka.remote.Remoting [] - Starting remoting
2022-06-16 03:42:26,448 INFO akka.remote.Remoting [] - Remoting started; listening on addresses :[akka.tcp://flink-metrics@seatunnel-flink-streaming-example.default:44706]
2022-06-16 03:42:26,456 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcServiceUtils [] - Actor system started at akka.tcp://flink-metrics@seatunnel-flink-streaming-example.default:44706
2022-06-16 03:42:26,531 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.metrics.dump.MetricQueryService at akka://flink-metrics/user/rpc/MetricQueryService .
2022-06-16 03:42:26,646 INFO org.apache.flink.configuration.Configuration [] - Config uses fallback configuration key 'jobmanager.rpc.address' instead of key 'rest.address'
2022-06-16 03:42:26,647 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Upload directory /tmp/flink-web-cfab19b8-ae0f-40e5-a09e-7f80d7ea93a3/flink-web-upload does not exist.
2022-06-16 03:42:26,648 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Created directory /tmp/flink-web-cfab19b8-ae0f-40e5-a09e-7f80d7ea93a3/flink-web-upload for file uploads.
2022-06-16 03:42:26,662 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Starting rest endpoint.
2022-06-16 03:42:26,833 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component log file: /opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.log
2022-06-16 03:42:26,833 INFO org.apache.flink.runtime.webmonitor.WebMonitorUtils [] - Determined location of main cluster component stdout file: /opt/flink/log/flink--kubernetes-application-0-seatunnel-flink-streaming-example-6c5cbb8969-b8zl2.out
2022-06-16 03:42:27,055 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Rest endpoint listening at seatunnel-flink-streaming-example.default:8081
2022-06-16 03:42:27,056 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - http://seatunnel-flink-streaming-example.default:8081 was granted leadership with leaderSessionID=00000000-0000-0000-0000-000000000000
2022-06-16 03:42:27,057 INFO org.apache.flink.runtime.jobmaster.MiniDispatcherRestEndpoint [] - Web frontend listening at http://seatunnel-flink-streaming-example.default:8081.
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: blob.server.port, 6124
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.replicas, 1
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.address, seatunnel-flink-streaming-example.default
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.taskmanager.cpu, 2.0
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.service-account, flink
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.cluster-id, seatunnel-flink-streaming-example
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.program-args, --config;/data/mysql-polardb.base_station.conf
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.container.image, seatunnel:2.1.0-flink-1.13
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: parallelism.default, 2
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.namespace, default
2022-06-16 03:42:27,544 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.numberOfTaskSlots, 2
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.rest-service.exposed.type, ClusterIP
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: $internal.application.main, org.apache.seatunnel.SeatunnelFlink
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.memory.process.size, 2048m
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.internal.jobmanager.entrypoint.class, org.apache.flink.kubernetes.entrypoint.KubernetesApplicationClusterEntrypoint
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file, /tmp/podTemplate_9550636116110032429.yaml
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.taskmanager, /tmp/podTemplate_17231682581835062062.yaml
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: execution.target, kubernetes-application
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.memory.process.size, 2048m
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: jobmanager.rpc.port, 6123
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: taskmanager.rpc.port, 6122
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: internal.cluster.execution-mode, NORMAL
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: queryable-state.proxy.ports, 6125
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: pipeline.jars, local:///opt/flink/usrlib/seatunnel-core-flink.jar
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.jobmanager.cpu, 1.0
2022-06-16 03:42:27,545 INFO org.apache.flink.configuration.GlobalConfiguration [] - Loading configuration property: kubernetes.pod-template-file.jobmanager, /tmp/podTemplate_9424114359362793158.yaml
2022-06-16 03:42:27,549 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager at akka://flink/user/rpc/resourcemanager_0 .
2022-06-16 03:42:27,562 INFO org.apache.flink.runtime.dispatcher.runner.DefaultDispatcherRunner [] - DefaultDispatcherRunner was granted leadership with leader id 00000000-0000-0000-0000-000000000000. Creating new DispatcherLeaderProcess.
2022-06-16 03:42:27,565 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Start SessionDispatcherLeaderProcess.
2022-06-16 03:42:27,630 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Recover all persisted job graphs.
2022-06-16 03:42:27,630 INFO org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess [] - Successfully recovered 0 persisted job graphs.
2022-06-16 03:42:27,632 INFO org.apache.flink.runtime.resourcemanager.active.ActiveResourceManager [] - Starting the resource manager.
2022-06-16 03:42:27,638 INFO org.apache.flink.runtime.rpc.akka.AkkaRpcService [] - Starting RPC endpoint for org.apache.flink.runtime.dispatcher.StandaloneDispatcher at akka://flink/user/rpc/dispatcher_1 .
2022-06-16 03:42:27,651 INFO org.apache.flink.client.ClientUtils [] - Starting program (detached: true)
2022-06-16 03:42:27,758 INFO org.apache.seatunnel.config.ConfigBuilder [] - Loading config file: /data/mysql-polardb.base_station.conf
2022-06-16 03:42:27,856 INFO org.apache.seatunnel.config.ConfigBuilder [] - parsed config file: {
"env" : {
"execution.parallelism" : 1
},
"sink" : [
{
"plugin_name" : "ConsoleSink"
}
],
"source" : [
{
"driver" : "com.mysql.jdbc.Driver",
"password" : "My Database Password",
"plugin_name" : "JdbcSource",
"query" : "select column1, column2 from TABLE_NAME",
"result_table_name" : "TABLE_NAME",
"url" : "My Database Address",
"username" : "My Database Username"
}
],
"transform" : [
{
"plugin_name" : "sql",
"sql" : "select column1, column2 from TABLE_NAME"
}
]
}
2022-06-16 03:42:28,629 WARN org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap [] - Application failed unexpectedly:
java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_332]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:257) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$1(ApplicationDispatcherBootstrap.java:212) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_332]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_332]
at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:159) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.13.6.jar:1.13.6]
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
... 11 more
Caused by: java.lang.NoClassDefFoundError: org/apache/flink/connector/jdbc/JdbcInputFormat
at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?]
at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?]
at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?]
at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332]
at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?]
at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?]
at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?]
at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
... 10 more
Caused by: java.lang.ClassNotFoundException: org.apache.flink.connector.jdbc.JdbcInputFormat
at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_332]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_332]
at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_332]
at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?]
at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?]
at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?]
at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332]
at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?]
at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?]
at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?]
at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
... 10 more
2022-06-16 03:42:28,641 ERROR org.apache.flink.runtime.entrypoint.ClusterEntrypoint [] - Fatal error occurred in the cluster entrypoint.
org.apache.flink.util.FlinkException: Application failed unexpectedly.
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAndShutdownClusterAsync$0(ApplicationDispatcherBootstrap.java:170) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at java.util.concurrent.CompletableFuture.uniHandle(CompletableFuture.java:836) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture$UniHandle.tryFire(CompletableFuture.java:811) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:488) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture.completeExceptionally(CompletableFuture.java:1990) ~[?:1.8.0_332]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:257) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.lambda$runApplicationAsync$1(ApplicationDispatcherBootstrap.java:212) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_332]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_332]
at org.apache.flink.runtime.concurrent.akka.ActorSystemScheduledExecutorAdapter$ScheduledFutureTask.run(ActorSystemScheduledExecutorAdapter.java:159) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.TaskInvocation.run(AbstractDispatcher.scala:40) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(ForkJoinExecutorConfigurator.scala:44) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) [flink-dist_2.12-1.13.6.jar:1.13.6]
at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107) [flink-dist_2.12-1.13.6.jar:1.13.6]
Caused by: java.util.concurrent.CompletionException: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:292) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:308) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture.uniCompose(CompletableFuture.java:957) ~[?:1.8.0_332]
at java.util.concurrent.CompletableFuture$UniCompose.tryFire(CompletableFuture.java:940) ~[?:1.8.0_332]
... 13 more
Caused by: org.apache.flink.client.deployment.application.ApplicationExecutionException: Could not execute application.
... 11 more
Caused by: java.lang.NoClassDefFoundError: org/apache/flink/connector/jdbc/JdbcInputFormat
at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?]
at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?]
at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?]
at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332]
at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?]
at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?]
at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?]
at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
... 10 more
Caused by: java.lang.ClassNotFoundException: org.apache.flink.connector.jdbc.JdbcInputFormat
at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_332]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_332]
at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:65) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_332]
at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:163) ~[?:?]
at org.apache.seatunnel.flink.source.JdbcSource.prepare(JdbcSource.java:60) ~[?:?]
at org.apache.seatunnel.Seatunnel.lambda$prepare$0(Seatunnel.java:160) ~[?:?]
at java.util.ArrayList.forEach(ArrayList.java:1259) ~[?:1.8.0_332]
at org.apache.seatunnel.Seatunnel.prepare(Seatunnel.java:160) ~[?:?]
at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:104) ~[?:?]
at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:65) ~[?:?]
at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:29) ~[?:?]
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:1.8.0_332]
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) ~[?:1.8.0_332]
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:1.8.0_332]
at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_332]
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
at org.apache.flink.client.deployment.application.ApplicationDispatcherBootstrap.runApplicationEntryPoint(ApplicationDispatcherBootstrap.java:242) ~[flink-dist_2.12-1.13.6.jar:1.13.6]
... 10 more
2022-06-16 03:42:29,651 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2022-06-16 03:42:29,653 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2022-06-16 03:42:29,654 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Shutting down remote daemon.
2022-06-16 03:42:29,655 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remote daemon shut down; proceeding with flushing remote transports.
2022-06-16 03:42:29,735 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
2022-06-16 03:42:29,736 INFO akka.remote.RemoteActorRefProvider$RemotingTerminator [] - Remoting shut down.
```
### Flink or Spark Version
Flink version：1.13
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] h472591847 commented on issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
Posted by GitBox <gi...@apache.org>.
h472591847 commented on issue #2018:
URL: https://github.com/apache/incubator-seatunnel/issues/2018#issuecomment-1178712925
Excuse me, how can I add dependencies: flink-connector-jdbc_xxxx in kubernetes
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ChenpiDog commented on issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
Posted by GitBox <gi...@apache.org>.
ChenpiDog commented on issue #2018:
URL: https://github.com/apache/incubator-seatunnel/issues/2018#issuecomment-1158621377
@ashulin What is the missing dependency? I put MySQL JDBC (mysql-connector-java-8.0.17.jar) into $FLINK_HOME/usrlib/, still not.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ChenpiDog commented on issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
Posted by GitBox <gi...@apache.org>.
ChenpiDog commented on issue #2018:
URL: https://github.com/apache/incubator-seatunnel/issues/2018#issuecomment-1158637307
> @ashulin What is the missing dependency? I put MySQL JDBC (mysql-connector-java-8.0.17.jar) into $FLINK_HOME/usrlib/, still not.
$FLINK_HOME/lib/, still not
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
Posted by GitBox <gi...@apache.org>.
Hisoka-X commented on issue #2018:
URL: https://github.com/apache/incubator-seatunnel/issues/2018#issuecomment-1166768226
Close by resolved
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ChenpiDog commented on issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
Posted by GitBox <gi...@apache.org>.
ChenpiDog commented on issue #2018:
URL: https://github.com/apache/incubator-seatunnel/issues/2018#issuecomment-1265409013
> Excuse me, how can I add dependencies: flink-connector-jdbc_xxxx in kubernetes
@h472591847 Sorry, have you solved it now? The following is my docker file for reference.
FROM flink:1.13.6
ENV SEATUNNEL_VERSION="2.1.0"
RUN wget https://archive.apache.org/dist/incubator/seatunnel/${SEATUNNEL_VERSION}/apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz
RUN tar -xzvf apache-seatunnel-incubating-${SEATUNNEL_VERSION}-bin.tar.gz
RUN mkdir -p $FLINK_HOME/usrlib
RUN cp apache-seatunnel-incubating-${SEATUNNEL_VERSION}/lib/seatunnel-core-flink.jar $FLINK_HOME/usrlib/seatunnel-core-flink.jar
ADD ./flink-connector-jdbc_2.11-1.13.6.jar $FLINK_HOME/lib/
ADD ./mysql-connector-java-8.0.17.jar $FLINK_HOME/lib/
RUN rm -fr apache-seatunnel-incubating-${SEATUNNEL_VERSION}*
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ChenpiDog commented on issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
Posted by GitBox <gi...@apache.org>.
ChenpiDog commented on issue #2018:
URL: https://github.com/apache/incubator-seatunnel/issues/2018#issuecomment-1158677057
Add dependency: flink-connector-jdbc_2.11-1.11.6.jar, solve the problem
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ashulin commented on issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
Posted by GitBox <gi...@apache.org>.
ashulin commented on issue #2018:
URL: https://github.com/apache/incubator-seatunnel/issues/2018#issuecomment-1157631468
'seatunnel-core-flink' contains the Jdbc connector jar.
You can refer to the link: https://seatunnel.apache.org/docs/2.1.0/flink/quick-start
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] Hisoka-X closed issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
Posted by GitBox <gi...@apache.org>.
Hisoka-X closed issue #2018: [Bug] [Set Up with Kubernetes, JDBC as source] According to the official website document, the data synchronization with MySQL as the source failed.
URL: https://github.com/apache/incubator-seatunnel/issues/2018
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org