[GitHub] [incubator-seatunnel] isMrH commented on issue #2698: [Bug] [Spark Sink tidb] Sink tidb exception

[GitBox <gi...@apache.org>]

isMrH commented on issue #2698:
URL: https://github.com/apache/incubator-seatunnel/issues/2698#issuecomment-1241751749

   @Carl-Zhou-CN Thank you for your answer.
   I removed `connectors/spark/seatunnel-connector-spark-tidb-2.1.2`.
   Do I need to do anything else?
   I also tried replacing `seatunnel-connector-spark-tidb-2.1.2` with `tispark-assembly-2.4.3-scala_2.11.jar` but it still doesn't work
   The following error occurred.
   
   ```
   22/09/09 17:24:13 INFO yarn.Client: 
   	 client token: N/A
   	 diagnostics: User class threw exception: java.lang.RuntimeException: java.lang.ClassNotFoundException: Plugin class not found by name :[tidb]
   	at org.apache.seatunnel.core.base.config.PluginFactory.lambda$createPlugins$7(PluginFactory.java:185)
   	at java.util.ArrayList.forEach(ArrayList.java:1257)
   	at org.apache.seatunnel.core.base.config.PluginFactory.createPlugins(PluginFactory.java:179)
   	at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:55)
   	at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:62)
   	at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
   	at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
   	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.lang.reflect.Method.invoke(Method.java:498)
   	at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:673)
   Caused by: java.lang.ClassNotFoundException: Plugin class not found by name :[tidb]
   	at org.apache.seatunnel.core.base.config.PluginFactory.createPluginInstanceIgnoreCase(PluginFactory.java:221)
   	at org.apache.seatunnel.core.base.config.PluginFactory.lambda$createPlugins$7(PluginFactory.java:181)
   	... 11 more
   
   	 ApplicationMaster host: cdh-07.qd.link-x.host
   	 ApplicationMaster RPC port: 43493
   	 queue: root.users.root
   	 start time: 1662715437408
   	 final status: FAILED
   	 tracking URL: http://cdh-01.qd.link-x.host:8088/proxy/application_1662097049317_8037/
   	 user: root
   22/09/09 17:24:13 ERROR yarn.Client: Application diagnostics message: User class threw exception: java.lang.RuntimeException: java.lang.ClassNotFoundException: Plugin class not found by name :[tidb]
   	at org.apache.seatunnel.core.base.config.PluginFactory.lambda$createPlugins$7(PluginFactory.java:185)
   	at java.util.ArrayList.forEach(ArrayList.java:1257)
   	at org.apache.seatunnel.core.base.config.PluginFactory.createPlugins(PluginFactory.java:179)
   	at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:55)
   	at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:62)
   	at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
   	at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
   	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.lang.reflect.Method.invoke(Method.java:498)
   	at org.apache.spark.deploy.yarn.ApplicationMaster$$anon$2.run(ApplicationMaster.scala:673)
   Caused by: java.lang.ClassNotFoundException: Plugin class not found by name :[tidb]
   	at org.apache.seatunnel.core.base.config.PluginFactory.createPluginInstanceIgnoreCase(PluginFactory.java:221)
   	at org.apache.seatunnel.core.base.config.PluginFactory.lambda$createPlugins$7(PluginFactory.java:181)
   	... 11 more
   
   Exception in thread "main" org.apache.spark.SparkException: Application application_1662097049317_8037 finished with failed status
   	at org.apache.spark.deploy.yarn.Client.run(Client.scala:1155)
   	at org.apache.spark.deploy.yarn.YarnClusterApplication.start(Client.scala:1603)
   	at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:851)
   	at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
   	at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
   	at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
   	at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:926)
   	at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:935)
   	at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
   22/09/09 17:24:13 INFO util.ShutdownHookManager: Shutdown hook called
   22/09/09 17:24:13 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-126a149f-8c22-43e0-b80e-5dbfab8a199a
   22/09/09 17:24:13 INFO util.ShutdownHookManager: Deleting directory /tmp/spark-ab7f566d-bd3b-4031-9816-5ca2c4a49285
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org