You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/05/11 13:46:20 UTC
[GitHub] [incubator-seatunnel] tmljob opened a new pull request, #1855: [Improve][IT]Solve the path problem when IT runs under windows
tmljob opened a new pull request, #1855:
URL: https://github.com/apache/incubator-seatunnel/pull/1855
<!--
Thank you for contributing to SeaTunnel! Please make sure that your code changes
are covered with tests. And in case of new features or big changes
remember to adjust the documentation.
Feel free to ping committers for the review!
## Contribution Checklist
- Make sure that the pull request corresponds to a [GITHUB issue](https://github.com/apache/incubator-seatunnel/issues).
- Name the pull request in the form "[Feature] [component] Title of the pull request", where *Feature* can be replaced by `Hotfix`, `Bug`, etc.
- Minor fixes should be named following this pattern: `[hotfix] [docs] Fix typo in README.md doc`.
-->
## Purpose of this pull request
Solve the path problem when IT runs under windows
<!-- Describe the purpose of this pull request. For example: This pull request adds checkstyle plugin.-->
## Check list
* [X ] Code changed are covered with tests, or it does not need tests for reason:
* [ X] If any new Jar binary package adding in your PR, please add License Notice according
[New License Guide](https://github.com/apache/incubator-seatunnel/blob/dev/docs/en/contribution/new-license.md)
* [X ] If necessary, please update the documentation to describe the new feature. https://github.com/apache/incubator-seatunnel/tree/dev/docs
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] tmljob commented on pull request #1855: [Improve][IT]Solve the path problem when IT runs under windows
Posted by GitBox <gi...@apache.org>.
tmljob commented on PR #1855:
URL: https://github.com/apache/incubator-seatunnel/pull/1855#issuecomment-1124456945
In the Windows environment, the log indicates that the related connector jar package cannot be loaded, and the log is detailed in the attachment, but the current IT use case can be executed, which is rather strange.
At 2022-05-12 01:33:58, "Wenjun Ruan" ***@***.***> wrote:
In fact, we have CI on Windows, it can run successfully~. Are you sure this change is needed?
—
Reply to this email directly, view it on GitHub, or unsubscribe.
You are receiving this because you authored the thread.Message ID: ***@***.***>
22/05/12 09:12:44 ERROR SparkContainer: 22/05/12 01:12:39 WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 WARN DependencyUtils: Local jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-webhook-2.1.1-SNAPSHOT.jar does not exist, skipping.
22/05/12 01:12:40 INFO ConfigBuilder: Loading config file: /tmp/fake/fakesource_to_console.conf
22/05/12 01:12:40 INFO ConfigBuilder: parsed config file: {
"env" : {
"spark.app.name" : "SeaTunnel",
"spark.executor.instances" : 2,
"spark.executor.cores" : 1,
"spark.executor.memory" : "1g",
"spark.master" : "local"
},
"source" : [
{
"result_table_name" : "my_dataset",
"plugin_name" : "Fake"
}
],
"transform" : [],
"sink" : [
{
"plugin_name" : "Console"
}
]
}
22/05/12 01:12:40 INFO SparkContext: Running Spark version 2.4.3
22/05/12 01:12:40 INFO SparkContext: Submitted application: SeaTunnel
22/05/12 01:12:40 INFO SecurityManager: Changing view acls to: spark
22/05/12 01:12:40 INFO SecurityManager: Changing modify acls to: spark
22/05/12 01:12:40 INFO SecurityManager: Changing view acls groups to:
22/05/12 01:12:40 INFO SecurityManager: Changing modify acls groups to:
22/05/12 01:12:40 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(spark); groups with view permissions: Set(); users with modify permissions: Set(spark); groups with modify permissions: Set()
22/05/12 01:12:40 INFO Utils: Successfully started service 'sparkDriver' on port 43881.
22/05/12 01:12:40 INFO SparkEnv: Registering MapOutputTracker
22/05/12 01:12:40 INFO SparkEnv: Registering BlockManagerMaster
22/05/12 01:12:40 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
22/05/12 01:12:40 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
22/05/12 01:12:40 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-4fb85862-c852-4dce-ab47-2e0360340937
22/05/12 01:12:40 INFO MemoryStore: MemoryStore started with capacity 366.3 MB
22/05/12 01:12:40 INFO SparkEnv: Registering OutputCommitCoordinator
22/05/12 01:12:40 INFO Utils: Successfully started service 'SparkUI' on port 4040.
22/05/12 01:12:40 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://4d50326a6034:4040
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-clickhouse-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-console-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-doris-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-elasticsearch-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-email-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-fake-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-feishu-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-file-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hbase-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hive-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-http-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-hudi-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-iceberg-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-jdbc-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kafka-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-kudu-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-mongodb-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-neo4j-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-phoenix-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-redis-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-socket-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/05/12 01:12:40 ERROR SparkContext: Failed to add file:/opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar to Spark environment
java.io.FileNotFoundException: Jar /opt/bitnami/spark/tmpsparkseatunnelconnectorssparkseatunnel-connector-spark-tidb-2.1.1-SNAPSHOT.jar not found
at org.apache.spark.SparkContext.addJarFile$1(SparkContext.scala:1838)
at org.apache.spark.SparkContext.addJar(SparkContext.scala:1868)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at org.apache.spark.SparkContext$$anonfun$12.apply(SparkContext.scala:458)
at scala.collection.immutable.List.foreach(List.scala:392)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:458)
at org.apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2520)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:935)
at org.apache.spark.sql.SparkSession$Builder$$anonfun$7.apply(SparkSession.scala:926)
at scala.Option.getOrElse(Option.scala:121)
at org.apache.spark.sql.SparkSession$Builder.getOrCreate(SparkSession.scala:926)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:106)
at org.apache.seatunnel.spark.SparkEnvironment.prepare(SparkEnvironment.java:43)
at org.apache.seatunnel.core.base.config.EnvironmentFactory.getEnvironment(EnvironmentFactory.java:61)
at org.apache.seatunnel.core.base.config.ExecutionContext.<init>(ExecutionContext.java:49)
at org.apache.seatunnel.core.spark.command.SparkTaskExecuteCommand.execute(SparkTaskExecuteCommand.java:52)
at org.apache.seatunnel.core.base.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.spark.SeatunnelSpark.main(SeatunnelSpark.java:32)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
at org.apache.spark.deploy.SparkSu
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] tmljob closed pull request #1855: [Improve][IT]Solve the path problem when IT runs under windows
Posted by GitBox <gi...@apache.org>.
tmljob closed pull request #1855: [Improve][IT]Solve the path problem when IT runs under windows
URL: https://github.com/apache/incubator-seatunnel/pull/1855
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] wuchunfu commented on pull request #1855: [Improve][IT]Solve the path problem when IT runs under windows
Posted by GitBox <gi...@apache.org>.
wuchunfu commented on PR #1855:
URL: https://github.com/apache/incubator-seatunnel/pull/1855#issuecomment-1125053998
> > > I remember we find the testcontainer has problem on Windows, so in fact we will not run IT in Windows now, do you think if we need to support IT on Windows? @wuchunfu.
> >
> >
> > I develop in the windows environment, and after developing the plug-in, I want to verify it through IT, so I think it is still meaningful for IT to run under windows, and there are problems that can be solved.
>
> It would be great, if we can run IT on Windows, my concern is that can we able to solve this kind of problems, and maintain two environment will cost a lot of attention. But it would be better if you want to maintain this module.
`testcontainers` doesn't seem to be supported in `windows` , so I'll remove this `integration test` first in `ci` , please refer to https://github.com/testcontainers/testcontainers-java/issues/2960 and https://stackoverflow.com/questions/66077884/testcontainers-in-windows-environment-on-github-actions-could-not-find-a-valid , If you can fix that, that's the best.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ruanwenjun commented on pull request #1855: [Improve][IT]Solve the path problem when IT runs under windows
Posted by GitBox <gi...@apache.org>.
ruanwenjun commented on PR #1855:
URL: https://github.com/apache/incubator-seatunnel/pull/1855#issuecomment-1124055724
In fact, we have CI on Windows, it can run success~. Are you sure this change is needed?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ruanwenjun commented on pull request #1855: [Improve][IT]Solve the path problem when IT runs under windows
Posted by GitBox <gi...@apache.org>.
ruanwenjun commented on PR #1855:
URL: https://github.com/apache/incubator-seatunnel/pull/1855#issuecomment-1124465967
> > I remember we find the testcontainer has problem on Windows, so in fact we will not run IT in Windows now, do you think if we need to support IT on Windows? @wuchunfu.
>
> I develop in the windows environment, and after developing the plug-in, I want to verify it through IT, so I think it is still meaningful for IT to run under windows, and there are problems that can be solved.
It would be great, if we can run IT on Windows, my concern is that can we able to solve this kind of problems, and maintain two environment will cost a lot of attention. But it would be better if you want to maintain this module.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] tmljob commented on pull request #1855: [Improve][IT]Solve the path problem when IT runs under windows
Posted by GitBox <gi...@apache.org>.
tmljob commented on PR #1855:
URL: https://github.com/apache/incubator-seatunnel/pull/1855#issuecomment-1124453731
> I remember we find the testcontainer has problem on Windows, so in fact we will not run IT in Windows now, do you think if we need to support IT on Windows? @wuchunfu.
I develop in the windows environment, and after developing the plug-in, I want to verify it through IT, so I think it is still meaningful for IT to run under windows, and there are problems that can be solved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org