You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/04/26 02:22:33 UTC
[GitHub] [incubator-seatunnel] BenJFan commented on issue #1733: [Bug] [Spark] Can't run SeaTunnel on spark standalone cluster.
BenJFan commented on issue #1733:
URL: https://github.com/apache/incubator-seatunnel/issues/1733#issuecomment-1109231004
> @BenJFan can you rerun script with `bash -x ./bin/start-seatunnel-spark.sh...` and paste log here?
@yx91490 here
```
➜ apache-seatunnel-incubating-2.1.1-SNAPSHOT git:(dev) ✗ bash -x ./bin/start-seatunnel-spark.sh --config ~/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf -m spark://localhost:7077 -e cluster
+ set -eu
+++ dirname ./bin/start-seatunnel-spark.sh
++ cd ./bin/../
++ pwd
+ APP_DIR=/Users/fanjia/Code/seatunnel-fork/seatunnel-dist/target/apache-seatunnel-incubating-2.1.1-SNAPSHOT
+ CONF_DIR=/Users/fanjia/Code/seatunnel-fork/seatunnel-dist/target/apache-seatunnel-incubating-2.1.1-SNAPSHOT/config
+ APP_JAR=/Users/fanjia/Code/seatunnel-fork/seatunnel-dist/target/apache-seatunnel-incubating-2.1.1-SNAPSHOT/lib/seatunnel-core-spark.jar
+ '[' -f /Users/fanjia/Code/seatunnel-fork/seatunnel-dist/target/apache-seatunnel-incubating-2.1.1-SNAPSHOT/config/seatunnel-env.sh ']'
+ . /Users/fanjia/Code/seatunnel-fork/seatunnel-dist/target/apache-seatunnel-incubating-2.1.1-SNAPSHOT/config/seatunnel-env.sh
++ SPARK_HOME=/Users/fanjia/Tool/spark-2.4.0-bin-hadoop2.6
++ FLINK_HOME=/Users/fanjia/Tool/flink-1.13.6
++ export SEATUNNEL_PRINT_ASCII_LOGO=true
++ SEATUNNEL_PRINT_ASCII_LOGO=true
++ java -cp /Users/fanjia/Code/seatunnel-fork/seatunnel-dist/target/apache-seatunnel-incubating-2.1.1-SNAPSHOT/lib/seatunnel-core-spark.jar org.apache.seatunnel.SparkStarter --config /Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf -m spark://localhost:7077 -e cluster
+ CMD='${SPARK_HOME}/bin/spark-submit --class "org.apache.seatunnel.SeatunnelSpark" --name "SeaTunnelGhy" --master "spark://localhost:7077" --deploy-mode "cluster" --files "plugins.tar.gz,/Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf" --conf "spark.executor.memory=512m" --conf "spark.master=local" --conf "spark.executor.cores=1" --conf "spark.app.name=SeaTunnelGhy" --conf "spark.executor.instances=2" lib/seatunnel-core-spark.jar --config /Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf -m spark://localhost:7077 -e cluster'
+ EXIT_CODE=0
+ '[' 0 -eq 234 ']'
+ '[' 0 -eq 0 ']'
+ echo 'Execute SeaTunnel Flink Job: ${SPARK_HOME}/bin/spark-submit --class "org.apache.seatunnel.SeatunnelSpark" --name "SeaTunnelGhy" --master "spark://localhost:7077" --deploy-mode "cluster" --files "plugins.tar.gz,/Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf" --conf "spark.executor.memory=512m" --conf "spark.master=local" --conf "spark.executor.cores=1" --conf "spark.app.name=SeaTunnelGhy" --conf "spark.executor.instances=2" lib/seatunnel-core-spark.jar --config /Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf -m spark://localhost:7077 -e cluster'
Execute SeaTunnel Flink Job: ${SPARK_HOME}/bin/spark-submit --class "org.apache.seatunnel.SeatunnelSpark" --name "SeaTunnelGhy" --master "spark://localhost:7077" --deploy-mode "cluster" --files "plugins.tar.gz,/Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf" --conf "spark.executor.memory=512m" --conf "spark.master=local" --conf "spark.executor.cores=1" --conf "spark.app.name=SeaTunnelGhy" --conf "spark.executor.instances=2" lib/seatunnel-core-spark.jar --config /Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf -m spark://localhost:7077 -e cluster
+ eval '${SPARK_HOME}/bin/spark-submit' --class '"org.apache.seatunnel.SeatunnelSpark"' --name '"SeaTunnelGhy"' --master '"spark://localhost:7077"' --deploy-mode '"cluster"' --files '"plugins.tar.gz,/Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf"' --conf '"spark.executor.memory=512m"' --conf '"spark.master=local"' --conf '"spark.executor.cores=1"' --conf '"spark.app.name=SeaTunnelGhy"' --conf '"spark.executor.instances=2"' lib/seatunnel-core-spark.jar --config /Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf -m spark://localhost:7077 -e cluster
++ /Users/fanjia/Tool/spark-2.4.0-bin-hadoop2.6/bin/spark-submit --class org.apache.seatunnel.SeatunnelSpark --name SeaTunnelGhy --master spark://localhost:7077 --deploy-mode cluster --files plugins.tar.gz,/Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf --conf spark.executor.memory=512m --conf spark.master=local --conf spark.executor.cores=1 --conf spark.app.name=SeaTunnelGhy --conf spark.executor.instances=2 lib/seatunnel-core-spark.jar --config /Users/fanjia/Code/seatunnel-fork/seatunnel-examples/seatunnel-spark-examples/src/main/resources/examples/spark.batch.conf -m spark://localhost:7077 -e cluster
2022-04-26 10:21:43 WARN Utils:66 - Your hostname, fanjias-MacBook-Pro.local resolves to a loopback address: 127.0.0.1; using 192.168.5.104 instead (on interface en0)
2022-04-26 10:21:43 WARN Utils:66 - Set SPARK_LOCAL_IP if you need to bind to another address
2022-04-26 10:21:43 WARN NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org