[GitHub] [incubator-seatunnel] chang-wd opened a new issue, #1792: [Bug] [SparkStarter] when spark extraJavaOptionsis null, an exception parameter will be generated, resulting in submission failure

[GitBox <gi...@apache.org>]

chang-wd opened a new issue, #1792:
URL: https://github.com/apache/incubator-seatunnel/issues/1792

   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
   
   
   ### What happened
   
   When submitting a task using spark, if spark.executor.extraJavaOptions or spark.driver.extraJavaOptions is null, an exception parameter will be generated, resulting in submission failure.
   
   ### SeaTunnel Version
   
   v2.1.1
   
   ### SeaTunnel Config
   
   ```conf
   env {
     # You can set spark configuration here
     # see available properties defined by spark: https://spark.apache.org/docs/latest/configuration.html#available-properties
     spark.app.name = "SeaTunnel"
     spark.executor.instances = 2
     spark.executor.cores = 1
     spark.executor.memory = "1g"
     spark.streaming.batchDuration = 5
   }
   
   source {
     # This is a example input plugin **only for test and demonstrate the feature input plugin**
     fakeStream {
       content = ["Hello World, SeaTunnel"]
     }
   
   }
   
   transform {
   
     split {
       fields = ["msg", "name"]
       delimiter = ","
     }
   
     Sql {
       sql = "select *, '"${dt_batch}"' as dt_batch from split_result_table"
     }
   }
   
   sink {
     # choose stdout output plugin to output data to console
     Console {}
   }
   ```
   
   
   ### Running Command
   
   ```shell
   ./bin/start-seatunnel-spark.sh  --master local[2] --deploy-mode client --config ./config/spark.streaming_test_variable.conf -i dt_batch=20220504
   ```
   
   
   ### Error Exception
   
   ```log
   Error: Could not find or load main class null
   ```
   
   
   ### Flink or Spark Version
   
   spark_version：2.4.8
   
   ### Java or Scala Version
   
   java version "1.8.0_251"
   
   ### Screenshots
   
   **The bug situation replay**
   ![script_replay_Snipaste_2022-05-04_21-42-44](https://user-images.githubusercontent.com/51365967/166703371-c58bdae9-839f-458a-ba88-030c5afe3901.jpeg)
   
   **Debug**
   ![debug_Snipaste_2022-05-04_21-40-32](https://user-images.githubusercontent.com/51365967/166703429-ba0d3ec0-6912-4283-b101-258592ecb52a.jpeg)
   
   **Right submit args**
   ![right_submit_args_Snipaste_2022-05-04_21-47-08](https://user-images.githubusercontent.com/51365967/166703461-7e0e96b8-d93f-4c6b-a5ad-02be16019308.jpeg)
   
   
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-seatunnel] wuchunfu closed issue #1792: [Bug] [SparkStarter] when spark extraJavaOptionsis null, an exception parameter will be generated, resulting in submission failure

[GitBox <gi...@apache.org>]

wuchunfu closed issue #1792: [Bug] [SparkStarter] when spark extraJavaOptionsis null, an exception parameter will be generated, resulting in submission failure
URL: https://github.com/apache/incubator-seatunnel/issues/1792


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org