[GitHub] [incubator-seatunnel] simon824 commented on pull request #885: [SeaTunnel #884] Fix NullPointerException caused by engine type

[GitBox <gi...@apache.org>]

simon824 commented on pull request #885:
URL: https://github.com/apache/incubator-seatunnel/pull/885#issuecomment-1002417743


   > hi @simon824, I checked the `-t` option as your case, seems we got different Exception.
   > 
   > ```
   > [dcadmin@dcadmin seatunnel-dist-2.0.5-SNAPSHOT-2.11.8]$ ./bin/start-seatunnel-spark.sh -c config/application.conf -e client -m local -i app=test -t
   > 
   > [INFO] spark conf: --conf "spark.app.name=seatunnel"
   > Warning: Ignoring non-spark config property: "spark.app.name=seatunnel"
   > 2021-12-29 13:29:10 WARN  NativeCodeLoader:62 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
   > 2021-12-29 13:29:10 INFO  ConfigBuilder:78 - Loading config file: config/application.conf
   > 2021-12-29 13:29:10 INFO  ConfigBuilder:89 - parsed config file: {
   >     "env" : {
   >         "spark.app.name" : "seatunnel"
   >     },
   >     "source" : [
   >         [
   >                         {
   >                 "plugin_name" : "result_table_name"
   >             },
   >             "my_dataset"${app}
   > ,
   >             "Fake"
   >         ]
   >     ],
   >     "transform" : [],
   >     "sink" : [
   >         [
   >             "Console"
   >         ]
   >     ]
   > }
   > 
   > 2021-12-29 13:29:10 ERROR Seatunnel:173 - 
   > 
   > ===============================================================================
   > 
   > 
   > 2021-12-29 13:29:10 ERROR Seatunnel:176 - Fatal Error, 
   > 
   > 2021-12-29 13:29:10 ERROR Seatunnel:178 - Please submit issue a bug in https://github.com/InterestingLab/waterdrop/issues
   > 
   > 2021-12-29 13:29:10 ERROR Seatunnel:180 - Reason:config/application.conf: 6: source has type list of LIST rather than list of OBJECT 
   > 
   > 2021-12-29 13:29:10 ERROR Seatunnel:181 - Exception StackTrace:org.apache.seatunnel.config.ConfigException$WrongType: config/application.conf: 6: source has type list of LIST rather than list of OBJECT
   >         at org.apache.seatunnel.config.impl.SimpleConfig.getHomogeneousWrappedList(SimpleConfig.java:471)
   >         at org.apache.seatunnel.config.impl.SimpleConfig.getObjectList(SimpleConfig.java:480)
   >         at org.apache.seatunnel.config.impl.SimpleConfig.getConfigList(SimpleConfig.java:485)
   >         at org.apache.seatunnel.config.ConfigBuilder.checkIsStreaming(ConfigBuilder.java:102)
   >         at org.apache.seatunnel.config.ConfigBuilder.createEnv(ConfigBuilder.java:185)
   >         at org.apache.seatunnel.config.ConfigBuilder.<init>(ConfigBuilder.java:62)
   >         at org.apache.seatunnel.Seatunnel.entryPoint(Seatunnel.java:92)
   >         at org.apache.seatunnel.Seatunnel.run(Seatunnel.java:59)
   >         at org.apache.seatunnel.SeatunnelSpark.main(SeatunnelSpark.java:29)
   >         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   >         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   >         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   >         at java.lang.reflect.Method.invoke(Method.java:498)
   >         at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
   >         at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:849)
   >         at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:167)
   >         at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:195)
   >         at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
   >         at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:924)
   >         at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:933)
   >         at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
   > ```
   
   Your case looks like the config was parsing failed, try this one.
   ```
   env {
       spark.app.name="seatunnel"
   }
   source {
     Fake {
       result_table_name = "my_dataset"
     }
   }
   }
   transform {
     sql {
       table_name = "user_view"
       sql = ${?table_name}"select * from user_view where city = '"${?sql}"'"
     }
   }
   sink {
     Console {}
   }
   }
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org