You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/05/11 09:54:01 UTC
[GitHub] [incubator-seatunnel] fpystart opened a new issue, #1851: Report error when using variable
fpystart opened a new issue, #1851:
URL: https://github.com/apache/incubator-seatunnel/issues/1851
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
when i use variable to start flink job, than report an error
### SeaTunnel Version
2.1.1
### SeaTunnel Config
```conf
transform {
sql {
sql = "select * from trans_slot where container_type = '${container_type}'"
result_table_name = "trans_slot_new"
}
}
```
### Running Command
```shell
./bin/start-seatunnel-flink.sh -c ~/data_process_test/debug_job/variable_2.conf --variable container_type=5
```
### Error Exception
```log
The program finished with the following exception:
org.apache.flink.client.program.ProgramInvocationException: The main method caused an error: Was passed main parameter '-Dcontainer_type=5' but no main parameter was defined in your arg class
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:372)
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:222)
at org.apache.flink.client.ClientUtils.executeProgram(ClientUtils.java:114)
at org.apache.flink.client.cli.CliFrontend.executeProgram(CliFrontend.java:812)
at org.apache.flink.client.cli.CliFrontend.run(CliFrontend.java:246)
at org.apache.flink.client.cli.CliFrontend.parseAndRun(CliFrontend.java:1054)
at org.apache.flink.client.cli.CliFrontend.lambda$main$10(CliFrontend.java:1132)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1836)
at org.apache.flink.runtime.security.contexts.HadoopSecurityContext.runSecured(HadoopSecurityContext.java:41)
at org.apache.flink.client.cli.CliFrontend.main(CliFrontend.java:1132)
Caused by: com.beust.jcommander.ParameterException: Was passed main parameter '-Dcontainer_type=5' but no main parameter was defined in your arg class
at com.beust.jcommander.JCommander.initMainParameterValue(JCommander.java:954)
at com.beust.jcommander.JCommander.parseValues(JCommander.java:755)
at com.beust.jcommander.JCommander.parse(JCommander.java:356)
at com.beust.jcommander.JCommander.parse(JCommander.java:335)
at org.apache.seatunnel.utils.CommandLineUtils.parseFlinkArgs(CommandLineUtils.java:44)
at org.apache.seatunnel.SeatunnelFlink.main(SeatunnelFlink.java:26)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:355)
... 11 more
```
### Flink or Spark Version
1.13.6
### Java or Scala Version
1.8
### Screenshots
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ruanwenjun commented on issue #1851: Report error when using variable
Posted by GitBox <gi...@apache.org>.
ruanwenjun commented on issue #1851:
URL: https://github.com/apache/incubator-seatunnel/issues/1851#issuecomment-1123627348
It seems this has already fixed at dev branch, but in flink engine, there is still bug related to the variable, since we use -D to set the variable, but flink script will not put our param into environment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ruanwenjun closed issue #1851: Report error when using variable
Posted by GitBox <gi...@apache.org>.
ruanwenjun closed issue #1851: Report error when using variable
URL: https://github.com/apache/incubator-seatunnel/issues/1851
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org