You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by GitBox <gi...@apache.org> on 2022/10/25 02:56:26 UTC
[GitHub] [incubator-seatunnel] mjp27258 opened a new issue, #3176: No configuration setting found for key 'query'
mjp27258 opened a new issue, #3176:
URL: https://github.com/apache/incubator-seatunnel/issues/3176
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
Use v2 to extract oracle data, and the query parameter reports an exception
### SeaTunnel Version
2.3.0-beat-v2
### SeaTunnel Config
```conf
source {
Jdbc {
query = "select * from table"
}
}
```
### Running Command
```shell
${SPARK_HOME}/bin/spark-submit --class "org.apache.seatunnel.core.starter.spark.SeatunnelSpark" --name "SeaTunnel" --master "local[4]" --deploy-mode "client" --jars "/usr/local/datagateway/Seatunnel2-3/apache-seatunnel-incubating-2.3.1-beta-SNAPSHOT/connectors/seatunnel/connector-jdbc-2.3.1-beta-SNAPSHOT.jar" --driver-java-options "-DDATA_DATE=2022-10-20" --conf "spark.executor.memory=8g" --conf "spark.executor.cores=4" --conf "spark.app.name=SeaTunnel" --conf "spark.executor.instances=4" --conf "spark.executor.extraJavaOptions=-DDATA_DATE=2022-10-20" /usr/local/datagateway/Seatunnel2-3/apache-seatunnel-incubating-2.3.1-beta-SNAPSHOT/lib/seatunnel-spark-starter.jar --master local[4] --deploy-mode client --config INFO_FI_VAL_CNBD.config -i DATA_DATE=2022-10-20
```
### Error Exception
```log
22/10/25 10:26:07 INFO Executor: Starting executor ID driver on host localhost
22/10/25 10:26:07 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 38841.
22/10/25 10:26:07 INFO NettyBlockTransferService: Server created on pool-100-2-99-21.nycmny.fios.verizon.net:38841
22/10/25 10:26:07 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
22/10/25 10:26:07 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, pool-100-2-99-21.nycmny.fios.verizon.net, 38841, None)
22/10/25 10:26:07 INFO BlockManagerMasterEndpoint: Registering block manager pool-100-2-99-21.nycmny.fios.verizon.net:38841 with 366.3 MB RAM, BlockManagerId(driver, pool-100-2-99-21.nycmny.fios.verizon.net, 38841, None)
22/10/25 10:26:07 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, pool-100-2-99-21.nycmny.fios.verizon.net, 38841, None)
22/10/25 10:26:07 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, pool-100-2-99-21.nycmny.fios.verizon.net, 38841, None)
22/10/25 10:26:07 INFO AbstractPluginDiscovery: Load SeaTunnelSource Plugin from /usr/local/datagateway/Seatunnel2-3/apache-seatunnel-incubating-2.3.1-beta-SNAPSHOT/connectors/seatunnel
22/10/25 10:26:07 INFO AbstractPluginDiscovery: Discovery plugin jar: Jdbc at: file:/usr/local/datagateway/Seatunnel2-3/apache-seatunnel-incubating-2.3.1-beta-SNAPSHOT/connectors/seatunnel/connector-jdbc-2.3.1-beta-SNAPSHOT.jar
22/10/25 10:26:07 INFO AbstractPluginDiscovery: Load plugin: PluginIdentifier<{>engineType='seatunnel', pluginType='source', pluginName='Jdbc'<}> from classpath
22/10/25 10:26:07 ERROR SparkApiTaskExecuteCommand: Run SeaTunnel on spark failed.
org.apache.seatunnel.shade.com.typesafe.config.ConfigException$Missing: No configuration setting found for key 'query'
at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findKeyOrNull(SimpleConfig.java:156)
at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.findOrNull(SimpleConfig.java:174)
at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:188)
at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.find(SimpleConfig.java:193)
at org.apache.seatunnel.shade.com.typesafe.config.impl.SimpleConfig.getString(SimpleConfig.java:250)
at org.apache.seatunnel.connectors.seatunnel.jdbc.config.JdbcConfig.buildJdbcConnectionOptions(JdbcConfig.java:74)
at org.apache.seatunnel.connectors.seatunnel.jdbc.config.JdbcSourceOptions.{<}init{>}(JdbcSourceOptions.java:42)
at org.apache.seatunnel.connectors.seatunnel.jdbc.source.JdbcSource.prepare(JdbcSource.java:76)
at org.apache.seatunnel.core.starter.spark.execution.SourceExecuteProcessor.initializePlugins(SourceExecuteProcessor.java:87)
at org.apache.seatunnel.core.starter.spark.execution.AbstractPluginExecuteProcessor.{<}init{>}(AbstractPluginExecuteProcessor.java:49)
at org.apache.seatunnel.core.starter.spark.execution.SourceExecuteProcessor.{<}init{>}(SourceExecuteProcessor.java:50)
at org.apache.seatunnel.core.starter.spark.execution.SparkExecution.{<}init{>}(SparkExecution.java:47)
at org.apache.seatunnel.core.starter.spark.command.SparkApiTaskExecuteCommand.execute(SparkApiTaskExecuteCommand.java:51)
at org.apache.seatunnel.core.starter.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.starter.spark.SeatunnelSpark.main(SeatunnelSpark.java:34)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:855)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:930)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:939)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
22/10/25 10:26:07 ERROR Seatunnel:
===============================================================================
22/10/25 10:26:07 ERROR Seatunnel: Fatal Error,
22/10/25 10:26:07 ERROR Seatunnel: Please submit bug report in https://github.com/apache/incubator-seatunnel/issues
22/10/25 10:26:07 ERROR Seatunnel: Reason:No configuration setting found for key 'query'
22/10/25 10:26:07 ERROR Seatunnel: Exception StackTrace:org.apache.seatunnel.core.starter.exception.CommandExecuteException: No configuration setting found for key 'query'
at org.apache.seatunnel.core.starter.spark.command.SparkApiTaskExecuteCommand.execute(SparkApiTaskExecuteCommand.java:55)
at org.apache.seatunnel.core.starter.Seatunnel.run(Seatunnel.java:39)
at org.apache.seatunnel.core.starter.spark.SeatunnelSpark.main(SeatunnelSpark.java:34)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.JavaMainApplication.start(SparkApplication.scala:52)
at org.apache.spark.deploy.SparkSubmit.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:855)
at org.apache.spark.deploy.SparkSubmit.doRunMain$1(SparkSubmit.scala:161)
at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:184)
at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:930)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:939)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
```
### Flink or Spark Version
_No response_
### Java or Scala Version
_No response_
### Screenshots
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] ic4y commented on issue #3176: No configuration setting found for key 'query'
Posted by GitBox <gi...@apache.org>.
ic4y commented on issue #3176:
URL: https://github.com/apache/incubator-seatunnel/issues/3176#issuecomment-1299527735
Thank you for reporting this problem, please upload the complete configuration file, you can delete sensitive information
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3176: No configuration setting found for key 'query'
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #3176:
URL: https://github.com/apache/incubator-seatunnel/issues/3176#issuecomment-1347569587
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] Hisoka-X commented on issue #3176: No configuration setting found for key 'query'
Posted by GitBox <gi...@apache.org>.
Hisoka-X commented on issue #3176:
URL: https://github.com/apache/incubator-seatunnel/issues/3176#issuecomment-1299515034
@ic4y PTAL
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] commented on issue #3176: No configuration setting found for key 'query'
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #3176:
URL: https://github.com/apache/incubator-seatunnel/issues/3176#issuecomment-1335982601
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] github-actions[bot] closed issue #3176: No configuration setting found for key 'query'
Posted by GitBox <gi...@apache.org>.
github-actions[bot] closed issue #3176: No configuration setting found for key 'query'
URL: https://github.com/apache/incubator-seatunnel/issues/3176
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-seatunnel] 19913144245 commented on issue #3176: No configuration setting found for key 'query'
Posted by GitBox <gi...@apache.org>.
19913144245 commented on issue #3176:
URL: https://github.com/apache/incubator-seatunnel/issues/3176#issuecomment-1293153357
source {
Jdbc {
query = "select * from table"
}
}
Are all required parameters written?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org