You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by Andy <an...@163.com> on 2022/05/31 06:22:25 UTC
[DISCUSS]How to write the parameters of the jar package submitted by the sdk
————— 2022-5-24 —————
Xi 13:40
Image 1 (can be viewed in the attachment)
Xi 13:40
When executing once, why upload and then download it here?
Enjoyyin_ Yin Qiang @ WDS 14:08
It should be considered that the map may be very large, and there may be special characters such as spaces and carriage returns.
Xi 14:12
When Flink submits the jar package, am I right? @Enjoyyin_Yin Qiang@WDS
Xi 14:12
When the client calls, do I add it through addStartupParam?
Enjoyyin_ Yin Qiang @ WDS 14:40
spelling is ok
Enjoyyin_ Yin Qiang @ WDS 14:40
Why not use the Java SDK and have to spell RESTFul yourself?
Xi 14:54
How to write the parameters of the jar package submitted by the sdk?
Xi 14:54
Are we not going to develop a spark jar submission?
Xi 14:54
I wrote this
Xi 14:55
Mainly the two bml do not know how to write
Xi 14:55
Because of the json spelled when watching
Xi 14:56
@Enjoyyin_Yin Qiang @WDS
Enjoyyin_ Yin Qiang @WDS 15:15
This usage is fine
Xi 15:18
Do you have any test samples?
Xi 15:18
Submit the jar
Enjoyyin_ Yin Qiang @WDS 15:18
But the spark engine needs to be transformed
Xi 15:18
flink can
Xi 15:19
I know, it has been remodeled almost, now test
Enjoyyin_ Yin Qiang @WDS 15:19
spark-examples.jar
Enjoyyin_ Yin Qiang @WDS 15:20
Just find any one
Xi 15:20
I mean example of parameters
Enjoyyin_ Yin Qiang @WDS 15:23
https://github.com/apache/incubator-linkis/blob/master/linkis-computation-governance/linkis-client/linkis-computation-client/src/test/java/org/apache/linkis/computation/client/ FlinkOnceJobTest.java
Xi 15:54
Is there anyone who submits jar? This one who submits sql has already seen it
Xi 17:59
Where did these two come from when Flink submitted?
Enjoyyin_ Yin Qiang @WDS 18:07
Image 2 (can be viewed in the attachment)
Xi 18:59
Isn't it necessary to judge whether these two are necessary? How are they written in the startup script?
peacewong@WDS 19:54
ECM-encapsulated:
peacewong@WDS 19:54
Image 3 (can be viewed in the attachment)
Xi 20:15
Okay, got it @peacewong@WDS , this is wrong, I read this before
————— 2022-5-24 —————
Xi 13:40
图片1(可在附件中查看)
Xi 13:40
once执行的时候,为啥这里要上传,然后再下载呢
Enjoyyin_尹强@WDS 14:08
需考虑map可能很大,而且里面可能会有空格、回车符等特殊字符
Xi 14:12
Flink 提交jar包时,我这样写对吗 @Enjoyyin_尹强@WDS
Xi 14:12
client调用时 我是不是通过addStartupParam添加
Enjoyyin_尹强@WDS 14:40
写法没问题
Enjoyyin_尹强@WDS 14:40
为啥不用Java SDK,一定要自己拼RESTFul?
Xi 14:54
sdk提交jar包的参数都怎么写呢
Xi 14:54
我们不是准备开发个spark jar提交嘛
Xi 14:54
我这样写的
Xi 14:55
主要是bml那两个不知道怎么写
Xi 14:55
因为看时拼的json
Xi 14:56
@Enjoyyin_尹强@WDS
Enjoyyin_尹强@WDS 15:15
这个用法是没问题的
Xi 15:18
你们那有没有测试的样例
Xi 15:18
提交jar的
Enjoyyin_尹强@WDS 15:18
但是spark引擎要改造
Xi 15:18
flink的就可以
Xi 15:19
我知道,已经改造差不多了,现在测试
Enjoyyin_尹强@WDS 15:19
spark-examples.jar
Enjoyyin_尹强@WDS 15:20
随便找一个就能测
Xi 15:20
我是说参数的样例
Enjoyyin_尹强@WDS 15:23
https://github.com/apache/incubator-linkis/blob/master/linkis-computation-governance/linkis-client/linkis-computation-client/src/test/java/org/apache/linkis/computation/client/FlinkOnceJobTest.java
Xi 15:54
提交jar的有没有,这个提交sql的,早就看过了
Xi 17:59
Flink提交的时候这两个是从哪里设置进来的
Enjoyyin_尹强@WDS 18:07
图片2(可在附件中查看)
Xi 18:59
这两个不是判断是不是必须的吗,是如何写到启动脚本里的呢
peacewong@WDS 19:54
ECM封装的:
peacewong@WDS 19:54
图片3(可在附件中查看)
Xi 20:15
好的,知道了@peacewong@WDS ,这个理解错了,之前看过这
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org