You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@linkis.apache.org by GitBox <gi...@apache.org> on 2022/08/09 02:44:30 UTC
[GitHub] [incubator-linkis] jasonmrliu opened a new issue, #2642: linkis1.1.1启动成功后提交任务给引擎执行时失败的问题[Bug]
jasonmrliu opened a new issue, #2642:
URL: https://github.com/apache/incubator-linkis/issues/2642
### Search before asking
- [X] I searched the [issues](https://github.com/apache/incubator-linkis/issues) and found no similar issues.
### Linkis Component
linkis-computation-governance, linkis-public-enhancements, linkis-spring-cloud-services
### Steps to reproduce
1.所有安装完成并启动，启动时无其他错误，但是在linkis-cg-engineconnmanager.log，linkis-cg-linkismanager.log，linkis-ps-publicservice.log这三个服务中报同一个错，如下：
```
2022-08-08 11:59:26.041 [INFO ] [DiscoveryClient-HeartbeatExecutor-0 ] c.n.d.s.t.d.RedirectingEurekaHttpClient (93) [execute] - Request execution error. endpoint=DefaultEndpoint{ serviceUrl='http://127.0.0.1:20303/eureka/} exception=org.apache.http.NoHttpResponseException: 127.0.0.1:20303 failed to respond stacktrace=com.sun.jersey.api.client.ClientHandlerException: org.apache.http.NoHttpResponseException: 127.0.0.1:20303 failed to respond
at com.sun.jersey.client.apache4.ApacheHttpClient4Handler.handle(ApacheHttpClient4Handler.java:187)
at com.sun.jersey.api.client.filter.GZIPContentEncodingFilter.handle(GZIPContentEncodingFilter.java:123)
at com.netflix.discovery.EurekaIdentityHeaderFilter.handle(EurekaIdentityHeaderFilter.java:27)
at com.sun.jersey.api.client.Client.handle(Client.java:652)
at com.sun.jersey.api.client.WebResource.handle(WebResource.java:682)
at com.sun.jersey.api.client.WebResource.access$200(WebResource.java:74)
at com.sun.jersey.api.client.WebResource$Builder.put(WebResource.java:529)
at com.netflix.discovery.shared.transport.jersey.AbstractJerseyEurekaHttpClient.sendHeartBeat(AbstractJerseyEurekaHttpClient.java:103)
at com.netflix.discovery.shared.transport.decorator.EurekaHttpClientDecorator$3.execute(EurekaHttpClientDecorator.java:92)
at com.netflix.discovery.shared.transport.decorator.MetricsCollectingEurekaHttpClient.execute(MetricsCollectingEurekaHttpClient.java:73)
at com.netflix.discovery.shared.transport.decorator.EurekaHttpClientDecorator.sendHeartBeat(EurekaHttpClientDecorator.java:89)
at com.netflix.discovery.shared.transport.decorator.EurekaHttpClientDecorator$3.execute(EurekaHttpClientDecorator.java:92)
at com.netflix.discovery.shared.transport.decorator.RedirectingEurekaHttpClient.execute(RedirectingEurekaHttpClient.java:91)
at com.netflix.discovery.shared.transport.decorator.EurekaHttpClientDecorator.sendHeartBeat(EurekaHttpClientDecorator.java:89)
at com.netflix.discovery.shared.transport.decorator.EurekaHttpClientDecorator$3.execute(EurekaHttpClientDecorator.java:92)
at com.netflix.discovery.shared.transport.decorator.RetryableEurekaHttpClient.execute(RetryableEurekaHttpClient.java:120)
at com.netflix.discovery.shared.transport.decorator.EurekaHttpClientDecorator.sendHeartBeat(EurekaHttpClientDecorator.java:89)
at com.netflix.discovery.shared.transport.decorator.EurekaHttpClientDecorator$3.execute(EurekaHttpClientDecorator.java:92)
at com.netflix.discovery.shared.transport.decorator.SessionedEurekaHttpClient.execute(SessionedEurekaHttpClient.java:77)
at com.netflix.discovery.shared.transport.decorator.EurekaHttpClientDecorator.sendHeartBeat(EurekaHttpClientDecorator.java:89)
at com.netflix.discovery.DiscoveryClient.renew(DiscoveryClient.java:893)
at com.netflix.discovery.DiscoveryClient$HeartbeatThread.run(DiscoveryClient.java:1457)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
[gateway-linkis-log-2022-08-08-02-2
[linkismanager-linkis-log.txt](https://github.com/apache/incubator-linkis/files/9286217/linkismanager-linkis-log.txt)
[gateway-linkis-log.txt](https://github.com/apache/incubator-linkis/files/9286218/gateway-linkis-log.txt)
[entrance-linkis-log.txt](https://github.com/apache/incubator-linkis/files/9286219/entrance-linkis-log.txt)
[linkis-client.txt](https://github.com/apache/incubator-linkis/files/9286220/linkis-client.txt)
.log](https://github.com/apache/incubator-linkis/files/9286212/gateway-linkis-log-2022-08-08-02-2.log)
[entrance-linkis-log-2022-08-08-02-2.log](https://github.com/apache/incubator-linkis/files/9286213/entrance-linkis-log-2022-08-08-02-2.log)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.http.NoHttpResponseException: 127.0.0.1:20303 failed to respond
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:141)
at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:56)
at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:259)
at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:294
[gateway-linkis-log.txt](https://github.com/apache/incubator-linkis/files/9286261/gateway-linkis-log.txt)
)
at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:257)
at org.apache.http.impl.conn.AbstractClientConnAdapter.receiveResponseHeader(AbstractClientConnAdapter.java:230)
at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:273)
at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:125)
at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:679)
at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:481)
at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:835)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:118)
at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:56)
at com.sun.jersey.client.apache4.ApacheHttpClient4Handler.handle(ApacheHttpClient4Handler.java:173)
... 26 more
```
2.采用以下命令测试引擎是否会成功
```
sh bin/linkis-cli -submitUser hadoop -engineType shell-1 -codeType shell -code "whoami"
```
发现如下几个微服务有报错信息（详细报错已上传日志文件）：
- linkis-client
- entrance
- linkismanager
- gateway
### Expected behavior
linkis-client主要异常信息：
```
2022-08-08 14:41:37,664 WARN LinkisJobOperator(233) - Get job status failed. retry time : 1/3 LinkisException{errCode=10905, desc='URL /api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status request failed! ResponseBody is {"timestamp":1659940897654,"path":"/api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status","status":500,"error":"Internal Server Error","message":"","requestId":"6e51ef7e-242"}. errCode: 10905 ,desc: URL /api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status request failed! ResponseBody is {"timestamp":1659940897654,"path":"/api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status","status":500,"error":"Internal Server Error","message":"","requestId":"6e51ef7e-242"}. ,ip: null ,port: 0 ,serviceKind: null', ip='null', port=0, serviceKind='
null'}
org.apache.linkis.httpclient.exception.HttpClientResultException: errCode: 10905 ,desc: URL /api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status request failed! ResponseBody is {"timestamp":1659940897654,"path":"/api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status","status":500,"error":"Internal Server Error","message":"","requestId":"6e51ef7e-242"}. errCode: 10905 ,desc: URL /api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status request failed! ResponseBody is {"timestamp":1659940897654,"path":"/api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status","status":500,"error":"Internal Server Error","message":"","requestId":"6e51ef7e-242"}. ,ip: null ,port: 0 ,serviceKind: null ,ip: null ,port: 0 ,serviceKind: null
at org.apache.linkis.httpclient.dws.response.DWSResult$$anonfun$set$2.apply(DWSResult.scala:77) ~[linkis-gateway-httpclient-support-1.1.1.jar:1.1.1]
at org.apache.linkis.httpclient.dws.response.DWSResult$$anonfun$set$2.apply(DWSResult.scala:75) ~[linkis-gateway-httpclient-support-1.1.1.jar:1.1.1]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:53) ~[linkis-common-1.1.1.jar:1.1.1]
at org.apache.linkis.httpclient.dws.response.DWSResult$class.set(DWSResult.scala:75) ~[linkis-gateway-httpclient-support-1.1.1.jar:1.1.1]
at org.apache.linkis.ujes.client.response.JobStatusResult.set(JobStatusResult.scala:23) ~[linkis-computation-client-1.1.1.jar:1.1.1]
at org.apache.linkis.httpclient.dws.DWSHttpClient$$anonfun$httpResponseToResult$2.apply(DWSHttpClient.scala:70) ~[linkis-gateway-httpclient-support-1.1.1.jar:1.1.1]
at org.apache.linkis.httpclient.dws.DWSHttpClient$$anonfun$httpResponseToResult$2.apply(DWSHttpClient.scala:66) ~[linkis-gateway-httpclient-support-1.1.1.jar:1.1.1]
at scala.Option.map(Option.scala:146) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.httpclient.dws.DWSHttpClient.httpResponseToResult(DWSHttpClient.scala:66) ~[linkis-gateway-httpclient-support-1.1.1.jar:1.1.1]
at org.apache.linkis.httpclient.AbstractHttpClient.responseToResult(AbstractHttpClient.scala:425) ~[linkis-httpclient-1.1.1.jar:1.1.1]
at org.apache.linkis.httpclient.AbstractHttpClient.execute(AbstractHttpClient.scala:126) ~[linkis-httpclient-1.1.1.jar:1.1.1]
at org.apache.linkis.httpclient.AbstractHttpClient.execute(AbstractHttpClient.scala:92) ~[linkis-httpclient-1.1.1.jar:1.1.1]
at org.apache.linkis.ujes.client.UJESClientImpl.executeUJESJob(UJESClientImpl.scala:28) ~[linkis-computation-client-1.1.1.jar:1.1.1]
at org.apache.linkis.ujes.client.UJESClient.executeJobExecIdAction(UJESClient.scala:42) ~[linkis-computation-client-1.1.1.jar:1.1.1]
at org.apache.linkis.ujes.client.UJESClient.status(UJESClient.scala:45) ~[linkis-computation-client-1.1.1.jar:1.1.1]
at org.apache.linkis.cli.application.operator.ujes.LinkisJobOperator.queryJobStatus(LinkisJobOperator.java:204) ~[linkis-cli-application-1.1.1.jar:1.1.1]
at org.apache.linkis.cli.application.interactor.job.LinkisSubmitJob.waitJobComplete(LinkisSubmitJob.java:166) ~[linkis-cli-application-1.1.1.jar:1.1.1]
at org.apache.linkis.cli.core.interactor.execution.SyncSubmission.ExecWithAsyncBackend(SyncSubmission.java:190) ~[linkis-cli-core-1.1.1.jar:1.1.1]
at org.apache.linkis.cli.core.interactor.execution.SyncSubmission.execute(SyncSubmission.java:80) ~[linkis-cli-core-1.1.1.jar:1.1.1]
at org.apache.linkis.cli.application.LinkisClientApplication.exec(LinkisClientApplication.java:287) ~[linkis-cli-application-1.1.1.jar:1.1.1]
at org.apache.linkis.cli.application.LinkisClientApplication.main(LinkisClientApplication.java:321) ~[linkis-cli-application-1.1.1.jar:1.1.1]
```
微服务LINKIS-CG-ENTRANCE主要异常信息如下：
```
2022-08-08 14:41:32.375 [INFO ] [qtp2098066214-167 ] o.a.l.e.r.EntranceRestfulApi (133) [submit] - Begin to get an execID
2022-08-08 14:41:32.420 [INFO ] [qtp2098066214-167 ] o.a.l.e.s.DefaultEntranceServer (41) [info] - received a request,convert JobRequest{id=6, reqId='null', submitUser='hadoop', executeUser='hadoop', labels=[[key: userCreator, value: {"creator":"LINKISCLI","user":"hadoop"}, str: hadoop-LINKISCLI], [key: codeType, value: {"codeType":"shell"}, str: shell], [key: engineType, value: {"engineType":"shell","version":"1"}, str: shell-1], [key: executeOnce, value: {}, str: ]], params={configuration={startup={}, runtime={hive.resultset.use.unique.column.names=true}}, variable={}}, status=Inited}
2022-08-08 14:41:32.421 [INFO ] [qtp2098066214-167 ] o.a.l.e.i.i.ShellDangerousGrammerInterceptor (41) [info] - GET REQUEST CODE_TYPE shell and ENGINE_TYPE EngineType
2022-08-08 14:41:32.567 [INFO ] [qtp2098066214-167 ] o.a.l.s.u.FileSystemUtils$ (41) [info] - doesn't need to call setOwner
2022-08-08 14:41:32.576 [INFO ] [qtp2098066214-167 ] o.a.l.s.u.FileSystemUtils$ (41) [info] - doesn't need to call setOwner
2022-08-08 14:41:32.753 [INFO ] [qtp2098066214-167 ] o.a.l.s.u.FileSystemUtils$ (41) [info] - doesn't need to call setOwner
2022-08-08 14:41:32.765 [INFO ] [qtp2098066214-167 ] o.a.l.s.u.FileSystemUtils$ (41) [info] - doesn't need to call setOwner
2022-08-08 14:41:32.765 [INFO ] [qtp2098066214-167 ] o.a.l.e.l.CacheLogManager (74) [createLogWriter] - job 6 create cacheLogWriter
2022-08-08 14:41:32.767 [INFO ] [qtp2098066214-167 ] o.a.l.e.c.h.CliHeartbeatMonitor (54) [registerIfCliJob] - registered cli job id: 6
2022-08-08 14:41:32.767 [INFO ] [qtp2098066214-167 ] o.a.l.e.s.EntranceGroupFactory (76) [getOrCreateGroup] - Getting user configurations for LINKISCLI_hadoop_shell userCreatorLabel: hadoop-LINKISCLI, engineTypeLabel:shell-1.
2022-08-08 14:41:32.811 [INFO ] [qtp2098066214-167 ] o.a.l.e.s.EntranceGroupFactory (83) [getOrCreateGroup] - Got user configurations: groupName=LINKISCLI_hadoop_shell, maxRunningJobs=10, initCapacity=100, maxCapacity=2000.
2022-08-08 14:41:32.812 [INFO ] [qtp2098066214-167 ] o.a.l.e.s.DefaultEntranceServer (112) [apply] - Job with jobId : LINKISCLI_hadoop_shell_0 and execID : LINKISCLI_hadoop_shell_0 submitted
2022-08-08 14:41:32.813 [INFO ] [LINKISCLI_hadoop_shellConsumerThread ] o.a.l.s.q.f.FIFOUserConsumer (41) [info] - LINKISCLI_hadoop_shellConsumer thread started!
2022-08-08 14:41:32.814 [INFO ] [LINKISCLI_hadoop_shellConsumerThread ] o.a.l.e.j.EntranceExecutionJob (41) [info] - jobGroupId:6 execID:LINKISCLI_hadoop_shell_0 change status Inited => Scheduled.
2022-08-08 14:41:32.815 [INFO ] [qtp2098066214-167 ] o.a.l.e.r.EntranceRestfulApi (177) [submit] - End to get an an execID: exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0, taskID: 6
2022-08-08 14:41:32.841 [INFO ] [EntranceJobScheduler-ThreadPool-6 ] o.a.l.e.j.EntranceExecutionJob (41) [info] - jobGroupId:6 execID:LINKISCLI_hadoop_shell_0 change status Scheduled => Running.
2022-08-08 14:41:32.862 [INFO ] [EntranceJobScheduler-ThreadPool-6 ] o.a.l.o.c.i.SessionStateImpl$$anon$4 (41) [info] - Finished to convert JobReq(6) to AstJob(astJob_2).
2022-08-08 14:41:32.864 [INFO ] [EntranceJobScheduler-ThreadPool-6 ] o.a.l.o.s.a.AsyncTaskManager (88) [putExecTask] - submit execTask astJob_2_job_4 to taskManager get executionTask execution_2
2022-08-08 14:41:32.864 [INFO ] [EntranceJobScheduler-ThreadPool-6 ] o.a.l.e.e.DefaultEntranceExecutor (41) [info] - Job with jobGroupId : 6 and subJobId : 6 was submitted to Orchestrator.
2022-08-08 14:41:32.865 [INFO ] [EntranceJobScheduler-ThreadPool-6 ] o.a.l.e.e.DefaultEntranceExecutor (302) [apply] - For job LINKISCLI_hadoop_shell_0 and subJob 6 to create EngineExecuteAsyncReturn
2022-08-08 14:41:32.866 [INFO ] [CodeReheaterNotifyTaskConsumer ] o.a.l.o.s.a.AsyncTaskManager (177) [apply] - user key hadoop-LINKISCLI,shell-1, executionTaskId execution_2 to addNumber: 1
2022-08-08 14:41:32.867 [INFO ] [BaseTaskScheduler-Thread-9 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (41) [info] - ExecTaskRunner Submit execTask(astJob_2_job_5) to running
2022-08-08 14:41:32.867 [INFO ] [BaseTaskScheduler-Thread-9 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (68) [run] - Succeed to execute ExecTask(astJob_2_job_5)
2022-08-08 14:41:32.867 [INFO ] [BaseTaskScheduler-Thread-9 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (90) [transientStatus] - astJob_2_job_5 change status Inited => Succeed.
2022-08-08 14:41:32.868 [INFO ] [BaseTaskScheduler-Thread-9 ] o.a.l.o.s.a.AsyncTaskManager (204) [addCompletedTask] - astJob_2_job_5 task completed, now remove from taskManager
2022-08-08 14:41:32.868 [INFO ] [BaseTaskScheduler-Thread-9 ] o.a.l.o.s.a.AsyncTaskManager (235) [apply] - executionTask(execution_2) no task running, user key hadoop-LINKISCLI,shell-1, minusNumber: 0
2022-08-08 14:41:32.869 [INFO ] [CodeReheaterNotifyTaskConsumer ] o.a.l.o.s.a.AsyncTaskManager (177) [apply] - user key hadoop-LINKISCLI,shell-1, executionTaskId execution_2 to addNumber: 1
2022-08-08 14:41:32.870 [INFO ] [BaseTaskScheduler-Thread-10 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (41) [info] - ExecTaskRunner Submit execTask(astJob_2_stage_5) to running
2022-08-08 14:41:32.870 [INFO ] [BaseTaskScheduler-Thread-10 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (68) [run] - Succeed to execute ExecTask(astJob_2_stage_5)
2022-08-08 14:41:32.870 [INFO ] [BaseTaskScheduler-Thread-10 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (90) [transientStatus] - astJob_2_stage_5 change status Inited => Succeed.
2022-08-08 14:41:32.870 [INFO ] [BaseTaskScheduler-Thread-10 ] o.a.l.o.s.a.AsyncTaskManager (204) [addCompletedTask] - astJob_2_stage_5 task completed, now remove from taskManager
2022-08-08 14:41:32.870 [INFO ] [BaseTaskScheduler-Thread-10 ] o.a.l.o.s.a.AsyncTaskManager (235) [apply] - executionTask(execution_2) no task running, user key hadoop-LINKISCLI,shell-1, minusNumber: 0
2022-08-08 14:41:32.871 [INFO ] [CodeReheaterNotifyTaskConsumer ] o.a.l.o.s.a.AsyncTaskManager (177) [apply] - user key hadoop-LINKISCLI,shell-1, executionTaskId execution_2 to addNumber: 1
2022-08-08 14:41:32.872 [INFO ] [BaseTaskScheduler-Thread-11 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (41) [info] - ExecTaskRunner Submit execTask(astJob_2_codeExec_2) to running
2022-08-08 14:41:32.872 [INFO ] [BaseTaskScheduler-Thread-11 ] o.a.l.o.c.p.CodeLogicalUnitExecTask (66) [execute] - Start to execute CodeLogicalUnitExecTask(astJob_2_codeExec_2).
2022-08-08 14:41:32.873 [INFO ] [BaseTaskScheduler-Thread-11 ] o.a.l.o.e.ComputationEngineConnManager (187) [addMark] - add mark mark_2
2022-08-08 14:41:32.873 [INFO ] [BaseTaskScheduler-Thread-11 ] o.a.l.o.c.e.DefaultCodeExecTaskExecutorManager (41) [info] - create Executor for execId astJob_2_codeExec_2 mark id is mark_2, user hadoop
2022-08-08 14:41:32.873 [INFO ] [BaseTaskScheduler-Thread-11 ] o.a.l.o.e.ComputationEngineConnManager (41) [info] - mark mark_2 start to getAvailableEngineConnExecutor
2022-08-08 14:41:32.886 [INFO ] [BaseTaskScheduler-Thread-11 ] o.a.l.o.e.ComputationEngineConnManager (41) [info] - mark_2 received EngineAskAsyncResponse id: bda01node03.oracle.cn:9101_2 serviceInstance: ServiceInstance(linkis-cg-linkismanager, bda01node03.oracle.cn:9101)
2022-08-08 14:41:33.658 [INFO ] [Linkis-Default-Scheduler-Thread-15 ] o.a.l.o.e.i.BaseTaskScheduler (41) [info] - Clear finished task from taskFutureCache size 2
2022-08-08 14:42:06.447 [INFO ] [entrance-cli-heartbeat-1 ] o.a.l.e.c.h.CliHeartbeatMonitor (111) [scanOneIteration] - Found linkis-cli connection lost job id: 6
2022-08-08 14:42:06.448 [INFO ] [entrance-cli-heartbeat-1 ] o.a.l.e.c.h.KillHandler (41) [info] - Killing job: LINKISCLI_hadoop_shell_0
2022-08-08 14:42:06.449 [INFO ] [entrance-cli-heartbeat-1 ] o.a.l.e.j.EntranceExecutionJob (41) [info] - job jobGroupId:6 execID:LINKISCLI_hadoop_shell_0 is onFailure on state Running with errorMsg: Job is killed because of client-server connection lost.
2022-08-08 14:42:06.450 [INFO ] [entrance-cli-heartbeat-1 ] o.a.l.e.j.EntranceExecutionJob (46) [info] - jobGroupId:6 execID:LINKISCLI_hadoop_shell_0 execute failed. Reason: Job is killed because of client-server connection lost.
2022-08-08 14:42:06.450 [INFO ] [Orchestrator-Listener-Asyn-Thread-Thread-0] o.a.l.o.e.i.ExecutionImpl (41) [info] - receive killRootExecTaskEvent astJob_2_job_4
2022-08-08 14:42:06.451 [INFO ] [Orchestrator-Listener-Asyn-Thread-Thread-0] o.a.l.o.e.i.BaseTaskScheduler (41) [info] - cancel task Runner astJob_2_codeExec_2
2022-08-08 14:42:06.451 [INFO ] [Orchestrator-Listener-Asyn-Thread-Thread-0] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (90) [transientStatus] - astJob_2_codeExec_2 change status Inited => Cancelled.
2022-08-08 14:42:06.451 [INFO ] [Orchestrator-Listener-Asyn-Thread-Thread-0] o.a.l.o.s.a.AsyncTaskManager (204) [addCompletedTask] - astJob_2_codeExec_2 task completed, now remove from taskManager
2022-08-08 14:42:06.451 [INFO ] [Orchestrator-Listener-Asyn-Thread-Thread-0] o.a.l.o.s.a.AsyncTaskManager (235) [apply] - executionTask(execution_2) no task running, user key hadoop-LINKISCLI,shell-1, minusNumber: 0
2022-08-08 14:42:06.452 [INFO ] [Orchestrator-Listener-Asyn-Thread-Thread-0] o.a.l.o.e.i.BaseTaskScheduler (41) [info] - from taskFutureCache to kill task Runner astJob_2_codeExec_2
2022-08-08 14:42:06.453 [INFO ] [CodeReheaterNotifyTaskConsumer ] o.a.l.o.c.c.r.PruneTaskRetryTransform (41) [apply] - task:astJob_2_stage_4 has 1 child tasks which execute failed, some of them may be retried
2022-08-08 14:42:06.453 [WARN ] [BaseTaskScheduler-Thread-11 ] o.a.l.o.e.ComputationEngineConnManager (50) [warn] - mark_2 Failed to askEngineAskRequest time taken (33579)
2022-08-08 14:42:06.453 [INFO ] [CodeReheaterNotifyTaskConsumer ] o.a.l.o.s.a.AsyncTaskManager (177) [apply] - user key hadoop-LINKISCLI,shell-1, executionTaskId execution_2 to addNumber: 1
2022-08-08 14:42:06.453 [ERROR] [BaseTaskScheduler-Thread-11 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (79) [run] - Failed to execute task astJob_2_codeExec_2 org.apache.linkis.orchestrator.ecm.exception.ECMPluginErrorException: errCode: 12003 ,desc: bda01node03.oracle.cn:9101_2 Failed to async get EngineNode java.lang.InterruptedException: sleep interrupted
at java.lang.Thread.sleep(Native Method)
at org.apache.linkis.common.utils.Utils$.aux$1(Utils.scala:191)
at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:199)
at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:202)
at org.apache.linkis.orchestrator.ecm.cache.EngineAsyncResponseCacheMap$$anonfun$getAndRemove$1.apply$mcV$sp(EngineAsyncResponseCache.scala:80)
at org.apache.linkis.orchestrator.ecm.cache.EngineAsyncResponseCacheMap$$anonfun$getAndRemove$1.apply(EngineAsyncResponseCache.scala:80)
at org.apache.linkis.orchestrator.ecm.cache.EngineAsyncResponseCacheMap$$anonfun$getAndRemove$1.apply(EngineAsyncResponseCache.scala:80)
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40)
at org.apache.linkis.orchestrator.ecm.cache.EngineAsyncResponseCacheMap.getAndRemove(EngineAsyncResponseCache.scala:81)
at org.apache.linkis.orchestrator.ecm.ComputationEngineConnManager.getEngineNodeAskManager(ComputationEngineConnManager.scala:156)
at org.apache.linkis.orchestrator.ecm.ComputationEngineConnManager.askEngineConnExecutor(ComputationEngineConnManager.scala:101)
at org.apache.linkis.orchestrator.ecm.AbstractEngineConnManager.getAvailableEngineConnExecutor(EngineConnManager.scala:132)
at org.apache.linkis.orchestrator.computation.execute.DefaultCodeExecTaskExecutorManager.createExecutor(DefaultCodeExecTaskExecutorManager.scala:113)
at org.apache.linkis.orchestrator.computation.execute.DefaultCodeExecTaskExecutorManager.askExecutor(DefaultCodeExecTaskExecutorManager.scala:89)
at org.apache.linkis.orchestrator.computation.physical.CodeLogicalUnitExecTask$$anonfun$execute$1.apply(CodeLogicalUnitExecTask.scala:69)
at org.apache.linkis.orchestrator.computation.physical.CodeLogicalUnitExecTask$$anonfun$execute$1.apply(CodeLogicalUnitExecTask.scala:69)
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40)
at org.apache.linkis.orchestrator.computation.physical.CodeLogicalUnitExecTask.execute(CodeLogicalUnitExecTask.scala:69)
at org.apache.linkis.orchestrator.strategy.async.AsyncExecTaskRunnerImpl.run(AsyncExecTaskRunnerImpl.scala:62)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748) ,ip: bda01node03.oracle.cn ,port: 9104 ,serviceKind: linkis-cg-entrance
at org.apache.linkis.orchestrator.ecm.ComputationEngineConnManager.getEngineNodeAskManager(ComputationEngineConnManager.scala:165) ~[linkis-orchestrator-ecm-plugin-1.1.1.jar:1.1.1]
at org.apache.linkis.orchestrator.ecm.ComputationEngineConnManager.askEngineConnExecutor(ComputationEngineConnManager.scala:101) ~[linkis-orchestrator-ecm-plugin-1.1.1.jar:1.1.1]
at org.apache.linkis.orchestrator.ecm.AbstractEngineConnManager.getAvailableEngineConnExecutor(EngineConnManager.scala:132) ~[linkis-orchestrator-ecm-plugin-1.1.1.jar:1.1.1]
at org.apache.linkis.orchestrator.computation.execute.DefaultCodeExecTaskExecutorManager.createExecutor(DefaultCodeExecTaskExecutorManager.scala:113) ~[linkis-computation-orchestrator-1.1.1.jar:1.1.1]
at org.apache.linkis.orchestrator.computation.execute.DefaultCodeExecTaskExecutorManager.askExecutor(DefaultCodeExecTaskExecutorManager.scala:89) ~[linkis-computation-orchestrator-1.1.1.jar:1.1.1]
at org.apache.linkis.orchestrator.computation.physical.CodeLogicalUnitExecTask$$anonfun$execute$1.apply(CodeLogicalUnitExecTask.scala:69) ~[linkis-computation-orchestrator-1.1.1.jar:1.1.1]
at org.apache.linkis.orchestrator.computation.physical.CodeLogicalUnitExecTask$$anonfun$execute$1.apply(CodeLogicalUnitExecTask.scala:69) ~[linkis-computation-orchestrator-1.1.1.jar:1.1.1]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
at org.apache.linkis.orchestrator.computation.physical.CodeLogicalUnitExecTask.execute(CodeLogicalUnitExecTask.scala:69) ~[linkis-computation-orchestrator-1.1.1.jar:1.1.1]
at org.apache.linkis.orchestrator.strategy.async.AsyncExecTaskRunnerImpl.run(AsyncExecTaskRunnerImpl.scala:62) ~[linkis-orchestrator-core-1.1.1.jar:1.1.1]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[?:1.8.0_141]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[?:1.8.0_141]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_141]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_141]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_141]
2022-08-08 14:42:06.454 [INFO ] [BaseTaskScheduler-Thread-12 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (41) [info] - ExecTaskRunner Submit execTask(astJob_2_stage_4) to running
2022-08-08 14:42:06.454 [INFO ] [BaseTaskScheduler-Thread-11 ] o.a.l.o.s.a.AsyncExecTaskRunnerImpl (86) [transientStatus] - TaskastJob_2_codeExec_2 status flip error! Cause: Failed to flip from Cancelled to Failed.
```
微服务LINKIS-CG-LINKISMANAGER主要异常信息如下：
```
2022-08-08 14:42:03.719 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.e.EurekaRPCServerLoader (41) [info] - Need a ServiceInstance(linkis-cg-engineconnmanager, bda01node03.oracle.cn:9102), but cannot find in DiscoveryClient refresh list.
2022-08-08 14:42:03.719 [INFO ] [AskEngineService-Thread-5 ] o.a.l.m.a.s.e.DefaultEngineCreateService (198) [apply] - Failed to create ec(13304e31-c72b-4eba-b4b2-9cc68f25b3e8) ask ecm ServiceInstance(linkis-cg-engineconnmanager, bda01node03.oracle.cn:9102)
2022-08-08 14:42:03.725 [INFO ] [AskEngineService-Thread-5 ] o.a.l.m.a.s.e.DefaultEngineStopService (81) [engineConnInfoClear] - Start to clear ec info AMEngineNode{nodeStatus=null, lock='null', serviceInstance=ServiceInstance(linkis-cg-engineconn, 13304e31-c72b-4eba-b4b2-9cc68f25b3e8), owner='null'}
2022-08-08 14:42:03.729 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.i.DefaultResourceManager (398) [resourceReleased] - resourceRelease ready:ServiceInstance(linkis-cg-engineconn, 13304e31-c72b-4eba-b4b2-9cc68f25b3e8),current node resourceCommonNodeResource{resourceType=LoadInstance, maxResource=Number of instances(实例数)：1，(RAM)内存：1024.0 MB,cpu:2, minResource=Number of instances(实例数)：1，(RAM)内存：1024.0 MB,cpu:2, usedResource=null, lockedResource=Number of instances(实例数)：1，(RAM)内存：1024.0 MB,cpu:2, expectedResource=null, leftResource=null}
2022-08-08 14:42:03.733 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.ResourceLockService (41) [info] - [key: engineInstance, value: {"instance":"13304e31-c72b-4eba-b4b2-9cc68f25b3e8","serviceName":"linkis-cg-engineconn"}, str: linkis-cg-engineconn-13304e31-c72b-4eba-b4b2-9cc68f25b3e8] successfully locked labellinkis-cg-engineconn-13304e31-c72b-4eba-b4b2-9cc68f25b3e8
2022-08-08 14:42:03.737 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.ResourceLockService (41) [info] - [key: emInstance, value: {"instance":"bda01node03.oracle.cn:9102","serviceName":"linkis-cg-engineconnmanager"}, str: linkis-cg-engineconnmanager-bda01node03.oracle.cn:9102] successfully locked labellinkis-cg-engineconnmanager-bda01node03.oracle.cn:9102
2022-08-08 14:42:03.739 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.ResourceLockService (41) [info] - CombinedLabelImpl{key=combined_userCreator_engineTypevalue=hadoop-LINKISCLI,shell-1} successfully locked labelhadoop-LINKISCLI,shell-1
2022-08-08 14:42:03.759 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.i.ResourceLogService (41) [info] - ECMResourceMinus success, ecm current resource:bda01node03.oracle.cn:9102{"instance":0,"memory":"0.0 B","cpu":0}
2022-08-08 14:42:03.781 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.i.ResourceLogService (41) [info] - EngineResourceClear success, engine current resource:13304e31-c72b-4eba-b4b2-9cc68f25b3e8{"memory":"0.0 B","cpu":0}
2022-08-08 14:42:03.783 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.ResourceLockService (41) [info] - unlocked linkis-cg-engineconn-13304e31-c72b-4eba-b4b2-9cc68f25b3e8
2022-08-08 14:42:03.786 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.ResourceLockService (41) [info] - unlocked linkis-cg-engineconnmanager-bda01node03.oracle.cn:9102
2022-08-08 14:42:03.789 [INFO ] [AskEngineService-Thread-5 ] o.a.l.r.s.ResourceLockService (41) [info] - unlocked hadoop-LINKISCLI,shell-1
2022-08-08 14:42:03.789 [INFO ] [AskEngineService-Thread-5 ] o.a.l.m.l.s.i.DefaultNodeLabelRemoveService (41) [info] - Start to remove labels from node ServiceInstance(linkis-cg-engineconn, 13304e31-c72b-4eba-b4b2-9cc68f25b3e8)
2022-08-08 14:42:03.803 [INFO ] [AskEngineService-Thread-5 ] o.a.l.m.l.s.i.DefaultNodeLabelRemoveService (41) [info] - Finished to remove labels from node ServiceInstance(linkis-cg-engineconn, 13304e31-c72b-4eba-b4b2-9cc68f25b3e8)
2022-08-08 14:42:03.811 [INFO ] [AskEngineService-Thread-5 ] o.a.l.m.a.s.e.DefaultEngineStopService (99) [engineConnInfoClear] - Finished to clear ec info AMEngineNode{nodeStatus=null, lock='null', serviceInstance=ServiceInstance(linkis-cg-engineconn, 13304e31-c72b-4eba-b4b2-9cc68f25b3e8), owner='null'}
2022-08-08 14:42:03.812 [INFO ] [AskEngineService-Thread-6 ] o.a.l.m.a.s.e.DefaultEngineAskEngineService (121) [apply] - Failed to async(bda01node03.oracle.cn:9101_2) createEngine, can Retry true java.lang.reflect.UndeclaredThrowableException: null
at com.sun.proxy.$Proxy185.receiveAndReply(Unknown Source) ~[?:?]
at org.apache.linkis.rpc.BaseRPCSender$$anonfun$ask$1.apply(BaseRPCSender.scala:86) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.BaseRPCInterceptorExchange.invoke(RPCInterceptorExchange.scala:31) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.common.CommonRPCInterceptor.intercept(CommonRPCInterceptor.scala:28) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.BaseRPCInterceptorChain.handle(RPCInterceptorChain.scala:34) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.common.RetryableRPCInterceptor.intercept(RetryableRPCInterceptor.scala:54) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.BaseRPCInterceptorChain.handle(RPCInterceptorChain.scala:34) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.common.CacheableRPCInterceptor.intercept(CacheableRPCInterceptor.scala:58) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.BaseRPCInterceptorChain.handle(RPCInterceptorChain.scala:34) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.common.BroadcastRPCInterceptor.intercept(BroadcastRPCInterceptor.scala:73) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.BaseRPCInterceptorChain.handle(RPCInterceptorChain.scala:34) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.BaseRPCSender.execute(BaseRPCSender.scala:79) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.BaseRPCSender.ask(BaseRPCSender.scala:83) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.manager.am.pointer.DefaultEMNodPointer.createEngine(DefaultEMNodPointer.scala:43) ~[linkis-application-manager-1.1.1.jar:1.1.1]
at org.apache.linkis.manager.am.manager.DefaultEMNodeManager.createEngine(DefaultEMNodeManager.scala:171) ~[linkis-application-manager-1.1.1.jar:1.1.1]
at org.apache.linkis.manager.am.service.em.DefaultEMEngineService.createEngine(DefaultEMEngineService.scala:68) ~[linkis-application-manager-1.1.1.jar:1.1.1]
at org.apache.linkis.manager.am.service.engine.DefaultEngineCreateService$$anonfun$2.apply(DefaultEngineCreateService.scala:196) ~[linkis-application-manager-1.1.1.jar:1.1.1]
at org.apache.linkis.manager.am.service.engine.DefaultEngineCreateService$$anonfun$2.apply(DefaultEngineCreateService.scala:196) ~[linkis-application-manager-1.1.1.jar:1.1.1]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
at org.apache.linkis.manager.am.service.engine.DefaultEngineCreateService.createEngine(DefaultEngineCreateService.scala:196) ~[linkis-application-manager-1.1.1.jar:1.1.1]
at org.apache.linkis.manager.am.service.engine.DefaultEngineAskEngineService$$anonfun$3.apply(DefaultEngineAskEngineService.scala:92) ~[linkis-application-manager-1.1.1.jar:1.1.1]
at org.apache.linkis.manager.am.service.engine.DefaultEngineAskEngineService$$anonfun$3.apply(DefaultEngineAskEngineService.scala:82) ~[linkis-application-manager-1.1.1.jar:1.1.1]
at scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) ~[scala-library-2.11.12.jar:?]
at scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) ~[scala-library-2.11.12.jar:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[?:1.8.0_141]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) ~[?:1.8.0_141]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_141]
Caused by: org.apache.linkis.rpc.exception.NoInstanceExistsException: errCode: 10051 ,desc: The instance bda01node03.oracle.cn:9102 of application linkis-cg-engineconnmanager is not exists. ,ip: bda01node03.oracle.cn ,port: 9101 ,serviceKind: linkis-cg-linkismanager
at org.apache.linkis.rpc.interceptor.AbstractRPCServerLoader.getOrRefresh(RPCServerLoader.scala:58) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.AbstractRPCServerLoader.getServer(RPCServerLoader.scala:76) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.sender.SpringMVCRPCSender$$anon$2$$anon$1$$anonfun$customizeLoadBalancerCommandBuilder$3.apply(SpringMVCRPCSender.scala:74) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.sender.SpringMVCRPCSender$$anon$2$$anon$1$$anonfun$customizeLoadBalancerCommandBuilder$3.apply(SpringMVCRPCSender.scala:73) ~[linkis-rpc-1.1.1.jar:1.1.1]
at scala.Option.foreach(Option.scala:257) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.rpc.sender.SpringMVCRPCSender$$anon$2$$anon$1.customizeLoadBalancerCommandBuilder(SpringMVCRPCSender.scala:73) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.sender.SpringMVCRPCSender$$anon$2$$anon$1.customizeLoadBalancerCommandBuilder(SpringMVCRPCSender.scala:54) ~[linkis-rpc-1.1.1.jar:1.1.1]
at com.netflix.client.AbstractLoadBalancerAwareClient.buildLoadBalancerCommand(AbstractLoadBalancerAwareClient.java:132) ~[ribbon-loadbalancer-2.3.0.jar:2.3.0]
at com.netflix.client.AbstractLoadBalancerAwareClient.executeWithLoadBalancer(AbstractLoadBalancerAwareClient.java:94) ~[ribbon-loadbalancer-2.3.0.jar:2.3.0]
at org.springframework.cloud.openfeign.ribbon.LoadBalancerFeignClient.execute(LoadBalancerFeignClient.java:84) ~[spring-cloud-openfeign-core-2.2.9.RELEASE.jar:2.2.9.RELEASE]
at feign.SynchronousMethodHandler.executeAndDecode(SynchronousMethodHandler.java:119) ~[feign-core-10.12.jar:?]
at feign.SynchronousMethodHandler.invoke(SynchronousMethodHandler.java:89) ~[feign-core-10.12.jar:?]
at feign.ReflectiveFeign$FeignInvocationHandler.invoke(ReflectiveFeign.java:100) ~[feign-core-10.12.jar:?]
... 27 more
Caused by: java.util.concurrent.TimeoutException
at org.apache.linkis.common.utils.Utils$.aux$1(Utils.scala:194) ~[linkis-common-1.1.1.jar:1.1.1]
at org.apache.linkis.common.utils.Utils$.waitUntil(Utils.scala:199) ~[linkis-common-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.AbstractRPCServerLoader$$anonfun$getOrRefresh$1.apply$mcV$sp(RPCServerLoader.scala:60) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.AbstractRPCServerLoader$$anonfun$getOrRefresh$1.apply(RPCServerLoader.scala:60) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.AbstractRPCServerLoader$$anonfun$getOrRefresh$1.apply(RPCServerLoader.scala:60) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.common.utils.Utils$.tryCatch(Utils.scala:40) ~[linkis-common-1.1.1.jar:1.1.1]
at org.apache.linkis.common.utils.Utils$.tryThrow(Utils.scala:57) ~[linkis-common-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.AbstractRPCServerLoader.getOrRefresh(RPCServerLoader.scala:66) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.interceptor.AbstractRPCServerLoader.getServer(RPCServerLoader.scala:76) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.sender.SpringMVCRPCSender$$anon$2$$anon$1$$anonfun$customizeLoadBalancerCommandBuilder$3.apply(SpringMVCRPCSender.scala:74) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.sender.SpringMVCRPCSender$$anon$2$$anon$1$$anonfun$customizeLoadBalancerCommandBuilder$3.apply(SpringMVCRPCSender.scala:73) ~[linkis-rpc-1.1.1.jar:1.1.1]
at scala.Option.foreach(Option.scala:257) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.rpc.sender.SpringMVCRPCSender$$anon$2$$anon$1.customizeLoadBalancerCommandBuilder(SpringMVCRPCSender.scala:73) ~[linkis-rpc-1.1.1.jar:1.1.1]
at org.apache.linkis.rpc.sender.SpringMVCRPCSender$$anon$2$$anon$1.customizeLoadBalancerCommandBuilder(SpringMVCRPCSender.scala:54) ~[linkis-rpc-1.1.1.jar:1.1.1]
at com.netflix.client.AbstractLoadBalancerAwareClient.buildLoadBalancerCommand(AbstractLoadBalancerAwareClient.java:132) ~[ribbon-loadbalancer-2.3.0.jar:2.3.0]
at com.netflix.client.AbstractLoadBalancerAwareClient.executeWithLoadBalancer(AbstractLoadBalancerAwareClient.java:94) ~[ribbon-loadbalancer-2.3.0.jar:2.3.0]
at org.springframework.cloud.openfeign.ribbon.LoadBalancerFeignClient.execute(LoadBalancerFeignClient.java:84) ~[spring-cloud-openfeign-core-2.2.9.RELEASE.jar:2.2.9.RELEASE]
at feign.SynchronousMethodHandler.executeAndDecode(SynchronousMethodHandler.java:119) ~[feign-core-10.12.jar:?]
at feign.SynchronousMethodHandler.invoke(SynchronousMethodHandler.java:89) ~[feign-core-10.12.jar:?]
at feign.ReflectiveFeign$FeignInvocationHandler.invoke(ReflectiveFeign.java:100) ~[feign-core-10.12.jar:?]
... 27 more
````
微服务LINKIS-MG-GATEWAY主要异常信息如下：
```
2022-08-08 14:41:37.593 [INFO ] [reactor-http-epoll-37 ] o.a.l.g.s.t.TokenAuthentication$ (41) [info] - Token authentication succeed, uri: /api/rest_j/v1/jobhistory/6/get, token: BML-AUTH, tokenUser: hadoop.
2022-08-08 14:41:37.594 [INFO ] [reactor-http-epoll-36 ] o.a.l.g.s.t.TokenAuthentication$ (41) [info] - Token authentication succeed, uri: /api/rest_j/v1/jobhistory/6/get, token: BML-AUTH, tokenUser: hadoop.
2022-08-08 14:41:37.594 [INFO ] [reactor-http-epoll-36 ] o.a.l.s.s.SSOUtils$ (41) [info] - add login userTicketCookie for user hadoop.
2022-08-08 14:41:37.594 [INFO ] [reactor-http-epoll-37 ] o.a.l.s.s.SSOUtils$ (41) [info] - add login userTicketCookie for user hadoop.
2022-08-08 14:41:37.595 [INFO ] [reactor-http-epoll-36 ] o.a.l.g.r.DefaultGatewayRouter (41) [info] - GatewayRouter route requestUri /api/rest_j/v1/jobhistory/6/get with parsedService linkis-ps-publicservice to ServiceInstance(linkis-ps-publicservice, null)
2022-08-08 14:41:37.596 [INFO ] [reactor-http-epoll-37 ] o.a.l.g.r.DefaultGatewayRouter (41) [info] - GatewayRouter route requestUri /api/rest_j/v1/jobhistory/6/get with parsedService linkis-ps-publicservice to ServiceInstance(linkis-ps-publicservice, null)
2022-08-08 14:41:37.651 [INFO ] [reactor-http-epoll-37 ] o.a.l.g.s.t.TokenAuthentication$ (41) [info] - Token authentication succeed, uri: /api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/log, token: BML-AUTH, tokenUser: hadoop.
2022-08-08 14:41:37.651 [INFO ] [reactor-http-epoll-36 ] o.a.l.g.s.t.TokenAuthentication$ (41) [info] - Token authentication succeed, uri: /api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status, token: BML-AUTH, tokenUser: hadoop.
2022-08-08 14:41:37.651 [INFO ] [reactor-http-epoll-37 ] o.a.l.s.s.SSOUtils$ (41) [info] - add login userTicketCookie for user hadoop.
2022-08-08 14:41:37.652 [INFO ] [reactor-http-epoll-36 ] o.a.l.s.s.SSOUtils$ (41) [info] - add login userTicketCookie for user hadoop.
2022-08-08 14:41:37.652 [INFO ] [reactor-http-epoll-37 ] o.a.l.g.r.DefaultGatewayRouter (41) [info] - GatewayRouter route requestUri /api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/log with parsedService linkis-cg-entrance to ServiceInstance(linkis-cg-entrance, bda01node03.oracle.cn:9104)
2022-08-08 14:41:37.652 [INFO ] [reactor-http-epoll-36 ] o.a.l.g.r.DefaultGatewayRouter (41) [info] - GatewayRouter route requestUri /api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status with parsedService linkis-cg-entrance to ServiceInstance(linkis-cg-entrance, bda01node03.oracle.cn:9104)
2022-08-08 14:41:37.653 [INFO ] [reactor-http-epoll-37 ] o.a.l.g.s.SpringCloudGatewayConfiguration$ (41) [info] - redirect to ServiceInstance(linkis-cg-entrance, bda01node03.oracle.cn:9104)
2022-08-08 14:41:37.653 [INFO ] [reactor-http-epoll-36 ] o.a.l.g.s.SpringCloudGatewayConfiguration$ (41) [info] - redirect to ServiceInstance(linkis-cg-entrance, bda01node03.oracle.cn:9104)
2022-08-08 14:41:37.655 [ERROR] [reactor-http-epoll-36 ] o.s.b.a.w.r.e.AbstractErrorWebExceptionHandler (122) [error] - [6e51ef7e-242] 500 Server Error for HTTP GET "/api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status" java.util.NoSuchElementException: None.get
at scala.None$.get(Option.scala:347) ~[scala-library-2.11.12.jar:?]
Suppressed: reactor.core.publisher.FluxOnAssembly$OnAssemblyException:
Error has been observed at the following site(s):
|_ checkpoint ⇢ org.springframework.cloud.gateway.filter.WeightCalculatorWebFilter [DefaultWebFilterChain]
|_ checkpoint ⇢ org.springframework.boot.actuate.metrics.web.reactive.server.MetricsWebFilter [DefaultWebFilterChain]
|_ checkpoint ⇢ HTTP GET "/api/rest_j/v1/entrance/exec_id018026linkis-cg-entrancebda01node03.oracle.cn:9104LINKISCLI_hadoop_shell_0/status" [ExceptionHandlingWebHandler]
Stack trace:
at scala.None$.get(Option.scala:347) ~[scala-library-2.11.12.jar:?]
at scala.None$.get(Option.scala:345) ~[scala-library-2.11.12.jar:?]
at org.apache.linkis.gateway.springcloud.SpringCloudGatewayConfiguration$$anon$1.choose(SpringCloudGatewayConfiguration.scala:109) ~[linkis-spring-cloud-gateway-1.1.1.jar:1.1.1]
at org.springframework.cloud.netflix.ribbon.RibbonLoadBalancerClient.choose(RibbonLoadBalancerClient.java:78) ~[spring-cloud-netflix-ribbon-2.2.9.RELEASE.jar:2.2.9.RELEASE]
at org.springframework.cloud.gateway.filter.LoadBalancerClientFilter.choose(LoadBalancerClientFilter.java:111) ~[spring-cloud-gateway-server-2.2.9.RELEASE.jar:2.2.9.RELEASE]
at org.springframework.cloud.gateway.filter.LoadBalancerClientFilter.filter(LoadBalancerClientFilter.java:83) ~[spring-cloud-gateway-server-2.2.9.RELEASE.jar:2.2.9.RELEASE]
at org.springframework.cloud.gateway.handler.FilteringWebHandler$GatewayFilterAdapter.filter(FilteringWebHandler.java:138) ~[spring-cloud-gateway-server-2.2.9.RELEASE.jar:2.2.9.RELEASE]
at org.springframework.cloud.gateway.filter.OrderedGatewayFilter.filter(OrderedGatewayFilter.java:44) ~[spring-cloud-gateway-server-2.2.9.RELEASE.jar:2.2.9.RELEASE]
at org.springframework.cloud.gateway.handler.FilteringWebHandler$DefaultGatewayFilterChain.lambda$filter$0(FilteringWebHandler.java:118) ~[spring-cloud-gateway-server-2.2.9.RELEASE.jar:2.2.9.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:44) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.Mono.subscribe(Mono.java:4252) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.subscribeNext(MonoIgnoreThen.java:253) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoIgnoreThen.subscribe(MonoIgnoreThen.java:51) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.Mono.subscribe(Mono.java:4252) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.subscribeNext(MonoIgnoreThen.java:253) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoIgnoreThen.subscribe(MonoIgnoreThen.java:51) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:150) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:67) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:76) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.innerNext(FluxConcatMap.java:274) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapInner.onNext(FluxConcatMap.java:851) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxSwitchIfEmpty$SwitchIfEmptySubscriber.onNext(FluxSwitchIfEmpty.java:67) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1812) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoFlatMap$FlatMapMain.onNext(MonoFlatMap.java:144) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxMap$MapSubscriber.onNext(FluxMap.java:114) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoNext$NextSubscriber.onNext(MonoNext.java:76) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.innerNext(FluxConcatMap.java:274) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapInner.onNext(FluxConcatMap.java:851) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxOnErrorResume$ResumeSubscriber.onNext(FluxOnErrorResume.java:73) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoPeekTerminal$MonoTerminalPeekSubscriber.onNext(MonoPeekTerminal.java:173) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.Operators$MonoSubscriber.complete(Operators.java:1812) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoFilterWhen$MonoFilterWhenMain.onNext(MonoFilterWhen.java:140) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.Operators$ScalarSubscription.request(Operators.java:2393) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoFilterWhen$MonoFilterWhenMain.onSubscribe(MonoFilterWhen.java:103) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoJust.subscribe(MonoJust.java:54) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.Mono.subscribe(Mono.java:4252) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.drain(FluxConcatMap.java:441) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.onNext(FluxConcatMap.java:243) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxDematerialize$DematerializeSubscriber.onNext(FluxDematerialize.java:91) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxDematerialize$DematerializeSubscriber.onNext(FluxDematerialize.java:38) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxIterable$IterableSubscription.slowPath(FluxIterable.java:267) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxIterable$IterableSubscription.request(FluxIterable.java:225) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxDematerialize$DematerializeSubscriber.request(FluxDematerialize.java:120) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.onSubscribe(FluxConcatMap.java:228) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxDematerialize$DematerializeSubscriber.onSubscribe(FluxDematerialize.java:70) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:161) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:86) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalFluxOperator.subscribe(InternalFluxOperator.java:62) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxDefer.subscribe(FluxDefer.java:54) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.Mono.subscribe(Mono.java:4252) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.drain(FluxConcatMap.java:441) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxConcatMap$ConcatMapImmediate.onSubscribe(FluxConcatMap.java:211) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:161) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.FluxIterable.subscribe(FluxIterable.java:86) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoDefer.subscribe(MonoDefer.java:52) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.Mono.subscribe(Mono.java:4252) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoIgnoreThen$ThenIgnoreMain.subscribeNext(MonoIgnoreThen.java:253) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.MonoIgnoreThen.subscribe(MonoIgnoreThen.java:51) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.core.publisher.InternalMonoOperator.subscribe(InternalMonoOperator.java:64) ~[reactor-core-3.3.17.RELEASE.jar:3.3.17.RELEASE]
at reactor.netty.http.server.HttpServerHandle.onStateChange(HttpServerHandle.java:65) ~[reactor-netty-0.9.20.RELEASE.jar:0.9.20.RELEASE]
at reactor.netty.ReactorNetty$CompositeConnectionObserver.onStateChange(ReactorNetty.java:537) ~[reactor-netty-0.9.20.RELEASE.jar:0.9.20.RELEASE]
at reactor.netty.tcp.TcpServerBind$ChildObserver.onStateChange(TcpServerBind.java:278) ~[reactor-netty-0.9.20.RELEASE.jar:0.9.20.RELEASE]
at reactor.netty.http.server.HttpServerOperations.onInboundNext(HttpServerOperations.java:475) ~[reactor-netty-0.9.20.RELEASE.jar:0.9.20.RELEASE]
at reactor.netty.channel.ChannelOperationsHandler.channelRead(ChannelOperationsHandler.java:96) ~[reactor-netty-0.9.20.RELEASE.jar:0.9.20.RELEASE]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at reactor.netty.http.server.HttpTrafficHandler.channelRead(HttpTrafficHandler.java:191) ~[reactor-netty-0.9.20.RELEASE.jar:0.9.20.RELEASE]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.CombinedChannelDuplexHandler$DelegatingChannelHandlerContext.fireChannelRead(CombinedChannelDuplexHandler.java:436) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:324) ~[netty-codec-4.1.65.Final.jar:4.1.65.Final]
at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:296) ~[netty-codec-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.CombinedChannelDuplexHandler.channelRead(CombinedChannelDuplexHandler.java:251) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) ~[netty-transport-4.1.65.Final.jar:4.1.65.Final]
at io.netty.channel.epoll.AbstractEpollStreamChannel$EpollStreamUnsafe.epollInReady(AbstractEpollStreamChannel.java:795) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
at io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:480) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
at io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:378) ~[netty-transport-native-epoll-4.1.65.Final-linux-x86_64.jar:4.1.65.Final]
at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:989) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ~[netty-common-4.1.65.Final.jar:4.1.65.Final]
at java.lang.Thread.run(Thread.java:748) ~[?:1.8.0_141]
```
### Your environment
<!-- Please describe the linkis version you are using and basic environment information -->
<!-- 请描述您使用的linkis版本和基本环境信息 -->
- Linkis version used: 1.1.1
- Environment name and version:
- cdh-5.12.1
- hdp-2.6.0-cdh5.12.1
- hive-1.1.0-cdh5.12.1
- spark-2.2.0.cloudera1
- scala-2.11.12
- jdk 1.8.0_121
- OS：Red Hat Enterprise Linux Server release 6.9
### Anything else
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] peacewong commented on issue #2642: linkis1.1.1启动成功后提交任务给引擎执行时失败的问题[Bug]
Posted by GitBox <gi...@apache.org>.
peacewong commented on issue #2642:
URL: https://github.com/apache/incubator-linkis/issues/2642#issuecomment-1209163345
This is because the service name registered in the registry is hostname, and then the service uses the domain name when registering with linkisManager. The solutions are mainly as follows:
1. Modify /etc/hosts to configure the mapping between domain name and ip, and remove the mapping of hostname. or just keep the mapping of hostname
2. Modify to IP registration, this requires modifying parameters: linkis-env.sh is export EUREKA_PREFER_IP=true
这个是因为在注册中心注册的服务名是hostname，然后服务在注册到linkisManager时用的是域名。解决办法主要如下：
1. 修改/etc/hosts配置域名和ip的映射，去掉hostname的映射。或者只保留hostname的映射
2. 修改为IP注册，这个需要修改参数：linkis-env.sh为export EUREKA_PREFER_IP=true
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] github-actions[bot] commented on issue #2642: linkis1.1.1启动成功后提交任务给引擎执行时失败的问题[Bug]
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2642:
URL: https://github.com/apache/incubator-linkis/issues/2642#issuecomment-1208849584
:blush: Welcome to the Apache Linkis (incubating) community!!
We are glad that you are contributing by opening this issue.
Please make sure to include all the relevant context.
We will be here shortly.
If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
:point_right: [How to Participate in Project Contribution](https://linkis.apache.org/community/how-to-contribute).
WeChat Group:
Mailing Lists:
|name|description|Subscribe|Unsubscribe|archive|
|:-----|:--------|:------|:-------|:-----|
| [dev@linkis.apache.org](mailto:dev@linkis.apache.org) | community activity information | [subscribe](mailto:dev-subscribe@linkis.apache.org) | [unsubscribe](mailto:dev-unsubscribe@linkis.apache.org) | [archive](http://mail-archives.apache.org/mod_mbox/linkis-dev) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [incubator-linkis] casionone closed issue #2642: linkis1.1.1启动成功后提交任务给引擎执行时失败的问题[Bug]
Posted by GitBox <gi...@apache.org>.
casionone closed issue #2642: linkis1.1.1启动成功后提交任务给引擎执行时失败的问题[Bug]
URL: https://github.com/apache/incubator-linkis/issues/2642
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [linkis] wangcomeoffit commented on issue #2642: linkis1.1.1启动成功后提交任务给引擎执行时失败的问题[Bug]
Posted by GitBox <gi...@apache.org>.
wangcomeoffit commented on issue #2642:
URL: https://github.com/apache/linkis/issues/2642#issuecomment-1373418115
>
我修改 linkis-env.sh为export EUREKA_PREFER_IP=true 和 修改/etc/hosts配置域名和ip的镜像，去掉hostname的镜像。或者只保留hostname的镜像 还是不行啊
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org