You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@linkis.apache.org by GitBox <gi...@apache.org> on 2021/10/31 10:27:00 UTC
[GitHub] [incubator-linkis] CCweixiao opened a new issue #1055: PySpark脚本执行报错，
CCweixiao opened a new issue #1055:
URL: https://github.com/apache/incubator-linkis/issues/1055
<img width="1201" alt="wecom-temp-91c36f02b1f761dc226fa4f2e626d0e0" src="https://user-images.githubusercontent.com/27730211/139578182-7c4d5b1b-eb4a-49dc-bdf2-1148dd0b230b.png">
2021-10-31 17:39:11.706 ERROR [Linkis-Default-Scheduler-Thread-3] com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor 57 error - initialize python executor failed, please ask administrator for help! java.util.concurrent.TimeoutException: null
at com.webank.wedatasphere.linkis.common.utils.Utils$.aux$1(Utils.scala:193) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.waitUntil(Utils.scala:198) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.waitUntil(Utils.scala:201) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.com$webank$wedatasphere$linkis$engineplugin$spark$executor$SparkPythonExecutor$$initGateway(SparkPythonExecutor.scala:193) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply$mcV$sp(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryThrow(Utils.scala:56) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.lazyInitGageWay(SparkPythonExecutor.scala:209) [linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.runCode(SparkPythonExecutor.scala:202) [linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2$$anonfun$2.apply(SparkEngineConnExecutor.scala:87) [linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2$$anonfun$2.apply(SparkEngineConnExecutor.scala:87) [linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2.apply(SparkEngineConnExecutor.scala:87) [linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2.apply(SparkEngineConnExecutor.scala:65) [linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor.executeLine(SparkEngineConnExecutor.scala:95) [linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:179) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:178) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:180) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:174) [linkis-computation-engineconn-1.0.2.jar:?]
at scala.collection.immutable.Range.foreach(Range.scala:160) [scala-library-2.11.12.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:173) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:149) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.toExecuteTask(ComputationExecutor.scala:222) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:237) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:237) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:54) [linkis-accessible-executor-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:48) [linkis-accessible-executor-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.ensureOp(ComputationExecutor.scala:133) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.execute(ComputationExecutor.scala:236) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl.com$webank$wedatasphere$linkis$engineconn$computation$executor$service$TaskExecutionServiceImpl$$executeTask(TaskExecutionServiceImpl.scala:239) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply$mcV$sp(TaskExecutionServiceImpl.scala:172) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryAndWarn(Utils.scala:68) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1.run(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_251]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_251]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_251]
2021-10-31 17:39:11.738 ERROR [Linkis-Default-Scheduler-Thread-3] com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor 57 error - execute code failed! java.util.concurrent.TimeoutException: null
at com.webank.wedatasphere.linkis.common.utils.Utils$.aux$1(Utils.scala:193) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.waitUntil(Utils.scala:198) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.waitUntil(Utils.scala:201) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.com$webank$wedatasphere$linkis$engineplugin$spark$executor$SparkPythonExecutor$$initGateway(SparkPythonExecutor.scala:193) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply$mcV$sp(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryThrow(Utils.scala:56) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.lazyInitGageWay(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.runCode(SparkPythonExecutor.scala:202) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2$$anonfun$2.apply(SparkEngineConnExecutor.scala:87) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2$$anonfun$2.apply(SparkEngineConnExecutor.scala:87) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2.apply(SparkEngineConnExecutor.scala:87) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2.apply(SparkEngineConnExecutor.scala:65) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor.executeLine(SparkEngineConnExecutor.scala:95) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:179) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:178) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:180) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:174) [linkis-computation-engineconn-1.0.2.jar:?]
at scala.collection.immutable.Range.foreach(Range.scala:160) [scala-library-2.11.12.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:173) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:149) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.toExecuteTask(ComputationExecutor.scala:222) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:237) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:237) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:54) [linkis-accessible-executor-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:48) [linkis-accessible-executor-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.ensureOp(ComputationExecutor.scala:133) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.execute(ComputationExecutor.scala:236) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl.com$webank$wedatasphere$linkis$engineconn$computation$executor$service$TaskExecutionServiceImpl$$executeTask(TaskExecutionServiceImpl.scala:239) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply$mcV$sp(TaskExecutionServiceImpl.scala:172) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryAndWarn(Utils.scala:68) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1.run(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_251]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_251]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_251]
2021-10-31 17:39:11.758 ERROR [Linkis-Default-Scheduler-Thread-3] com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl 57 error - TimeoutException: java.util.concurrent.TimeoutException: null
at com.webank.wedatasphere.linkis.common.utils.Utils$.aux$1(Utils.scala:193) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.waitUntil(Utils.scala:198) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.waitUntil(Utils.scala:201) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.com$webank$wedatasphere$linkis$engineplugin$spark$executor$SparkPythonExecutor$$initGateway(SparkPythonExecutor.scala:193) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply$mcV$sp(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor$$anonfun$lazyInitGageWay$1.apply(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryThrow(Utils.scala:56) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.lazyInitGageWay(SparkPythonExecutor.scala:209) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkPythonExecutor.runCode(SparkPythonExecutor.scala:202) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2$$anonfun$2.apply(SparkEngineConnExecutor.scala:87) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2$$anonfun$2.apply(SparkEngineConnExecutor.scala:87) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2.apply(SparkEngineConnExecutor.scala:87) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor$$anonfun$executeLine$2.apply(SparkEngineConnExecutor.scala:65) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.spark.executor.SparkEngineConnExecutor.executeLine(SparkEngineConnExecutor.scala:95) ~[linkis-engineplugin-spark-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:179) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10$$anonfun$apply$11.apply(ComputationExecutor.scala:178) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:180) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2$$anonfun$apply$10.apply(ComputationExecutor.scala:174) ~[linkis-computation-engineconn-1.0.2.jar:?]
at scala.collection.immutable.Range.foreach(Range.scala:160) ~[scala-library-2.11.12.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:173) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$toExecuteTask$2.apply(ComputationExecutor.scala:149) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.toExecuteTask(ComputationExecutor.scala:222) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:237) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor$$anonfun$3.apply(ComputationExecutor.scala:237) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryFinally(Utils.scala:60) ~[linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:54) ~[linkis-accessible-executor-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.acessible.executor.entity.AccessibleExecutor.ensureIdle(AccessibleExecutor.scala:48) ~[linkis-accessible-executor-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.ensureOp(ComputationExecutor.scala:133) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.execute.ComputationExecutor.execute(ComputationExecutor.scala:236) ~[linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl.com$webank$wedatasphere$linkis$engineconn$computation$executor$service$TaskExecutionServiceImpl$$executeTask(TaskExecutionServiceImpl.scala:239) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply$mcV$sp(TaskExecutionServiceImpl.scala:172) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1$$anonfun$run$1.apply(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryAndWarn(Utils.scala:68) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineconn.computation.executor.service.TaskExecutionServiceImpl$$anon$1.run(TaskExecutionServiceImpl.scala:170) [linkis-computation-engineconn-1.0.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_251]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_251]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_251]
2021-10-31 17:39:11.039 ERROR Task is Failed,errorMsg: TimeoutException:
### 2. 引擎日志中的报错信息如下：
linkis-cg-engineplugin.log
hadoopEngineConn.
2021-10-31 17:37:18.495 [ERROR] [Linkis-Default-Scheduler-Thread-1 ] c.w.w.l.e.s.s.DefaultEngineConnResourceService (99) [apply] - error code（错误码）: 20001, Error message（错误信息）: Cannot find the home path of engineconn dist.. com.webank.wedatasphere.linkis.manager.engineplugin.common.exception.EngineConnPluginErrorException: errCode: 20001 ,desc: Cannot find the home path of engineconn dist. ,ip: centos-bigdatacdh-24203 ,port: 9103 ,serviceKind: linkis-cg-engineplugin
at com.webank.wedatasphere.linkis.engineplugin.server.localize.AbstractEngineConnBmlResourceGenerator.getEngineConnDistHomeList(AbstractEngineConnBmlResourceGenerator.scala:56) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.localize.DefaultEngineConnBmlResourceGenerator.generate(DefaultEngineConnBmlResourceGenerator.scala:30) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2$$anonfun$apply$1.apply$mcV$sp(DefaultEngineConnResourceService.scala:84) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2$$anonfun$apply$1.apply(DefaultEngineConnResourceService.scala:82) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2$$anonfun$apply$1.apply(DefaultEngineConnResourceService.scala:82) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryAndError(Utils.scala:96) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2.apply(DefaultEngineConnResourceService.scala:82) [linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2.apply(DefaultEngineConnResourceService.scala:81) [linkis-engineconn-plugin-server-1.0.2.jar:?]
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) [scala-library-2.11.12.jar:?]
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) [scala-library-2.11.12.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1.run(DefaultEngineConnResourceService.scala:81) [linkis-engineconn-plugin-server-1.0.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_251]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_251]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_251]
2021-10-31 17:37:18.500 [INFO ] [Linkis-Default-Scheduler-Thread-1 ] c.w.w.l.e.s.s.DefaultEngineConnResourceService (40) [info] - Try to initialize all versions of engineConnPublickDirEngineConn.
2021-10-31 17:37:18.500 [ERROR] [Linkis-Default-Scheduler-Thread-1 ] c.w.w.l.e.s.s.DefaultEngineConnResourceService (99) [apply] - error code（错误码）: 20001, Error message（错误信息）: Cannot find the home path of engineconn dist.. com.webank.wedatasphere.linkis.manager.engineplugin.common.exception.EngineConnPluginErrorException: errCode: 20001 ,desc: Cannot find the home path of engineconn dist. ,ip: centos-bigdatacdh-24203 ,port: 9103 ,serviceKind: linkis-cg-engineplugin
at com.webank.wedatasphere.linkis.engineplugin.server.localize.AbstractEngineConnBmlResourceGenerator.getEngineConnDistHomeList(AbstractEngineConnBmlResourceGenerator.scala:56) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.localize.DefaultEngineConnBmlResourceGenerator.generate(DefaultEngineConnBmlResourceGenerator.scala:30) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2$$anonfun$apply$1.apply$mcV$sp(DefaultEngineConnResourceService.scala:84) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2$$anonfun$apply$1.apply(DefaultEngineConnResourceService.scala:82) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2$$anonfun$apply$1.apply(DefaultEngineConnResourceService.scala:82) ~[linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryCatch(Utils.scala:39) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.common.utils.Utils$.tryAndError(Utils.scala:96) [linkis-common-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2.apply(DefaultEngineConnResourceService.scala:82) [linkis-engineconn-plugin-server-1.0.2.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1$$anonfun$run$2.apply(DefaultEngineConnResourceService.scala:81) [linkis-engineconn-plugin-server-1.0.2.jar:?]
at scala.collection.IndexedSeqOptimized$class.foreach(IndexedSeqOptimized.scala:33) [scala-library-2.11.12.jar:?]
at scala.collection.mutable.ArrayOps$ofRef.foreach(ArrayOps.scala:186) [scala-library-2.11.12.jar:?]
at com.webank.wedatasphere.linkis.engineplugin.server.service.DefaultEngineConnResourceService$$anon$1.run(DefaultEngineConnResourceService.scala:81) [linkis-engineconn-plugin-server-1.0.2.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_251]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180) [?:1.8.0_251]
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_251]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_251]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_251]
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org
[GitHub] [incubator-linkis] peacewong commented on issue #1055: PySpark脚本执行报错，
Posted by GitBox <gi...@apache.org>.
peacewong commented on issue #1055:
URL: https://github.com/apache/incubator-linkis/issues/1055#issuecomment-976450063
Hello, you can check whether the matplotlib module is available
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@linkis.apache.org
For additional commands, e-mail: dev-help@linkis.apache.org
[GitHub] [incubator-linkis] peacewong closed issue #1055: PySpark脚本执行报错，
Posted by GitBox <gi...@apache.org>.
peacewong closed issue #1055:
URL: https://github.com/apache/incubator-linkis/issues/1055
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@linkis.apache.org
For additional commands, e-mail: commits-help@linkis.apache.org