[DISCUSS]SQL execution and YARN logs

[康悦Rita <ri...@163.com>]

Dear:

Wechat group "Apache Linkis community Development group "chat records are as follows:  微信群"Apache Linkis 社区开发群"的聊天记录如下:

—————  2022-9-3  —————

Biandou 扁豆  10:52







Biandou 扁豆 10:52







Biandou 扁豆  10:53

大佬 这种错误 同一个sql 在有时候执行失败有时候执行成功

This is an error where the same SQL sometimes fails and sometimes succeeds


Biandou 扁豆  10:53

然后查看yarn上日志 也没给出具体有价值的报错提示

After checking the YARN log, no valuable error message is displayed


 utopianet 闪电先生  10:54

code 2 这个，我常常碰到，一般来说是资源问题

Code 2, which I run into a lot, is generally a resource problem


 utopianet 闪电先生   10:57

个人经验，不一定对 Personal experience is not always right






peacewong@WDS  11:02

用yarn logs看看 Use Yarn logs to see




Biandou 扁豆  11:19

看了的 Look at the




Biandou 扁豆  11:22







Biandou 扁豆 11:22

这个目录下确实没有 It's not in this directory






peacewong@WDS  12:25

我看是hadoop用户启动的，你的切换到hadoop用户去，yarn logs  I think it is started by Hadoop user, and your switch to Hadoop user, Yarn logs




Biandou 扁豆 13:07







Biandou 扁豆  13:08

现在我配置日志聚合 现在日志是有了 Now I've configured the log aggregation and now the log is there






Biandou 扁豆  13:08

但是我没发掘出有价值的日志 But I didn't dig up any valuable logs




peacewong@WDS  13:25

没其他日志吗 No other logs




Biandou 扁豆  13:26

@peacewong@WDS 主要是没详细报错日志 mainly because there is no detailed error log




Biandou 扁豆  13:26







peacewong@WDS  13:26

看起来是yarn底层有问题   There appears to be a problem with the underlying YARN




Biandou 扁豆  13:26

这种日志看不出来日志 This kind of log does not show the log




Biandou 扁豆  13:26

他并不是代码造成的 The code didn't make him




Biandou 扁豆  13:27

因为hive 客户端或者hive be客户端执行 hsql sql 是没有问题的 

The Hive client or Hive BE client runs HSQL SQL normally


Biandou 扁豆  13:27

但是提高引擎提交至yarn上  执行有时会报错 但是也没有详细报错 However, when the improvement engine submits to YARN for execution, sometimes an error is reported but no detailed error is reported




peacewong@WDS  13:29

可以开debug看看 could you debug？ 




Biandou 扁豆  13:34

引擎开启debug么  Enable debug of the engine？