You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@linkis.apache.org by GitBox <gi...@apache.org> on 2022/08/18 07:52:32 UTC

[GitHub] [incubator-linkis] Andywli opened a new issue, #2879: [Question] spark-sql failed to execute, prompting exception to get main Yarn resourcemanager

Andywli opened a new issue, #2879:
URL: https://github.com/apache/incubator-linkis/issues/2879

   ### Before asking
   
   - [X] I have read the [How to ask for help](https://linkis.apache.org/community/how-to-ask-for-help) (我已阅读[如何寻求帮助](https://linkis.apache.org/zh-CN/community/how-to-ask-for-help)指引文档).
   
   
   ### Your environment
   
   <!-- Please describe the linkis version you are using and basic environment information -->
   <!-- 请描述您使用的linkis版本和基本环境信息 -->
   - Linkis version used: 1.1.2
   - Environment name and version:
       - cdh-5.14.2
       - hdp-3.1.5
       - hive-2.1.1
       - spark-3.2.1
       - scala-2.12.2
       - jdk 1.8.0_121
       - ....
   
   
   ### Describe your questions
   
   spark-sql failed to execute, prompting exception to get main Yarn resourcemanager
   
   At present, yarn is deployed with high availability, which are xx.xx.xx.12:5004 (active) and xx.xx.xx.11:5004 (standby). When configuring, the active machine is configured, and the execution of spark appears as follows abnormal
   
   spark-sql执行失败，提示获取主Yarn resourcemanager异常
   
   目前yarn部署了高可用，分别为xx.xx.xx.12:5004（active）以及 xx.xx.xx.11:5004(standby) 在配置时候，配置的是active这台机器，执行spark出现如下异常
   ![image](https://user-images.githubusercontent.com/55732213/185340531-0e368bd2-bb21-47e8-8583-e7c84743af27.png)
   
   ERROR Log：
   ERROR Job with execId-IDE_hadoop_spark_2 + subJobId : 5  execut, Task is Failed,errorMsg: errCode: 12003 ,desc: VM-11-3-centos:9101_4 Failed  to async get EngineNode MatchError: LinkisException{errCode=11006, desc='Failed to request external resourceRMErrorException: errCode: 11007 ,desc: Get active Yarn resourcemanager from : xx.xx.xx.12:5004 exception.(从 xx.xx.xx.12:5004 获取主Yarn resourcemanager异常) ,ip: VM-11-3-centos ,port: 9101 ,serviceKind: linkis-cg-linkismanager', ip='VM-11-3-centos', port=9101, serviceKind='linkis-cg-linkismanager'} (of class org.apache.linkis.manager.common.exception.RMErrorException) ,ip: VM-11-3-centos ,port: 9104 ,serviceKind: linkis-cg-entrance 
   
   
   
   ### Eureka service list
   
   <!-- You can directly copy and paste the screenshot of the list of registered service instances displayed on the Eureka page here -->
   <!--  可以将Eureka页面显示的注册服务实例列表的的截图 直接复制并粘贴到这里。 粘贴后，会自动生成如下格式的url-->
   
   eg:![image](https://user-images.githubusercontent.com/7869972/183326205-381b4e30-c727-44ba-8197-9998da78b1e3.png)
   
   
   ### Some logs info or acctch file
   
   <!-- Please add the log in the following format, the key error log must be pasted in the code style, and the text as much as possible, the detailed log or other files can be dragged and uploaded as an attachment -->
   <!-- 请按如下格式 添加日志，关键错误日志请贴到[````log][````]之间，尽可能贴文字，详细日志或则其它文件，可以拖拽上传作为附件 -->
   
   linkis-xxx.log:
   ````log
   
   <!--日志文字贴到这里-->
   
   ````
   log file:
    <!-- 拖拽上传后，会自动生成如下示例格式的附件url -->
   [linkis-xxx.log](https://github.com/apache/incubator-linkis/files/9219529/yarn-error.log)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org

[GitHub] [incubator-linkis] Andywli commented on issue #2879: [Question] spark-sql failed to execute, prompting exception to get main Yarn resourcemanager

Posted by GitBox <gi...@apache.org>.
Andywli commented on issue #2879:
URL: https://github.com/apache/incubator-linkis/issues/2879#issuecomment-1219153200

   Please try to modify the yarn address in linkis_cg_rm_external_resource_provider.config in the database to the correct address and restart ECP ECM
   
   请尝试修改数据库中 linkis_cg_rm_external_resource_provider.config里面的yarn地址为正确地址，重启ECP ECM


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org

[GitHub] [incubator-linkis] Andywli closed issue #2879: [Question] spark-sql failed to execute, prompting exception to get main Yarn resourcemanager

Posted by GitBox <gi...@apache.org>.
Andywli closed issue #2879: [Question] spark-sql failed to execute, prompting exception to get main Yarn resourcemanager
URL: https://github.com/apache/incubator-linkis/issues/2879


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org

[GitHub] [incubator-linkis] github-actions[bot] commented on issue #2879: [Question] spark-sql failed to execute, prompting exception to get main Yarn resourcemanager

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #2879:
URL: https://github.com/apache/incubator-linkis/issues/2879#issuecomment-1219153428

   :blush:  Welcome to the Apache Linkis (incubating) community!!
   We are glad that you are contributing by opening this issue.
   
   Please make sure to include all the relevant context.
   We will be here shortly.
   
   If you are interested in contributing to our website project, please let us know!
   You can check out our contributing guide on 
    :point_right:  [How to Participate in Project Contribution](https://linkis.apache.org/community/how-to-contribute).
    
   WeChat  Group:
   
   ![image](https://linkis.apache.org/Images/wedatasphere_contact_01.png)
   Mailing Lists:
   |name|description|Subscribe|Unsubscribe|archive|
   |:-----|:--------|:------|:-------|:-----|
   | [dev@linkis.apache.org](mailto:dev@linkis.apache.org) | community activity information | [subscribe](mailto:dev-subscribe@linkis.apache.org) | [unsubscribe](mailto:dev-unsubscribe@linkis.apache.org) | [archive](http://mail-archives.apache.org/mod_mbox/linkis-dev) |


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org