You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2020/05/07 16:39:50 UTC

[GitHub] [incubator-dolphinscheduler] itbasketplayer opened a new issue #2625: add a checking about yarn appIds'state using historyserver,when 'yarn.resourcemanager.max-completed-applications' too small

itbasketplayer opened a new issue #2625:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2625


   **Is your feature request related to a problem? Please describe.**
   SHELL,SPARK,MR,HIVE tasks happend because they creates yarn applications!
   when 'yarn.resourcemanager.max-completed-applications' is too small,for example 1000.
   DS can't get the yarn appIds's  state successfully
   
   **Describe the solution you'd like**
   add a checking about yarn appIds'state using historyserver,when 'yarn.resourcemanager.max-completed-applications' too small
   
   **Describe alternatives you've considered**
   HadoopUtils#getApplicationStatus add a query using historyserver restapi when the code not 200 using resourcemanager restapi
   
   **Additional context**
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] chengshiwen closed issue #2625: add a checking about yarn appIds'state using historyserver,when 'yarn.resourcemanager.max-completed-applications' too small

Posted by GitBox <gi...@apache.org>.
chengshiwen closed issue #2625:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2625


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] chengshiwen commented on issue #2625: add a checking about yarn appIds'state using historyserver,when 'yarn.resourcemanager.max-completed-applications' too small

Posted by GitBox <gi...@apache.org>.
chengshiwen commented on issue #2625:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2625#issuecomment-817118901


   Close by #2848


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] itbasketplayer commented on issue #2625: add a checking about yarn appIds'state using historyserver,when 'yarn.resourcemanager.max-completed-applications' too small

Posted by GitBox <gi...@apache.org>.
itbasketplayer commented on issue #2625:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2625#issuecomment-636295368


   yeah,I will submit a PR


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [incubator-dolphinscheduler] dailidong commented on issue #2625: add a checking about yarn appIds'state using historyserver,when 'yarn.resourcemanager.max-completed-applications' too small

Posted by GitBox <gi...@apache.org>.
dailidong commented on issue #2625:
URL: https://github.com/apache/incubator-dolphinscheduler/issues/2625#issuecomment-625649668


   good idea, could you submit a PR to solve this problem?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org