You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@dolphinscheduler.apache.org by GitBox <gi...@apache.org> on 2021/05/27 07:22:27 UTC

[GitHub] [dolphinscheduler] SbloodyS opened a new issue #5551: [Bug][Module Name] job state always in final state:RUNNING_EXECUTION when execution engine is tez

SbloodyS opened a new issue #5551:
URL: https://github.com/apache/dolphinscheduler/issues/5551


   yarn application -status application_1621995850095_6901
   21/05/27 07:06:04 INFO client.RMProxy: Connecting to ResourceManager at ip-192-168-24-254.us-west-2.compute.internal/192.168.24.254:8032
   21/05/27 07:06:04 INFO client.AHSProxy: Connecting to Application History server at ip-192-168-24-254.us-west-2.compute.internal/192.168.24.254:10200
   21/05/27 07:06:04 INFO conf.Configuration: resource-types.xml not found
   21/05/27 07:06:04 INFO resource.ResourceUtils: Unable to find 'resource-types.xml'.
   21/05/27 07:06:04 INFO resource.ResourceUtils: Adding resource type - name = memory-mb, units = Mi, type = COUNTABLE
   21/05/27 07:06:04 INFO resource.ResourceUtils: Adding resource type - name = vcores, units = , type = COUNTABLE
   Application Report : 
           Application-Id : application_1621995850095_6901
           Application-Name : HIVE-f07905b9-25b6-4e3f-93a4-652ed349b9bd
           Application-Type : TEZ
           User : hadoop
           Queue : default
           Application Priority : 0
           Start-Time : 1622098349177
           Finish-Time : 1622098762224
           Progress : 100%
           State : FINISHED
           Final-State : ENDED
   
   job final state is not SUCCEEDED but ENDED.Cause shell command always running.
   
   worker.log
   [INFO] 2021-05-27 07:05:41.030  - [taskAppId=TASK-10-264-3804]:[127] - FINALIZE_SESSION
   [INFO] 2021-05-27 07:05:41.809  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:42.811  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:43.812  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:44.814  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:45.816  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:46.818  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:47.820  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:48.821  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:49.823  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:50.825  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   [INFO] 2021-05-27 07:05:51.826  - [taskAppId=TASK-16-259-3724]:[404] - appId:application_1621995850095_6901, final state:RUNNING_EXECUTION
   
   **Which version of Dolphin Scheduler:**
    -[1.3.6]
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] SbloodyS edited a comment on issue #5551: [Bug][Module Name] job state always in final state:RUNNING_EXECUTION when execution engine is tez

Posted by GitBox <gi...@apache.org>.
SbloodyS edited a comment on issue #5551:
URL: https://github.com/apache/dolphinscheduler/issues/5551#issuecomment-855210156


   It seems Constants.ENDED is not in org.apache.dolphinscheduler.common.utils.HadoopUtils#getApplicationStatus.resulting in continuous running state.
   
   `            case Constants.ACCEPTED:
                   return ExecutionStatus.SUBMITTED_SUCCESS;
               case Constants.SUCCEEDED:
                   return ExecutionStatus.SUCCESS;
               case Constants.NEW:
               case Constants.NEW_SAVING:
               case Constants.SUBMITTED:
               case Constants.FAILED:
                   return ExecutionStatus.FAILURE;
               case Constants.KILLED:
                   return ExecutionStatus.KILL;
               case Constants.RUNNING:
               default:
                   return ExecutionStatus.RUNNING_EXECUTION;`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] lenboo closed issue #5551: [Bug][Module Name] job state always in final state:RUNNING_EXECUTION when execution engine is tez

Posted by GitBox <gi...@apache.org>.
lenboo closed issue #5551:
URL: https://github.com/apache/dolphinscheduler/issues/5551


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5551: [Bug][Module Name] job state always in final state:RUNNING_EXECUTION when execution engine is tez

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5551:
URL: https://github.com/apache/dolphinscheduler/issues/5551#issuecomment-849400414


   Hi:
   * Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
   * In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
   * If you haven't received a reply for a long time, you can subscribe to the developer's email,Mail subscription steps reference https://dolphinscheduler.apache.org/zh-cn/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] SbloodyS commented on issue #5551: [Bug][Module Name] job state always in final state:RUNNING_EXECUTION when execution engine is tez

Posted by GitBox <gi...@apache.org>.
SbloodyS commented on issue #5551:
URL: https://github.com/apache/dolphinscheduler/issues/5551#issuecomment-855210156


   It seems Constants.ENDED is not in org.apache.dolphinscheduler.common.utils.HadoopUtils#getApplicationStatus.resulting in continuous running state.
   
   `            case Constants.ACCEPTED:
                   return ExecutionStatus.SUBMITTED_SUCCESS;
               case Constants.SUCCEEDED:
                   return ExecutionStatus.SUCCESS;
               case Constants.NEW:
               case Constants.NEW_SAVING:
               case Constants.SUBMITTED:
               case Constants.FAILED:
                   return ExecutionStatus.FAILURE;
               case Constants.KILLED:
                   return ExecutionStatus.KILL;
   
               case Constants.RUNNING:
               default:
                   return ExecutionStatus.RUNNING_EXECUTION;`


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [dolphinscheduler] SbloodyS edited a comment on issue #5551: [Bug][Module Name] job state always in final state:RUNNING_EXECUTION when execution engine is tez

Posted by GitBox <gi...@apache.org>.
SbloodyS edited a comment on issue #5551:
URL: https://github.com/apache/dolphinscheduler/issues/5551#issuecomment-855210156


   It seems Constants.ENDED is not in org.apache.dolphinscheduler.common.utils.HadoopUtils#getApplicationStatus.resulting in continuous running state.
   
   ```
           switch (result) {
               case Constants.ACCEPTED:
                   return ExecutionStatus.SUBMITTED_SUCCESS;
               case Constants.SUCCEEDED:
                   return ExecutionStatus.SUCCESS;
               case Constants.NEW:
               case Constants.NEW_SAVING:
               case Constants.SUBMITTED:
               case Constants.FAILED:
                   return ExecutionStatus.FAILURE;
               case Constants.KILLED:
                   return ExecutionStatus.KILL;
   
               case Constants.RUNNING:
               default:
                   return ExecutionStatus.RUNNING_EXECUTION;
           }
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org