[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #5672: [Question] Shell failed to call hive to execute DDL

[GitBox <gi...@apache.org>]

github-actions[bot] commented on issue #5672:
URL: https://github.com/apache/dolphinscheduler/issues/5672#issuecomment-865477444


   **Which version of DolphinScheduler:**
    -[1.3.6]
   
   **Additional context**
   org.apache.hadoop.hive.ql.exec.DDLTask. No such file or directory
   
   **Requirement or improvement**
   - when i use shell merge the hive orc partitions, FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. No such file or directory
   
   ```
   2021-06-22 01:00:00.858 INFO  - [taskAppId=TASK-10-168-172]:[160] - raw script : #!/bin/bash
   source  /etc/profile
   date=`date -d "-2 days" +%Y%m%d`
   hive -e "
     ALTER TABLE monitor_data_1 PARTITION(level='0',day='${date}') CONCATENATE;
     ALTER TABLE monitor_data_1 PARTITION(level='1',day='${date}') CONCATENATE;
     
   "
   2021-06-22 01:00:00.858 INFO  - [taskAppId=TASK-10-168-172]:[161] - task execute path : /var/lib/dolphinscheduler/exec/process/1/10/168/172
   2021-06-22 01:00:00.858 INFO  - [taskAppId=TASK-10-168-172]:[87] - tenantCode user:bde, task dir:10_168_172
   2021-06-22 01:00:00.859 INFO  - [taskAppId=TASK-10-168-172]:[92] - create command file:/var/lib/dolphinscheduler/exec/process/1/10/168/172/10_168_172.command
   2021-06-22 01:00:00.859 INFO  - [taskAppId=TASK-10-168-172]:[111] - command : #!/bin/sh
   BASEDIR=$(cd `dirname $0`; pwd)
   cd $BASEDIR
   source /usr/local/apache-dolphinscheduler-1.3.6-bin/conf/env/dolphinscheduler_env.sh
   /var/lib/dolphinscheduler/exec/process/1/10/168/172/10_168_172_node.sh
   2021-06-22 01:00:00.861 INFO  - [taskAppId=TASK-10-168-172]:[327] - task run command:
   sudo -u bde sh /var/lib/dolphinscheduler/exec/process/1/10/168/172/10_168_172.command
   2021-06-22 01:00:00.861 INFO  - [taskAppId=TASK-10-168-172]:[208] - process start, process id is: 6988
   2021-06-22 01:00:10.935 INFO  - [taskAppId=TASK-10-168-172]:[129] -  -> 
   	Logging initialized using configuration in file:/usr/local/apache-hive-2.3.7-bin/conf/hive-log4j2.properties Async: true
   2021-06-22 01:00:18.981 INFO  - [taskAppId=TASK-10-168-172]:[129] -  -> Job Submission failed with exception 'org.apache.hadoop.io.nativeio.NativeIOException(No such file or directory)'
   	FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. No such file or directory
   2021-06-22 01:00:19.187 INFO  - [taskAppId=TASK-10-168-172]:[217] - process has exited, execute path:/var/lib/dolphinscheduler/exec/process/1/10/168/172, processId:6988 ,exitStatusCode:0
   
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org