[jira] [Created] (TEZ-4414) Tez job failed with hudi table query

["Jeff Tang (Jira)" <ji...@apache.org>]

Jeff Tang created TEZ-4414:
------------------------------

             Summary: Tez job failed with hudi table query
                 Key: TEZ-4414
                 URL: https://issues.apache.org/jira/browse/TEZ-4414
             Project: Apache Tez
          Issue Type: Bug
    Affects Versions: 0.9.2
         Environment: hive: 3.1.2
Tez.0.9.2
hudi :0.10.0
            Reporter: Jeff Tang
         Attachments: image-2022-05-21-12-20-38-686.png, image-2022-05-21-12-21-18-105.png, image-2022-05-21-12-24-39-135.png

hive on Tez  query failed when do aggregation operation on hudi table:
e.g:  select count(1) from ods.xxx_saas_audit_aud_cost_check_detail  

Error: Error while processing statement: FAILED: Execution Error, return code 2 from org.apache.hadoop.hive.ql.exec.tez.TezTask. Vertex failed
attempt_1651137377155_0198_1_00_000004_0 being failed for too many output errors. failureFraction=1.0, MAX_ALLOWED_OUTPUT_FAILURES_FRACTION=0.1, uniquefailedOutputReports=1, MAX_ALLOWED_OUTPUT_FAILURES=10, MAX_ALLOWED_TIME_FOR_TASK_READ_ERROR_SEC=300, readErrorTimespan=0


the hive debug logs shows up interupteException in Tez runtime:
ERROR] [TezChild] |tez.ReduceRecordSource|: org.apache.tez.runtime.library.api.IOInterruptedException: java.lang.InterruptedException
        at org.apache.tez.runtime.library.common.readers.UnorderedKVReader.moveToNextInput(UnorderedKVReader.java:206)


with simple select column it works fine:  
e.g:
select check_value from ods.hope_saas_audit_aud_cost_check_detail limit 5;



--
This message was sent by Atlassian Jira
(v8.20.7#820007)