You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "vinoyang (Jira)" <ji...@apache.org> on 2021/01/06 11:51:00 UTC

[jira] [Closed] (HUDI-1506) Fix wrong exception thrown in HoodieAvroUtils

     [ https://issues.apache.org/jira/browse/HUDI-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

vinoyang closed HUDI-1506.
--------------------------
    Resolution: Fixed

Fixed via master branch: 47c5e518a756df815287502a50da9d73d28fc662

> Fix wrong exception thrown in HoodieAvroUtils
> ---------------------------------------------
>
>                 Key: HUDI-1506
>                 URL: https://issues.apache.org/jira/browse/HUDI-1506
>             Project: Apache Hudi
>          Issue Type: Bug
>            Reporter: wangxianghu
>            Assignee: wangxianghu
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 0.7.0
>
>
> {code:java}
> //
> Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 4 in stage 4.0 failed 4 times, most recent failure: Lost task 4.3 in stage 4.0 (TID 24, al-prd-dtp-data-lake-10-0-88-26, executor 4): org.apache.hudi.exception.HoodieException: etlDatetime(Part -etlDatetime) field not found in record. Acceptable fields were :[vin, uuid, commercialType, businessType, vehicleNo, plateColor, vehicleColor, engineId, nextFixDate, feePrintId, transArea, createTime, updateTime, registerDate, curVehicleNo, reportVehicleNo, model, checkDate, certifyDateA, certifyDateB, certificate, transAgency, transAgencyNet, transDateStart, transDateStop, insurCom, insurNum, insurType, insurCount, insurEff, insurExp, insurCreateTime, insurUpdateTime, curVehicleCertno, reportVehicleCertno, seats, brand, vehicleType, fuelType, engineDisplace, photo, enginePower, gpsBrand, gpsModel, gpsImei, gpsInstallDate, curDriverUuid, reportDrivers, curTimeOn, curTimeOff, timeFrom, timeTo, ownerName, fixState, checkState, photoId, photoIdUrl, fareType, wheelBase, vehicleTec, vehicleSafe, lesseeName, lesseeCode, sdcOperationType, hivePartition, etlDatetime]
> {code}
> we can see the `etlDatetime` do exist. it is caused by null value acturally



--
This message was sent by Atlassian Jira
(v8.3.4#803005)