[GitHub] [hudi] jkdll removed a comment on issue #3113: [SUPPORT] Deltastreamer Error when reading AVRO Schema with UNION Types

[GitBox <gi...@apache.org>]

jkdll removed a comment on issue #3113:
URL: https://github.com/apache/hudi/issues/3113#issuecomment-864336980


   I have also tested with the latest version on the `master` branch. Same error.
   
   Moreover, without `--transformer-class org.apache.hudi.utilities.transform.FlatteningTransformer` I get this error within the application logs: 
   ```
   21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=39662 partitionPath=1616684167}, currentLocation='null', newLocation='null'}
   java.lang.ArrayIndexOutOfBoundsException
   21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=39576 partitionPath=1616419975}, currentLocation='null', newLocation='null'}
   java.lang.ArrayIndexOutOfBoundsException
   21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=39575 partitionPath=1616419975}, currentLocation='null', newLocation='null'}
   java.lang.ArrayIndexOutOfBoundsException
   21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=39589 partitionPath=1616426425}, currentLocation='null', newLocation='null'}
   java.lang.ArrayIndexOutOfBoundsException
   21/06/19 01:10:36 ERROR HoodieWriteHandle: Error writing record HoodieRecord{key=HoodieKey { recordKey=37234 partitionPath=1616426425}, currentLocation='null', newLocation='null'}
   ```
   I believe is triggered due to UNION structs. I believe the flatten transformer "fixes" this by flattening the struct, however it is only a workaround. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org