You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "CTTY (via GitHub)" <gi...@apache.org> on 2023/06/10 03:28:47 UTC

[GitHub] [hudi] CTTY commented on pull request #8190: [HUDI-5936] Fix serialization problem when FileStatus is not serializable

CTTY commented on PR #8190:
URL: https://github.com/apache/hudi/pull/8190#issuecomment-1585445444

   > @CTTY It looks like Hive query fails in the bundle validation due to: `org.apache.hive.service.cli.HiveSQLException: java.lang.NoClassDefFoundError: org/apache/hudi/org/apache/avro/AvroMissingFieldException`. Could you take a look? This is likely because `hudi-hadoop-mr-bundle` relies on Avro 1.8 which does not have the class, while other modules can be compiled with a higher Avro version. And this PR uses Avro to serialize the file status.
   
   Thanks for pointing this out. 
   
   I guess we still need a new `SerializableFileStatus` so we don't have to depend on Avro-generated `HoodieFileStatus` if `hudi-hadoop-mr-bundle` has to use `hive.avro.version` which is 1.8.2. I'll try to add it back later.
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org