You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2020/11/06 12:20:51 UTC

[GitHub] [hudi] BalaMahesh commented on issue #2230: [SUPPORT] HoodieLogFileReader failing to read log files from s3a [Throwing corrupt block]

BalaMahesh commented on issue #2230:
URL: https://github.com/apache/hudi/issues/2230#issuecomment-723052237


   Update : 1
   
   I am able to by pass this issue by upgrading hadoop-aws-x.x.x.jar to 2.8.0 along with other dependencies in spark stand alone mode's jars. The logic of seek(pos) in the version 2.8.o is different from the 2.7.3.  But my next doubt is , while querying the _rt table also HoodieLogReader comes into the picture if I am not wrong . If the cluster is running on hadoop < 2.8.0 then this will become the problem to query _rt tables unless the entire cluster is upgraded. Correct me if I am wrong.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org