You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/05/10 13:11:01 UTC
[GitHub] [hudi] nleena123 opened a new issue, #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
nleena123 opened a new issue, #5551:
URL: https://github.com/apache/hudi/issues/5551
Hi Team,
Getting the below error in hudi job.
HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file
at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
**To Reproduce**
we are running the hudi job through Azure databricks .
below dependancies we added in our code.
org.apache.spark:spark-avro_2.12:3.1.1
org.apache.hudi:hudi-spark3-bundle_2.12:0.8.0
org.apache.hudi:hudi-utilities-bundle_2.12:0.8.0
**Environment Description**
* Hudi version :0.8.0
* Spark version :3.2.1
* Storage (HDFS/S3/GCS..) : AZURE blob storage.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1131944757
You can suggest some other app as per your convenience, else google meet also works.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma closed issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
pratyakshsharma closed issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
URL: https://github.com/apache/hudi/issues/5551
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nleena123 commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
nleena123 commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1123347014
@nsivabalan
i didn't understand much by those links , can you please let me know briefly .
Do i need to do the code changes in hudi classes to fix the issue , if yes in which class i need to do the changes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1126598998
those are the fixes for the issue you are facing. you may need to apply those patches to your hudi if you cannot upgrade to 0.11 for now.
@pratyakshsharma : can you help here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1166456667
No followups with me. @nsivabalan can you confirm as well?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nleena123 commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
nleena123 commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1131688701
@nsivabalan
slack is not allowed in my organisation , can we connect by any other app ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1123170710
you may have to apply 2 patches on this regard
https://github.com/apache/hudi/pull/4016
https://github.com/apache/hudi/pull/5261
let us know how it goes.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1128514496
Ack. @nleena123 Were you able to apply the patches? If not, we can probably connect on slack and I can help you there.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] codope commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
codope commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1160585195
@nsivabalan @pratyakshsharma is there any followup on this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] pratyakshsharma commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
pratyakshsharma commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1247833911
Closing this due to inactivity. Feel free to reopen if you are still facing issues @nleena123
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #5551: HoodieCommitException: Failed to archive commits Caused by: IOException: Not an Avro data file at org.apache.hudi.table.HoodieTimelineArchiveLog.archive(HoodieTimelineArchiveLog.java:324)
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5551:
URL: https://github.com/apache/hudi/issues/5551#issuecomment-1229360403
@nleena123 : any updates here please. I don't think I had any conversations in slack either.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org