[jira] [Work logged] (AVRO-3266) Output stream incompatible with MagicS3GuardCommitter

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/AVRO-3266?focusedWorklogId=769503&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-769503 ]

ASF GitHub Bot logged work on AVRO-3266:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 12/May/22 09:33
            Start Date: 12/May/22 09:33
    Worklog Time Spent: 10m 
      Work Description: RyanSkraba commented on PR #1618:
URL: https://github.com/apache/avro/pull/1618#issuecomment-1124752427

   Hello!  My apologies, I'm getting back to Avro after a pretty constrained month.
   
   This looks important for 1.11.1, which should be coming out within the month!  I've set the fix version in the JIRA, so you can be sure that this PR will get some attention.




Issue Time Tracking
-------------------

    Worklog Id:     (was: 769503)
    Time Spent: 2.5h  (was: 2h 20m)

> Output stream incompatible with MagicS3GuardCommitter
> -----------------------------------------------------
>
>                 Key: AVRO-3266
>                 URL: https://issues.apache.org/jira/browse/AVRO-3266
>             Project: Apache Avro
>          Issue Type: Bug
>          Components: java
>            Reporter: Michiel de Jong
>            Assignee: Emil Ejbyfeldt
>            Priority: Minor
>              Labels: pull-request-available
>             Fix For: 1.11.1
>
>          Time Spent: 2.5h
>  Remaining Estimate: 0h
>
> Avro's output stream can not be used in combination with the MagicS3GuardCommitter
> {code:java}
> Error: java.lang.ClassCastException: class org.apache.hadoop.fs.s3a.commit.magic.MagicS3GuardCommitter cannot be cast to class org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter{code}
> The reason for this problem is that AvroOutputFormatBase.getAvroFileOutputStream tries to cast the outputcommiter to a FileOutputCommitter.
> It can be solved by casting to a PathOutputCommitter instead (which is a superclass of both the FileOutputCommitter and the MagicS3GuardCommitter)



--
This message was sent by Atlassian Jira
(v8.20.7#820007)