[jira] Commented: (AVRO-105) Avro data file should be able to write binary data using blocking for arrays/maps

["Ravi Gummadi (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/AVRO-105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12753442#action_12753442 ] 

Ravi Gummadi commented on AVRO-105:
-----------------------------------

There are 2 problems if we want to support Json format data file writer/reader: (1) Json encoder/decoder are doing validation of schema, we need different encoders for writing (a) sync (b) footer of data file (c) actual object schema. Similarly different Json decoders for the above 3 schemas.

(2) JsonParser seem to be reading the file's content extra into some buffer and we need to seek back to the position till which we actually read.

So for the time being, we could support only binary format for avro data file and  DataFileWriter's constructor can take BinaryEncoder as a param. So user can send BinaryEncoder or BlockingBinaryEncoder to DataFIleWriter.

> Avro data file should be able to write binary data using blocking for arrays/maps
> ---------------------------------------------------------------------------------
>
>                 Key: AVRO-105
>                 URL: https://issues.apache.org/jira/browse/AVRO-105
>             Project: Avro
>          Issue Type: New Feature
>          Components: java
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>         Attachments: AVRO-105.patch, temp.patch
>
>
> Currently DataFileWriter uses BinaryEncoder only. It would be better if DataFileWriter can use BlockingBinaryEncoder if user wants to use.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.