[jira] [Assigned] (ARROW-5845) [Java] Implement converter between Arrow record batches and Avro records

["Todd Farmer (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Farmer reassigned ARROW-5845:
----------------------------------

    Assignee:     (was: Ji Liu)

This issue was last updated over 90 days ago, which may be an indication it is no longer being actively worked. To better reflect the current state, the issue is being unassigned. Please feel free to re-take assignment of the issue if it is being actively worked, or if you plan to start that work soon.

> [Java] Implement converter between Arrow record batches and Avro records
> ------------------------------------------------------------------------
>
>                 Key: ARROW-5845
>                 URL: https://issues.apache.org/jira/browse/ARROW-5845
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: Java
>            Reporter: Ji Liu
>            Priority: Major
>
> It would be useful for applications which need convert Avro data to Arrow data.
> This is an adapter which convert data with existing API (like JDBC adapter) rather than a native reader (like orc).
> We implement this function through Avro java project, receiving param like Decoder/Schema/DatumReader of Avro and return VectorSchemaRoot. For each data type we have a consumer class as below to get Avro data and write it into vector to avoid boxing/unboxing (e.g. GenericRecord#get returns Object)
> {code:java}
> public class AvroIntConsumer implements Consumer {
> private final IntWriter writer;
> public AvroIntConsumer(IntVector vector)
> { this.writer = new IntWriterImpl(vector); }
> @Override
> public void consume(Decoder decoder) throws IOException
> { writer.writeInt(decoder.readInt()); writer.setPosition(writer.getPosition() + 1); }
> {code}
> We intended to support primitive and complex types (null value represented via unions type with null type), size limit and field selection could be optional for users. 



--
This message was sent by Atlassian Jira
(v8.20.10#820010)