You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Mark S (JIRA)" <ji...@apache.org> on 2015/10/06 20:31:26 UTC

[jira] [Updated] (AVRO-1744) New AvroValueInputFormat class to process Avro messages without a key.

     [ https://issues.apache.org/jira/browse/AVRO-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Mark S updated AVRO-1744:
-------------------------
    Status: Patch Available  (was: Open)

> New AvroValueInputFormat class to process Avro messages without a key.
> ----------------------------------------------------------------------
>
>                 Key: AVRO-1744
>                 URL: https://issues.apache.org/jira/browse/AVRO-1744
>             Project: Avro
>          Issue Type: New Feature
>          Components: java
>    Affects Versions: 1.7.7
>            Reporter: Mark S
>   Original Estimate: 1h
>  Remaining Estimate: 1h
>
> My Avro messages do not contain a Key value and as such, there are no Avro supporting classes to deal with this.
> As I was unable to use the following classes,
> * org.apache.avro.mapreduce.AvroKeyInputFormat
> * org.apache.avro.mapreduce.AvroKeyValueInputFormat
> I created the following supporting classes:
> * [AvroValueInputFormat|https://github.com/mark1900/druid-sandbox/blob/master/spark-hdfs-avro-test/src/main/java/test/avro/AvroValueInputFormat.java]
> * [AvroValueRecordReader|https://github.com/mark1900/druid-sandbox/blob/master/spark-hdfs-avro-test/src/main/java/test/avro/AvroValueRecordReader.java]
> * [AvroValueOutputFormat|https://github.com/mark1900/druid-sandbox/blob/master/spark-hdfs-avro-test/src/main/java/test/avro/AvroValueOutputFormat.java]
> * [AvroValueRecordWriter|https://github.com/mark1900/druid-sandbox/blob/master/spark-hdfs-avro-test/src/main/java/test/avro/AvroValueRecordWriter.java]



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)