You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@avro.apache.org by "Mark S (JIRA)" <ji...@apache.org> on 2015/10/06 20:31:26 UTC
[jira] [Updated] (AVRO-1744) New AvroValueInputFormat class to
process Avro messages without a key.
[ https://issues.apache.org/jira/browse/AVRO-1744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mark S updated AVRO-1744:
-------------------------
Status: Patch Available (was: Open)
> New AvroValueInputFormat class to process Avro messages without a key.
> ----------------------------------------------------------------------
>
> Key: AVRO-1744
> URL: https://issues.apache.org/jira/browse/AVRO-1744
> Project: Avro
> Issue Type: New Feature
> Components: java
> Affects Versions: 1.7.7
> Reporter: Mark S
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> My Avro messages do not contain a Key value and as such, there are no Avro supporting classes to deal with this.
> As I was unable to use the following classes,
> * org.apache.avro.mapreduce.AvroKeyInputFormat
> * org.apache.avro.mapreduce.AvroKeyValueInputFormat
> I created the following supporting classes:
> * [AvroValueInputFormat|https://github.com/mark1900/druid-sandbox/blob/master/spark-hdfs-avro-test/src/main/java/test/avro/AvroValueInputFormat.java]
> * [AvroValueRecordReader|https://github.com/mark1900/druid-sandbox/blob/master/spark-hdfs-avro-test/src/main/java/test/avro/AvroValueRecordReader.java]
> * [AvroValueOutputFormat|https://github.com/mark1900/druid-sandbox/blob/master/spark-hdfs-avro-test/src/main/java/test/avro/AvroValueOutputFormat.java]
> * [AvroValueRecordWriter|https://github.com/mark1900/druid-sandbox/blob/master/spark-hdfs-avro-test/src/main/java/test/avro/AvroValueRecordWriter.java]
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)