[jira] [Created] (PARQUET-132) AvroParquetInputFormat should use a parameterized type

["Ryan Blue (JIRA)" <ji...@apache.org>]

Ryan Blue created PARQUET-132:
---------------------------------

             Summary: AvroParquetInputFormat should use a parameterized type
                 Key: PARQUET-132
                 URL: https://issues.apache.org/jira/browse/PARQUET-132
             Project: Parquet
          Issue Type: Bug
            Reporter: Ryan Blue


The {{AvroParquetInputFormat}} currently extends {{ParquetInputFormat<IndexedRecord>}}, which works for regular MR cases. But Spark's {{hadoopRDD}} and {{newAPIHadoopRDD}} methods (correctly) create a RDD with the types from the InputFormat. This means that the RDD always uses {{IndexedRecord}} rather than the correct type.

The {{AvroParquetInputFormat}} should be {{AvroParquetInputFormat<T extends IndexedRecord> extends ParquetInputFormat<T>}}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)