You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Cheng Lian (JIRA)" <ji...@apache.org> on 2015/08/21 15:49:46 UTC
[jira] [Created] (PARQUET-364) Parque-avro cannot decode Avro array
of primitive array (e.g. array>)
Cheng Lian created PARQUET-364:
----------------------------------
Summary: Parque-avro cannot decode Avro array of primitive array (e.g. array<array<int>>)
Key: PARQUET-364
URL: https://issues.apache.org/jira/browse/PARQUET-364
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Affects Versions: 1.8.0, 1.7.0, 1.6.0, 1.5.0
Reporter: Cheng Lian
The following Avro schema
{noformat}
record AvroNonNullableArrays {
array<array<int>> int_arrays_column;
}
{noformat}
is translated into the following Parquet schema by parquet-avro 1.7.0:
{noformat}
message root {
required group int_arrays_column (LIST) {
repeated group array (LIST) {
repeated int32 array;
}
}
}
{noformat}
{{AvroIndexedRecordConverter}} cannot decode such records correctly. The reason is that the 2nd level repeated group {{array}} doesn't pass {{AvroIndexedRecordConverter.isElementType()}} check. We probably should check for field name "array" in {{isElementType()}} to fix this issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)