You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "yiming.xu (JIRA)" <ji...@apache.org> on 2018/11/09 03:13:00 UTC
[jira] [Created] (PARQUET-1456) Use page index, ParquetFileReader
throw ArrayIndexOutOfBoundsException
yiming.xu created PARQUET-1456:
----------------------------------
Summary: Use page index, ParquetFileReader throw ArrayIndexOutOfBoundsException
Key: PARQUET-1456
URL: https://issues.apache.org/jira/browse/PARQUET-1456
Project: Parquet
Issue Type: Bug
Components: parquet-mr
Reporter: yiming.xu
hi, We use page index to adaptive spark with master branch find a concurrent proble, class org.apache.parquet.internal.column.columnindex.ColumnIndexBuilder#build cached ColumnIndexBuilder but not lock it,
PrimitiveTypeName typeName = type.getPrimitiveTypeName();
ColumnIndexBuilder builder = BUILDERS.get(typeName);
if (builder == null) {
builder = createNewBuilder(type, Integer.MAX_VALUE);
BUILDERS.put(typeName, builder);
}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)