You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Artavazd Balaian (JIRA)" <ji...@apache.org> on 2019/01/11 21:08:00 UTC
[jira] [Created] (PARQUET-1491) Conditional debug logging in
InternalParquetRecordReader to reduce GC
Artavazd Balaian created PARQUET-1491:
-----------------------------------------
Summary: Conditional debug logging in InternalParquetRecordReader to reduce GC
Key: PARQUET-1491
URL: https://issues.apache.org/jira/browse/PARQUET-1491
Project: Parquet
Issue Type: Improvement
Components: parquet-avro
Reporter: Artavazd Balaian
Attachments: image-2019-01-12-04-03-48-005.png
Currently there is no check for the log level in [https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/InternalParquetRecordReader.javaL249|https://github.com/apache/parquet-mr/blob/master/parquet-hadoop/src/main/java/org/apache/parquet/hadoop/InternalParquetRecordReader.java#L230;L249.] which causes a lot of memory allocation and performance degradation.
Screenshot of Java Mission Control comparison with fix and without (link to the JFR files https://drive.google.com/open?id=1blSeF-AyAhQyRYaqVsihyzy7pJCJt7U3):
!image-2019-01-12-04-03-48-005.png!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)