You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Paul Rogers (JIRA)" <ji...@apache.org> on 2017/03/14 23:34:41 UTC
[jira] [Created] (DRILL-5356) Refactor Parquet Record Reader
Paul Rogers created DRILL-5356:
----------------------------------
Summary: Refactor Parquet Record Reader
Key: DRILL-5356
URL: https://issues.apache.org/jira/browse/DRILL-5356
Project: Apache Drill
Issue Type: Improvement
Affects Versions: 1.10.0, 1.11.0
Reporter: Paul Rogers
Assignee: Paul Rogers
Priority: Minor
Fix For: 1.11.0
The Parquet record reader class is a key part of Drill that has evolved over time to become somewhat hard to follow.
A number of us are working on Parquet-related tasks and find we have to spend an uncomfortable amount of time trying to understand the code. In particular, this writer needs to figure out how to convince the reader to provide higher-density record batches.
Rather than continue to decypher the complex code multiple times, this ticket requests to refactor the code to make it functionally identical, but structurally cleaner. The result will be faster time to value when working with this code.
This is a lower-priority change and will be coordinated with others working on this code base.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)