You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Sameer Agarwal (JIRA)" <ji...@apache.org> on 2016/03/18 19:19:33 UTC

[jira] [Created] (SPARK-14008) Cleanup/Extend the Vectorized Parquet Reader

Sameer Agarwal created SPARK-14008:
--------------------------------------

             Summary: Cleanup/Extend the Vectorized Parquet Reader
                 Key: SPARK-14008
                 URL: https://issues.apache.org/jira/browse/SPARK-14008
             Project: Spark
          Issue Type: Improvement
          Components: SQL
            Reporter: Sameer Agarwal


Per [~nongli]'s suggestions:

We should do these things:
1. Remove the non-vectorized parquet reader code.
2. Support the remaining types (just big decimals?)
3. Move the logic to determine if our parquet reader can be used to planning. Only complex types should fall back to the parquet-mr reader.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org