[jira] [Commented] (SPARK-2551) Cleanup FilteringParquetRowInputFormat

["Thomas Omans (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-2551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14569912#comment-14569912 ] 

Thomas Omans commented on SPARK-2551:
-------------------------------------

Wanted to chime in since I upgraded parquet re: SPARK-7743

After looking at the PARQUET-16 issue it looks like the pull request https://github.com/apache/parquet-mr/pull/17 made by [~liancheng] (the reporter of PARQUET-16) closed the PR as resolved by https://github.com/apache/parquet-mr/pull/45 (which is included in the 1.7.0 upgrade).

That means that these reflection hacks should be ready for removal, or that the PARQUET-16 ticket should be closed at the very least ;)

> Cleanup FilteringParquetRowInputFormat
> --------------------------------------
>
>                 Key: SPARK-2551
>                 URL: https://issues.apache.org/jira/browse/SPARK-2551
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL
>    Affects Versions: 1.0.1, 1.0.2
>            Reporter: Cheng Lian
>            Priority: Minor
>
> To workaround [PARQUET-16|https://issues.apache.org/jira/browse/PARQUET-16] and fix [SPARK-2119|https://issues.apache.org/jira/browse/SPARK-2119], we did some reflection hacks in {{FilteringParquetRowInputFormat}}. This should be cleaned up once PARQUET-16 is fixed.
> A PR for PARQUET-16 is [here|https://github.com/apache/incubator-parquet-mr/pull/17].



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org