[GitHub] spark pull request #18991: [SPARK-21783][SQL][WIP] Turn on ORC filter push-d...

[dongjoon-hyun <gi...@git.apache.org>]

GitHub user dongjoon-hyun reopened a pull request:

    https://github.com/apache/spark/pull/18991

    [SPARK-21783][SQL][WIP] Turn on ORC filter push-down by default

    ## What changes were proposed in this pull request?
    
    ORC filter push-down is disabled by default from the beginning, [SPARK-2883](https://github.com/apache/spark/commit/aa31e431fc09f0477f1c2351c6275769a31aca90#diff-41ef65b9ef5b518f77e2a03559893f4dR149
    )
    
    Now, Apache Spark starts to depend on Apache ORC 1.4.0. For Apache Spark 2.3, this PR turns on ORC filter push-down by default like Parquet ([SPARK-9207](https://issues.apache.org/jira/browse/SPARK-21783)) as a part of [SPARK-20901](https://issues.apache.org/jira/browse/SPARK-20901), "Feature parity for ORC with Parquet".
    
    
    ## How was this patch tested?
    
    Pass the Jenkins with the existing tests.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/dongjoon-hyun/spark SPARK-21783

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/spark/pull/18991.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #18991
    
----
commit 2bc2b17aba5231c6ac3e0ab7c830acc56790df9f
Author: Dongjoon Hyun <do...@...>
Date:   2017-08-18T07:26:18Z

    [SPARK-21783][SQL] Turn on ORC filter push-down by default

----


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org