You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2019/10/31 06:14:30 UTC
[GitHub] [spark] dongjoon-hyun edited a comment on issue #25955:
[SPARK-29277][SQL] Add early DSv2 filter and projection pushdown
dongjoon-hyun edited a comment on issue #25955: [SPARK-29277][SQL] Add early DSv2 filter and projection pushdown
URL: https://github.com/apache/spark/pull/25955#issuecomment-548230386
Hi, Guys.
Sorry, but this breaks our `SBT with Hadoop 3.2` profile.
- https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-3.2/681/
- https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Test%20(Dashboard)/job/spark-master-test-sbt-hadoop-3.2/682/ (This is running, but it fails again)
I checked that the failure happens consistently on `master` branch.
```
$ build/sbt "sql/testOnly *.OrcFilterSuite" -Phadoop-3.2
...
[info] - filter pushdown - integer *** FAILED *** (2 seconds, 173 milliseconds)
[info] org.apache.spark.sql.AnalysisException: Can not match OrcTable in the query.;
...
[info] *** 10 TESTS FAILED ***
[error] Failed: Total 14, Failed 10, Errors 0, Passed 4
[error] Failed tests:
[error] org.apache.spark.sql.execution.datasources.orc.OrcFilterSuite
[error] (sql/test:testOnly) sbt.TestsFailedException: Tests unsuccessful
[error] Total time: 57 s, completed Oct 30, 2019 11:05:15 PM
```
Without this patch, it's recovered. Although this is not a part of `3.0.0-preview` RC2, I'll revert this urgently in order to recover our all Jenkins environment during votes. Also, we may have RC3.
cc @jiangxb1987 since he is a release manager for 3.0.0-preview.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org