You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by we...@apache.org on 2021/11/04 14:27:41 UTC
[spark] branch master updated (1325481 -> e91d461)
This is an automated email from the ASF dual-hosted git repository.
wenchen pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from 1325481 [SPARK-37206][BUILD] Upgrade Avro to 1.11.0
add e91d461 [SPARK-37038][SQL] DSV2 Sample Push Down
No new revisions were added by this update.
Summary of changes:
docs/sql-data-sources-jdbc.md | 11 ++-
.../sql/jdbc/v2/PostgresIntegrationSuite.scala | 5 +
.../org/apache/spark/sql/jdbc/v2/V2JDBCTest.scala | 110 +++++++++++++++++++++
.../spark/sql/connector/read/ScanBuilder.java | 2 +-
...Limit.java => SupportsPushDownTableSample.java} | 13 ++-
.../spark/sql/execution/DataSourceScanExec.scala | 16 +--
.../execution/datasources/DataSourceStrategy.scala | 10 +-
.../execution/datasources/jdbc/JDBCOptions.scala | 8 +-
.../sql/execution/datasources/jdbc/JDBCRDD.scala | 15 ++-
.../execution/datasources/jdbc/JDBCRelation.scala | 3 +
.../datasources/v2/DataSourceV2Strategy.scala | 7 +-
.../execution/datasources/v2/PushDownUtils.scala | 14 ++-
.../datasources/v2/PushedDownOperators.scala | 14 +--
.../execution/datasources/v2/TableSampleInfo.scala | 11 ++-
.../datasources/v2/V2ScanRelationPushDown.scala | 41 ++++++--
.../execution/datasources/v2/jdbc/JDBCScan.scala | 5 +-
.../datasources/v2/jdbc/JDBCScanBuilder.scala | 37 +++++--
.../org/apache/spark/sql/jdbc/JdbcDialects.scala | 6 ++
.../apache/spark/sql/jdbc/PostgresDialect.scala | 10 ++
.../org/apache/spark/sql/jdbc/JDBCV2Suite.scala | 19 +++-
20 files changed, 294 insertions(+), 63 deletions(-)
copy sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/{SupportsPushDownLimit.java => SupportsPushDownTableSample.java} (76%)
copy core/src/main/java/org/apache/spark/api/java/function/Function0.java => sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/PushedDownOperators.scala (74%)
copy core/src/main/resources/org/apache/spark/ui/static/initialize-tooltips.js => sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/TableSampleInfo.scala (82%)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org