You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by li...@apache.org on 2017/07/19 21:45:13 UTC
spark git commit: [SPARK-21446][SQL] Fix setAutoCommit never executed
Repository: spark
Updated Branches:
refs/heads/master ef6177558 -> c9729187b
[SPARK-21446][SQL] Fix setAutoCommit never executed
## What changes were proposed in this pull request?
JIRA Issue: https://issues.apache.org/jira/browse/SPARK-21446
options.asConnectionProperties can not have fetchsize，because fetchsize belongs to Spark-only options, and Spark-only options have been excluded in connection properities.
So change properties of beforeFetch from options.asConnectionProperties.asScala.toMap to options.asProperties.asScala.toMap
## How was this patch tested?
Author: DFFuture <al...@gmail.com>
Closes #18665 from DFFuture/sparksql_pg.
Project: http://git-wip-us.apache.org/repos/asf/spark/repo
Commit: http://git-wip-us.apache.org/repos/asf/spark/commit/c9729187
Tree: http://git-wip-us.apache.org/repos/asf/spark/tree/c9729187
Diff: http://git-wip-us.apache.org/repos/asf/spark/diff/c9729187
Branch: refs/heads/master
Commit: c9729187bcef78299390e53cd9af38c3e084060e
Parents: ef61775
Author: DFFuture <al...@gmail.com>
Authored: Wed Jul 19 14:45:11 2017 -0700
Committer: gatorsmile <ga...@gmail.com>
Committed: Wed Jul 19 14:45:11 2017 -0700
----------------------------------------------------------------------
.../org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/spark/blob/c9729187/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala
----------------------------------------------------------------------
diff --git a/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala b/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala
index 57e9bc9..24e1369 100644
--- a/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala
+++ b/sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/JDBCRDD.scala
@@ -271,7 +271,7 @@ private[jdbc] class JDBCRDD(
conn = getConnection()
val dialect = JdbcDialects.get(url)
import scala.collection.JavaConverters._
- dialect.beforeFetch(conn, options.asConnectionProperties.asScala.toMap)
+ dialect.beforeFetch(conn, options.asProperties.asScala.toMap)
// H2's JDBC driver does not support the setSchema() method. We pass a
// fully-qualified table name in the SELECT statement. I don't know how to
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org