You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "caican (Jira)" <ji...@apache.org> on 2022/03/08 08:32:00 UTC
[jira] [Created] (SPARK-38444) Automatically calculate the upper and lower bounds of partitions when no specified partition related params
caican created SPARK-38444:
------------------------------
Summary: Automatically calculate the upper and lower bounds of partitions when no specified partition related params
Key: SPARK-38444
URL: https://issues.apache.org/jira/browse/SPARK-38444
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.1.2
Reporter: caican
when access rdbms, such as mysql, if partitionColumn, lowerBound, upperBound, numPartitions are not specified, by default only one partition to scan database is working.
It makes load data from database slow and makes it difficult for users to configure multiple parameters to improve parallelism.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org