You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@paimon.apache.org by "JingsongLi (via GitHub)" <gi...@apache.org> on 2023/05/16 06:40:58 UTC
[GitHub] [incubator-paimon] JingsongLi opened a new pull request, #1160: [flink] Default enable scan.infer-parallelism
JingsongLi opened a new pull request, #1160:
URL: https://github.com/apache/incubator-paimon/pull/1160
### Purpose
Considering that splits have already been scanned during the statistical information inference process, we can default to enabling parallelism inference.
Additionally, we do not need to pass the splits to the runtime, as there may be a risk of OOM when there are many splits.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-paimon] yuzelin commented on a diff in pull request #1160: [flink] Default enable scan.infer-parallelism
Posted by "yuzelin (via GitHub)" <gi...@apache.org>.
yuzelin commented on code in PR #1160:
URL: https://github.com/apache/incubator-paimon/pull/1160#discussion_r1194937427
##########
paimon-flink/paimon-flink-common/src/test/java/org/apache/paimon/flink/ReadWriteTableITCase.java:
##########
@@ -1146,7 +1146,12 @@ public void testSourceParallelism() throws Exception {
createTable(
Arrays.asList("currency STRING", "rate BIGINT"),
Collections.emptyList(),
- Collections.emptyList());
+ Collections.emptyList(),
+ new HashMap<String, String>() {
+ {
+ put(INFER_SCAN_PARALLELISM.key(), "false");
+ }
+ });
Review Comment:
`Collections.singletonMap`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-paimon] JingsongLi merged pull request #1160: [flink] Default enable scan.infer-parallelism
Posted by "JingsongLi (via GitHub)" <gi...@apache.org>.
JingsongLi merged PR #1160:
URL: https://github.com/apache/incubator-paimon/pull/1160
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@paimon.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org