Re: [PR] Build: Cap the number of workers in Flink CI [iceberg]

["jbonofre (via GitHub)" <gi...@apache.org>]

jbonofre commented on code in PR #15541:
URL: https://github.com/apache/iceberg/pull/15541#discussion_r2929911331


##########
build.gradle:
##########
@@ -165,7 +165,8 @@ subprojects {
   if (testParallelism != null) {
     def numTestWorkers
     if (testParallelism.equalsIgnoreCase('auto')) {
-      numTestWorkers = Math.ceil(Runtime.getRuntime().availableProcessors() / 2.0) as int
+      // Cap at 4 to avoid memory pressure on CI runners (each fork uses up to 1500m heap)
+      numTestWorkers = Math.min(Math.ceil(Runtime.getRuntime().availableProcessors() / 2.0) as int, 4)

Review Comment:
   Done, I created a PR for the timeout (#15617). The intent of this PR is to avoid memory pressure on CI runners only to investigate why Flink sometime runs for more than 1 hour (flaky).



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@iceberg.apache.org
For additional commands, e-mail: issues-help@iceberg.apache.org