You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by tw...@apache.org on 2018/11/12 09:33:50 UTC
[flink] branch master updated (17a6e7a -> 6115b05)
This is an automated email from the ASF dual-hosted git repository.
twalthr pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git.
from 17a6e7a [FLINK-10626] [docs] [table] Add documentation for temporal table joins
new f393fb7 [FLINK-10826] [e2e] Decrease deployment size of heavy deplyment e2e test for Travis
new 6115b05 [FLINK-10826] [e2e] Increase network timeout
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh | 11 ++++++-----
1 file changed, 6 insertions(+), 5 deletions(-)
[flink] 01/02: [FLINK-10826] [e2e] Decrease deployment size of
heavy deplyment e2e test for Travis
Posted by tw...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
twalthr pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
commit f393fb70b27cd2a64cb2c010d7d2e902f75c519f
Author: Stefan Richter <s....@data-artisans.com>
AuthorDate: Thu Nov 8 15:08:35 2018 +0100
[FLINK-10826] [e2e] Decrease deployment size of heavy deplyment e2e test for Travis
This closes #7066.
---
flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh | 10 +++++-----
1 file changed, 5 insertions(+), 5 deletions(-)
diff --git a/flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh b/flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh
index 895e4a7..b4646fc 100755
--- a/flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh
+++ b/flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh
@@ -25,7 +25,7 @@ TEST=flink-heavy-deployment-stress-test
TEST_PROGRAM_NAME=HeavyDeploymentStressTestProgram
TEST_PROGRAM_JAR=${END_TO_END_DIR}/$TEST/target/$TEST_PROGRAM_NAME.jar
-set_conf "taskmanager.heap.mb" "256" # 256Mb x 20TMs = 5Gb total heap
+set_conf "taskmanager.heap.mb" "512" # 512Mb x 10TMs = 5Gb total heap
set_conf "taskmanager.memory.size" "8" # 8Mb
set_conf "taskmanager.network.memory.min" "8mb"
@@ -35,12 +35,12 @@ set_conf "taskmanager.memory.segment-size" "8kb"
set_conf "taskmanager.numberOfTaskSlots" "10" # 10 slots per TM
start_cluster # this also starts 1TM
-start_taskmanagers 19 # 1TM + 19TM = 20TM a 10 slots = 200 slots
+start_taskmanagers 9 # 1TM + 9TM = 10TM a 10 slots = 100 slots
-# This call will result in a deployment with state meta data of 200 x 200 x 50 union states x each 75 entries.
+# This call will result in a deployment with state meta data of 100 x 100 x 50 union states x each 100 entries.
# We can scale up the numbers to make the test even heavier.
$FLINK_DIR/bin/flink run ${TEST_PROGRAM_JAR} \
---environment.max_parallelism 1024 --environment.parallelism 200 \
+--environment.max_parallelism 1024 --environment.parallelism 100 \
--environment.restart_strategy fixed_delay --environment.restart_strategy.fixed_delay.attempts 3 \
--state_backend.checkpoint_directory ${CHECKPOINT_DIR} \
---heavy_deployment_test.num_list_states_per_op 50 --heavy_deployment_test.num_partitions_per_list_state 75
+--heavy_deployment_test.num_list_states_per_op 50 --heavy_deployment_test.num_partitions_per_list_state 100
[flink] 02/02: [FLINK-10826] [e2e] Increase network timeout
Posted by tw...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
twalthr pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/flink.git
commit 6115b05c87e387c301b21758a6d29e300d138a84
Author: Timo Walther <tw...@apache.org>
AuthorDate: Mon Nov 12 10:28:51 2018 +0100
[FLINK-10826] [e2e] Increase network timeout
---
flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh | 1 +
1 file changed, 1 insertion(+)
diff --git a/flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh b/flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh
index b4646fc..8613470 100755
--- a/flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh
+++ b/flink-end-to-end-tests/test-scripts/test_heavy_deployment.sh
@@ -30,6 +30,7 @@ set_conf "taskmanager.heap.mb" "512" # 512Mb x 10TMs = 5Gb total heap
set_conf "taskmanager.memory.size" "8" # 8Mb
set_conf "taskmanager.network.memory.min" "8mb"
set_conf "taskmanager.network.memory.max" "8mb"
+set_conf "taskmanager.network.request-backoff.max" "60000"
set_conf "taskmanager.memory.segment-size" "8kb"
set_conf "taskmanager.numberOfTaskSlots" "10" # 10 slots per TM