You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by po...@apache.org on 2023/11/18 18:29:13 UTC
(airflow) branch add-more-disk-for-arm-instance created (now b6cfeee2e9)
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch add-more-disk-for-arm-instance
in repository https://gitbox.apache.org/repos/asf/airflow.git
at b6cfeee2e9 Add more disk space for ARM image
This branch includes the following new commits:
new b6cfeee2e9 Add more disk space for ARM image
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
(airflow) 01/01: Add more disk space for ARM image
Posted by po...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a commit to branch add-more-disk-for-arm-instance
in repository https://gitbox.apache.org/repos/asf/airflow.git
commit b6cfeee2e9ef17d9b641cf65fbde4ff55ffc2e2d
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Sat Nov 18 19:27:06 2023 +0100
Add more disk space for ARM image
We are quite close to fill disk space for ARM instance (8GB) when
building images and sometime the build fails. We should increase
the space.
---
scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh | 2 ++
scripts/ci/images/file_mapping.json | 6 ++++++
2 files changed, 8 insertions(+)
diff --git a/scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh b/scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh
index 6fcd62a20c..6e7047daf6 100755
--- a/scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh
+++ b/scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh
@@ -25,6 +25,7 @@ MARKET_OPTIONS="MarketType=spot,SpotOptions={MaxPrice=0.25,SpotInstanceType=one-
REGION="us-east-2"
EC2_USER="ec2-user"
USER_DATA_FILE="${SCRIPTS_DIR}/initialize.sh"
+MAPPING_FILE="${SCRIPTS_DIR}/file_mapping.json"
METADATA_ADDRESS="http://169.254.169.254/latest/meta-data"
MAC_ADDRESS=$(curl -s "${METADATA_ADDRESS}/network/interfaces/macs/" | head -n1 | tr -d '/')
CIDR=$(curl -s "${METADATA_ADDRESS}/network/interfaces/macs/${MAC_ADDRESS}/vpc-ipv4-cidr-block/")
@@ -38,6 +39,7 @@ function start_arm_instance() {
--image-id "${ARM_AMI}" \
--count 1 \
--instance-type "${INSTANCE_TYPE}" \
+ --blockd-device-mappings "file://${MAPPING_FILE}" \
--user-data "file://${USER_DATA_FILE}" \
--instance-market-options "${MARKET_OPTIONS}" \
--instance-initiated-shutdown-behavior terminate \
diff --git a/scripts/ci/images/file_mapping.json b/scripts/ci/images/file_mapping.json
new file mode 100644
index 0000000000..b144e995a0
--- /dev/null
+++ b/scripts/ci/images/file_mapping.json
@@ -0,0 +1,6 @@
+{
+ "DeviceName": "/dev/xvda",
+ "Ebs": {
+ "VolumeSize": 16
+ }
+}