You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@cassandra.apache.org by br...@apache.org on 2022/01/26 17:00:32 UTC
[cassandra] branch trunk updated (d543dae -> ab491988)
This is an automated email from the ASF dual-hosted git repository.
brandonwilliams pushed a change to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git.
from d543dae Fix restarting a node when other nodes are down in dtests
new 1eb7779 remove python 2 code which is now EOL and unsupported
new ab491988 remove py2 circle tests
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.circleci/config-2_1.yml | 102 --------
.circleci/config-2_1.yml.mid_res.patch | 416 ++++++++++--------------------
.circleci/config.yml.HIGHRES | 424 -------------------------------
.circleci/config.yml.LOWRES | 424 -------------------------------
.circleci/config.yml.MIDRES | 424 -------------------------------
CHANGES.txt | 1 +
README.asc | 2 +-
bin/cqlsh | 8 +-
bin/cqlsh.py | 9 +-
pylib/Dockerfile.ubuntu.py2 | 2 -
pylib/README.asc | 6 +-
pylib/cqlshlib/test/test_cqlsh_output.py | 17 --
12 files changed, 147 insertions(+), 1688 deletions(-)
delete mode 100644 pylib/Dockerfile.ubuntu.py2
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org
[cassandra] 02/02: remove py2 circle tests
Posted by br...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
brandonwilliams pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git
commit ab4919880793e43b361054754b65f750f9f56c2e
Author: Brandon Williams <br...@apache.org>
AuthorDate: Mon Jan 24 12:14:46 2022 -0600
remove py2 circle tests
Patch by brandonwilliams; reviewed by bereng for CASSANDRA-17242
---
.circleci/config-2_1.yml | 102 --------
.circleci/config-2_1.yml.mid_res.patch | 416 +++++++++++---------------------
.circleci/config.yml.HIGHRES | 424 ---------------------------------
.circleci/config.yml.LOWRES | 424 ---------------------------------
.circleci/config.yml.MIDRES | 424 ---------------------------------
5 files changed, 137 insertions(+), 1653 deletions(-)
diff --git a/.circleci/config-2_1.yml b/.circleci/config-2_1.yml
index b270a52..1692e95 100644
--- a/.circleci/config-2_1.yml
+++ b/.circleci/config-2_1.yml
@@ -284,10 +284,6 @@ j8_with_dtests_jobs: &j8_with_dtests_jobs
# Java 8 cqlsh dtests
- start_j8_cqlsh_tests:
type: approval
- - j8_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j8_cqlsh_tests
- - j8_build
- j8_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j8_cqlsh_tests
@@ -296,10 +292,6 @@ j8_with_dtests_jobs: &j8_with_dtests_jobs
requires:
- start_j8_cqlsh_tests
- j8_build
- - j8_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j8_cqlsh_tests
- - j8_build
- j8_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j8_cqlsh_tests
@@ -311,10 +303,6 @@ j8_with_dtests_jobs: &j8_with_dtests_jobs
# Java 11 cqlsh dtests
- start_j11_cqlsh_tests:
type: approval
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j8_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -323,10 +311,6 @@ j8_with_dtests_jobs: &j8_with_dtests_jobs
requires:
- start_j11_cqlsh_tests
- j8_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j8_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -464,18 +448,12 @@ j8_pre-commit_jobs: &j8_pre-commit_jobs
- j8_build
- start_upgrade_tests
# Java 8 cqlsh dtests
- - j8_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j8_build
- j8_cqlsh-dtests-py3-with-vnodes:
requires:
- j8_build
- j8_cqlsh-dtests-py38-with-vnodes:
requires:
- j8_build
- - j8_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j8_build
- j8_cqlsh-dtests-py3-no-vnodes:
requires:
- j8_build
@@ -483,18 +461,12 @@ j8_pre-commit_jobs: &j8_pre-commit_jobs
requires:
- j8_build
# Java 11 cqlsh dtests
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j8_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- j8_build
- j11_cqlsh-dtests-py38-with-vnodes:
requires:
- j8_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j8_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- j8_build
@@ -583,10 +555,6 @@ j11_with_dtests_jobs: &j11_with_dtests_jobs
- j11_build
- start_j11_cqlsh_tests:
type: approval
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j11_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -595,10 +563,6 @@ j11_with_dtests_jobs: &j11_with_dtests_jobs
requires:
- start_j11_cqlsh_tests
- j11_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j11_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -650,18 +614,12 @@ j11_pre-commit_jobs: &j11_pre-commit_jobs
- j11_dtests-no-vnodes:
requires:
- j11_build
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j11_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- j11_build
- j11_cqlsh-dtests-py38-with-vnodes:
requires:
- j11_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j11_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- j11_build
@@ -943,21 +901,6 @@ jobs:
file_tag: j8_upgradetests_without_vnodes
pytest_extra_args: '--execute-upgrade-tests-only --upgrade-target-version-only --upgrade-version-selection all'
- j8_cqlsh-dtests-py2-with-vnodes:
- <<: *j8_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
- - clone_dtest
- - create_venv
- - create_dtest_containers:
- file_tag: j8_with_vnodes
- run_dtests_extra_args: "--use-vnodes --skip-resource-intensive-tests --pytest-options '-k cql'"
- - run_dtests:
- file_tag: j8_with_vnodes
- pytest_extra_args: '--use-vnodes --num-tokens=16 --skip-resource-intensive-tests'
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python2.7'
-
j8_cqlsh-dtests-py3-with-vnodes:
<<: *j8_par_executor
steps:
@@ -991,21 +934,6 @@ jobs:
extra_env_args: 'CQLSH_PYTHON=/usr/bin/python3.8'
python_version: '3.8'
- j8_cqlsh-dtests-py2-no-vnodes:
- <<: *j8_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
- - clone_dtest
- - create_venv
- - create_dtest_containers:
- file_tag: j8_without_vnodes
- run_dtests_extra_args: "--skip-resource-intensive-tests --pytest-options '-k cql'"
- - run_dtests:
- file_tag: j8_without_vnodes
- pytest_extra_args: '--skip-resource-intensive-tests'
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python2.7'
-
j8_cqlsh-dtests-py3-no-vnodes:
<<: *j8_par_executor
steps:
@@ -1039,21 +967,6 @@ jobs:
extra_env_args: 'CQLSH_PYTHON=/usr/bin/python3.8'
python_version: '3.8'
- j11_cqlsh-dtests-py2-with-vnodes:
- <<: *j11_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
- - clone_dtest
- - create_venv
- - create_dtest_containers:
- file_tag: j11_with_vnodes
- run_dtests_extra_args: "--use-vnodes --skip-resource-intensive-tests --pytest-options '-k cql'"
- - run_dtests:
- file_tag: j11_with_vnodes
- pytest_extra_args: '--use-vnodes --num-tokens=16 --skip-resource-intensive-tests'
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python2.7'
-
j11_cqlsh-dtests-py3-with-vnodes:
<<: *j11_par_executor
steps:
@@ -1087,21 +1000,6 @@ jobs:
extra_env_args: 'CQLSH_PYTHON=/usr/bin/python3.8'
python_version: '3.8'
- j11_cqlsh-dtests-py2-no-vnodes:
- <<: *j11_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
- - clone_dtest
- - create_venv
- - create_dtest_containers:
- file_tag: j11_without_vnodes
- run_dtests_extra_args: "--skip-resource-intensive-tests --pytest-options '-k cql'"
- - run_dtests:
- file_tag: j11_without_vnodes
- pytest_extra_args: '--skip-resource-intensive-tests'
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python2.7'
-
j11_cqlsh-dtests-py3-no-vnodes:
<<: *j11_par_executor
steps:
diff --git a/.circleci/config-2_1.yml.mid_res.patch b/.circleci/config-2_1.yml.mid_res.patch
index 28021f6..8b51adb 100644
--- a/.circleci/config-2_1.yml.mid_res.patch
+++ b/.circleci/config-2_1.yml.mid_res.patch
@@ -1,279 +1,137 @@
---- config-2_1.yml 2021-11-12 11:02:52.301079060 +0100
-+++ config-2_1.yml.MIDRES 2021-11-16 11:53:09.052881200 +0100
-@@ -101,14 +101,14 @@
- j8_par_executor: &j8_par_executor
- executor:
- name: java8-executor
-- #exec_resource_class: xlarge
-- parallelism: 4
-+ exec_resource_class: medium
-+ parallelism: 25
-
- j8_small_par_executor: &j8_small_par_executor
- executor:
- name: java8-executor
-- #exec_resource_class: xlarge
-- parallelism: 1
-+ exec_resource_class: large
-+ parallelism: 10
-
- j8_small_executor: &j8_small_executor
- executor:
-@@ -119,26 +119,38 @@
- j8_medium_par_executor: &j8_medium_par_executor
- executor:
- name: java8-executor
-- #exec_resource_class: xlarge
-- parallelism: 1
-+ exec_resource_class: large
-+ parallelism: 4
-+
-+j8_large_par_executor: &j8_large_par_executor
-+ executor:
-+ name: java8-executor
-+ exec_resource_class: large
-+ parallelism: 50
-+
-+j8_very_large_par_executor: &j8_very_large_par_executor
-+ executor:
-+ name: java8-executor
-+ exec_resource_class: xlarge
-+ parallelism: 100
-
- j8_seq_executor: &j8_seq_executor
- executor:
- name: java8-executor
-- #exec_resource_class: xlarge
-+ exec_resource_class: medium
- parallelism: 1 # sequential, single container tests: no parallelism benefits
-
- j11_par_executor: &j11_par_executor
- executor:
- name: java11-executor
-- #exec_resource_class: xlarge
-- parallelism: 4
-+ exec_resource_class: medium
-+ parallelism: 25
-
- j11_small_par_executor: &j11_small_par_executor
- executor:
- name: java11-executor
-- #exec_resource_class: xlarge
-- parallelism: 1
-+ #exec_resource_class: large
-+ parallelism: 10
-
- j11_small_executor: &j11_small_executor
- executor:
-@@ -146,35 +158,47 @@
- #exec_resource_class: medium
- parallelism: 1
-
-+j11_large_par_executor: &j11_large_par_executor
-+ executor:
-+ name: java11-executor
-+ exec_resource_class: large
-+ parallelism: 50
-+
- j8_repeated_utest_executor: &j8_repeated_utest_executor
- executor:
- name: java8-executor
-- parallelism: 4
-+ exec_resource_class: medium
-+ parallelism: 25
-
- j8_repeated_dtest_executor: &j8_repeated_dtest_executor
- executor:
- name: java8-executor
-- parallelism: 4
-+ exec_resource_class: large
-+ parallelism: 25
-
- j8_repeated_upgrade_dtest_executor: &j8_repeated_upgrade_dtest_executor
- executor:
- name: java8-executor
-- parallelism: 4
-+ exec_resource_class: xlarge
-+ parallelism: 25
-
- j8_repeated_jvm_upgrade_dtest_executor: &j8_repeated_jvm_upgrade_dtest_executor
- executor:
- name: java8-executor
-- parallelism: 4
-+ exec_resource_class: large
-+ parallelism: 25
-
- j11_repeated_utest_executor: &j11_repeated_utest_executor
- executor:
- name: java11-executor
-- parallelism: 4
-+ exec_resource_class: medium
-+ parallelism: 25
-
- j11_repeated_dtest_executor: &j11_repeated_dtest_executor
- executor:
- name: java11-executor
-- parallelism: 4
-+ exec_resource_class: large
-+ parallelism: 25
-
- j8_with_dtests_jobs: &j8_with_dtests_jobs
- jobs:
-@@ -872,7 +896,7 @@
- target: testclasslist-system-keyspace-directory
-
- j8_dtests-with-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -886,7 +910,7 @@
- pytest_extra_args: '--use-vnodes --num-tokens=16 --skip-resource-intensive-tests'
-
- j11_dtests-with-vnodes:
-- <<: *j11_par_executor
-+ <<: *j11_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -901,7 +925,7 @@
- pytest_extra_args: '--use-vnodes --num-tokens=16 --skip-resource-intensive-tests'
-
- j8_dtests-no-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -915,7 +939,7 @@
- pytest_extra_args: '--skip-resource-intensive-tests'
-
- j11_dtests-no-vnodes:
-- <<: *j11_par_executor
-+ <<: *j11_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -930,7 +954,7 @@
- pytest_extra_args: '--skip-resource-intensive-tests'
-
- j8_upgradetests-no-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_very_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -944,7 +968,7 @@
- pytest_extra_args: '--execute-upgrade-tests-only --upgrade-target-version-only --upgrade-version-selection all'
-
- j8_cqlsh-dtests-py2-with-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -959,7 +983,7 @@
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python2.7'
-
- j8_cqlsh-dtests-py3-with-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -974,7 +998,7 @@
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python3.6'
-
- j8_cqlsh-dtests-py38-with-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -992,7 +1016,7 @@
- python_version: '3.8'
-
- j8_cqlsh-dtests-py2-no-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1007,7 +1031,7 @@
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python2.7'
-
- j8_cqlsh-dtests-py3-no-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1022,7 +1046,7 @@
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python3.6'
-
- j8_cqlsh-dtests-py38-no-vnodes:
-- <<: *j8_par_executor
-+ <<: *j8_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1040,7 +1064,7 @@
- python_version: '3.8'
-
- j11_cqlsh-dtests-py2-with-vnodes:
-- <<: *j11_par_executor
-+ <<: *j11_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1055,7 +1079,7 @@
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python2.7'
-
- j11_cqlsh-dtests-py3-with-vnodes:
-- <<: *j11_par_executor
-+ <<: *j11_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1070,7 +1094,7 @@
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python3.6'
-
- j11_cqlsh-dtests-py38-with-vnodes:
-- <<: *j11_par_executor
-+ <<: *j11_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1088,7 +1112,7 @@
- python_version: '3.8'
-
- j11_cqlsh-dtests-py2-no-vnodes:
-- <<: *j11_par_executor
-+ <<: *j11_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1103,7 +1127,7 @@
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python2.7'
-
- j11_cqlsh-dtests-py3-no-vnodes:
-- <<: *j11_par_executor
-+ <<: *j11_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1118,7 +1142,7 @@
- extra_env_args: 'CQLSH_PYTHON=/usr/bin/python3.6'
-
- j11_cqlsh-dtests-py38-no-vnodes:
-- <<: *j11_par_executor
-+ <<: *j11_large_par_executor
- steps:
- - attach_workspace:
- at: /home/cassandra
-@@ -1760,3 +1784,4 @@
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_logs
-+
+104,105c104,105
+< #exec_resource_class: xlarge
+< parallelism: 4
+---
+> exec_resource_class: medium
+> parallelism: 25
+110,111c110,111
+< #exec_resource_class: xlarge
+< parallelism: 1
+---
+> exec_resource_class: large
+> parallelism: 10
+122,123c122,135
+< #exec_resource_class: xlarge
+< parallelism: 1
+---
+> exec_resource_class: large
+> parallelism: 4
+>
+> j8_large_par_executor: &j8_large_par_executor
+> executor:
+> name: java8-executor
+> exec_resource_class: large
+> parallelism: 50
+>
+> j8_very_large_par_executor: &j8_very_large_par_executor
+> executor:
+> name: java8-executor
+> exec_resource_class: xlarge
+> parallelism: 100
+128c140
+< #exec_resource_class: xlarge
+---
+> exec_resource_class: medium
+134,135c146,147
+< #exec_resource_class: xlarge
+< parallelism: 4
+---
+> exec_resource_class: medium
+> parallelism: 25
+140,141c152,153
+< #exec_resource_class: xlarge
+< parallelism: 1
+---
+> #exec_resource_class: large
+> parallelism: 10
+148a161,166
+> j11_large_par_executor: &j11_large_par_executor
+> executor:
+> name: java11-executor
+> exec_resource_class: large
+> parallelism: 50
+>
+152c170,171
+< parallelism: 4
+---
+> exec_resource_class: medium
+> parallelism: 25
+157c176,177
+< parallelism: 4
+---
+> exec_resource_class: large
+> parallelism: 25
+162c182,183
+< parallelism: 4
+---
+> exec_resource_class: xlarge
+> parallelism: 25
+167c188,189
+< parallelism: 4
+---
+> exec_resource_class: large
+> parallelism: 25
+172c194,195
+< parallelism: 4
+---
+> exec_resource_class: medium
+> parallelism: 25
+177c200,201
+< parallelism: 4
+---
+> exec_resource_class: large
+> parallelism: 25
+833c857
+< <<: *j8_par_executor
+---
+> <<: *j8_large_par_executor
+847c871
+< <<: *j11_par_executor
+---
+> <<: *j11_large_par_executor
+862c886
+< <<: *j8_par_executor
+---
+> <<: *j8_large_par_executor
+876c900
+< <<: *j11_par_executor
+---
+> <<: *j11_large_par_executor
+891c915
+< <<: *j8_par_executor
+---
+> <<: *j8_very_large_par_executor
+905c929
+< <<: *j8_par_executor
+---
+> <<: *j8_large_par_executor
+920c944
+< <<: *j8_par_executor
+---
+> <<: *j8_large_par_executor
+938c962
+< <<: *j8_par_executor
+---
+> <<: *j8_large_par_executor
+953c977
+< <<: *j8_par_executor
+---
+> <<: *j8_large_par_executor
+971c995
+< <<: *j11_par_executor
+---
+> <<: *j11_large_par_executor
+986c1010
+< <<: *j11_par_executor
+---
+> <<: *j11_large_par_executor
+1004c1028
+< <<: *j11_par_executor
+---
+> <<: *j11_large_par_executor
+1019c1043
+< <<: *j11_par_executor
+---
+> <<: *j11_large_par_executor
+1660a1685
+>
diff --git a/.circleci/config.yml.HIGHRES b/.circleci/config.yml.HIGHRES
index 5d80d38..3d15e4b 100644
--- a/.circleci/config.yml.HIGHRES
+++ b/.circleci/config.yml.HIGHRES
@@ -302,101 +302,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j8_cqlsh-dtests-py2-with-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11-w-dependencies:20210929
- resource_class: xlarge
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 100
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j8_with_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j8_with_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --use-vnodes --skip-r [...]
- - run:
- name: Run dtests (j8_with_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --use-vnodes --num-tokens=16 --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j8_with_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j8_with_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j8_with_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
j11_unit_tests:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -1107,101 +1012,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j8_cqlsh-dtests-py2-no-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11-w-dependencies:20210929
- resource_class: xlarge
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 100
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j8_without_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j8_without_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --skip-resource-in [...]
- - run:
- name: Run dtests (j8_without_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j8_without_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j8_without_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j8_without_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
j11_repeated_dtest:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -1469,102 +1279,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j11_cqlsh-dtests-py2-with-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11:20210304
- resource_class: xlarge
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 100
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j11_with_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j11_with_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --use-vnodes --skip- [...]
- - run:
- name: Run dtests (j11_with_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --use-vnodes --num-tokens=16 --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j11_with_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j11_with_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j11_with_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - CASSANDRA_USE_JDK11: true
j11_dtests-with-vnodes:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -2197,102 +1911,6 @@ jobs:
- JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- CASSANDRA_USE_JDK11: true
- j11_cqlsh-dtests-py2-no-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11:20210304
- resource_class: xlarge
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 100
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j11_without_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j11_without_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --skip-resource-i [...]
- - run:
- name: Run dtests (j11_without_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j11_without_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j11_without_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j11_without_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - CASSANDRA_USE_JDK11: true
j11_cqlshlib_tests:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -3963,10 +3581,6 @@ workflows:
- j8_build
- start_j8_cqlsh_tests:
type: approval
- - j8_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j8_cqlsh_tests
- - j8_build
- j8_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j8_cqlsh_tests
@@ -3975,10 +3589,6 @@ workflows:
requires:
- start_j8_cqlsh_tests
- j8_build
- - j8_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j8_cqlsh_tests
- - j8_build
- j8_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j8_cqlsh_tests
@@ -3989,10 +3599,6 @@ workflows:
- j8_build
- start_j11_cqlsh_tests:
type: approval
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j8_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4001,10 +3607,6 @@ workflows:
requires:
- start_j11_cqlsh_tests
- j8_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j8_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4128,36 +3730,24 @@ workflows:
requires:
- j8_build
- start_upgrade_tests
- - j8_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j8_build
- j8_cqlsh-dtests-py3-with-vnodes:
requires:
- j8_build
- j8_cqlsh-dtests-py38-with-vnodes:
requires:
- j8_build
- - j8_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j8_build
- j8_cqlsh-dtests-py3-no-vnodes:
requires:
- j8_build
- j8_cqlsh-dtests-py38-no-vnodes:
requires:
- j8_build
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j8_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- j8_build
- j11_cqlsh-dtests-py38-with-vnodes:
requires:
- j8_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j8_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- j8_build
@@ -4237,10 +3827,6 @@ workflows:
- j11_build
- start_j11_cqlsh_tests:
type: approval
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j11_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4249,10 +3835,6 @@ workflows:
requires:
- start_j11_cqlsh_tests
- j11_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j11_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4301,18 +3883,12 @@ workflows:
- j11_dtests-no-vnodes:
requires:
- j11_build
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j11_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- j11_build
- j11_cqlsh-dtests-py38-with-vnodes:
requires:
- j11_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j11_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- j11_build
diff --git a/.circleci/config.yml.LOWRES b/.circleci/config.yml.LOWRES
index 4041abd..ee3f52c 100644
--- a/.circleci/config.yml.LOWRES
+++ b/.circleci/config.yml.LOWRES
@@ -302,101 +302,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j8_cqlsh-dtests-py2-with-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11-w-dependencies:20210929
- resource_class: medium
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 4
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j8_with_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j8_with_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --use-vnodes --skip-r [...]
- - run:
- name: Run dtests (j8_with_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --use-vnodes --num-tokens=16 --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j8_with_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j8_with_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j8_with_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
j11_unit_tests:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -1107,101 +1012,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j8_cqlsh-dtests-py2-no-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11-w-dependencies:20210929
- resource_class: medium
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 4
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j8_without_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j8_without_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --skip-resource-in [...]
- - run:
- name: Run dtests (j8_without_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j8_without_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j8_without_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j8_without_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
j11_repeated_dtest:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -1469,102 +1279,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j11_cqlsh-dtests-py2-with-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11:20210304
- resource_class: medium
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 4
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j11_with_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j11_with_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --use-vnodes --skip- [...]
- - run:
- name: Run dtests (j11_with_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --use-vnodes --num-tokens=16 --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j11_with_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j11_with_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j11_with_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - CASSANDRA_USE_JDK11: true
j11_dtests-with-vnodes:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -2197,102 +1911,6 @@ jobs:
- JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- CASSANDRA_USE_JDK11: true
- j11_cqlsh-dtests-py2-no-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11:20210304
- resource_class: medium
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 4
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j11_without_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j11_without_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --skip-resource-i [...]
- - run:
- name: Run dtests (j11_without_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j11_without_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j11_without_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j11_without_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - CASSANDRA_USE_JDK11: true
j11_cqlshlib_tests:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -3963,10 +3581,6 @@ workflows:
- j8_build
- start_j8_cqlsh_tests:
type: approval
- - j8_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j8_cqlsh_tests
- - j8_build
- j8_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j8_cqlsh_tests
@@ -3975,10 +3589,6 @@ workflows:
requires:
- start_j8_cqlsh_tests
- j8_build
- - j8_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j8_cqlsh_tests
- - j8_build
- j8_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j8_cqlsh_tests
@@ -3989,10 +3599,6 @@ workflows:
- j8_build
- start_j11_cqlsh_tests:
type: approval
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j8_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4001,10 +3607,6 @@ workflows:
requires:
- start_j11_cqlsh_tests
- j8_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j8_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4128,36 +3730,24 @@ workflows:
requires:
- j8_build
- start_upgrade_tests
- - j8_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j8_build
- j8_cqlsh-dtests-py3-with-vnodes:
requires:
- j8_build
- j8_cqlsh-dtests-py38-with-vnodes:
requires:
- j8_build
- - j8_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j8_build
- j8_cqlsh-dtests-py3-no-vnodes:
requires:
- j8_build
- j8_cqlsh-dtests-py38-no-vnodes:
requires:
- j8_build
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j8_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- j8_build
- j11_cqlsh-dtests-py38-with-vnodes:
requires:
- j8_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j8_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- j8_build
@@ -4237,10 +3827,6 @@ workflows:
- j11_build
- start_j11_cqlsh_tests:
type: approval
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j11_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4249,10 +3835,6 @@ workflows:
requires:
- start_j11_cqlsh_tests
- j11_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j11_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4301,18 +3883,12 @@ workflows:
- j11_dtests-no-vnodes:
requires:
- j11_build
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j11_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- j11_build
- j11_cqlsh-dtests-py38-with-vnodes:
requires:
- j11_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j11_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- j11_build
diff --git a/.circleci/config.yml.MIDRES b/.circleci/config.yml.MIDRES
index 4b5616d..981dccf 100644
--- a/.circleci/config.yml.MIDRES
+++ b/.circleci/config.yml.MIDRES
@@ -302,101 +302,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j8_cqlsh-dtests-py2-with-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11-w-dependencies:20210929
- resource_class: large
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 50
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j8_with_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j8_with_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --use-vnodes --skip-r [...]
- - run:
- name: Run dtests (j8_with_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j8_with_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --use-vnodes --num-tokens=16 --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j8_with_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j8_with_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j8_with_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
j11_unit_tests:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -1107,101 +1012,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j8_cqlsh-dtests-py2-no-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11-w-dependencies:20210929
- resource_class: large
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 50
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j8_without_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j8_without_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --skip-resource-in [...]
- - run:
- name: Run dtests (j8_without_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j8_without_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j8_without_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j8_without_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j8_without_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
j11_repeated_dtest:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -1469,102 +1279,6 @@ jobs:
- REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- JAVA_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- j11_cqlsh-dtests-py2-with-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11:20210304
- resource_class: large
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 50
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j11_with_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j11_with_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --use-vnodes --skip- [...]
- - run:
- name: Run dtests (j11_with_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j11_with_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --use-vnodes --num-tokens=16 --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j11_with_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j11_with_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j11_with_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - CASSANDRA_USE_JDK11: true
j11_dtests-with-vnodes:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -2197,102 +1911,6 @@ jobs:
- JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- CASSANDRA_USE_JDK11: true
- j11_cqlsh-dtests-py2-no-vnodes:
- docker:
- - image: apache/cassandra-testing-ubuntu2004-java11:20210304
- resource_class: large
- working_directory: ~/
- shell: /bin/bash -eo pipefail -l
- parallelism: 50
- steps:
- - attach_workspace:
- at: /home/cassandra
- - run:
- name: Clone Cassandra dtest Repository (via git)
- command: |
- git clone --single-branch --branch $DTEST_BRANCH --depth 1 $DTEST_REPO ~/cassandra-dtest
- - run:
- name: Configure virtualenv and python Dependencies
- command: |
- # note, this should be super quick as all dependencies should be pre-installed in the docker image
- # if additional dependencies were added to requirmeents.txt and the docker image hasn't been updated
- # we'd have to install it here at runtime -- which will make things slow, so do yourself a favor and
- # rebuild the docker image! (it automatically pulls the latest requirements.txt on build)
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- pip3 install --exists-action w --upgrade -r ~/cassandra-dtest/requirements.txt
- pip3 uninstall -y cqlsh
- pip3 freeze
- - run:
- name: Determine Tests to Run (j11_without_vnodes)
- no_output_timeout: 5m
- command: "# reminder: this code (along with all the steps) is independently executed on every circle container\n# so the goal here is to get the circleci script to return the tests *this* container will run\n# which we do via the `circleci` cli tool.\n\ncd cassandra-dtest\nsource ~/env3.6/bin/activate\nexport PATH=$JAVA_HOME/bin:$PATH\n\nif [ -n '' ]; then\n export \nfi\n\necho \"***Collected DTests (j11_without_vnodes)***\"\nset -eo pipefail && ./run_dtests.py --skip-resource-i [...]
- - run:
- name: Run dtests (j11_without_vnodes)
- no_output_timeout: 15m
- command: |
- echo "cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt"
- cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt
-
- source ~/env3.6/bin/activate
- export PATH=$JAVA_HOME/bin:$PATH
- if [ -n 'CQLSH_PYTHON=/usr/bin/python2.7' ]; then
- export CQLSH_PYTHON=/usr/bin/python2.7
- fi
-
- java -version
- cd ~/cassandra-dtest
- mkdir -p /tmp/dtest
-
- echo "env: $(env)"
- echo "** done env"
- mkdir -p /tmp/results/dtests
- # we need the "set -o pipefail" here so that the exit code that circleci will actually use is from pytest and not the exit code from tee
- export SPLIT_TESTS=`cat /tmp/split_dtest_tests_j11_without_vnodes_final.txt`
- set -o pipefail && cd ~/cassandra-dtest && pytest --skip-resource-intensive-tests --log-cli-level=DEBUG --junit-xml=/tmp/results/dtests/pytest_result_j11_without_vnodes.xml -s --cassandra-dir=/home/cassandra/cassandra --keep-test-dir $SPLIT_TESTS 2>&1 | tee /tmp/dtest/stdout.txt
- - store_test_results:
- path: /tmp/results
- - store_artifacts:
- path: /tmp/dtest
- destination: dtest_j11_without_vnodes
- - store_artifacts:
- path: ~/cassandra-dtest/logs
- destination: dtest_j11_without_vnodes_logs
- environment:
- - ANT_HOME: /usr/share/ant
- - JAVA11_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JAVA8_HOME: /usr/lib/jvm/java-8-openjdk-amd64
- - LANG: en_US.UTF-8
- - KEEP_TEST_DIR: true
- - DEFAULT_DIR: /home/cassandra/cassandra-dtest
- - PYTHONIOENCODING: utf-8
- - PYTHONUNBUFFERED: true
- - CASS_DRIVER_NO_EXTENSIONS: true
- - CASS_DRIVER_NO_CYTHON: true
- - CASSANDRA_SKIP_SYNC: true
- - DTEST_REPO: https://github.com/apache/cassandra-dtest.git
- - DTEST_BRANCH: trunk
- - CCM_MAX_HEAP_SIZE: 1024M
- - CCM_HEAP_NEWSIZE: 256M
- - REPEATED_UTEST_TARGET: testsome
- - REPEATED_UTEST_CLASS: null
- - REPEATED_UTEST_METHODS: null
- - REPEATED_UTEST_COUNT: 100
- - REPEATED_UTEST_STOP_ON_FAILURE: false
- - REPEATED_DTEST_NAME: null
- - REPEATED_DTEST_VNODES: false
- - REPEATED_DTEST_COUNT: 100
- - REPEATED_DTEST_STOP_ON_FAILURE: false
- - REPEATED_UPGRADE_DTEST_NAME: null
- - REPEATED_UPGRADE_DTEST_COUNT: 100
- - REPEATED_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - REPEATED_JVM_UPGRADE_DTEST_CLASS: null
- - REPEATED_JVM_UPGRADE_DTEST_METHODS: null
- - REPEATED_JVM_UPGRADE_DTEST_COUNT: 100
- - REPEATED_JVM_UPGRADE_DTEST_STOP_ON_FAILURE: false
- - JAVA_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - JDK_HOME: /usr/lib/jvm/java-11-openjdk-amd64
- - CASSANDRA_USE_JDK11: true
j11_cqlshlib_tests:
docker:
- image: apache/cassandra-testing-ubuntu2004-java11:20210304
@@ -3963,10 +3581,6 @@ workflows:
- j8_build
- start_j8_cqlsh_tests:
type: approval
- - j8_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j8_cqlsh_tests
- - j8_build
- j8_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j8_cqlsh_tests
@@ -3975,10 +3589,6 @@ workflows:
requires:
- start_j8_cqlsh_tests
- j8_build
- - j8_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j8_cqlsh_tests
- - j8_build
- j8_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j8_cqlsh_tests
@@ -3989,10 +3599,6 @@ workflows:
- j8_build
- start_j11_cqlsh_tests:
type: approval
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j8_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4001,10 +3607,6 @@ workflows:
requires:
- start_j11_cqlsh_tests
- j8_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j8_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4128,36 +3730,24 @@ workflows:
requires:
- j8_build
- start_upgrade_tests
- - j8_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j8_build
- j8_cqlsh-dtests-py3-with-vnodes:
requires:
- j8_build
- j8_cqlsh-dtests-py38-with-vnodes:
requires:
- j8_build
- - j8_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j8_build
- j8_cqlsh-dtests-py3-no-vnodes:
requires:
- j8_build
- j8_cqlsh-dtests-py38-no-vnodes:
requires:
- j8_build
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j8_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- j8_build
- j11_cqlsh-dtests-py38-with-vnodes:
requires:
- j8_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j8_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- j8_build
@@ -4237,10 +3827,6 @@ workflows:
- j11_build
- start_j11_cqlsh_tests:
type: approval
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j11_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4249,10 +3835,6 @@ workflows:
requires:
- start_j11_cqlsh_tests
- j11_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - start_j11_cqlsh_tests
- - j11_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- start_j11_cqlsh_tests
@@ -4301,18 +3883,12 @@ workflows:
- j11_dtests-no-vnodes:
requires:
- j11_build
- - j11_cqlsh-dtests-py2-with-vnodes:
- requires:
- - j11_build
- j11_cqlsh-dtests-py3-with-vnodes:
requires:
- j11_build
- j11_cqlsh-dtests-py38-with-vnodes:
requires:
- j11_build
- - j11_cqlsh-dtests-py2-no-vnodes:
- requires:
- - j11_build
- j11_cqlsh-dtests-py3-no-vnodes:
requires:
- j11_build
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org
[cassandra] 01/02: remove python 2 code which is now EOL and unsupported
Posted by br...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
brandonwilliams pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/cassandra.git
commit 1eb777946434a578f2aa673063ba992692c358d4
Author: Brad Schoening <57...@users.noreply.github.com>
AuthorDate: Thu Jan 20 06:19:45 2022 -0500
remove python 2 code which is now EOL and unsupported
Patch by Brad Schoening; reviewed by brandonwilliams and bereng for
CASSANDRA-17242
---
CHANGES.txt | 1 +
README.asc | 2 +-
bin/cqlsh | 8 +++++---
bin/cqlsh.py | 9 +--------
pylib/Dockerfile.ubuntu.py2 | 2 --
pylib/README.asc | 6 ++----
pylib/cqlshlib/test/test_cqlsh_output.py | 17 -----------------
7 files changed, 10 insertions(+), 35 deletions(-)
diff --git a/CHANGES.txt b/CHANGES.txt
index 71a91a3..03a97fa 100644
--- a/CHANGES.txt
+++ b/CHANGES.txt
@@ -1,4 +1,5 @@
4.1
+ * Remove python 2.x support from cqlsh (CASSANDRA-17242)
* Prewarm role and credential caches to avoid timeouts at startup (CASSANDRA-16958)
* Make capacity/validity/updateinterval/activeupdate for Auth Caches configurable via nodetool (CASSANDRA-17063)
* Added startup check for read_ahead_kb setting (CASSANDRA-16436)
diff --git a/README.asc b/README.asc
index f1270a8..27850cd 100644
--- a/README.asc
+++ b/README.asc
@@ -12,7 +12,7 @@ For more information, see http://cassandra.apache.org/[the Apache Cassandra web
Requirements
------------
. Java >= 1.8 (OpenJDK and Oracle JVMS have been tested)
-. Python 3.6+ (for cqlsh; 2.7 works but is deprecated)
+. Python 3.6+ (for cqlsh)
Getting started
---------------
diff --git a/bin/cqlsh b/bin/cqlsh
index a962e11..90c9b00 100755
--- a/bin/cqlsh
+++ b/bin/cqlsh
@@ -62,8 +62,8 @@ is_supported_version() {
version=$1
major_version="${version%.*}"
minor_version="${version#*.}"
- # python3.6+ is supported. python2.7 is deprecated but still compatible.
- if [ "$major_version" = 3 ] && [ "$minor_version" -ge 6 ] || [ "$version" = "2.7" ]; then
+ # python3.6+ is supported
+ if [ "$major_version" = 3 ] && [ "$minor_version" -ge 6 ]; then
echo "supported"
else
echo "unsupported"
@@ -79,6 +79,8 @@ run_if_supported_version() {
if [ "$(is_supported_version "$version")" = "supported" ]; then
exec "$interpreter" "$($interpreter -c "import os; print(os.path.dirname(os.path.realpath('$0')))")/cqlsh.py" "$@"
exit
+ else
+ echo "Warning: unsupported version of Python:" $version >&2
fi
fi
}
@@ -88,7 +90,7 @@ if [ "$USER_SPECIFIED_PYTHON" != "" ]; then
# run a user specified Python interpreter
run_if_supported_version "$USER_SPECIFIED_PYTHON" "$@"
else
- for interpreter in python3 python python2.7; do
+ for interpreter in python3 python; do
run_if_supported_version "$interpreter" "$@"
done
fi
diff --git a/bin/cqlsh.py b/bin/cqlsh.py
index 3c711a9..1a5f84a 100755
--- a/bin/cqlsh.py
+++ b/bin/cqlsh.py
@@ -37,7 +37,7 @@ from glob import glob
from uuid import UUID
if sys.version_info < (3, 6) and sys.version_info[0:2] != (2, 7):
- sys.exit("\ncqlsh requires Python 3.6+ or Python 2.7 (deprecated)\n")
+ sys.exit("\ncqlsh requires Python 3.6+\n")
# see CASSANDRA-10428
if platform.python_implementation().startswith('Jython'):
@@ -522,7 +522,6 @@ class Shell(cmd.Cmd):
if tty:
self.reset_prompt()
- self.maybe_warn_py2()
self.report_connection()
print('Use HELP for help.')
else:
@@ -609,12 +608,6 @@ class Shell(cmd.Cmd):
vers['cql'] = self.cql_version
print("[cqlsh %(shver)s | Cassandra %(build)s | CQL spec %(cql)s | Native protocol v%(protocol)s]" % vers)
- def maybe_warn_py2(self):
- py2_suppress_warn = 'CQLSH_NO_WARN_PY2'
- if sys.version_info[0:2] == (2, 7) and not os.environ.get(py2_suppress_warn):
- print("Python 2.7 support is deprecated. "
- "Install Python 3.6+ or set %s to suppress this message.\n" % (py2_suppress_warn,))
-
def show_session(self, sessionid, partial_session=False):
print_trace_session(self, self.session, sessionid, partial_session)
diff --git a/pylib/Dockerfile.ubuntu.py2 b/pylib/Dockerfile.ubuntu.py2
deleted file mode 100644
index 93016f0..0000000
--- a/pylib/Dockerfile.ubuntu.py2
+++ /dev/null
@@ -1,2 +0,0 @@
-FROM ubuntu:bionic
-RUN apt-get update && apt-get install -y python-minimal
diff --git a/pylib/README.asc b/pylib/README.asc
index b0b6c7d..a192393 100644
--- a/pylib/README.asc
+++ b/pylib/README.asc
@@ -1,11 +1,9 @@
== Overview
This directory contains code primarily for cqlsh. cqlsh uses cqlshlib in this directory.
-Currently, cqlshlib supports Python 2 as well as Python 3. Support for Python 3 is relatively
-new.
== Requirements
-. Python 3 and 2.7 (for cqlsh)
+. Python 3.6+ (for cqlsh)
. virtualenv
. Docker (optional)
@@ -32,4 +30,4 @@ This will try to spawn a cqlsh instance inside the Docker container running Ubun
with minimal Python installation. It will try to connect to the Cassandra instance running on the
Docker host at port 9042. If you have Cassandra running elsewhere, replace host.docker.internal
with the IP / hostname as usual. Please ensure that the IP / host is accessible from _within_ the
-Docker container.
\ No newline at end of file
+Docker container.
diff --git a/pylib/cqlshlib/test/test_cqlsh_output.py b/pylib/cqlshlib/test/test_cqlsh_output.py
index 5678def..106f2ee 100644
--- a/pylib/cqlshlib/test/test_cqlsh_output.py
+++ b/pylib/cqlshlib/test/test_cqlsh_output.py
@@ -781,23 +781,6 @@ class TestCqlshOutput(BaseTestCase):
self.assertRegex(output, '^Connected to .* at %s:%d$'
% (re.escape(TEST_HOST), TEST_PORT))
- @unittest.skipIf(six.PY3, 'Will not emit warning when running Python 3')
- def test_warn_py2(self):
- # has the warning
- with testrun_cqlsh(tty=True, env=self.default_env) as c:
- self.assertIn('Python 2.7 support is deprecated.', c.output_header, 'cqlsh did not output expected warning.')
-
- # can suppress
- env = self.default_env.copy()
- env['CQLSH_NO_WARN_PY2'] = '1'
- with testrun_cqlsh(tty=True, env=env) as c:
- self.assertNotIn('Python 2.7 support is deprecated.', c.output_header, 'cqlsh did not output expected warning.')
-
- @unittest.skipIf(six.PY2, 'Warning will be emitted when running Python 2.7')
- def test_no_warn_py3(self):
- with testrun_cqlsh(tty=True, env=self.default_env) as c:
- self.assertNotIn('Python 2.7 support is deprecated.', c.output_header, 'cqlsh did not output expected warning.')
-
@unittest.skipIf(sys.platform == "win32", 'EOF signaling not supported on Windows')
def test_eof_prints_newline(self):
with testrun_cqlsh(tty=True, env=self.default_env) as c:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org