You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@geode.apache.org by mh...@apache.org on 2020/02/21 23:51:26 UTC
[geode] branch mass-test-run updated (efc3b3b -> f33ace4)
This is an automated email from the ASF dual-hosted git repository.
mhanson pushed a change to branch mass-test-run
in repository https://gitbox.apache.org/repos/asf/geode.git.
discard efc3b3b remove meta-* jobs that we won't use for mass-test-run
discard f402ad1 Mass-test-run branch, no windows or publication jobs
add 1a0d976 GEODE-7727: modify sender thread to detect release of connection (#4629)
add 9f8a2ff GEODE-7800: Add Redis PSUBSCRIBE and PUNSUBSCRIBE commands (#4705)
add 7bde96a Fix for failing Postgres connector acceptance test (#4712)
add 54890b3 GEODE-7746: onServers function throws a NPE if the distributed system is shutdown (#4690)
add 71fafc8 Feature/geode 7796: CI hang in LocatorDUnitTest.testCrashLocatorMultipleTimes (#4706)
add 1befce1 GEODE-7798: Fix flaky PubSub test (#4714)
add 9ad6417 GEODE-7773: remove redundant addAll command (#4703)
add e2905f4 GEODE-7770: remove unused cache reference (#4700)
add d6c1497 GEODE-7769: use parseFloat instead of valueOf (#4699)
add bf3e280 GEODE-7768: remove redundant null checks (#4701)
add 2dae396 GEODE-7798: Ignore PubSubTest until the flakiness can be removed (#4721)
add b3d4458 GEODE-7774: Remove addAll in ReflectionLuceneSerializer (#4718)
add d5d3c78 GEODE-7550: Param to only list gw receivers or senders (#4429)
add 22403e0 GEODE-7799: Distribute rebalance status to other locators (#4692)
add b430b8b GEODE-7513: Fix PersistentColocatedPartitionedRegionDistributedTest (#4715)
add aff1549 GEODE-7635: Create DestroyRegionDuringGIIDistributedTest
new ec5465d Mass-test-run branch, no windows or publication jobs
new f33ace4 remove meta-* jobs that we won't use for mass-test-run
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (efc3b3b)
\
N -- N -- N refs/heads/mass-test-run (f33ace4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../util/ClientServerSessionCacheDUnitTest.java | 4 +-
.../modules/session/bootstrap/AbstractCache.java | 4 +-
.../geode/modules/util/BootstrappingFunction.java | 3 +-
.../ClusterManagementServiceBuilderDUnitTest.java | 7 +-
.../ClientClusterManagementServiceDunitTest.java | 13 +-
.../rest/RebalanceManagementDunitTest.java | 119 ++--
.../geode/connectors/jdbc/internal/postgres.yml | 1 +
.../org/apache/geode/connectors/jdbc/postgres.yml | 1 +
.../apache/geode/distributed/LocatorDUnitTest.java | 5 +-
.../DestroyRegionDuringGIIDistributedTest.java | 787 +++++++++++++++++++++
...tColocatedPartitionedRegionDistributedTest.java | 18 +-
.../geode/internal/tcp/TCPConduitDUnitTest.java | 42 ++
...butedSystemMXBeanWithAlertsDistributedTest.java | 1 +
.../apache/geode/codeAnalysis/excludedClasses.txt | 1 -
.../java/org/apache/geode/cache/RegionFactory.java | 9 +-
.../cache/client/internal/ExecuteFunctionOp.java | 4 +
.../distributed/internal/DistributionImpl.java | 2 +-
.../internal/InternalDistributedSystem.java | 11 +-
.../distributed/internal/InternalLocator.java | 49 +-
.../internal/admin/remote/RemoteApplicationVM.java | 2 +-
.../admin/statalerts/DummyStatisticInfoImpl.java | 2 +-
.../admin/statalerts/StatisticInfoImpl.java | 2 +-
.../apache/geode/internal/cache/FilterProfile.java | 2 +-
.../internal/cache/PartitionedRegionHelper.java | 2 +-
.../geode/internal/cache/RegionFactoryImpl.java | 30 +-
.../geode/internal/cache/TXCommitMessage.java | 2 +-
.../apache/geode/internal/cache/TXEntryState.java | 2 +-
.../org/apache/geode/internal/cache/TXState.java | 2 +-
.../cache/tier/sockets/HAEventWrapper.java | 2 +-
.../cache/versions/RegionVersionHolder.java | 2 +-
.../org/apache/geode/internal/tcp/Connection.java | 18 +-
.../apache/geode/internal/tcp/ConnectionTable.java | 12 +
.../api/LocatorClusterManagementService.java | 124 ++--
.../geode/management/internal/i18n/CliStrings.java | 8 +
.../operation/OperationHistoryManager.java | 155 ++--
.../internal/operation/OperationManager.java | 43 +-
.../internal/operation/OperationState.java | 96 +++
.../internal/operation/OperationStateStore.java | 61 ++
.../operation/RegionOperationStateStore.java | 116 +++
.../org/apache/geode/pdx/internal/PdxField.java | 2 +-
.../org/apache/geode/pdx/internal/PdxType.java | 2 +-
.../sanctioned-geode-core-serializables.txt | 1 +
.../sanctioned-geode-management-serializables.txt | 5 +-
.../internal/cache/RegionFactoryImplTest.java | 75 ++
.../api/LocatorClusterManagementServiceTest.java | 64 +-
.../operation/OperationHistoryManagerTest.java | 227 +++---
.../internal/operation/OperationManagerTest.java | 188 +++--
.../internal/operation/OperationStateTest.java | 117 +++
.../operation/RegionOperationStateStoreTest.java | 172 +++++
.../gfsh/command-pages/list.html.md.erb | 6 +-
.../geode/cache30/MultiVMRegionTestCase.java | 409 -----------
.../geode/test/dunit/rules/CacheXmlRule.java | 230 ++++++
.../geode/test/dunit/rules/ClusterStartupRule.java | 4 +-
.../geode/test/greplogs/ExpectedStrings.java | 1 -
.../cli/commands/DescribeMemberCommand.java | 2 +-
.../internal/cli/commands/ListGatewayCommand.java | 63 +-
.../main/java/org/apache/geode/DeltaTestImpl.java | 2 +-
.../geode/cache/query/data/PortfolioData.java | 2 +-
.../lucene/internal/LuceneRegionListener.java | 6 +-
.../cache/lucene/internal/LuceneServiceImpl.java | 2 +-
.../internal/cli/LuceneListIndexCommand.java | 3 +-
.../serializer/ReflectionLuceneSerializer.java | 3 +-
.../internal/LuceneRegionListenerJUnitTest.java | 2 +-
.../api/ClusterManagementListOperationsResult.java | 14 +-
.../management/api/ClusterManagementOperation.java | 7 +-
.../api/ClusterManagementOperationResult.java | 100 ++-
.../management/api/ClusterManagementService.java | 30 +-
.../api/ClusterManagementServiceTransport.java | 28 +-
...tTemplateClusterManagementServiceTransport.java | 128 ++--
.../internal/ClientClusterManagementService.java | 71 +-
.../ClusterManagementOperationStatusResult.java | 74 --
.../internal/CompletableFutureProxy.java | 116 ---
.../internal/api/BaseManagementServiceBuilder.java | 1 +
.../management/operation/RebalanceOperation.java | 11 +
.../geode/management/runtime/OperationResult.java | 4 +-
.../management/runtime/RebalanceRegionResult.java | 4 +-
.../api/ClusterManagementOperationResultTest.java | 30 +-
...plateClusterManagementServiceTransportTest.java | 129 ++++
.../ClusterManagementServiceBuilderTest.java | 7 +-
.../ClientClusterManagementServiceTest.java | 227 ++++++
...ClusterManagementOperationStatusResultTest.java | 63 --
.../internal/membership/gms/GMSMemberData.java | 2 +-
.../internal/membership/gms/GMSMembership.java | 6 +-
.../gms/locator/MembershipLocatorImpl.java | 7 +-
.../java/org/apache/geode/redis/PubSubTest.java | 218 +++---
.../apache/geode/redis/mocks/MockSubscriber.java | 14 +-
.../org/apache/geode/redis/GeodeRedisServer.java | 3 +-
.../{Subscriber.java => AbstractSubscription.java} | 46 +-
.../{Client.java => ChannelSubscription.java} | 38 +-
.../org/apache/geode/redis/internal/Client.java | 2 +-
.../{Client.java => PatternSubscription.java} | 38 +-
.../org/apache/geode/redis/internal/PubSub.java | 21 +
.../apache/geode/redis/internal/PubSubImpl.java | 91 ++-
.../apache/geode/redis/internal/PublishResult.java | 25 +-
.../geode/redis/internal/RedisCommandType.java | 56 ++
.../internal/{Client.java => Subscription.java} | 56 +-
.../apache/geode/redis/internal/Subscriptions.java | 84 +++
.../executor/pubsub/PsubscribeExecutor.java | 70 ++
.../internal/executor/pubsub/PublishExecutor.java | 4 +-
...lishExecutor.java => PunsubscribeExecutor.java} | 45 +-
.../internal/org/apache/hadoop/fs/GlobPattern.java | 18 +
.../sanctioned-geode-redis-serializables.txt | 2 +
.../geode/redis/internal/PubSubImplJUnitTest.java | 52 ++
.../geode/redis/internal/SubscriptionsTest.java | 170 +++++
.../distributed/internal/tcpserver/TcpServer.java | 4 +-
.../wancommand/ListGatewaysCommandDUnitTest.java | 126 ++++
.../ClientClusterManagementServiceDUnitTest.java | 3 +-
.../internal/rest/RebalanceIntegrationTest.java | 16 +-
.../RebalanceOperationControllerSpringTest.java | 13 +-
.../controllers/RebalanceOperationController.java | 41 +-
110 files changed, 3913 insertions(+), 1754 deletions(-)
create mode 100644 geode-core/src/distributedTest/java/org/apache/geode/internal/cache/DestroyRegionDuringGIIDistributedTest.java
create mode 100644 geode-core/src/main/java/org/apache/geode/management/internal/operation/OperationState.java
create mode 100644 geode-core/src/main/java/org/apache/geode/management/internal/operation/OperationStateStore.java
create mode 100644 geode-core/src/main/java/org/apache/geode/management/internal/operation/RegionOperationStateStore.java
create mode 100644 geode-core/src/test/java/org/apache/geode/internal/cache/RegionFactoryImplTest.java
create mode 100644 geode-core/src/test/java/org/apache/geode/management/internal/operation/OperationStateTest.java
create mode 100644 geode-core/src/test/java/org/apache/geode/management/internal/operation/RegionOperationStateStoreTest.java
create mode 100644 geode-dunit/src/main/java/org/apache/geode/test/dunit/rules/CacheXmlRule.java
delete mode 100644 geode-management/src/main/java/org/apache/geode/management/internal/ClusterManagementOperationStatusResult.java
delete mode 100644 geode-management/src/main/java/org/apache/geode/management/internal/CompletableFutureProxy.java
create mode 100644 geode-management/src/test/java/org/apache/geode/management/api/RestTemplateClusterManagementServiceTransportTest.java
create mode 100644 geode-management/src/test/java/org/apache/geode/management/internal/ClientClusterManagementServiceTest.java
delete mode 100644 geode-management/src/test/java/org/apache/geode/management/internal/ClusterManagementOperationStatusResultTest.java
rename geode-redis/src/main/java/org/apache/geode/redis/internal/{Subscriber.java => AbstractSubscription.java} (68%)
copy geode-redis/src/main/java/org/apache/geode/redis/internal/{Client.java => ChannelSubscription.java} (55%)
copy geode-redis/src/main/java/org/apache/geode/redis/internal/{Client.java => PatternSubscription.java} (53%)
rename geode-core/src/main/java/org/apache/geode/management/internal/operation/TaggedWithOperator.java => geode-redis/src/main/java/org/apache/geode/redis/internal/PublishResult.java (58%)
copy geode-redis/src/main/java/org/apache/geode/redis/internal/{Client.java => Subscription.java} (54%)
create mode 100644 geode-redis/src/main/java/org/apache/geode/redis/internal/Subscriptions.java
create mode 100644 geode-redis/src/main/java/org/apache/geode/redis/internal/executor/pubsub/PsubscribeExecutor.java
copy geode-redis/src/main/java/org/apache/geode/redis/internal/executor/pubsub/{PublishExecutor.java => PunsubscribeExecutor.java} (53%)
create mode 100644 geode-redis/src/test/java/org/apache/geode/redis/internal/PubSubImplJUnitTest.java
create mode 100644 geode-redis/src/test/java/org/apache/geode/redis/internal/SubscriptionsTest.java
[geode] 01/02: Mass-test-run branch, no windows or publication jobs
Posted by mh...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mhanson pushed a commit to branch mass-test-run
in repository https://gitbox.apache.org/repos/asf/geode.git
commit ec5465dc7d98b960623d630af835c59021f01382
Author: Robert Houghton <rh...@pivotal.io>
AuthorDate: Mon Jan 27 15:20:46 2020 -0800
Mass-test-run branch, no windows or publication jobs
Co-authored-by: Robert Houghton <rh...@pivotal.io>
Co-authored-by: Mark Hanson <mh...@pivotal.io>
---
ci/pipelines/geode-build/jinja.template.yml | 310 +---------------------------
ci/pipelines/shared/jinja.variables.yml | 77 +------
2 files changed, 9 insertions(+), 378 deletions(-)
diff --git a/ci/pipelines/geode-build/jinja.template.yml b/ci/pipelines/geode-build/jinja.template.yml
index da6e399..f9dcbda 100644
--- a/ci/pipelines/geode-build/jinja.template.yml
+++ b/ci/pipelines/geode-build/jinja.template.yml
@@ -92,66 +92,6 @@ GRADLE_GLOBAL_ARGS: ((gradle-global-args))
{%- endfor -%}
{% endmacro %}
-groups:
-- name: main
- jobs:
- - {{ build_test.name }}
- {{- all_gating_jobs() | indent(2) }}
- - UpdatePassingTokens
- {%- if repository.upstream_fork != "apache" or repository.branch == "develop" %}
- - PublishArtifacts
- {%- endif %}
- {%- for flavor in (benchmarks.flavors) %}
- - Benchmark{{flavor.title}}
- {%- endfor %}
-- name: complete
- jobs:
- - {{ build_test.name }}
- {%- for test in (tests) if not test.name=="StressNew" -%}
- {%- for java_test_version in (java_test_versions) %}
- - {{test.name}}Test{{java_test_version.name}}
- {%- endfor -%}
- {%- endfor %}
- - UpdatePassingTokens
- {%- if repository.upstream_fork != "apache" or repository.branch == "develop" %}
- - PublishArtifacts
- {%- endif %}
- {%- for flavor in (benchmarks.flavors) %}
- - Benchmark{{flavor.title}}
- {%- endfor %}
-- name: linux
- jobs:
- - {{ build_test.name }}
- {%- for test in (tests) if test.PLATFORM=="linux" and not test.name=="StressNew" -%}
- {% for java_test_version in (java_test_versions) %}
- - {{test.name}}Test{{java_test_version.name}}
- {%- endfor -%}
- {%- endfor %}
- {%- for flavor in (benchmarks.flavors) %}
- - Benchmark{{flavor.title}}
- {%- endfor %}
-- name: windows
- jobs:
- - {{ build_test.name }}
- {%- for test in (tests) if test.PLATFORM=="windows" -%}
- {% for java_test_version in (java_test_versions) %}
- - {{test.name}}Test{{java_test_version.name}}
- {%- endfor -%}
- {%- endfor %}
-{%- for java_test_version in (java_test_versions) %}
-- name: {{java_test_version.name}}
- jobs:
- - {{ build_test.name }}
- {%- for test in (tests) if not test.name=="StressNew" %}
- - {{test.name}}Test{{java_test_version.name}}
- {%- endfor -%}
-{%- endfor %}
-- name: Semver Management
- jobs:
- {%- for semverPiece in ['major', 'minor', 'patch'] %}
- - Bump{{ semverPiece.title() }}
- {%- endfor %}
-
resources:
- name: concourse-metadata-resource
type: concourse-metadata-resource
@@ -173,12 +113,7 @@ resources:
paths:
- ci/*
{{ github_access() | indent(4) }}
-- name: geode-benchmarks
- type: git
- source:
- branch: {{benchmarks.benchmark_branch}}
- depth: 1
- uri: https://github.com/apache/geode-benchmarks.git
+
- name: geode-build-version
type: semver
source:
@@ -187,12 +122,7 @@ resources:
initial_version: {{ metadata.initial_version }}
json_key: ((!concourse-gcp-key))
key: semvers/((pipeline-prefix))((geode-build-branch))/version
-- name: geode-passing-tokens
- type: gcs-resource
- source:
- bucket: ((artifact-bucket))
- json_key: ((concourse-gcp-key))
- versioned_file: semvers/((pipeline-prefix))((geode-build-branch))/passing-build-tokens.json
+
- name: alpine-tools-image
type: docker-image
source:
@@ -201,12 +131,6 @@ resources:
repository: gcr.io/((gcp-project))/((pipeline-prefix))alpine-tools
tag: latest
-- name: windows-builder-image-family
- type: gci
- source:
- key: ((concourse-gcp-key))
- family_project: ((gcp-project))
- family: ((pipeline-prefix))windows-geode-builder
- name: linux-builder-image-family
type: gci
@@ -233,16 +157,8 @@ resource_types:
source:
repository: frodenas/gcs-resource
jobs:
-{% for semverPiece in ['major', 'minor', 'patch'] -%}
-- name: Bump{{ semverPiece.title() }}
- serial: true
- plan:
- - get: geode-build-version
- params: { bump: {{ semverPiece }} }
- - put: geode-build-version
- params:
- file: geode-build-version/number
-{% endfor %}
+
+
- name: {{build_test.name}}
public: true
max_in_flight: {{build_test.MAX_IN_FLIGHT}}
@@ -388,224 +304,6 @@ jobs:
- name: instance-data
timeout: 1h
-- name: UpdatePassingTokens
- public: true
- serial: true
- plan:
- - aggregate:
- - get: alpine-tools-image
- - get: geode
- passed: &update-token-passed-anchor
-{%- if repository.upstream_fork != "apache" or repository.branch == "develop" %}
- - PublishArtifacts
-{% else %}
- {% for flavor in (benchmarks.flavors) %}
- - Benchmark{{flavor.title}}
- {% endfor %}
-{% endif %}
- trigger: true
- - get: geode-build-version
- trigger: true
- passed: *update-token-passed-anchor
- - task: couple-sha-and-build-id
- image: alpine-tools-image
- config:
- platform: linux
- inputs:
- - name: geode
- - name: geode-build-version
- outputs:
- - name: geode-passing-tokens
- run:
- path: bash
- args:
- - -cx
- - |
- pushd geode
- GEODE_SHA=$(git rev-parse HEAD)
- popd
- GEODE_SEMVER=$(cat geode-build-version/number)
-
- GS_PATH=gs://((artifact-bucket))/semvers/((pipeline-prefix))((geode-build-branch))/passing-build-tokens.json
- CURRENT_PASSING_SHA=$(gsutil cat ${GS_PATH} | jq -r .ref)
- set -e
- # Check that the incoming GEODE_SHA is a descendent of the currently stored value.
- # Keeps us from winding back the repository in the case of an out-of-order pipeline pass
- if [ -z "${CURRENT_PASSING_SHA}" ] || (cd geode; git merge-base --is-ancestor ${CURRENT_PASSING_SHA} ${GEODE_SHA}); then
- cat > geode-passing-tokens/passing-build-tokens.json <<JSON
- {
- "ref": "${GEODE_SHA}",
- "semver": "${GEODE_SEMVER}"
- }
- JSON
- fi
- - aggregate:
- - put: geode-passing-tokens
- params:
- file: geode-passing-tokens/passing-build-tokens.json
-
-{% for run_var in (benchmarks.flavors) %}
-- name: Benchmark{{ run_var.title }}
- public: true
- max_in_flight: 3
- plan:
- - get: geode-ci
- passed:
- {{ all_gating_jobs() | indent(4) }}
- - get: alpine-tools-image
- - aggregate:
- - get: geode
- passed:
- {{ all_gating_jobs() | indent(6) }}
- trigger: true
- - get: geode-benchmarks
- - get: geode-build-version
- trigger: true
- passed:
- {{ all_gating_jobs() | indent(6) }}
- - put: concourse-metadata-resource
- - do:
- - task: run_benchmarks{{ run_var.title }}
- image: alpine-tools-image
- config:
- platform: linux
- params:
- AWS_ACCESS_KEY_ID: ((benchmarks-access-key-id))
- AWS_SECRET_ACCESS_KEY: ((benchmarks-secret-access-key))
- AWS_DEFAULT_REGION: us-west-2
- AWS_REGION: us-west-2
- ARTIFACT_BUCKET: ((artifact-bucket))
- BENCHMARKS_BRANCH: {{benchmarks.benchmark_branch}}
- BASELINE_BRANCH: {{benchmarks.baseline_branch}}
- BASELINE_VERSION: {{benchmarks.baseline_version}}
- FLAGS: {{ run_var.flag }}
- TAG_POSTFIX: {{ run_var.title }}
- TEST_OPTIONS: {{ run_var.options }}
- run:
- path: geode-ci/ci/scripts/run_benchmarks.sh
- inputs:
- - name: geode
- - name: geode-ci
- - name: geode-benchmarks
- - name: concourse-metadata-resource
- outputs:
- - name: results
- timeout: 8h
- ensure:
- do:
- - task: cleanup_benchmarks
- image: alpine-tools-image
- config:
- platform: linux
- params:
- AWS_ACCESS_KEY_ID: ((benchmarks-access-key-id))
- AWS_SECRET_ACCESS_KEY: ((benchmarks-secret-access-key))
- AWS_DEFAULT_REGION: us-west-2
- AWS_REGION: us-west-2
- ARTIFACT_BUCKET: ((artifact-bucket))
- BASELINE_BRANCH: {{benchmarks.baseline_branch}}
- BASELINE_VERSION: {{benchmarks.baseline_version}}
- FLAGS: {{ run_var.flag }}
- TAG_POSTFIX: {{ run_var.title }}
- TEST_OPTIONS: {{ run_var.options }}
- run:
- path: geode-ci/ci/scripts/cleanup_benchmarks.sh
- inputs:
- - name: geode
- - name: geode-ci
- - name: geode-benchmarks
- - name: concourse-metadata-resource
- - name: results
-{% endfor %}
-{% if repository.upstream_fork != "apache" or repository.branch == "develop" %}
-- name: PublishArtifacts
- public: true
- plan:
- - aggregate:
- - get: geode-ci
- passed: &publish-passed-inputs
- {% for flavor in (benchmarks.flavors) %}
- - Benchmark{{flavor.title}}
- {% endfor %}
- - get: alpine-tools-image
- - get: geode
- passed: *publish-passed-inputs
- trigger: true
- - get: linux-builder-image-family
- - aggregate:
- - get: geode-build-version
- trigger: true
- passed: *publish-passed-inputs
- - put: concourse-metadata-resource
- {{ init_retry()|indent(4) }}
- - task: create_instance
- image: alpine-tools-image
- config:
- platform: linux
- params:
- {{ common_instance_params(publish_artifacts) | indent(8) }}
- GEODE_BRANCH: {{repository.branch}}
- GEODE_FORK: {{repository.fork}}
- JAVA_BUILD_VERSION: {{ java_build_version.version }}
- IMAGE_FAMILY_NAME: ((pipeline-prefix))linux-geode-builder
- run:
- path: geode-ci/ci/scripts/create_instance.sh
- inputs:
- - name: concourse-metadata-resource
- - name: geode-ci
- - name: geode
- - name: attempts-log
- path: old
- outputs:
- - name: instance-data
- - name: attempts-log
- path: new
- timeout: 20m
- attempts: 5
- - task: rsync_code_up
- image: alpine-tools-image
- config:
- platform: linux
- run:
- path: geode-ci/ci/scripts/rsync_code_up.sh
- inputs:
- - name: geode-ci
- - name: geode
- - name: instance-data
- timeout: 5m
- - task: publish
- image: alpine-tools-image
- config:
- platform: linux
- params:
- MAINTENANCE_VERSION: ((geode-build-branch))
- ARTIFACT_BUCKET: ((artifact-bucket))
- SERVICE_ACCOUNT: ((!concourse-gcp-account))
- JAVA_BUILD_VERSION: {{ java_build_version.version }}
- MAVEN_SNAPSHOT_BUCKET: ((maven-snapshot-bucket))
- GRADLE_GLOBAL_ARGS: ((gradle-global-args))
- run:
- path: geode-ci/ci/scripts/execute_publish.sh
- inputs:
- - name: instance-data
- - name: geode
- - name: geode-ci
- - name: geode-build-version
- ensure:
- do:
- - task: delete_instance
- image: alpine-tools-image
- config:
- platform: linux
- run:
- path: geode-ci/ci/scripts/delete_instance.sh
- inputs:
- - name: geode-ci
- - name: instance-data
- timeout: 1h
-
-{% endif %}
-
{%- for test in tests if not test.name=="StressNew" %}
{%- set parameters = {} %}
{%- do deep_merge(parameters, test) %}
diff --git a/ci/pipelines/shared/jinja.variables.yml b/ci/pipelines/shared/jinja.variables.yml
index a82cdca..3931254 100644
--- a/ci/pipelines/shared/jinja.variables.yml
+++ b/ci/pipelines/shared/jinja.variables.yml
@@ -84,7 +84,7 @@ tests:
DUNIT_PARALLEL_FORKS: '0'
EXECUTE_TEST_TIMEOUT: 30m
GRADLE_TASK: test
- MAX_IN_FLIGHT: 1
+ MAX_IN_FLIGHT: 5
PARALLEL_DUNIT: 'false'
PARALLEL_GRADLE: 'true'
PLATFORM: linux
@@ -96,7 +96,7 @@ tests:
DUNIT_PARALLEL_FORKS: '0'
EXECUTE_TEST_TIMEOUT: 1h30m
GRADLE_TASK: acceptanceTest
- MAX_IN_FLIGHT: 2
+ MAX_IN_FLIGHT: 5
PARALLEL_DUNIT: 'false'
PARALLEL_GRADLE: 'false'
PLATFORM: linux
@@ -108,7 +108,7 @@ tests:
DUNIT_PARALLEL_FORKS: '24'
EXECUTE_TEST_TIMEOUT: 3h00m
GRADLE_TASK: distributedTest
- MAX_IN_FLIGHT: 3
+ MAX_IN_FLIGHT: 5
PARALLEL_DUNIT: 'true'
PLATFORM: linux
RAM: '250'
@@ -119,7 +119,7 @@ tests:
DUNIT_PARALLEL_FORKS: '48'
EXECUTE_TEST_TIMEOUT: 40m
GRADLE_TASK: integrationTest
- MAX_IN_FLIGHT: 1
+ MAX_IN_FLIGHT: 5
PARALLEL_DUNIT: 'true'
PLATFORM: linux
RAM: '90'
@@ -130,75 +130,8 @@ tests:
DUNIT_PARALLEL_FORKS: '48'
EXECUTE_TEST_TIMEOUT: 1h
GRADLE_TASK: upgradeTest
- MAX_IN_FLIGHT: 2
+ MAX_IN_FLIGHT: 5
PARALLEL_DUNIT: 'true'
PLATFORM: linux
RAM: '210'
name: Upgrade
-- ARTIFACT_SLUG: stressnewtestfiles
- CALL_STACK_TIMEOUT: '20700'
- CPUS: '96'
- DUNIT_PARALLEL_FORKS: '24'
- EXECUTE_TEST_TIMEOUT: 6h
- GRADLE_TASK: repeatTest
- PARALLEL_DUNIT: 'true'
- PARALLEL_GRADLE: 'false'
- PLATFORM: linux
- RAM: '280'
- name: StressNew
-- ARTIFACT_SLUG: windows-acceptancetestfiles
- CPUS: '16'
- DUNIT_PARALLEL_FORKS: '0'
- EXECUTE_TEST_TIMEOUT: 6h
- GRADLE_TASK: :geode-assembly:acceptanceTest
- MAX_IN_FLIGHT: 3
- PARALLEL_DUNIT: 'false'
- PARALLEL_GRADLE: 'false'
- PLATFORM: windows
- RAM: '64'
- name: WindowsAcceptance
-- ARTIFACT_SLUG: windows-gfshdistributedtest
- CPUS: '16'
- DUNIT_PARALLEL_FORKS: '0'
- EXECUTE_TEST_TIMEOUT: 6h
- GRADLE_TASK: distributedTest
- GRADLE_TASK_OPTIONS: -PtestCategory=org.apache.geode.test.junit.categories.GfshTest
- MAX_IN_FLIGHT: 5
- PARALLEL_DUNIT: 'false'
- PARALLEL_GRADLE: 'false'
- PLATFORM: windows
- RAM: '64'
- name: WindowsGfshDistributed
-- ARTIFACT_SLUG: windows-integrationtestfiles
- CPUS: '16'
- DUNIT_PARALLEL_FORKS: '0'
- EXECUTE_TEST_TIMEOUT: 6h
- GRADLE_TASK: integrationTest
- GRADLE_TASK_OPTIONS: -x geode-core:integrationTest
- MAX_IN_FLIGHT: 2
- PARALLEL_DUNIT: 'false'
- PARALLEL_GRADLE: 'false'
- PLATFORM: windows
- RAM: '64'
- name: WindowsIntegration
-- ARTIFACT_SLUG: windows-coreintegrationtestfiles
- CPUS: '16'
- DUNIT_PARALLEL_FORKS: '0'
- EXECUTE_TEST_TIMEOUT: 6h
- GRADLE_TASK: geode-core:integrationTest
- MAX_IN_FLIGHT: 6
- PARALLEL_DUNIT: 'false'
- PARALLEL_GRADLE: 'false'
- PLATFORM: windows
- RAM: '64'
- name: WindowsCoreIntegration
-- ARTIFACT_SLUG: windows-unittestfiles
- CPUS: '16'
- DUNIT_PARALLEL_FORKS: '0'
- EXECUTE_TEST_TIMEOUT: 6h
- GRADLE_TASK: test
- MAX_IN_FLIGHT: 1
- PARALLEL_DUNIT: 'false'
- PLATFORM: windows
- RAM: '64'
- name: WindowsUnit
[geode] 02/02: remove meta-* jobs that we won't use for
mass-test-run
Posted by mh...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
mhanson pushed a commit to branch mass-test-run
in repository https://gitbox.apache.org/repos/asf/geode.git
commit f33ace49671584f48683c7961970714693e6944b
Author: Mark Hanson <mh...@pivotal.io>
AuthorDate: Mon Jan 27 15:27:19 2020 -0800
remove meta-* jobs that we won't use for mass-test-run
---
ci/pipelines/meta/jinja.template.yml | 206 +----------------------------------
1 file changed, 1 insertion(+), 205 deletions(-)
diff --git a/ci/pipelines/meta/jinja.template.yml b/ci/pipelines/meta/jinja.template.yml
index 792254f..a67e377 100644
--- a/ci/pipelines/meta/jinja.template.yml
+++ b/ci/pipelines/meta/jinja.template.yml
@@ -51,13 +51,7 @@ resources:
branch: ((!geode-build-branch))
paths:
- ci/pipelines/images/*
-- name: geode-reaper-pipeline
- type: git
- source:
- {{ github_access() | indent(4) }}
- branch: ((!geode-build-branch))
- paths:
- - ci/pipelines/reaper/*
+
- name: meta-mini-dockerfile
type: git
source:
@@ -71,35 +65,6 @@ resources:
username: ((!docker-username))
password: ((!docker-password))
repository: gcr.io/((!gcp-project))/((!sanitized-geode-fork))-((!sanitized-geode-build-branch))-meta-img
-{% if repository.fork == repository.upstream_fork %}
-- name: geode-examples-pipeline
- type: git
- source:
- {{ github_access() | indent(4) }}
- branch: ((!geode-build-branch))
- paths:
- - ci/pipelines/examples/*
- - ci/pipelines/shared/*
- - ci/pipelines/render.py
- - ci/pipelines/meta/meta.properties
-- name: geode-pr-pipeline
- type: git
- source:
- {{ github_access() | indent(4) }}
- branch: ((!geode-build-branch))
- paths:
- - ci/pipelines/pull-request/*
- - ci/pipelines/shared/*
- - ci/pipelines/render.py
- - ci/pipelines/meta/meta.properties
-{% endif %}
-- name: geode-metrics-pipeline
- type: git
- source:
- {{ github_access() | indent(4) }}
- branch: ((!geode-build-branch))
- paths:
- - ci/pipelines/metrics/*
jobs:
- name: set-images-pipeline
@@ -187,175 +152,6 @@ jobs:
- results/pipeline-vars.yml
-{% if repository.fork == repository.upstream_fork %}
-- name: set-examples-pipeline
- serial: true
- public: ((!public-pipelines))
- plan:
- - get: geode-examples-pipeline
- trigger: true
- - get: meta-mini-image
- trigger: true
- passed: [build-meta-mini-docker-image]
- - task: deploy-build
- image: meta-mini-image
- config:
- platform: linux
- inputs:
- - name: geode-examples-pipeline
- outputs:
- - name: results
- params:
- OUTPUT_DIRECTORY: results
- GEODE_BRANCH: ((geode-build-branch))
- GEODE_FORK: ((geode-fork))
- GEODE_REPO_NAME: ((geode-repo-name))
- REPOSITORY_PUBLIC: {{ repository.public }}
- ARTIFACT_BUCKET: ((artifact-bucket))
- UPSTREAM_FORK: {{ repository.upstream_fork }}
- PIPELINE_PREFIX: ((pipeline-prefix))
- SANITIZED_GEODE_BRANCH: ((sanitized-geode-build-branch))
- SANITIZED_GEODE_FORK: ((sanitized-geode-fork))
- GCP_PROJECT: ((gcp-project))
- PUBLIC_PIPELINES: ((public-pipelines))
- SEMVER_PRERELEASE_TOKEN: ((semver-prerelease-token))
- run:
- path: geode-examples-pipeline/ci/pipelines/examples/deploy_pipeline.sh
- - put: concourse
- params:
- pipelines:
- - name: ((!pipeline-prefix))examples
- team: ((!concourse-team))
- config_file: results/generated-pipeline.yml
- vars_files:
- - results/pipeline-vars.yml
-
-- name: set-pr-pipeline
- serial: true
- public: ((!public-pipelines))
- plan:
- - get: geode-pr-pipeline
- trigger: true
- - get: meta-mini-image
- trigger: true
- passed: [build-meta-mini-docker-image]
- - task: deploy-pr
- image: meta-mini-image
- config:
- platform: linux
- inputs:
- - name: geode-pr-pipeline
- outputs:
- - name: results
- params:
- OUTPUT_DIRECTORY: results
- GEODE_BRANCH: ((!geode-build-branch))
- GEODE_FORK: ((!geode-fork))
- GEODE_REPO_NAME: ((geode-repo-name))
- REPOSITORY_PUBLIC: {{ repository.public }}
- ARTIFACT_BUCKET: ((artifact-bucket))
- UPSTREAM_FORK: {{ repository.upstream_fork }}
- PIPELINE_PREFIX: ((pipeline-prefix))
- GCP_PROJECT: ((gcp-project))
- PUBLIC_PIPELINES: ((public-pipelines))
- GRADLE_GLOBAL_ARGS: ((gradle-global-args))
- run:
- path: geode-pr-pipeline/ci/pipelines/pull-request/deploy_pr_pipeline.sh
- - put: concourse
- params:
- pipelines:
- - name: ((!pipeline-prefix))pr
- team: ((!concourse-team))
- config_file: results/generated-pipeline.yml
- vars_files:
- - results/pipeline-vars.yml
-
-{% endif %}
-
-- name: set-metrics-pipeline
- serial: true
- public: ((!public-pipelines))
- plan:
- - get: geode-metrics-pipeline
- trigger: true
- - get: meta-mini-image
- trigger: true
- passed: [build-meta-mini-docker-image]
- - task: create-metrics-pipeline-yml
- image: meta-mini-image
- config:
- platform: linux
- inputs:
- - name: geode-metrics-pipeline
- outputs:
- - name: results
- params:
- OUTPUT_DIRECTORY: results
- GEODE_BRANCH: ((geode-build-branch))
- GEODE_FORK: ((geode-fork))
- GEODE_REPO_NAME: ((geode-repo-name))
- REPOSITORY_PUBLIC: {{ repository.public }}
- ARTIFACT_BUCKET: ((artifact-bucket))
- UPSTREAM_FORK: {{ repository.upstream_fork }}
- PIPELINE_PREFIX: ((pipeline-prefix))
- SANITIZED_GEODE_BRANCH: ((sanitized-geode-build-branch))
- SANITIZED_GEODE_FORK: ((sanitized-geode-fork))
- GCP_PROJECT: ((gcp-project))
- PUBLIC_PIPELINES: ((public-pipelines))
- CONCOURSE_URL: ((concourse-url))
- CONCOURSE_HOST: ((concourse-host))
- CONCOURSE_TEAM: ((concourse-team))
- run:
- path: geode-metrics-pipeline/ci/pipelines/metrics/deploy_metrics_pipeline.sh
- - put: concourse
- params:
- pipelines:
- - name: ((!pipeline-prefix))metrics
- team: ((!concourse-team))
- config_file: results/generated-pipeline.yml
- vars_files:
- - results/pipeline-vars.yml
-
-- name: set-reaper-pipeline
- serial: true
- public: ((!public-pipelines))
- plan:
- - get: geode-reaper-pipeline
- trigger: true
- - get: meta-mini-image
- trigger: true
- passed: [build-meta-mini-docker-image]
- - task: create-image-yml
- image: meta-mini-image
- config:
- platform: linux
- inputs:
- - name: geode-reaper-pipeline
- outputs:
- - name: results
- params:
- OUTPUT_DIRECTORY: results
- GEODE_BRANCH: ((geode-build-branch))
- GEODE_FORK: ((geode-fork))
- GEODE_REPO_NAME: ((geode-repo-name))
- REPOSITORY_PUBLIC: {{ repository.public }}
- UPSTREAM_FORK: {{ repository.upstream_fork }}
- PIPELINE_PREFIX: ((pipeline-prefix))
- SANITIZED_GEODE_BRANCH: ((sanitized-geode-build-branch))
- SANITIZED_GEODE_FORK: ((sanitized-geode-fork))
- GCP_PROJECT: ((gcp-project))
- PUBLIC_PIPELINES: ((public-pipelines))
- run:
- path: geode-reaper-pipeline/ci/pipelines/reaper/deploy_reaper_pipeline.sh
- - put: concourse
- params:
- pipelines:
- - name: ((!pipeline-prefix))reaper
- team: ((!concourse-team))
- config_file: results/generated-pipeline.yml
- vars_files:
- - results/pipeline-vars.yml
-
- name: build-meta-mini-docker-image
public: ((!public-pipelines))
serial: true