You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@flink.apache.org by ch...@apache.org on 2022/11/14 09:27:29 UTC
[flink-connector-elasticsearch] branch v3.0 updated (b32f832 -> 7d4eb8d)
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a change to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git
from b32f832 [FLINK-29958][docs] Use connector_artifact shortcode
new ee70363 [hotfix] Use official version of release scripts
new d098736 [FLINK-29935][ci] Make ci.yml reusable
new 19c32d1 [FLINK-29935][ci] Setup weekly run against 1.16/1.17-SNAPSHOT
new 7d4eb8d [FLINK-29935][ci] Setup weekly run against 1.16-SNAPSHOT
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.github/workflows/ci.yml | 28 ++++++++++++++++------
.../workflows/push_pr.yml | 19 +++++++--------
.../workflows/weekly.yml | 24 +++++++++++--------
.gitmodules | 2 +-
tools/releasing/shared | 2 +-
5 files changed, 46 insertions(+), 29 deletions(-)
copy flink-connector-elasticsearch-base/src/test/resources/log4j2-test.properties => .github/workflows/push_pr.yml (70%)
copy flink-connector-elasticsearch6/src/test/resources/log4j2-test.properties => .github/workflows/weekly.yml (70%)
[flink-connector-elasticsearch] 04/04: [FLINK-29935][ci] Setup weekly run against 1.16-SNAPSHOT
Posted by ch...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git
commit 7d4eb8d6ac184be807c7b8900869f1f5c89ba6b4
Author: Chesnay Schepler <ch...@apache.org>
AuthorDate: Mon Nov 14 10:27:20 2022 +0100
[FLINK-29935][ci] Setup weekly run against 1.16-SNAPSHOT
---
.github/workflows/weekly.yml | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
index 260c325..4e3cb02 100644
--- a/.github/workflows/weekly.yml
+++ b/.github/workflows/weekly.yml
@@ -24,7 +24,7 @@ jobs:
compile_and_test:
strategy:
matrix:
- flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
+ flink: [1.16-SNAPSHOT]
uses: ./.github/workflows/ci.yml
with:
flink_version: ${{ matrix.flink }}
[flink-connector-elasticsearch] 02/04: [FLINK-29935][ci] Make ci.yml reusable
Posted by ch...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git
commit d098736e7aaf0f313e2ad085306dd6bb8fe87b6b
Author: Chesnay Schepler <ch...@apache.org>
AuthorDate: Tue Nov 8 13:56:33 2022 +0100
[FLINK-29935][ci] Make ci.yml reusable
---
.github/workflows/ci.yml | 28 +++++++++++++++++++++-------
.github/workflows/push_pr.yml | 27 +++++++++++++++++++++++++++
2 files changed, 48 insertions(+), 7 deletions(-)
diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml
index 2211cf1..af39b82 100644
--- a/.github/workflows/ci.yml
+++ b/.github/workflows/ci.yml
@@ -16,8 +16,22 @@
# limitations under the License.
################################################################################
-name: Build flink-connector-elasticsearch
-on: [push, pull_request]
+on:
+ workflow_call:
+ inputs:
+ flink_url:
+ description: "Url to Flink binary."
+ required: true
+ type: string
+ flink_version:
+ description: "Flink version to test against."
+ required: true
+ type: string
+ cache_flink_binary:
+ description: "Whether to cache the Flink binary. Should be false for SNAPSHOT URLs, true otherwise."
+ required: true
+ type: boolean
+
jobs:
compile_and_test:
runs-on: ubuntu-latest
@@ -26,10 +40,9 @@ jobs:
jdk: [8, 11]
timeout-minutes: 40
env:
- MVN_COMMON_OPTIONS: -U -B --no-transfer-progress
+ MVN_COMMON_OPTIONS: -U -B --no-transfer-progress -Dflink.version=${{ inputs.flink_version }}
MVN_CONNECTION_OPTIONS: -Dhttp.keepAlive=false -Dmaven.wagon.http.pool=false -Dmaven.wagon.httpconnectionManager.ttlSeconds=120
FLINK_CACHE_DIR: "/tmp/cache/flink"
- FLINK_URL: https://dist.apache.org/repos/dist/release/flink/flink-1.16.0/flink-1.16.0-bin-scala_2.12.tgz
MVN_BUILD_OUTPUT_FILE: "/tmp/mvn_build_output.out"
MVN_VALIDATION_DIR: "/tmp/flink-validation-deployment"
steps:
@@ -54,16 +67,17 @@ jobs:
run: mkdir -p ${{ env.FLINK_CACHE_DIR }}
- name: Cache Flink binary
+ if: ${{ inputs.cache_flink_binary == 'true' }}
uses: actions/cache@v3
id: cache-flink
with:
path: ${{ env.FLINK_CACHE_DIR }}
- key: ${{ env.FLINK_URL }}
+ key: ${{ inputs.flink_url }}
- name: Download Flink binary
working-directory: ${{ env.FLINK_CACHE_DIR }}
if: steps.cache-flink.outputs.cache-hit != 'true'
- run: wget -q -c ${{ env.FLINK_URL }} -O - | tar -xz
+ run: wget -q -c ${{ inputs.flink_url }} -O - | tar -xz
- name: Compile and test flink-connector-elasticsearch
timeout-minutes: 30
@@ -73,7 +87,7 @@ jobs:
mvn clean deploy ${MVN_COMMON_OPTIONS} \
-DaltDeploymentRepository=validation_repository::default::file:${{ env.MVN_VALIDATION_DIR }} \
-Dscala-2.12 \
- -Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-1.16.0 \
+ -Prun-end-to-end-tests -DdistDir=${{ env.FLINK_CACHE_DIR }}/flink-${{ inputs.flink_version }} \
-Dflink.convergence.phase=install -Pcheck-convergence \
${{ env.MVN_CONNECTION_OPTIONS }} \
-Dlog4j.configurationFile=file://$(pwd)/tools/ci/log4j.properties \
diff --git a/.github/workflows/push_pr.yml b/.github/workflows/push_pr.yml
new file mode 100644
index 0000000..45eeed0
--- /dev/null
+++ b/.github/workflows/push_pr.yml
@@ -0,0 +1,27 @@
+################################################################################
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+################################################################################
+
+name: Build flink-connector-elasticsearch
+on: [push, pull_request]
+jobs:
+ compile_and_test:
+ uses: ./.github/workflows/ci.yml
+ with:
+ flink_version: 1.16.0
+ flink_url: https://dist.apache.org/repos/dist/release/flink/flink-1.16.0/flink-1.16.0-bin-scala_2.12.tgz
+ cache_flink_binary: true
[flink-connector-elasticsearch] 03/04: [FLINK-29935][ci] Setup weekly run against 1.16/1.17-SNAPSHOT
Posted by ch...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git
commit 19c32d1cf7f60a4e8d180f2ea8b853a13a92f2fc
Author: Chesnay Schepler <ch...@apache.org>
AuthorDate: Tue Nov 8 13:57:07 2022 +0100
[FLINK-29935][ci] Setup weekly run against 1.16/1.17-SNAPSHOT
---
.github/workflows/weekly.yml | 32 ++++++++++++++++++++++++++++++++
1 file changed, 32 insertions(+)
diff --git a/.github/workflows/weekly.yml b/.github/workflows/weekly.yml
new file mode 100644
index 0000000..260c325
--- /dev/null
+++ b/.github/workflows/weekly.yml
@@ -0,0 +1,32 @@
+################################################################################
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+################################################################################
+
+name: Build flink-connector-elasticsearch
+on:
+ schedule:
+ - cron: "0 0 * * 0"
+jobs:
+ compile_and_test:
+ strategy:
+ matrix:
+ flink: [1.16-SNAPSHOT, 1.17-SNAPSHOT]
+ uses: ./.github/workflows/ci.yml
+ with:
+ flink_version: ${{ matrix.flink }}
+ flink_url: https://s3.amazonaws.com/flink-nightly/flink-${{ matrix.flink }}-bin-scala_2.12.tgz
+ cache_flink_binary: false
[flink-connector-elasticsearch] 01/04: [hotfix] Use official version of release scripts
Posted by ch...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
chesnay pushed a commit to branch v3.0
in repository https://gitbox.apache.org/repos/asf/flink-connector-elasticsearch.git
commit ee70363e12f3218aa7489f99087b826b736ba740
Author: Chesnay Schepler <ch...@apache.org>
AuthorDate: Thu Nov 10 13:27:42 2022 +0100
[hotfix] Use official version of release scripts
---
.gitmodules | 2 +-
tools/releasing/shared | 2 +-
2 files changed, 2 insertions(+), 2 deletions(-)
diff --git a/.gitmodules b/.gitmodules
index 0036e26..e5d40f3 100644
--- a/.gitmodules
+++ b/.gitmodules
@@ -1,4 +1,4 @@
[submodule "tools/releasing/shared"]
path = tools/releasing/shared
- url = https://github.com/zentol/flink-connector-shared-utils
+ url = https://github.com/apache/flink-connector-shared-utils
branch = release_utils
diff --git a/tools/releasing/shared b/tools/releasing/shared
index 98f28b3..606d8b8 160000
--- a/tools/releasing/shared
+++ b/tools/releasing/shared
@@ -1 +1 @@
-Subproject commit 98f28b341e44a641220bbe2868585edcaebd7f05
+Subproject commit 606d8b8c56c3aa77e2262b25107c5f911d0ce2ac