You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@solr.apache.org by ho...@apache.org on 2022/05/10 20:11:22 UTC
[solr] branch main updated: Add script to upload maven artifacts during release (#807)
This is an automated email from the ASF dual-hosted git repository.
houston pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/solr.git
The following commit(s) were added to refs/heads/main by this push:
new 9657a409006 Add script to upload maven artifacts during release (#807)
9657a409006 is described below
commit 9657a40900681953fb6514043d12a005caaa5547
Author: Houston Putman <ho...@apache.org>
AuthorDate: Tue May 10 16:11:17 2022 -0400
Add script to upload maven artifacts during release (#807)
---
dev-tools/scripts/releaseWizard.yaml | 21 ++---
dev-tools/scripts/upload-maven.sh | 160 +++++++++++++++++++++++++++++++++++
2 files changed, 171 insertions(+), 10 deletions(-)
diff --git a/dev-tools/scripts/releaseWizard.yaml b/dev-tools/scripts/releaseWizard.yaml
index 505c8f4fdc8..2c47e66ea3b 100644
--- a/dev-tools/scripts/releaseWizard.yaml
+++ b/dev-tools/scripts/releaseWizard.yaml
@@ -704,9 +704,11 @@ groups:
vars:
logfile: '{{ [rc_folder, ''logs'', ''buildAndPushRelease.log''] | path_join }}'
git_rev: '{{ current_git_rev }}' # Note, git_rev will be recorded in todo state AFTER completion of commands
+ git_rev_short: '{{ git_rev | truncate(7,true,"") }}' # Note, git_rev_short will be recorded in todo state AFTER completion of commands
local_keys: '{% if keys_downloaded %} --local-keys "{{ [config_path, ''KEYS''] | path_join }}"{% endif %}'
persist_vars:
- - git_rev
+ - git_rev
+ - git_rev_short
commands: !Commands
root_folder: '{{ git_checkout_folder }}'
commands_text: |-
@@ -1040,6 +1042,7 @@ groups:
id: stage_maven
title: Stage the maven artifacts for publishing
vars:
+ git_sha: '{{ build_rc.git_rev_short | default("<git_sha>", True) }}'
dist_folder: solr-{{ release_version }}-RC{{ rc_number }}-rev-{{ build_rc.git_rev | default("<git_rev>", True) }}
commands: !Commands
root_folder: '{{ git_checkout_folder }}'
@@ -1047,30 +1050,28 @@ groups:
commands_text: In the source checkout do the following (note that this step will prompt you for your Apache LDAP credentials)
commands:
- !Command
- cmd: ant clean stage-maven-artifacts -Dmaven.dist.dir={{ [dist_file_path, dist_folder, 'solr', 'maven'] | path_join }} -Dm2.repository.id=apache.releases.https -Dm2.repository.url={{ m2_repository_url }}
+ cmd: bash dev-tools/scripts/upload-maven.sh -u {{ gpg.apache_id }} -v {{ release_version }} -c {{ git_sha }} -d "{{ [dist_file_path, dist_folder, 'solr', 'maven'] | path_join }}"
+ tee: true
logfile: publish_solr_maven.log
post_description: The artifacts are not published yet, please proceed with the next step to actually publish!
- !Todo
id: publish_maven
depends: stage_maven
title: Publish the staged maven artifacts
+ vars:
+ git_sha: '{{ build_rc.git_rev_short | default("<git_sha>", True) }}'
description: |
Once you have transferred all maven artifacts to repository.apache.org,
you will need to do some manual steps to actually release them to Maven Central:
- * Close the staging repository
+ * Release the Solr artifacts
. Log in to https://repository.apache.org/ with your ASF credentials
. Select "Staging Repositories" under "Build Promotion" from the navigation bar on the left
- . Select the staging repository containing the Solr artifacts
- . Click on the "Close" button above the repository list, then enter a description when prompted, e.g. "Solr {{ release_version }} RC{{ rc_number }}"
- * The system will now spend some time validating the artifacts. Grab a coke and come back.
- * Release the Solr artifacts
- . Wait and keep clicking refresh until the "Release" button becomes available
+ . Select the staging repository containing the Solr artifacts, "Apache Solr {{ release_version }} (commit {{ git_sha }})"
. Click on the "Release" button above the repository list, then enter a description when prompted, e.g. "Solr {{ release_version }}".
Maven central should show the release after a short while
links:
- - https://wiki.apache.org/lucene-java/PublishMavenArtifacts
- https://repository.apache.org/index.html
- !Todo
id: check_distribution_directory
@@ -1234,7 +1235,7 @@ groups:
Fortunately the only thing you need to change is a few variables in `pelicanconf.py`.
If you release a current latest release, change the `SOLR_LATEST_RELEASE` and `SOLR_LATEST_RELEASE_DATE`
variables.
- If you relese a bugfix release for previos version, then change the `SOLR_PREVIOUS_MAJOR_RELEASE` variable.
+ If you relese a bugfix release for previous version, then change the `SOLR_PREVIOUS_MAJOR_RELEASE` variable.
commands: !Commands
root_folder: '{{ git_website_folder }}'
commands_text: Edit pelicanconf.py to update version numbers
diff --git a/dev-tools/scripts/upload-maven.sh b/dev-tools/scripts/upload-maven.sh
new file mode 100755
index 00000000000..d74957bbe0e
--- /dev/null
+++ b/dev-tools/scripts/upload-maven.sh
@@ -0,0 +1,160 @@
+#!/usr/bin/env bash
+# Licensed to the Apache Software Foundation (ASF) under one or more
+# contributor license agreements. See the NOTICE file distributed with
+# this work for additional information regarding copyright ownership.
+# The ASF licenses this file to You under the Apache License, Version 2.0
+# (the "License"); you may not use this file except in compliance with
+# the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# Functionality forked and adapted from https://github.com/apache/spark/blob/v3.2.1/dev/create-release/release-build.sh - Apache license
+
+function LOG() {
+ local STATUS=$1
+ local MESSAGE=$2
+ echo ""
+ echo "[$(date)] ${STATUS} ${MESSAGE}"
+}
+
+function usage() {
+ cat << EOF
+Usage: dev-tools/scripts/upload-maven.sh [<options>]
+ -v The version of Solr
+ -c The commit hash for this version of Solr
+ -d Directory where the maven artifacts to upload live.
+ -u ASF Username
+
+If "ASF_PASSWORD" is not set, you will be prompted for your password.
+
+Example:
+ dev-tools/scripts/upload-maven.sh -v 9.0.0 -c asdf23 -d /tmp/release-candidate/maven -u houston
+EOF
+}
+
+while getopts ":hv:c:d:u:" opt; do
+ case ${opt} in
+ v)
+ SOLR_VERSION="$OPTARG"
+ ;;
+ c)
+ COMMIT_HASH="$OPTARG"
+ ;;
+ d)
+ MAVEN_DIRECTORY="$OPTARG"
+ ;;
+ u)
+ ASF_USERNAME="$OPTARG"
+ ;;
+ h)
+ usage
+ exit 0
+ ;;
+ \?)
+ echo "Unknown option $OPTARG"
+ usage
+ exit 1
+ esac
+done
+shift $((OPTIND -1))
+
+if [[ -z "$SOLR_VERSION" ]]; then
+ LOG ERROR "Lacking -v option, must specify Solr version."
+ usage
+ exit 1
+fi
+
+if [[ -z "$COMMIT_HASH" ]]; then
+ LOG ERROR "Lacking -c option, must specify Commit Hash."
+ usage
+ exit 1
+fi
+
+if [[ -z "$MAVEN_DIRECTORY" ]]; then
+ LOG ERROR "Lacking -d option, must specify directory where maven artifacts live."
+ usage
+ exit 1
+fi
+
+if [[ -z "$ASF_USERNAME" ]]; then
+ LOG ERROR 'Lacking -u option or ASF_USERNAME envVar, must specify ASF Username to upload artifacts.'
+ usage
+ exit 1
+fi
+
+if [[ -z "$ASF_PASSWORD" ]]; then
+ LOG INFO 'The environment variable ASF_PASSWORD is not set.'
+ stty -echo
+ echo ""
+ echo "Please provide ${ASF_USERNAME}'s ASF Password:"
+ read -r ASF_PASSWORD
+ stty echo
+ printf "\n"
+fi
+
+NEXUS_ROOT=https://repository.apache.org/service/local/staging
+NEXUS_PROFILE=4bfe5196a41e63 # Profile for Solr staging uploads
+
+# Using Nexus API documented here:
+# https://support.sonatype.com/entries/39720203-Uploading-to-a-Staging-Repository-via-REST-API
+
+function create_staging_repo() {
+ repo_request="<promoteRequest><data><description>Apache Solr ${SOLR_VERSION} (commit ${COMMIT_HASH})</description></data></promoteRequest>"
+ out="$(curl -X POST -d "${repo_request}" -u "${ASF_USERNAME}:${ASF_PASSWORD}" \
+ -H "Content-Type:application/xml" -v \
+ "${NEXUS_ROOT}/profiles/${NEXUS_PROFILE}/start")"
+ # shellcheck disable=SC2001
+ staged_repo_id="$(echo "${out}" | tr -d '\n' | tr -d '\r' | sed -e "s/.*\(orgapachesolr-[0-9]\{4\}\).*/\1/")"
+ echo "${staged_repo_id}"
+}
+
+function finalize_staging_repo() {
+ STAGING_REPO_ID="$1"
+ repo_request="<promoteRequest><data><stagedRepositoryId>${STAGING_REPO_ID}</stagedRepositoryId><description>Apache Solr ${SOLR_VERSION} (commit ${COMMIT_HASH})</description></data></promoteRequest>"
+ out=$(curl -X POST -d "${repo_request}" -u "${ASF_USERNAME}:${ASF_PASSWORD}" \
+ -H "Content-Type:application/xml" -v \
+ "${NEXUS_ROOT}/profiles/${NEXUS_PROFILE}/finish")
+}
+
+LOG "INFO" "Creating Nexus staging repository"
+printf "\n\n"
+STAGING_REPO_ID="$(create_staging_repo)"
+if [[ -z "${STAGING_REPO_ID}" ]]; then
+ LOG ERROR "Error creating staging repo, please debug using the curl output logged above."
+ exit 1
+fi
+LOG "INFO" "Staging repo created with id: ${STAGING_REPO_ID}"
+
+printf "\n\n"
+LOG "INFO" "Uploading files to Nexus staging repository"
+printf "\n\n"
+(
+ cd "${MAVEN_DIRECTORY}" || exit 1
+
+ NEXUS_FILE_UPLOAD_URL="${NEXUS_ROOT}/deployByRepositoryId/${STAGING_REPO_ID}"
+ while IFS= read -r -d '' file
+ do
+ if [[ $file == *"maven-metadata"* ]]; then
+ continue
+ fi
+ # strip leading ./
+ file_short="${file#./}"
+ echo " Uploading ${file_short}"
+ curl -u "${ASF_USERNAME}:${ASF_PASSWORD}" --upload-file "${file_short}" "${NEXUS_FILE_UPLOAD_URL}/${file_short}"
+ done < <(find . -type f -print0)
+) || exit 1
+pwd
+
+printf "\n\n"
+LOG "INFO" "Finalizing Nexus staging repository"
+printf "\n\n"
+finalize_staging_repo "${STAGING_REPO_ID}"
+
+printf "\n\n"
+LOG "INFO" "SUCCESS on creating staging repository ${STAGING_REPO_ID} for Solr Release ${SOLR_VERSION}"