You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "László Bodor (Jira)" <ji...@apache.org> on 2026/10/06 09:18:00 UTC
[jira] [Comment Edited] (HIVE-30137) Deploy Hive SNAPSHOT artifacts on every commit on master
[ https://issues.apache.org/jira/browse/HIVE-30137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18123682#comment-18123682 ]
László Bodor edited comment on HIVE-30137 at 10/6/26 9:17 AM:
--------------------------------------------------------------
created job:
https://ci-hadoop.apache.org/job/Hive-qbt-master-snapshots
with pipeline script (sharing here as it doesn't reveal secrets, all of them are inherited within the Jenkins instance):
{code}
#!/usr/bin/env bash
# Build and deploy Hive snapshot artifacts to the ASF snapshot repository.
set -euo pipefail
export TOOLS_HOME=${TOOLS_HOME:-/home/jenkins/tools}
export MAVEN_HOME=${MAVEN_HOME:-${TOOLS_HOME}/maven/latest}
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}
export PATH=${JAVA_HOME}/bin:${MAVEN_HOME}/bin:$PATH
BASEDIR=${BASEDIR:-${WORKSPACE}/sourcedir}
ARTIFACTS=${ARTIFACTS:-${WORKSPACE}/out}
# Persisted between runs on purpose: wiping it forces a full re-download.
LOCAL_REPO=${LOCAL_REPO:-${WORKSPACE}/.m2/repository}
rm -rf "${ARTIFACTS}"
mkdir -p "${ARTIFACTS}" "${LOCAL_REPO}"
MVN_ARGS=(
-B -ntp -e
-Dmaven.repo.local="${LOCAL_REPO}"
-DskipTests # tests still COMPILE: many modules publish test-jars
-Dmaven.javadoc.skip=true
-DdeployAtEnd=true # all-or-nothing: nothing is pushed until the reactor passes
-DretryFailedDeploymentCount=10
-Dmaven.wagon.http.retryHandler.count=3
-Dmaven.wagon.httpconnectionManager.ttlSeconds=120
)
# Credentials for server id 'apache.snapshots.https' (from the org.apache:apache:35 parent).
if [[ -n ${MAVEN_SETTINGS:-} ]]; then
MVN_ARGS+=(--settings "${MAVEN_SETTINGS}")
fi
# The packaging module only builds the binary tarball; set SKIP_PACKAGING=1 to drop it.
if [[ ${SKIP_PACKAGING:-0} == 1 ]]; then
MVN_ARGS+=(-pl '!packaging')
fi
cd "${BASEDIR}"
java -version
mvn --version
mvn clean deploy "${MVN_ARGS[@]}" 2>&1 | tee "${ARTIFACTS}/deploy.log"
{code}
output of the successful job is:
[^deploy.log.txt]
was (Author: abstractdog):
created job:
https://ci-hadoop.apache.org/job/Hive-qbt-master-snapshots
with pipeline script (sharing here as it doesn't reveal secrets, all of them are inherited within the Jenkins instance):
{code}
#!/usr/bin/env bash
# Build and deploy Hive snapshot artifacts to the ASF snapshot repository.
set -euo pipefail
export TOOLS_HOME=${TOOLS_HOME:-/home/jenkins/tools}
export MAVEN_HOME=${MAVEN_HOME:-${TOOLS_HOME}/maven/latest}
export JAVA_HOME=${JAVA_HOME:-/usr/lib/jvm/java-21-openjdk-amd64}
export PATH=${JAVA_HOME}/bin:${MAVEN_HOME}/bin:$PATH
BASEDIR=${BASEDIR:-${WORKSPACE}/sourcedir}
ARTIFACTS=${ARTIFACTS:-${WORKSPACE}/out}
# Persisted between runs on purpose: wiping it forces a full re-download.
LOCAL_REPO=${LOCAL_REPO:-${WORKSPACE}/.m2/repository}
rm -rf "${ARTIFACTS}"
mkdir -p "${ARTIFACTS}" "${LOCAL_REPO}"
MVN_ARGS=(
-B -ntp -e
-Dmaven.repo.local="${LOCAL_REPO}"
-DskipTests # tests still COMPILE: many modules publish test-jars
-Dmaven.javadoc.skip=true
-DdeployAtEnd=true # all-or-nothing: nothing is pushed until the reactor passes
-DretryFailedDeploymentCount=10
-Dmaven.wagon.http.retryHandler.count=3
-Dmaven.wagon.httpconnectionManager.ttlSeconds=120
)
# Credentials for server id 'apache.snapshots.https' (from the org.apache:apache:35 parent).
if [[ -n ${MAVEN_SETTINGS:-} ]]; then
MVN_ARGS+=(--settings "${MAVEN_SETTINGS}")
fi
# The packaging module only builds the binary tarball; set SKIP_PACKAGING=1 to drop it.
if [[ ${SKIP_PACKAGING:-0} == 1 ]]; then
MVN_ARGS+=(-pl '!packaging')
fi
cd "${BASEDIR}"
java -version
mvn --version
mvn clean deploy "${MVN_ARGS[@]}" 2>&1 | tee "${ARTIFACTS}/deploy.log"
{code}
> Deploy Hive SNAPSHOT artifacts on every commit on master
> --------------------------------------------------------
>
> Key: HIVE-30137
> URL: https://issues.apache.org/jira/browse/HIVE-30137
> Project: Hive
> Issue Type: Improvement
> Reporter: László Bodor
> Assignee: László Bodor
> Priority: Major
> Attachments: deploy.log.txt
>
>
> The goal is to have Hive SNAPSHOT artifacts here: https://repository.apache.org/content/repositories/snapshots/org/apache/hive/hive-exec/ (last one is 1.3.0-SNAPSHOT)
> Given an official Jenkins build instance having the needed credentials: https://ci-hadoop.apache.org/
> Similar to Tez job: https://ci-hadoop.apache.org/job/Tez-qbt-0.10-snapshots/
> A possible challenge is that Hive doesn't utilize Yetus, hence doesn't have a corresponding Yetus file, so the build script should be a standalone mvn command and its dependencies.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)