You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/10/27 15:51:56 UTC
[GitHub] [arrow] bkmgit opened a new pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
bkmgit opened a new pull request #11562:
URL: https://github.com/apache/arrow/pull/11562
Make it easier for community verification
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741822998
##########
File path: dev/tasks/verify-rc-alma/action.yml
##########
@@ -0,0 +1,34 @@
+# Licensed to the Apache Software Foundation (ASF) under one
Review comment:
Ok
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
Review comment:
Have used `setup-rhel-clones.sh`
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,26 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-Ubuntu.sh` and
+`setup-AlmaLinux-Rocky-Linux.sh`. These can be adapted to different
Review comment:
done
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
+sudo dnf -y install llvm-devel
+git clone https://github.com/apache/arrow
+cd arrow/
+dev/release/verify-release-candidate.sh source $VERSION $TYPE
Review comment:
ok
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
Review comment:
Done.
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
Review comment:
ok, can install directly.
##########
File path: dev/tasks/verify-rc-alma/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,59 @@
+#!/bin/sh -l
Review comment:
ok
##########
File path: dev/tasks/verify-rc-alma/Dockerfile
##########
@@ -0,0 +1,8 @@
+# Container image that runs
+FROM almalinux:8.4
+
+# Copy script into container
+COPY setup-AlmaLinux-Rocky-Linux.sh /setup-AlmaLinux-Rocky-Linux.sh
+
+# Execute script
+ENTRYPOINT ["/setup-AlmaLinux-Rocky-Linux.sh"]
Review comment:
Ok. Maybe a verification script for a Docker image can be created in a separate issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748740644
##########
File path: dev/release/setup-ubuntu.sh
##########
@@ -0,0 +1,33 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# A script to install dependencies required for release
+# verification on Ubuntu 20.04
+
+apt-get update
+apt-get -y install \
+ build-essential \
+ openjdk-8-jdk \
+ pkg-config \
+ maven \
+ ruby-dev \
+ cmake \
+ python3-pip \
+ ninja-build \
+ llvm-dev \
+ clang \
+ libssl-dev
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751185904
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
+ git \
+ gobject-introspection-devel \
+ java-1.8.0-openjdk-devel \
+ libcurl-devel \
+ libffi-devel \
Review comment:
libffi-devel can be dropped
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-989047506
@kou Probably ready for review as https://github.com/apache/arrow/pull/11735 has been merged
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991976245
Revision: 251c0378880c5ca8a732bf3155d1280934544c7a
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1286](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1286)
|Task|Status|
|----|------|
|verify-rc-source-cpp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-cpp-linux-almalinux-8-amd64)|
|verify-rc-source-cpp-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-cpp-linux-ubuntu-18.04-amd64)|
|verify-rc-source-cpp-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-cpp-linux-ubuntu-20.04-amd64)|
|verify-rc-source-csharp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-csharp-linux-almalinux-8-amd64)|
|verify-rc-source-csharp-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-csharp-linux-ubuntu-18.04-amd64)|
|verify-rc-source-csharp-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-csharp-linux-ubuntu-20.04-amd64)|
|verify-rc-source-go-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-go-linux-almalinux-8-amd64)|
|verify-rc-source-go-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-go-linux-ubuntu-18.04-amd64)|
|verify-rc-source-go-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-go-linux-ubuntu-20.04-amd64)|
|verify-rc-source-go-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-go-macos-amd64)|
|verify-rc-source-go-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-go-macos-arm64)|
|verify-rc-source-integration-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-integration-linux-almalinux-8-amd64)|
|verify-rc-source-integration-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-integration-linux-ubuntu-18.04-amd64)|
|verify-rc-source-integration-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-integration-linux-ubuntu-20.04-amd64)|
|verify-rc-source-java-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-java-linux-almalinux-8-amd64)|
|verify-rc-source-java-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-java-linux-ubuntu-18.04-amd64)|
|verify-rc-source-java-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-java-linux-ubuntu-20.04-amd64)|
|verify-rc-source-js-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-js-linux-almalinux-8-amd64)|
|verify-rc-source-js-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-js-linux-ubuntu-18.04-amd64)|
|verify-rc-source-js-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-js-linux-ubuntu-20.04-amd64)|
|verify-rc-source-python-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-python-linux-almalinux-8-amd64)|
|verify-rc-source-python-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-python-linux-ubuntu-18.04-amd64)|
|verify-rc-source-python-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-python-linux-ubuntu-20.04-amd64)|
|verify-rc-source-ruby-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-ruby-linux-almalinux-8-amd64)|
|verify-rc-source-ruby-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-ruby-linux-ubuntu-18.04-amd64)|
|verify-rc-source-ruby-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1286-github-verify-rc-source-ruby-linux-ubuntu-20.04-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991798392
@github-actions crossbow submit verify-rc-source-csharp-linux-almalinux-8-amd64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991796564
Revision: 9115cbf2cd2cfe837aa2f568203850a72e33b00c
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1277](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1277)
|Task|Status|
|----|------|
|verify-rc-source-csharp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1277-github-verify-rc-source-csharp-linux-almalinux-8-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751012818
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,36 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-derivatives.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748740596
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
+dnf -y install \
+ dnf-plugins-core \
+ yum-utils
Review comment:
dnf-plugins-core is needed for the config-manager https://dnf-plugins-core.readthedocs.io/en/latest/config_manager.html
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748669833
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,35 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-clone.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+script in the testing environment.
+
+Verifying the binaries additionally requires installation of Docker.
+Verifying the wheels additionally requires running
+```console
+git submodule init
+git submodule update
+export PARQUET_TEST_DATA="${PWD}/cpp/submodules/parquet-testing/data"
+export ARROW_TEST_DATA="${PWD}/testing/data"
+```
+from the arrow directory.
Review comment:
We don't need this because the verification script does this automatically.
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
+dnf -y install \
+ dnf-plugins-core \
+ yum-utils
+dnf config-manager --set-enabled powertools
+dnf -y update
Review comment:
Why is this needed?
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
Review comment:
Whey are they needed?
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
Review comment:
Filename is wrong: `setup-rhel-rebuilds.sh` -> `setup-rhel-clone.sh`
##########
File path: dev/tasks/verify-rc/github.Almalinux.amd64.yml
##########
@@ -0,0 +1,25 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+jobs:
+ verify:
+ name: "Verify release candidate AlmaLinux"
+ runs:
+ using: 'docker'
+ image: 'AlmaLinuxDockerfile'
+
Review comment:
If we don't work on Crossbow task in this pull request, we should not add/change any files under `dev/tasks/`.
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
+dnf -y install \
+ dnf-plugins-core \
+ yum-utils
Review comment:
Why is this needed?
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
+dnf -y install \
+ dnf-plugins-core \
+ yum-utils
+dnf config-manager --set-enabled powertools
+dnf -y update
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ epel-release \
+ ninja-build \
+ libcurl-devel \
+ python3-pip \
+ cmake \
+ git \
+ ncurses-devel \
+ gobject-introspection-devel \
+ libffi-devel \
+ openssl-devel \
+ maven \
+ java-1.8.0-openjdk-devel \
+ wget \
+ readline-devel \
+ gdbm-devel \
+ ruby-devel \
+ llvm-toolset \
+ llvm-devel
+dnf -y update
Review comment:
Why is this needed?
##########
File path: dev/release/setup-ubuntu.sh
##########
@@ -0,0 +1,33 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# A script to install dependencies required for release
+# verification on Ubuntu 20.04
+
+apt-get update
+apt-get -y install \
+ build-essential \
+ openjdk-8-jdk \
+ pkg-config \
+ maven \
+ ruby-dev \
+ cmake \
+ python3-pip \
+ ninja-build \
+ llvm-dev \
+ clang \
+ libssl-dev
Review comment:
Could you sort this list in alphabetical order?
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
+dnf -y install \
+ dnf-plugins-core \
+ yum-utils
+dnf config-manager --set-enabled powertools
+dnf -y update
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ epel-release \
+ ninja-build \
+ libcurl-devel \
+ python3-pip \
+ cmake \
+ git \
+ ncurses-devel \
+ gobject-introspection-devel \
+ libffi-devel \
+ openssl-devel \
+ maven \
+ java-1.8.0-openjdk-devel \
+ wget \
+ readline-devel \
+ gdbm-devel \
+ ruby-devel \
+ llvm-toolset \
+ llvm-devel
Review comment:
Could you sort this list in alphabetical order?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748722787
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
Review comment:
RHEL does not like the use of clone, as an example Wikpedia uses derivatives https://en.wikipedia.org/wiki/Red_Hat_Enterprise_Linux_derivatives
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991937829
Revision: 42db1edcbe5e1cd8775d12c4d30d20e4181863cb
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1281](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1281)
|Task|Status|
|----|------|
|verify-rc-source-cpp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-cpp-linux-almalinux-8-amd64)|
|verify-rc-source-cpp-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-cpp-linux-ubuntu-18.04-amd64)|
|verify-rc-source-cpp-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-cpp-linux-ubuntu-20.04-amd64)|
|verify-rc-source-cpp-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-cpp-macos-amd64)|
|verify-rc-source-cpp-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-cpp-macos-arm64)|
|verify-rc-source-csharp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-csharp-linux-almalinux-8-amd64)|
|verify-rc-source-csharp-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-csharp-linux-ubuntu-18.04-amd64)|
|verify-rc-source-csharp-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-csharp-linux-ubuntu-20.04-amd64)|
|verify-rc-source-csharp-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-csharp-macos-amd64)|
|verify-rc-source-csharp-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-csharp-macos-arm64)|
|verify-rc-source-go-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-go-linux-almalinux-8-amd64)|
|verify-rc-source-go-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-go-linux-ubuntu-18.04-amd64)|
|verify-rc-source-go-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-go-linux-ubuntu-20.04-amd64)|
|verify-rc-source-go-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-go-macos-amd64)|
|verify-rc-source-go-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-go-macos-arm64)|
|verify-rc-source-integration-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-integration-linux-almalinux-8-amd64)|
|verify-rc-source-integration-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-integration-linux-ubuntu-18.04-amd64)|
|verify-rc-source-integration-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-integration-linux-ubuntu-20.04-amd64)|
|verify-rc-source-integration-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-integration-macos-amd64)|
|verify-rc-source-integration-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-integration-macos-arm64)|
|verify-rc-source-java-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-java-linux-almalinux-8-amd64)|
|verify-rc-source-java-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-java-linux-ubuntu-18.04-amd64)|
|verify-rc-source-java-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-java-linux-ubuntu-20.04-amd64)|
|verify-rc-source-java-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-java-macos-amd64)|
|verify-rc-source-js-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-js-linux-almalinux-8-amd64)|
|verify-rc-source-js-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-js-linux-ubuntu-18.04-amd64)|
|verify-rc-source-js-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-js-linux-ubuntu-20.04-amd64)|
|verify-rc-source-js-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-js-macos-amd64)|
|verify-rc-source-js-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-js-macos-arm64)|
|verify-rc-source-python-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-python-linux-almalinux-8-amd64)|
|verify-rc-source-python-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-python-linux-ubuntu-18.04-amd64)|
|verify-rc-source-python-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-python-linux-ubuntu-20.04-amd64)|
|verify-rc-source-python-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-python-macos-amd64)|
|verify-rc-source-python-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-python-macos-arm64)|
|verify-rc-source-ruby-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-ruby-linux-almalinux-8-amd64)|
|verify-rc-source-ruby-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-ruby-linux-ubuntu-18.04-amd64)|
|verify-rc-source-ruby-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-ruby-linux-ubuntu-20.04-amd64)|
|verify-rc-source-ruby-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-ruby-macos-amd64)|
|verify-rc-source-ruby-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-ruby-macos-arm64)|
|verify-rc-source-windows|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1281-github-verify-rc-source-windows)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991948499
Revision: 39a2a1cd08da3948c3afdb308daf558ec48b0b0d
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1284](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1284)
|Task|Status|
|----|------|
|verify-rc-source-integration-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1284-github-verify-rc-source-integration-macos-arm64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741822998
##########
File path: dev/tasks/verify-rc-alma/action.yml
##########
@@ -0,0 +1,34 @@
+# Licensed to the Apache Software Foundation (ASF) under one
Review comment:
Ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741844502
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
Review comment:
Done.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741847928
##########
File path: dev/tasks/verify-rc-alma/Dockerfile
##########
@@ -0,0 +1,8 @@
+# Container image that runs
+FROM almalinux:8.4
+
+# Copy script into container
+COPY setup-AlmaLinux-Rocky-Linux.sh /setup-AlmaLinux-Rocky-Linux.sh
+
+# Execute script
+ENTRYPOINT ["/setup-AlmaLinux-Rocky-Linux.sh"]
Review comment:
Ok. Maybe a verification script for a Docker image can be created in a separate issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748740653
##########
File path: dev/tasks/verify-rc/github.Almalinux.amd64.yml
##########
@@ -0,0 +1,25 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+jobs:
+ verify:
+ name: "Verify release candidate AlmaLinux"
+ runs:
+ using: 'docker'
+ image: 'AlmaLinuxDockerfile'
+
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991796481
@github-actions crossbow submit verify-rc-source-csharp-linux-almalinux-8-amd64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r765476787
##########
File path: dev/tasks/verify-rc/github.Almalinux.amd64.yml
##########
@@ -0,0 +1,25 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+jobs:
+ verify:
+ name: "Verify release candidate AlmaLinux"
+ runs:
+ using: 'docker'
+ image: 'AlmaLinuxDockerfile'
+
Review comment:
Sorry missed this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991795989
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991998219
@github-actions crossbow submit verify-rc-source-js-linux-* --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991947935
@github-actions crossbow submit verify-rc-source-integration-macos-arm64 --param release=6.0.1 --param rc=1
@github-actions crossbow submit verify-rc-source-go-macos-arm64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r739033233
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
Review comment:
@kou There are verification scripts at
- https://github.com/bkmgit/arrow/blob/ARROW-14446/.github/workflows/rc_rocky.yml
- https://github.com/bkmgit/arrow/blob/ARROW-14446/.github/workflows/rc_alma.yml
which run the files in `dev/tasks/verify-rc-rocky` and in `dev/tasks/verify-rc-alma`. Still need to figure out how to put these in the `dev/tasks/verify-rc` directory since Docker is not needed for verification on Ubuntu.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751280981
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
+ git \
+ gobject-introspection-devel \
+ java-1.8.0-openjdk-devel \
+ libcurl-devel \
+ libffi-devel \
+ llvm-devel \
+ llvm-toolset \
+ maven \
+ ncurses-devel \
+ ninja-build \
+ openssl-devel \
+ python3-pip \
+ python3-devel \
+ readline-devel \
+ ruby-devel \
+ wget
+dnf -y upgrade
+alias pip=pip3
Review comment:
can remove `alias pip=pip3`
Have also removed `dnf -y upgrade`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r739028470
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
+% tar -xvf ruby-3.0.2.tar.gz
+% cd ruby-3.0.2/
+% CC=gcc ./configure --prefix=$HOME/ruby
+% CC=gcc make
+% make install
+% cd ..
+% export PATH=$HOME/ruby/bin:$PATH
+% wget https://apt.llvm.org/llvm.sh
+% chmod +x llvm.sh
+% ./llvm.sh 10
+% apt-get install -y clang-format clang-tidy clang-tools clang clangd libc++-dev
+% apt-get install -y libc++1 libc++abi-dev libc++abi1 libclang-dev libclang1
+% apt-get install -y liblldb-dev libllvm-ocaml-dev libomp-dev libomp5 lld lldb
+% apt-get install -y llvm-dev llvm-runtime llvm python-clang
+% apt-get install -y ninja-build python3-pip
+% curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg
Review comment:
Have removed this from the script, and added it as a comment.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741843352
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
+sudo dnf -y install llvm-devel
+git clone https://github.com/apache/arrow
+cd arrow/
+dev/release/verify-release-candidate.sh source $VERSION $TYPE
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741822998
##########
File path: dev/tasks/verify-rc-alma/action.yml
##########
@@ -0,0 +1,34 @@
+# Licensed to the Apache Software Foundation (ASF) under one
Review comment:
Ok
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
Review comment:
Have used `setup-rhel-clones.sh`
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,26 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-Ubuntu.sh` and
+`setup-AlmaLinux-Rocky-Linux.sh`. These can be adapted to different
Review comment:
done
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
+sudo dnf -y install llvm-devel
+git clone https://github.com/apache/arrow
+cd arrow/
+dev/release/verify-release-candidate.sh source $VERSION $TYPE
Review comment:
ok
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
Review comment:
Done.
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
Review comment:
ok, can install directly.
##########
File path: dev/tasks/verify-rc-alma/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,59 @@
+#!/bin/sh -l
Review comment:
ok
##########
File path: dev/tasks/verify-rc-alma/Dockerfile
##########
@@ -0,0 +1,8 @@
+# Container image that runs
+FROM almalinux:8.4
+
+# Copy script into container
+COPY setup-AlmaLinux-Rocky-Linux.sh /setup-AlmaLinux-Rocky-Linux.sh
+
+# Execute script
+ENTRYPOINT ["/setup-AlmaLinux-Rocky-Linux.sh"]
Review comment:
Ok. Maybe a verification script for a Docker image can be created in a separate issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-990092077
`VERSION=6.0.1 RC=1 archery docker run almalinux-verify-rc-source`
and
`VERSION=6.0.1 RC=1 archery docker run ubuntu-verify-rc-source`
both partially work. May want to pass in other variables for tests to enable and disable. For Ubuntu 20.04 easier to use JDK 11 the default rather than JDK 8.
Perhaps can automate AlmaLinux verification in a separate pull request since the current [Ubuntu based verification](https://github.com/apache/arrow/blob/master/dev/tasks/tasks.yml) can possibly also be refactored to minimize code duplication.
The testing also seems fragile, maybe exact image should be specified and update periodically.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991798492
Revision: f0527c8d042d6976831b046541f707442d0ec024
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1278](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1278)
|Task|Status|
|----|------|
|verify-rc-source-csharp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1278-github-verify-rc-source-csharp-linux-almalinux-8-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991975937
We can ignore the verify-rc-source-python-macos-arm64 failure because it's caused without this:
https://github.com/apache/arrow/pull/11671
https://github.com/ursacomputing/crossbow/runs/4170361954?check_suite_focus=true
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r738471645
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741822998
##########
File path: dev/tasks/verify-rc-alma/action.yml
##########
@@ -0,0 +1,34 @@
+# Licensed to the Apache Software Foundation (ASF) under one
Review comment:
Ok
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
Review comment:
Have used `setup-rhel-clones.sh`
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,26 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-Ubuntu.sh` and
+`setup-AlmaLinux-Rocky-Linux.sh`. These can be adapted to different
Review comment:
done
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
+sudo dnf -y install llvm-devel
+git clone https://github.com/apache/arrow
+cd arrow/
+dev/release/verify-release-candidate.sh source $VERSION $TYPE
Review comment:
ok
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
Review comment:
Done.
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
Review comment:
ok, can install directly.
##########
File path: dev/tasks/verify-rc-alma/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,59 @@
+#!/bin/sh -l
Review comment:
ok
##########
File path: dev/tasks/verify-rc-alma/Dockerfile
##########
@@ -0,0 +1,8 @@
+# Container image that runs
+FROM almalinux:8.4
+
+# Copy script into container
+COPY setup-AlmaLinux-Rocky-Linux.sh /setup-AlmaLinux-Rocky-Linux.sh
+
+# Execute script
+ENTRYPOINT ["/setup-AlmaLinux-Rocky-Linux.sh"]
Review comment:
Ok. Maybe a verification script for a Docker image can be created in a separate issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-959254189
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991844059
@github-actions crossbow submit verify-rc-source--linux-almalinux- --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991949001
Test again to see if get same error
@github-actions crossbow submit verify-rc-source-python-macos-arm64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-992051715
@github-actions crossbow submit verify-rc-source-js-* --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991844885
@github-actions crossbow submit verify-rc-source-ruby-linux-ubuntu-20.04-amd64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991796116
Revision: 8fa64b4f3d0f16ca115ce941e315aa2f8585e230
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1276](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1276)
|Task|Status|
|----|------|
|verify-rc-source-cpp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1276-github-verify-rc-source-cpp-linux-almalinux-8-amd64)|
|verify-rc-source-csharp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1276-github-verify-rc-source-csharp-linux-almalinux-8-amd64)|
|verify-rc-source-go-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1276-github-verify-rc-source-go-linux-almalinux-8-amd64)|
|verify-rc-source-integration-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1276-github-verify-rc-source-integration-linux-almalinux-8-amd64)|
|verify-rc-source-java-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1276-github-verify-rc-source-java-linux-almalinux-8-amd64)|
|verify-rc-source-js-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1276-github-verify-rc-source-js-linux-almalinux-8-amd64)|
|verify-rc-source-python-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1276-github-verify-rc-source-python-linux-almalinux-8-amd64)|
|verify-rc-source-ruby-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1276-github-verify-rc-source-ruby-linux-almalinux-8-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991799311
@github-actions crossbow submit verify-rc-source-csharp-linux-almalinux-8-amd64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991943049
```
while constructing a mapping
in "<unicode string>", line 175, column 3:
conda-clean:
^ (line: 175)
found duplicate key "verify-rc-source-js-linux-almalinux-8-amd64" with value "ordereddict([('ci', 'github'), ('template', 'docker-tests/github.linux.yml'), ('params', ordereddict([('flags', '-e INSTALL_NODE=1 -e TEST_DEFAULT=0 -e TEST_JS=1'), ('image', 'almalinux-verify-rc-source')]))])" (original value: "ordereddict([('ci', 'github'), ('template', 'docker-tests/github.linux.yml'), ('params', ordereddict([('flags', '-e INSTALL_NODE=0 -e TEST_DEFAULT=0 -e TEST_JS=1'), ('image', 'almalinux-verify-rc-source')]))])")
in "<unicode string>", line 2609, column 3:
verify-rc-source-js-linux-almali ...
^ (line: 2609)
To suppress this check see:
http://yaml.readthedocs.io/en/latest/api.html#duplicate-keys
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/1570050544```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741825692
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
Review comment:
Have used `setup-rhel-clones.sh`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit edited a comment on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit edited a comment on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991949001
Test again to see if get same error
@github-actions crossbow submit verify-rc-source-python-macos-arm64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991947605
Mac OS arm 64 failures because https://dl.google.com/go/go1.15.14.darwin-arm64.tar.gz does not exist. There is go1.16.darwin-arm64.tar.gz at https://go.dev/dl/
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991109536
@kou please review.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748740538
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
Review comment:
Sets a clean state, though can manage without these.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748873101
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
+dnf -y install \
+ dnf-plugins-core \
+ yum-utils
+dnf config-manager --set-enabled powertools
+dnf -y update
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ epel-release \
+ ninja-build \
+ libcurl-devel \
+ python3-pip \
+ cmake \
+ git \
+ ncurses-devel \
+ gobject-introspection-devel \
+ libffi-devel \
+ openssl-devel \
+ maven \
+ java-1.8.0-openjdk-devel \
+ wget \
+ readline-devel \
+ gdbm-devel \
+ ruby-devel \
+ llvm-toolset \
+ llvm-devel
+dnf -y update
Review comment:
Use latest versions of dependencies https://dnf.readthedocs.io/en/latest/command_ref.html?highlight=upgrade#upgrade-command Can manage without these, though would take advantages of any improvements. Let me know if prefer to not have `dnf -y update`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r750999494
##########
File path: dev/release/README.md
##########
@@ -22,3 +22,5 @@
To learn more, see the project wiki:
https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
+
+and [VERIFY.md](https://github.com/apache/arrow/blob/master/dev/release/VERIFY.md)
Review comment:
Can we use relative path here?
```suggestion
and [VERIFY.md](VERIFY.md)
```
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,36 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-derivatives.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+
Review comment:
```suggestion
```
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,36 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-derivatives.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+
+script in the testing environment. Verifying the binaries additionally
+requires installation of Docker. Verifying the wheels requires
+installation of packages listed in `../../python/requirements-test.txt`,
+and additionally requires running
+
+```console
+git submodule init
+git submodule update
+```
Review comment:
This instruction isn't needed. Because:
1. The verification script verifies in `apache-arrow-X.Y.Z/` that is created by extraction of `apache-arrow-X.Y.Z.tar.gz` not the checkout-ed directory. (No `.git/` in `apache-arrow-X.Y.Z/'.)
2. The verification script clones test data automatically: https://github.com/apache/arrow/blob/master/dev/release/verify-release-candidate.sh#L703
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
+ git \
+ gobject-introspection-devel \
+ java-1.8.0-openjdk-devel \
+ libcurl-devel \
+ libffi-devel \
+ llvm-devel \
+ llvm-toolset \
+ maven \
+ ncurses-devel \
Review comment:
Is this needed?
##########
File path: dev/release/setup-ubuntu.sh
##########
@@ -0,0 +1,33 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+# A script to install dependencies required for release
+# verification on Ubuntu 20.04
+
+apt-get update
+apt-get -y install \
+ build-essential \
+ clang \
+ cmake \
+ lblssl-dev \
Review comment:
```suggestion
libssl-dev \
```
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
+ git \
+ gobject-introspection-devel \
+ java-1.8.0-openjdk-devel \
+ libcurl-devel \
+ libffi-devel \
+ llvm-devel \
+ llvm-toolset \
+ maven \
+ ncurses-devel \
+ ninja-build \
+ openssl-devel \
+ python3-pip \
+ python3-devel \
+ readline-devel \
+ ruby-devel \
+ wget
+dnf -y upgrade
+alias pip=pip3
Review comment:
Is this needed?
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
Review comment:
Is this needed?
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
Review comment:
```suggestion
'dnf-command(config-manager)'
```
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
+ git \
+ gobject-introspection-devel \
+ java-1.8.0-openjdk-devel \
+ libcurl-devel \
+ libffi-devel \
+ llvm-devel \
+ llvm-toolset \
+ maven \
+ ncurses-devel \
+ ninja-build \
+ openssl-devel \
+ python3-pip \
+ python3-devel \
+ readline-devel \
Review comment:
Is this needed?
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
+ git \
+ gobject-introspection-devel \
+ java-1.8.0-openjdk-devel \
+ libcurl-devel \
+ libffi-devel \
Review comment:
Is this needed?
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
Review comment:
```suggestion
#!/bin/sh
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-953064706
https://issues.apache.org/jira/browse/ARROW-14446
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991844141
```
Unable to match any tasks for `verify-rc-source--linux-almalinux-`
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/1568895965```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991998582
Revision: f8ddbbd1b848f122ca113d347fe72b76fa38756a
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1287](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1287)
|Task|Status|
|----|------|
|verify-rc-source-js-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1287-github-verify-rc-source-js-linux-almalinux-8-amd64)|
|verify-rc-source-js-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1287-github-verify-rc-source-js-linux-ubuntu-18.04-amd64)|
|verify-rc-source-js-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1287-github-verify-rc-source-js-linux-ubuntu-20.04-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991948096
Revision: 39a2a1cd08da3948c3afdb308daf558ec48b0b0d
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1283](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1283)
|Task|Status|
|----|------|
|verify-rc-source-go-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1283-github-verify-rc-source-go-macos-arm64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-992008132
Revision: 33db7f8de2d05052a2196ad94993ea79b5d969e6
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1288](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1288)
|Task|Status|
|----|------|
|verify-rc-source-js-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1288-github-verify-rc-source-js-linux-almalinux-8-amd64)|
|verify-rc-source-js-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1288-github-verify-rc-source-js-linux-ubuntu-18.04-amd64)|
|verify-rc-source-js-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1288-github-verify-rc-source-js-linux-ubuntu-20.04-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-992007860
@github-actions crossbow submit verify-rc-source-js-linux-* --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991796116
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991942888
@github-actions crossbow submit verify-rc-source-js-linux-* --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-968331186
@kou ready for review again.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751813452
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,36 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-derivatives.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+
+script in the testing environment. Verifying the binaries additionally
+requires installation of Docker. Verifying the wheels requires
+installation of packages listed in `../../python/requirements-test.txt`,
+and additionally requires running
+
+```console
+git submodule init
+git submodule update
+```
Review comment:
Thanks.
It's a bug of `verify-release-candidate.sh`. We should use the target source (6.0.1) directory instead of the current source (master) here: https://github.com/apache/arrow/blob/master/dev/release/verify-release-candidate.sh#L625
```shell
INSTALL_PYARROW=OFF ${ARROW_DIR}/ci/scripts/python_wheel_unix_test.sh ${source_dir not ARROW_DIR}
```
We should fix this as a separated task first and then update this pull request.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748739072
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
+dnf -y install \
+ dnf-plugins-core \
+ yum-utils
+dnf config-manager --set-enabled powertools
+dnf -y update
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ epel-release \
+ ninja-build \
+ libcurl-devel \
+ python3-pip \
+ cmake \
+ git \
+ ncurses-devel \
+ gobject-introspection-devel \
+ libffi-devel \
+ openssl-devel \
+ maven \
+ java-1.8.0-openjdk-devel \
+ wget \
+ readline-devel \
+ gdbm-devel \
+ ruby-devel \
+ llvm-toolset \
+ llvm-devel
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751013891
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,36 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-derivatives.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+
+script in the testing environment. Verifying the binaries additionally
+requires installation of Docker. Verifying the wheels requires
+installation of packages listed in `../../python/requirements-test.txt`,
+and additionally requires running
+
+```console
+git submodule init
+git submodule update
+```
Review comment:
Without this, the verification failed on a fresh install of RockyLinux 8
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-962906753
@kou Ready for review - automated testing can follow in separate issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-953064618
@kou Initial review would be helpful.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741844835
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
Review comment:
ok, can install directly.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741843024
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,26 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-Ubuntu.sh` and
+`setup-AlmaLinux-Rocky-Linux.sh`. These can be adapted to different
Review comment:
done
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r737949786
##########
File path: dev/release/VERIFY.md
##########
@@ -26,9 +26,9 @@ Windows. Read the comments in `verify-release-candidate.bat` for instructions.
## Linux and macOS
-We've provided a convenience script for verifying the C++, Python, C
-GLib, Java and JavaScript builds on Linux and macOS. Read the comments in
-`verify-release-candidate.sh` for instructions.
+We've provided a convenience script for verifying the C++, Python, C GLib,
+Java, Ruby, Go and JavaScript builds on Linux and macOS. Read the script
Review comment:
C# is missing.
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
Review comment:
```suggestion
```console
```
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
Review comment:
```suggestion
### Dependencies for C++, C#, C GLib, Go, JavaScript, Python, Ruby
```
I'm not sure that this title is good for the following sentences...
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
Review comment:
Do you want to describe how to setup environments to run verification script?
If so, how about creating a setup script something like `dev/release/setup.sh` instead of writing command lines? It may be able to use `dev/tasks/verify-rc/github.linux.amd64.yml`.
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
Review comment:
```suggestion
% TEST_DEFAULT=0 TEST_GO=1 dev/release/verify-release-candidate.sh source 6.0.0 3
```
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
Review comment:
Why don't you install `maven` package instead of building Maven?
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
+% tar -xvf ruby-3.0.2.tar.gz
+% cd ruby-3.0.2/
+% CC=gcc ./configure --prefix=$HOME/ruby
+% CC=gcc make
+% make install
+% cd ..
+% export PATH=$HOME/ruby/bin:$PATH
+% wget https://apt.llvm.org/llvm.sh
Review comment:
We can use system LLVM related packages.
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
+% tar -xvf ruby-3.0.2.tar.gz
+% cd ruby-3.0.2/
+% CC=gcc ./configure --prefix=$HOME/ruby
+% CC=gcc make
+% make install
+% cd ..
+% export PATH=$HOME/ruby/bin:$PATH
+% wget https://apt.llvm.org/llvm.sh
+% chmod +x llvm.sh
+% ./llvm.sh 10
+% apt-get install -y clang-format clang-tidy clang-tools clang clangd libc++-dev
+% apt-get install -y libc++1 libc++abi-dev libc++abi1 libclang-dev libclang1
+% apt-get install -y liblldb-dev libllvm-ocaml-dev libomp-dev libomp5 lld lldb
+% apt-get install -y llvm-dev llvm-runtime llvm python-clang
+% apt-get install -y ninja-build python3-pip
+% curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg
Review comment:
Why do you install Docker?
`verify-release-candidate.sh source` doesn't use Docker. `verify-release-candidate.sh binaries` only uses Docker.
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
Review comment:
Why don't you install `ruby-dev` package instead of building Ruby?
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
+% tar -xvf ruby-3.0.2.tar.gz
+% cd ruby-3.0.2/
+% CC=gcc ./configure --prefix=$HOME/ruby
+% CC=gcc make
+% make install
+% cd ..
+% export PATH=$HOME/ruby/bin:$PATH
+% wget https://apt.llvm.org/llvm.sh
+% chmod +x llvm.sh
+% ./llvm.sh 10
+% apt-get install -y clang-format clang-tidy clang-tools clang clangd libc++-dev
+% apt-get install -y libc++1 libc++abi-dev libc++abi1 libclang-dev libclang1
+% apt-get install -y liblldb-dev libllvm-ocaml-dev libomp-dev libomp5 lld lldb
+% apt-get install -y llvm-dev llvm-runtime llvm python-clang
+% apt-get install -y ninja-build python3-pip
+% curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg
+% echo "deb [arch=$(dpkg --print-architecture) signed-by=/usr/share/keyrings/docker-archive-keyring.gpg] https://download.docker.com/linux/ubuntu \
+% $(lsb_release -cs) stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
+% apt-get update
+% apt-get install -y docker-ce docker-ce-cli containerd.io
+% git clone https://github.com/apache/arrow
+% cd arrow/
+% bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+### CentOS 8, Alma Linux 8, Rocky Linux 8
Review comment:
```suggestion
### AlmaLinux 8, Rocky Linux 8
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r738471308
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
+% tar -xvf ruby-3.0.2.tar.gz
+% cd ruby-3.0.2/
+% CC=gcc ./configure --prefix=$HOME/ruby
+% CC=gcc make
+% make install
+% cd ..
+% export PATH=$HOME/ruby/bin:$PATH
+% wget https://apt.llvm.org/llvm.sh
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r738471475
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748739318
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,35 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-clone.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+script in the testing environment.
+
+Verifying the binaries additionally requires installation of Docker.
+Verifying the wheels additionally requires running
+```console
+git submodule init
+git submodule update
+export PARQUET_TEST_DATA="${PWD}/cpp/submodules/parquet-testing/data"
+export ARROW_TEST_DATA="${PWD}/testing/data"
+```
+from the arrow directory.
Review comment:
```
export PARQUET_TEST_DATA="${PWD}/cpp/submodules/parquet-testing/data"
export ARROW_TEST_DATA="${PWD}/testing/data"
```
are in the verification script but
```
git submodule init
git submodule update
```
were not and some of the wheel tests fail without this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-992059520
Revision: 3f754d81cddb79bb961cdc8af6e37b8c4468acd0
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1290](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1290)
|Task|Status|
|----|------|
|verify-rc-source-csharp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1290-github-verify-rc-source-csharp-linux-almalinux-8-amd64)|
|verify-rc-source-js-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1290-github-verify-rc-source-js-macos-amd64)|
|verify-rc-source-js-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1290-github-verify-rc-source-js-macos-arm64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou closed pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou closed pull request #11562:
URL: https://github.com/apache/arrow/pull/11562
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r765471791
##########
File path: dev/tasks/verify-rc/github.Almalinux.amd64.yml
##########
@@ -0,0 +1,25 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+jobs:
+ verify:
+ name: "Verify release candidate AlmaLinux"
+ runs:
+ using: 'docker'
+ image: 'AlmaLinuxDockerfile'
+
Review comment:
I don't know why you marked this as resolved.
If you don't work on Crossbow task in this pull request, please revert changes under `dev/tasks/`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991844966
Revision: 42db1edcbe5e1cd8775d12c4d30d20e4181863cb
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1280](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1280)
|Task|Status|
|----|------|
|verify-rc-source-ruby-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1280-github-verify-rc-source-ruby-linux-ubuntu-20.04-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-992052149
Revision: 33db7f8de2d05052a2196ad94993ea79b5d969e6
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1289](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1289)
|Task|Status|
|----|------|
|verify-rc-source-js-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1289-github-verify-rc-source-js-linux-almalinux-8-amd64)|
|verify-rc-source-js-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1289-github-verify-rc-source-js-linux-ubuntu-18.04-amd64)|
|verify-rc-source-js-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1289-github-verify-rc-source-js-linux-ubuntu-20.04-amd64)|
|verify-rc-source-js-macos-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1289-github-verify-rc-source-js-macos-amd64)|
|verify-rc-source-js-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1289-github-verify-rc-source-js-macos-arm64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r765327347
##########
File path: dev/tasks/verify-rc/github.Almalinux.amd64.yml
##########
@@ -0,0 +1,25 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+jobs:
+ verify:
+ name: "Verify release candidate AlmaLinux"
+ runs:
+ using: 'docker'
+ image: 'AlmaLinuxDockerfile'
+
Review comment:
You want to work on Crossbow task in this pull request, right?
We should add `almalinux-verify-rc-*` and `ubuntu-verify-rc-*` entries to `docker-compose.yml` and use it in `dev/tasks/`. I think that it will be something like the following:
```yaml
almalinux-verify-rc-source:
image: almalinux:${ALMALINUX}
volumes:
- .:/arrow:delegated
command: >
/bin/bash -c "
/arrow/ci/dev/release/setup-rhel-rebuilds.sh &&
/arrow/ci/dev/release/verify-release-candidate.sh source ${VERSION} ${RC}"
```
Note that we also need to add `ALMALINUX=8` to `.env`.
We can use this by `archery docker run -e VERSION=6.0.1 -e RC=1 almalinux-verify-rc-source`.
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,27 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, Java, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-rebuild.sh`. These can be adapted to different
Review comment:
```suggestion
`setup-rhel-rebuilds.sh`. These can be adapted to different
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991976080
@github-actions crossbow submit verify-rc-source-go-* verify-rc-source-*-linux-* --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-959254189
Using dnf to install Ruby on RHEL 8 clones is not good as the default version is ruby 2.5.9p229 which is EOL, where verification of release candidate 6.0.0 3 fails with
```bash
Traceback (most recent call last):
15: from test/run-test.rb:71:in `<main>'
14: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/autorunner.rb:66:in `run'
13: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/autorunner.rb:446:in `run'
12: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/autorunner.rb:106:in `block in <class:AutoRunner>'
11: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:38:in `collect'
10: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:138:in `add_load_path'
9: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:43:in `block in collect'
8: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:43:in `each'
7: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:46:in `block (2 levels) in collect'
6: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:87:in `collect_recursive'
5: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:87:in `each'
4: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:89:in `block in collect_recursive'
3: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:114:in `collect_file'
2: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:138:in `add_load_path'
1: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:116:in `block in collect_file'
/tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:116:in `require': /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/test/test-table.rb:189: syntax error, unexpected .. (SyntaxError)
...<-TABLE, @table.slice(count: ..8).to_s)
... ^~
/tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/test/test-table.rb:199: syntax error, unexpected ...
...-TABLE, @table.slice(count: ...8).to_s)
... ^~~
/tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/test/test-table.rb:208: syntax error, unexpected ')'
...ABLE, @table.slice(count: 16..).to_s)
... ^
/tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/test/test-table.rb:925: syntax error, unexpected keyword_end, expecting end-of-input
+ cleanup
+ '[' no = yes ']'
+ echo 'Failed to verify release candidate. See /tmp/arrow-6.0.0.SfZpR for details.'
Failed to verify release candidate. See /tmp/arrow-6.0.0.SfZpR for details.
```
With Ruby 2.7.2 and Ruby 3.0.0 tests pass. Can use RVM or build from source to get an updated Ruby version. Sample RVM steps
```
gpg2 --keyserver hkps://keys.openpgp.org --recv-keys 409B6B1796C275462A1703113804BB82D39DC0E3 7D2BAF1CF37B13E2069D6956105BD0E739499BDB
\curl -sSL https://get.rvm.io | bash -s stable
source /etc/profile.d/rvm.sh
rvm install 2.7
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-959254189
Using dnf to install Ruby on RHEL 8 clones is not good as the default version is ruby 2.5.9p229 which is EOL, where verification of release candidate 6.0.0 3 fails with
```bash
Traceback (most recent call last):
15: from test/run-test.rb:71:in `<main>'
14: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/autorunner.rb:66:in `run'
13: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/autorunner.rb:446:in `run'
12: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/autorunner.rb:106:in `block in <class:AutoRunner>'
11: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:38:in `collect'
10: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:138:in `add_load_path'
9: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:43:in `block in collect'
8: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:43:in `each'
7: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:46:in `block (2 levels) in collect'
6: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:87:in `collect_recursive'
5: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:87:in `each'
4: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:89:in `block in collect_recursive'
3: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:114:in `collect_file'
2: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:138:in `add_load_path'
1: from /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:116:in `block in collect_file'
/tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/vendor/bundle/ruby/2.5.0/gems/test-unit-3.5.0/lib/test/unit/collector/load.rb:116:in `require': /tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/test/test-table.rb:189: syntax error, unexpected .. (SyntaxError)
...<-TABLE, @table.slice(count: ..8).to_s)
... ^~
/tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/test/test-table.rb:199: syntax error, unexpected ...
...-TABLE, @table.slice(count: ...8).to_s)
... ^~~
/tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/test/test-table.rb:208: syntax error, unexpected ')'
...ABLE, @table.slice(count: 16..).to_s)
... ^
/tmp/arrow-6.0.0.SfZpR/apache-arrow-6.0.0/ruby/red-arrow/test/test-table.rb:925: syntax error, unexpected keyword_end, expecting end-of-input
+ cleanup
+ '[' no = yes ']'
+ echo 'Failed to verify release candidate. See /tmp/arrow-6.0.0.SfZpR for details.'
Failed to verify release candidate. See /tmp/arrow-6.0.0.SfZpR for details.
```
With Ruby 2.7.2 and Ruby 3.0.0 tests pass. Can use RVM or build from source to get an updated Ruby version. Sample RVM steps
```
gpg2 --keyserver hkps://keys.openpgp.org --recv-keys 409B6B1796C275462A1703113804BB82D39DC0E3 7D2BAF1CF37B13E2069D6956105BD0E739499BDB
\curl -sSL https://get.rvm.io | bash -s stable
source /etc/profile.d/rvm.sh
rvm install 2.7
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991799413
Revision: 42db1edcbe5e1cd8775d12c4d30d20e4181863cb
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1279](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1279)
|Task|Status|
|----|------|
|verify-rc-source-csharp-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1279-github-verify-rc-source-csharp-linux-almalinux-8-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991943888
@github-actions crossbow submit verify-rc-source-js-linux-* --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r752095083
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,36 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-derivatives.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+
+script in the testing environment. Verifying the binaries additionally
+requires installation of Docker. Verifying the wheels requires
+installation of packages listed in `../../python/requirements-test.txt`,
+and additionally requires running
+
+```console
+git submodule init
+git submodule update
+```
Review comment:
Ok, created https://github.com/apache/arrow/pull/11735
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751082379
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
+ git \
+ gobject-introspection-devel \
+ java-1.8.0-openjdk-devel \
+ libcurl-devel \
+ libffi-devel \
+ llvm-devel \
+ llvm-toolset \
+ maven \
+ ncurses-devel \
Review comment:
ncurses-devel provides libtinfo needed by Gandiva
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751191881
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,36 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-derivatives.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+
+script in the testing environment. Verifying the binaries additionally
+requires installation of Docker. Verifying the wheels requires
+installation of packages listed in `../../python/requirements-test.txt`,
+and additionally requires running
+
+```console
+git submodule init
+git submodule update
+```
Review comment:
Commands are
```console
dnf -y install \
'dnf-command(config-manager)'
dnf config-manager --set-enabled powertools
dnf -y module disable ruby
dnf -y module enable ruby:2.7
dnf -y groupinstall "Development Tools"
dnf -y install \
cmake \
epel-release \
gdbm-devel \
git \
gobject-introspection-devel \
java-1.8.0-openjdk-devel \
libcurl-devel \
llvm-devel \
llvm-toolset \
maven \
ncurses-devel \
ninja-build \
openssl-devel \
python3-pip \
python3-devel \
ruby-devel \
wget
alternatives --set python /usr/bin/python3
git clone https://github.com/apache/arrow
cd arrow/dev/release
./verify-release-candidate.sh wheels 6.0.1 1
```
The following test does not pass without adding the submodule
```console
================================================ FAILURES ================================================
____________________________________________ test_tls_do_get _____________________________________________
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
> with (root / path).open("rb") as f:
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:77:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), mode = 'rb', buffering = -1
encoding = None, errors = None, newline = None
def open(self, mode='r', buffering=-1, encoding=None,
errors=None, newline=None):
"""
Open the file pointed by this path and return a file object, as
the built-in open() function does.
"""
if self._closed:
self._raise_closed()
return io.open(str(self), mode, buffering, encoding, errors, newline,
> opener=self._opener)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1183:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem')
name = '/root/arrow/testing/data/flight/root-ca.pem', flags = 524288, mode = 438
def _opener(self, name, flags, mode=0o666):
# A stub for the opener argument to built-in open()
> return self._accessor.open(self, flags, mode)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1037:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pathobj = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), args = (524288, 438)
@functools.wraps(strfunc)
def wrapped(pathobj, *args):
> return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:387: FileNotFoundError
During handling of the above exception, another exception occurred:
@pytest.mark.requires_testing_data
def test_tls_do_get():
"""Try a simple do_get call over TLS."""
table = simple_ints_table()
> certs = example_tls_certs()
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:1345:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:89: in example_tls_certs
"root_cert": read_flight_resource("root-ca.pem"),
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
with (root / path).open("rb") as f:
return f.read()
except FileNotFoundError:
raise RuntimeError(
"Test resource {} not found; did you initialize the "
"test resource submodule?\n{}".format(root / path,
> traceback.format_exc()))
E RuntimeError: Test resource /root/arrow/testing/data/flight/root-ca.pem not found; did you initialize the test resource submodule?
E Traceback (most recent call last):
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py", line 77, in read_flight_resource
E with (root / path).open("rb") as f:
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1183, in open
E opener=self._opener)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1037, in _opener
E return self._accessor.open(self, flags, mode)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 387, in wrapped
E return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:83: RuntimeError
__________________________________ test_tls_disable_server_verification __________________________________
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
> with (root / path).open("rb") as f:
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:77:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), mode = 'rb', buffering = -1
encoding = None, errors = None, newline = None
def open(self, mode='r', buffering=-1, encoding=None,
errors=None, newline=None):
"""
Open the file pointed by this path and return a file object, as
the built-in open() function does.
"""
if self._closed:
self._raise_closed()
return io.open(str(self), mode, buffering, encoding, errors, newline,
> opener=self._opener)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1183:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem')
name = '/root/arrow/testing/data/flight/root-ca.pem', flags = 524288, mode = 438
def _opener(self, name, flags, mode=0o666):
# A stub for the opener argument to built-in open()
> return self._accessor.open(self, flags, mode)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1037:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pathobj = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), args = (524288, 438)
@functools.wraps(strfunc)
def wrapped(pathobj, *args):
> return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:387: FileNotFoundError
During handling of the above exception, another exception occurred:
@pytest.mark.requires_testing_data
def test_tls_disable_server_verification():
"""Try a simple do_get call over TLS with server verification disabled."""
table = simple_ints_table()
> certs = example_tls_certs()
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:1358:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:89: in example_tls_certs
"root_cert": read_flight_resource("root-ca.pem"),
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
with (root / path).open("rb") as f:
return f.read()
except FileNotFoundError:
raise RuntimeError(
"Test resource {} not found; did you initialize the "
"test resource submodule?\n{}".format(root / path,
> traceback.format_exc()))
E RuntimeError: Test resource /root/arrow/testing/data/flight/root-ca.pem not found; did you initialize the test resource submodule?
E Traceback (most recent call last):
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py", line 77, in read_flight_resource
E with (root / path).open("rb") as f:
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1183, in open
E opener=self._opener)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1037, in _opener
E return self._accessor.open(self, flags, mode)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 387, in wrapped
E return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:83: RuntimeError
_______________________________________ test_tls_override_hostname _______________________________________
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
> with (root / path).open("rb") as f:
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:77:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), mode = 'rb', buffering = -1
encoding = None, errors = None, newline = None
def open(self, mode='r', buffering=-1, encoding=None,
errors=None, newline=None):
"""
Open the file pointed by this path and return a file object, as
the built-in open() function does.
"""
if self._closed:
self._raise_closed()
return io.open(str(self), mode, buffering, encoding, errors, newline,
> opener=self._opener)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1183:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem')
name = '/root/arrow/testing/data/flight/root-ca.pem', flags = 524288, mode = 438
def _opener(self, name, flags, mode=0o666):
# A stub for the opener argument to built-in open()
> return self._accessor.open(self, flags, mode)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1037:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pathobj = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), args = (524288, 438)
@functools.wraps(strfunc)
def wrapped(pathobj, *args):
> return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:387: FileNotFoundError
During handling of the above exception, another exception occurred:
@pytest.mark.requires_testing_data
def test_tls_override_hostname():
"""Check that incorrectly overriding the hostname fails."""
> certs = example_tls_certs()
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:1373:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:89: in example_tls_certs
"root_cert": read_flight_resource("root-ca.pem"),
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
with (root / path).open("rb") as f:
return f.read()
except FileNotFoundError:
raise RuntimeError(
"Test resource {} not found; did you initialize the "
"test resource submodule?\n{}".format(root / path,
> traceback.format_exc()))
E RuntimeError: Test resource /root/arrow/testing/data/flight/root-ca.pem not found; did you initialize the test resource submodule?
E Traceback (most recent call last):
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py", line 77, in read_flight_resource
E with (root / path).open("rb") as f:
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1183, in open
E opener=self._opener)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1037, in _opener
E return self._accessor.open(self, flags, mode)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 387, in wrapped
E return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:83: RuntimeError
_______________________________________________ test_mtls ________________________________________________
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
> with (root / path).open("rb") as f:
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:77:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), mode = 'rb', buffering = -1
encoding = None, errors = None, newline = None
def open(self, mode='r', buffering=-1, encoding=None,
errors=None, newline=None):
"""
Open the file pointed by this path and return a file object, as
the built-in open() function does.
"""
if self._closed:
self._raise_closed()
return io.open(str(self), mode, buffering, encoding, errors, newline,
> opener=self._opener)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1183:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem')
name = '/root/arrow/testing/data/flight/root-ca.pem', flags = 524288, mode = 438
def _opener(self, name, flags, mode=0o666):
# A stub for the opener argument to built-in open()
> return self._accessor.open(self, flags, mode)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1037:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pathobj = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), args = (524288, 438)
@functools.wraps(strfunc)
def wrapped(pathobj, *args):
> return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:387: FileNotFoundError
During handling of the above exception, another exception occurred:
@pytest.mark.requires_testing_data
def test_mtls():
"""Test mutual TLS (mTLS) with gRPC."""
> certs = example_tls_certs()
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:1724:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:89: in example_tls_certs
"root_cert": read_flight_resource("root-ca.pem"),
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
with (root / path).open("rb") as f:
return f.read()
except FileNotFoundError:
raise RuntimeError(
"Test resource {} not found; did you initialize the "
"test resource submodule?\n{}".format(root / path,
> traceback.format_exc()))
E RuntimeError: Test resource /root/arrow/testing/data/flight/root-ca.pem not found; did you initialize the test resource submodule?
E Traceback (most recent call last):
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py", line 77, in read_flight_resource
E with (root / path).open("rb") as f:
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1183, in open
E opener=self._opener)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1037, in _opener
E return self._accessor.open(self, flags, mode)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 387, in wrapped
E return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:83: RuntimeError
__________________________________________ test_generic_options __________________________________________
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
> with (root / path).open("rb") as f:
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:77:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), mode = 'rb', buffering = -1
encoding = None, errors = None, newline = None
def open(self, mode='r', buffering=-1, encoding=None,
errors=None, newline=None):
"""
Open the file pointed by this path and return a file object, as
the built-in open() function does.
"""
if self._closed:
self._raise_closed()
return io.open(str(self), mode, buffering, encoding, errors, newline,
> opener=self._opener)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1183:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
self = PosixPath('/root/arrow/testing/data/flight/root-ca.pem')
name = '/root/arrow/testing/data/flight/root-ca.pem', flags = 524288, mode = 438
def _opener(self, name, flags, mode=0o666):
# A stub for the opener argument to built-in open()
> return self._accessor.open(self, flags, mode)
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:1037:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
pathobj = PosixPath('/root/arrow/testing/data/flight/root-ca.pem'), args = (524288, 438)
@functools.wraps(strfunc)
def wrapped(pathobj, *args):
> return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py:387: FileNotFoundError
During handling of the above exception, another exception occurred:
@pytest.mark.requires_testing_data
def test_generic_options():
"""Test setting generic client options."""
> certs = example_tls_certs()
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:1882:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:89: in example_tls_certs
"root_cert": read_flight_resource("root-ca.pem"),
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
path = 'root-ca.pem'
def read_flight_resource(path):
"""Get the contents of a test resource file."""
root = resource_root()
if not root:
return None
try:
with (root / path).open("rb") as f:
return f.read()
except FileNotFoundError:
raise RuntimeError(
"Test resource {} not found; did you initialize the "
"test resource submodule?\n{}".format(root / path,
> traceback.format_exc()))
E RuntimeError: Test resource /root/arrow/testing/data/flight/root-ca.pem not found; did you initialize the test resource submodule?
E Traceback (most recent call last):
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py", line 77, in read_flight_resource
E with (root / path).open("rb") as f:
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1183, in open
E opener=self._opener)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 1037, in _opener
E return self._accessor.open(self, flags, mode)
E File "/tmp/arrow-6.0.1.edIR4/test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/pathlib.py", line 387, in wrapped
E return strfunc(str(pathobj), *args)
E FileNotFoundError: [Errno 2] No such file or directory: '/root/arrow/testing/data/flight/root-ca.pem'
../test-miniconda/envs/_verify_wheel-3.6m/lib/python3.6/site-packages/pyarrow/tests/test_flight.py:83: RuntimeError
============================================ warnings summary ============================================
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751278397
##########
File path: dev/release/setup-rhel-derivatives.sh
##########
@@ -0,0 +1,52 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y install \
+ dnf-plugins-core
+dnf config-manager --set-enabled powertools
+dnf -y module disable ruby
+dnf -y module enable ruby:2.7
+dnf -y groupinstall "Development Tools"
+dnf -y install \
+ cmake \
+ epel-release \
+ gdbm-devel \
+ git \
+ gobject-introspection-devel \
+ java-1.8.0-openjdk-devel \
+ libcurl-devel \
+ libffi-devel \
+ llvm-devel \
+ llvm-toolset \
+ maven \
+ ncurses-devel \
+ ninja-build \
+ openssl-devel \
+ python3-pip \
+ python3-devel \
+ readline-devel \
Review comment:
Can remove readline-devel
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-989557426
@kou Thanks. Change applied.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r738479077
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
+% tar -xvf ruby-3.0.2.tar.gz
+% cd ruby-3.0.2/
+% CC=gcc ./configure --prefix=$HOME/ruby
+% CC=gcc make
+% make install
+% cd ..
+% export PATH=$HOME/ruby/bin:$PATH
+% wget https://apt.llvm.org/llvm.sh
+% chmod +x llvm.sh
+% ./llvm.sh 10
+% apt-get install -y clang-format clang-tidy clang-tools clang clangd libc++-dev
+% apt-get install -y libc++1 libc++abi-dev libc++abi1 libclang-dev libclang1
+% apt-get install -y liblldb-dev libllvm-ocaml-dev libomp-dev libomp5 lld lldb
+% apt-get install -y llvm-dev llvm-runtime llvm python-clang
+% apt-get install -y ninja-build python3-pip
+% curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg
Review comment:
For completeness, good to have Docker to run binary verification.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r738487968
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
Review comment:
Simplified.
By default the verification script will try to verify all
implementations and bindings. Should one of verification tests fail,
the script will exit before running the other tests. It can be helpful
to repeat the failed test to see if it will complete, since
failures can occur for problems such as slow or failed download
of a dependency from the internet. It is possible to run specific
verification tests by setting environment variables, for example
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991795989
@github-actions crossbow submit verify-rc-source-*-linux-almalinux-* --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991937672
@github-actions crossbow submit verify-rc-source-* --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991950073
Revision: 39a2a1cd08da3948c3afdb308daf558ec48b0b0d
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1285](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1285)
|Task|Status|
|----|------|
|verify-rc-source-python-macos-arm64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1285-github-verify-rc-source-python-macos-arm64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991949879
@github-actions crossbow submit verify-rc-source-python-macos-arm64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-992059184
@github-actions crossbow submit verify-rc-source-js-macos-* verify-rc-source-csharp-linux-almalinux-8-amd64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] github-actions[bot] commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991944127
Revision: 0d3841532c1cc6780aa916baa3b1f06052f090c1
Submitted crossbow builds: [ursacomputing/crossbow @ actions-1282](https://github.com/ursacomputing/crossbow/branches/all?query=actions-1282)
|Task|Status|
|----|------|
|verify-rc-source-js-linux-almalinux-8-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1282-github-verify-rc-source-js-linux-almalinux-8-amd64)|
|verify-rc-source-js-linux-ubuntu-18.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1282-github-verify-rc-source-js-linux-ubuntu-18.04-amd64)|
|verify-rc-source-js-linux-ubuntu-20.04-amd64|[](https://github.com/ursacomputing/crossbow/actions?query=branch:actions-1282-github-verify-rc-source-js-linux-ubuntu-20.04-amd64)|
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#issuecomment-991948361
@github-actions crossbow submit verify-rc-source-integration-macos-arm64 --param release=6.0.1 --param rc=1
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751015651
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,36 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-ubuntu.sh` and
+`setup-rhel-derivatives.sh`. These can be adapted to different
+situations. Go and JavaScript are installed by the verification
+
+script in the testing environment. Verifying the binaries additionally
+requires installation of Docker. Verifying the wheels requires
+installation of packages listed in `../../python/requirements-test.txt`,
+and additionally requires running
+
+```console
+git submodule init
+git submodule update
+```
Review comment:
Could you show instruction how to reproduce it?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r751012369
##########
File path: dev/release/README.md
##########
@@ -22,3 +22,5 @@
To learn more, see the project wiki:
https://cwiki.apache.org/confluence/display/ARROW/Release+Management+Guide
+
+and [VERIFY.md](https://github.com/apache/arrow/blob/master/dev/release/VERIFY.md)
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748872843
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification Red Hat Enterprise Linux 8 clones in particular
+# on AlmaLinux 8 and Rocky Linux 8
+
+dnf -y update
+dnf clean all
+dnf -y install \
+ dnf-plugins-core \
+ yum-utils
+dnf config-manager --set-enabled powertools
+dnf -y update
Review comment:
Can be removed
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r748873715
##########
File path: dev/release/setup-rhel-rebuilds.sh
##########
@@ -0,0 +1,53 @@
+#!/bin/sh -l
Review comment:
See also https://wiki.centos.org/FAQ/General#What_is_CentOS.27s_relationship_with_Red_Hat.2BAK4.2C_Inc._or_RHEL.3F where it is stated clone is inappropriate
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r737957816
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
Review comment:
Could you simplify this sentence?
It's difficult for me...
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r738486482
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,98 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### Dependencies for C++, C Glib, GO, Javascript, Python, Ruby
+
+Possible setups to be able to run the verification script that
+can be adapted to different situations. GO and Javascript are
+installed by the script in the testing environment.
+
+By default the script will try to verify all implementations and
+bindings. Should one of them fail, it can be helpful to repeat
+the failed test and run the tests which have not been completed.
+This can be done by setting environment variables, for example
+```console
+% env "TEST_DEFAULT=0" env "TEST_GO=1" bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+##### Ubuntu 20.04
+
+Possible steps run as root user. They should be modified for
+your setup appropriately.
+
+```console
+% apt-get update
+% apt-get install -y cmake wget curl libboost-all-dev jq unzip
+% apt-get install -y -q autoconf-archive gtk-doc-tools libgirepository1.0-dev
+% apt-get update -y -qq
+% apt-get install -y build-essential openjdk-8-jdk
+% wget https://dlcdn.apache.org/maven/maven-3/3.8.3/binaries/apache-maven-3.8.3-bin.zip
+% unzip apache-maven-3.8.3-bin.zip
+% mkdir -p $HOME/java
+% mv apache-maven-3.8.3 $HOME/java
+% export PATH=$HOME/java/apache-maven-3.8.3/bin:$PATH
+% apt-get install -y curl g++ gcc autoconf automake bison libc6-dev libffi-dev
+% apt-get install -y libgdbm-dev libncurses5-dev libsqlite3-dev libtool libyaml-dev
+% apt-get install -y make pkg-config sqlite3 zlib1g-dev libgmp-dev
+% apt-get install -y libreadline-dev libssl-dev
+% wget https://cache.ruby-lang.org/pub/ruby/3.0/ruby-3.0.2.tar.gz
+% tar -xvf ruby-3.0.2.tar.gz
+% cd ruby-3.0.2/
+% CC=gcc ./configure --prefix=$HOME/ruby
+% CC=gcc make
+% make install
+% cd ..
+% export PATH=$HOME/ruby/bin:$PATH
+% wget https://apt.llvm.org/llvm.sh
+% chmod +x llvm.sh
+% ./llvm.sh 10
+% apt-get install -y clang-format clang-tidy clang-tools clang clangd libc++-dev
+% apt-get install -y libc++1 libc++abi-dev libc++abi1 libclang-dev libclang1
+% apt-get install -y liblldb-dev libllvm-ocaml-dev libomp-dev libomp5 lld lldb
+% apt-get install -y llvm-dev llvm-runtime llvm python-clang
+% apt-get install -y ninja-build python3-pip
+% curl -fsSL https://download.docker.com/linux/ubuntu/gpg | sudo gpg --dearmor -o /usr/share/keyrings/docker-archive-keyring.gpg
+% echo "deb [arch=$(dpkg --print-architecture) signed-by=/usr/share/keyrings/docker-archive-keyring.gpg] https://download.docker.com/linux/ubuntu \
+% $(lsb_release -cs) stable" | sudo tee /etc/apt/sources.list.d/docker.list > /dev/null
+% apt-get update
+% apt-get install -y docker-ce docker-ce-cli containerd.io
+% git clone https://github.com/apache/arrow
+% cd arrow/
+% bash dev/release/verify-release-candidate.sh source 6.0.0 3
+```
+
+### CentOS 8, Alma Linux 8, Rocky Linux 8
Review comment:
This section has been removed.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] kou commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r739928991
##########
File path: dev/release/VERIFY.md
##########
@@ -26,9 +26,9 @@ Windows. Read the comments in `verify-release-candidate.bat` for instructions.
## Linux and macOS
-We've provided a convenience script for verifying the C++, Python, C
-GLib, Java and JavaScript builds on Linux and macOS. Read the comments in
-`verify-release-candidate.sh` for instructions.
+We've provided a convenience script for verifying the C++, C#, C GLib, Go,
+Java, Javascript, Ruby and Python builds on Linux and macOS. Read the script
Review comment:
```suggestion
Java, JavaScript, Ruby and Python builds on Linux and macOS. Read the script
```
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
Review comment:
Are they needed?
`llvm-toolset` is included in appstream too.
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
Review comment:
Could you unify to one `dnf install`?
```bash
sudo dnf -y install \
... \
...
```
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
+sudo dnf -y groupinstall "Development Tools"
+sudo dnf -y module enable llvm-toolset
+sudo dnf -y module install llvm-toolset
+sudo dnf -y install llvm-devel
+git clone https://github.com/apache/arrow
+cd arrow/
+dev/release/verify-release-candidate.sh source $VERSION $TYPE
Review comment:
How about running `dev/release/verify-release-candidate.sh` separately instead of running from this script?
`setup-XXX.sh` script should just setup. And users who run this script must have cloned `apache/arrow` directory.
##########
File path: dev/release/VERIFY.md
##########
@@ -74,3 +74,26 @@ You need to set `PKG_CONFIG_PATH` to find libffi on macOS:
```console
% export PKG_CONFIG_PATH=$(brew --prefix libffi)/lib/pkgconfig:$PKG_CONFIG_PATH
```
+
+### C++, C#, C GLib, Go, JavaScript, Python, Ruby
+
+Example scripts to install the dependencies to run the verification
+script for verifying the source on Ubuntu 20.04, Rocky Linux 8 and
+AlmaLinux 8 are in this folder and named `setup-Ubuntu.sh` and
+`setup-AlmaLinux-Rocky-Linux.sh`. These can be adapted to different
Review comment:
Could you use lowercase for file name?
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
Review comment:
Are they needed?
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
Review comment:
How about renaming to `setup-rhel.sh` and use `RHEL clones such as ...`?
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
Review comment:
`-y` is missing?
##########
File path: dev/tasks/verify-rc-alma/Dockerfile
##########
@@ -0,0 +1,8 @@
+# Container image that runs
+FROM almalinux:8.4
+
+# Copy script into container
+COPY setup-AlmaLinux-Rocky-Linux.sh /setup-AlmaLinux-Rocky-Linux.sh
+
+# Execute script
+ENTRYPOINT ["/setup-AlmaLinux-Rocky-Linux.sh"]
Review comment:
We don't need this file.
We can use `--volume` for using file on host.
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
Review comment:
Can we use `sudo dnf -y install epel-release`?
##########
File path: dev/tasks/verify-rc-alma/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,59 @@
+#!/bin/sh -l
Review comment:
We should not have duplicated file in this repository.
We should use `dev/release/setup-...`.
##########
File path: dev/tasks/verify-rc-alma/action.yml
##########
@@ -0,0 +1,34 @@
+# Licensed to the Apache Software Foundation (ASF) under one
Review comment:
We don't need to create a new directory for this. We can reuse `/dev/tasks/verify-rc/` directory.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r741845115
##########
File path: dev/tasks/verify-rc-alma/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,59 @@
+#!/bin/sh -l
Review comment:
ok
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] bkmgit commented on a change in pull request #11562: ARROW-14446: [Docs][Release] Update documentation on verification of release candidates
Posted by GitBox <gi...@apache.org>.
bkmgit commented on a change in pull request #11562:
URL: https://github.com/apache/arrow/pull/11562#discussion_r745019349
##########
File path: dev/release/setup-AlmaLinux-Rocky-Linux.sh
##########
@@ -0,0 +1,56 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+
+
+# A script to install dependencies required for release
+# verification on AlmaLinux 8 and Rocky Linux 8
+
+if [ $# -lt 2 ]; then
+ echo "Usage: $0 VERSION rc"
+ echo " $0 VERSION staging-rc"
+ echo " $0 VERSION release"
+ echo " $0 VERSION staging-release"
+ echo " $0 VERSION local"
+ echo " e.g.: $0 0.13.0 3 # Verify 0.13.0 3"
+ echo " e.g.: $0 0.13.0 staging-rc # Verify 0.13.0 RC on staging"
+ echo " e.g.: $0 0.13.0 release # Verify 0.13.0"
+ echo " e.g.: $0 0.13.0 staging-release # Verify 0.13.0 on staging"
+ echo " e.g.: $0 0.13.0-dev20210203 local # Verify 0.13.0-dev20210203 on local"
+ exit 1
+fi
+
+VERSION="$1"
+TYPE="$2"
+
+sudo dnf -y update
+sudo dnf clean all
+sudo dnf -y install dnf-plugins-core
+sudo dnf config-manager --set-enabled powertools
+sudo dnf update
+sudo dnf -y install \
+ https://dl.fedoraproject.org/pub/epel/epel-release-latest-8.noarch.rpm
+sudo dnf -y install ninja-build libcurl-devel python3-pip cmake git
+sudo dnf -y ncurses-devel gobject-introspection-devel libffi-devel
+sudo dnf -y install openssl-devel maven java-1.8.0-openjdk-devel
+sudo dnf install -y yum-utils readline-devel gdbm-devel ruby-devel
Review comment:
Could get it to two. Hopefully ok.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org