You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2020/12/14 19:28:08 UTC

[GitHub] [arrow] terencehonles opened a new pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

terencehonles opened a new pull request #8915:
URL: https://github.com/apache/arrow/pull/8915


   Picking back up from #8386 in case I can handle this or someone else wants to work off of it.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] mafrosis commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
mafrosis commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-763133797


   Ah thanks for that, but I haven't tested pyarrow 3 at all - I was hoping for a built wheel of 2.0.0 for Python 3.9 on macos


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] aberres commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
aberres commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-762359412


   Great work, looking forward to get this released!
   
   > Thanks, hopefully this made the cut for the next release and there are no issues with the build system changing 🙂
   
   Is there any place where one can find a release schedule?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-755054148


   @kou not sure if you might have a chance to review the PR, it looks like the change to GitHub actions seems to be working.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] kszucs commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754698886






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on a change in pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on a change in pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#discussion_r552826019



##########
File path: dev/tasks/python-wheels/github.osx.yml
##########
@@ -0,0 +1,143 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# NOTE: must set "Crossbow" as name to have the badge links working in the
+# github comment reports!
+name: Crossbow
+
+on:
+  push:
+    branches:
+      - "*-github-*"
+
+jobs:
+  build:
+    name: Build wheel for OS X
+    runs-on: macos-latest
+    steps:
+      - name: Checkout Arrow
+        run: |
+          set -ex
+
+          git clone --no-checkout {{ arrow.remote }} arrow
+          git -C arrow fetch -t {{ arrow.remote }} {{ arrow.branch }}
+          git -C arrow checkout FETCH_HEAD
+          git -C arrow submodule update --init --recursive
+
+      - name: Build wheel
+        run: |
+          set -ex
+
+          git clone https://github.com/matthew-brett/multibuild
+          git -C multibuild checkout 8882150df6529658700b66bec124dfb77eefca26
+
+          # source utilities required for wheel builds
+          export CONFIG_PATH=`pwd`/arrow/dev/tasks/python-wheels/osx-build.sh
+          source multibuild/common_utils.sh
+          source multibuild/travis_osx_steps.sh
+
+          # provided by travis_osx_steps
+          before_install
+
+          brew install \
+            automake \
+            bison \
+            boost \
+            ccache \
+            cmake \
+            flatbuffers \
+            flex \
+            git \
+            openblas \
+            openssl@1.1 \
+            protobuf \
+            python@3.8 \
+            thrift \
+            wget
+
+          # overridden by osx-build.sh
+          build_wheel arrow
+
+          # test the built wheels, move Homebrew directory to ensure things
+          # are properly statically-linked
+          CELLAR=$(brew --cellar)
+          sudo mv $CELLAR{,.bak}
+
+          # make a new Cellar, allowing numpy to dynamically link to openblas
+          sudo mkdir $CELLAR
+          sudo ln -s ../Cellar.bak/openblas $CELLAR/openblas
+          # and brew's openblas will need gcc
+          sudo ln -s ../Cellar.bak/gcc $CELLAR/gcc
+
+          # install the built wheel and test dependencies (osx-build.sh)
+          install_wheel arrow
+
+          # run unit tests before removing the system libraries (osx-build.sh)
+          ulimit -S -n 4096 && run_unit_tests arrow
+
+          # run the import tests (osx-build.sh)
+          run_import_tests
+
+          # restore the original Cellar
+          CELLAR=$(brew --cellar)

Review comment:
       done, thanks




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] kou commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
kou commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-755656441


   Thanks!


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] aberres commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
aberres commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-762793348


   > Glad to see this is coming. What date will the wheel be available?
   
   An RC for 3.0 is on its way. See https://lists.apache.org/list.html?dev@arrow.apache.org


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] kou closed pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
kou closed pull request #8915:
URL: https://github.com/apache/arrow/pull/8915


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] github-actions[bot] commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-755030041


   Revision: 28c36b4acd821c70348abba2ceb5e4b5035d1c86
   
   Submitted crossbow builds: [ursa-labs/crossbow @ actions-827](https://github.com/ursa-labs/crossbow/branches/all?query=actions-827)
   
   |Task|Status|
   |----|------|
   |conda-clean|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-clean)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-clean)|
   |conda-linux-gcc-py36-aarch64|[![Drone](https://img.shields.io/drone/build/ursa-labs/crossbow/actions-827-drone-conda-linux-gcc-py36-aarch64.svg)](https://cloud.drone.io/ursa-labs/crossbow)|
   |conda-linux-gcc-py36-cpu-r36|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-linux-gcc-py36-cpu-r36)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-linux-gcc-py36-cpu-r36)|
   |conda-linux-gcc-py36-cuda|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-linux-gcc-py36-cuda)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-linux-gcc-py36-cuda)|
   |conda-linux-gcc-py37-aarch64|[![Drone](https://img.shields.io/drone/build/ursa-labs/crossbow/actions-827-drone-conda-linux-gcc-py37-aarch64.svg)](https://cloud.drone.io/ursa-labs/crossbow)|
   |conda-linux-gcc-py37-cpu-r40|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-linux-gcc-py37-cpu-r40)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-linux-gcc-py37-cpu-r40)|
   |conda-linux-gcc-py37-cuda|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-linux-gcc-py37-cuda)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-linux-gcc-py37-cuda)|
   |conda-linux-gcc-py38-aarch64|[![Drone](https://img.shields.io/drone/build/ursa-labs/crossbow/actions-827-drone-conda-linux-gcc-py38-aarch64.svg)](https://cloud.drone.io/ursa-labs/crossbow)|
   |conda-linux-gcc-py38-cpu|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-linux-gcc-py38-cpu)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-linux-gcc-py38-cpu)|
   |conda-linux-gcc-py38-cuda|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-linux-gcc-py38-cuda)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-linux-gcc-py38-cuda)|
   |conda-linux-gcc-py39-aarch64|[![Drone](https://img.shields.io/drone/build/ursa-labs/crossbow/actions-827-drone-conda-linux-gcc-py39-aarch64.svg)](https://cloud.drone.io/ursa-labs/crossbow)|
   |conda-linux-gcc-py39-cpu|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-linux-gcc-py39-cpu)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-linux-gcc-py39-cpu)|
   |conda-linux-gcc-py39-cuda|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-linux-gcc-py39-cuda)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-linux-gcc-py39-cuda)|
   |conda-osx-clang-py36-r36|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-osx-clang-py36-r36)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-osx-clang-py36-r36)|
   |conda-osx-clang-py37-r40|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-osx-clang-py37-r40)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-osx-clang-py37-r40)|
   |conda-osx-clang-py38|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-osx-clang-py38)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-osx-clang-py38)|
   |conda-osx-clang-py39|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-osx-clang-py39)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-osx-clang-py39)|
   |conda-win-vs2017-py36-r36|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-win-vs2017-py36-r36)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-win-vs2017-py36-r36)|
   |conda-win-vs2017-py37-r40|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-win-vs2017-py37-r40)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-win-vs2017-py37-r40)|
   |conda-win-vs2017-py38|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-conda-win-vs2017-py38)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-conda-win-vs2017-py38)|
   |wheel-manylinux1-cp36m|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux1-cp36m)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux1-cp36m)|
   |wheel-manylinux1-cp37m|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux1-cp37m)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux1-cp37m)|
   |wheel-manylinux1-cp38|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux1-cp38)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux1-cp38)|
   |wheel-manylinux1-cp39|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux1-cp39)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux1-cp39)|
   |wheel-manylinux2010-cp36m|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux2010-cp36m)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux2010-cp36m)|
   |wheel-manylinux2010-cp37m|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux2010-cp37m)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux2010-cp37m)|
   |wheel-manylinux2010-cp38|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux2010-cp38)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux2010-cp38)|
   |wheel-manylinux2010-cp39|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux2010-cp39)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux2010-cp39)|
   |wheel-manylinux2014-cp36m|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux2014-cp36m)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux2014-cp36m)|
   |wheel-manylinux2014-cp37m|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux2014-cp37m)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux2014-cp37m)|
   |wheel-manylinux2014-cp38|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux2014-cp38)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux2014-cp38)|
   |wheel-manylinux2014-cp39|[![Azure](https://dev.azure.com/ursa-labs/crossbow/_apis/build/status/ursa-labs.crossbow?branchName=actions-827-azure-wheel-manylinux2014-cp39)](https://dev.azure.com/ursa-labs/crossbow/_build/latest?definitionId=1&branchName=actions-827-azure-wheel-manylinux2014-cp39)|
   |wheel-osx-high-sierra-cp36m|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-osx-high-sierra-cp36m)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-osx-high-sierra-cp36m)|
   |wheel-osx-high-sierra-cp37m|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-osx-high-sierra-cp37m)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-osx-high-sierra-cp37m)|
   |wheel-osx-high-sierra-cp38|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-osx-high-sierra-cp38)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-osx-high-sierra-cp38)|
   |wheel-osx-high-sierra-cp39|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-osx-high-sierra-cp39)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-osx-high-sierra-cp39)|
   |wheel-osx-mavericks-cp36m|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-osx-mavericks-cp36m)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-osx-mavericks-cp36m)|
   |wheel-osx-mavericks-cp37m|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-osx-mavericks-cp37m)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-osx-mavericks-cp37m)|
   |wheel-osx-mavericks-cp38|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-osx-mavericks-cp38)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-osx-mavericks-cp38)|
   |wheel-osx-mavericks-cp39|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-osx-mavericks-cp39)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-osx-mavericks-cp39)|
   |wheel-win-cp36m|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-win-cp36m)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-win-cp36m)|
   |wheel-win-cp37m|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-win-cp37m)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-win-cp37m)|
   |wheel-win-cp38|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-827-github-wheel-win-cp38)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-827-github-wheel-win-cp38)|


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] mafrosis edited a comment on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
mafrosis edited a comment on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-763133797






----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754339737


   @kszucs I noticed there was a list of allowed actions. Could the allow list just be updated or is that enforced at the apache (org) level rather than the repo level?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] mafrosis commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
mafrosis commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-762791147


   Glad to see this is coming. What date will the wheel be available? 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] kszucs commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754300248


   Yes, the comment bot seems to be failing https://github.com/apache/arrow/actions/runs/462228610
   This is most likely caused by the recent security changes, so we need to update the [comment_bot.yml](https://github.com/apache/arrow/blob/master/.github/workflows/comment_bot.yml) action to use verified plugins only.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754937202


   > Should be fixed by #9103
   
   Thanks @kszucs !


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-755029760


   @github-actions crossbow submit -g conda -g wheel


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] github-actions[bot] commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-744661305


   https://issues.apache.org/jira/browse/ARROW-10904


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] mafrosis edited a comment on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
mafrosis edited a comment on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-763133797


   Ah thanks for that, but I wasn't looking for PyArrow 3; I was hoping for a built wheel of 2.0.0 for Python 3.9 on macos.
   
   I think safest for now to tell my users Python 3.9 is unsupported 😄 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] kszucs commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754560147


   I'm afraid that it is enforced at organization level, so we need to update that action.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] kou commented on a change in pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
kou commented on a change in pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#discussion_r552365095



##########
File path: dev/tasks/python-wheels/github.osx.yml
##########
@@ -0,0 +1,143 @@
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements.  See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership.  The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License.  You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing, software
+# distributed under the License is distributed on an "AS IS" BASIS,
+# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+# See the License for the specific language governing permissions and
+# limitations under the License.
+
+# NOTE: must set "Crossbow" as name to have the badge links working in the
+# github comment reports!
+name: Crossbow
+
+on:
+  push:
+    branches:
+      - "*-github-*"
+
+jobs:
+  build:
+    name: Build wheel for OS X
+    runs-on: macos-latest
+    steps:
+      - name: Checkout Arrow
+        run: |
+          set -ex
+
+          git clone --no-checkout {{ arrow.remote }} arrow
+          git -C arrow fetch -t {{ arrow.remote }} {{ arrow.branch }}
+          git -C arrow checkout FETCH_HEAD
+          git -C arrow submodule update --init --recursive
+
+      - name: Build wheel
+        run: |
+          set -ex
+
+          git clone https://github.com/matthew-brett/multibuild
+          git -C multibuild checkout 8882150df6529658700b66bec124dfb77eefca26
+
+          # source utilities required for wheel builds
+          export CONFIG_PATH=`pwd`/arrow/dev/tasks/python-wheels/osx-build.sh
+          source multibuild/common_utils.sh
+          source multibuild/travis_osx_steps.sh
+
+          # provided by travis_osx_steps
+          before_install
+
+          brew install \
+            automake \
+            bison \
+            boost \
+            ccache \
+            cmake \
+            flatbuffers \
+            flex \
+            git \
+            openblas \
+            openssl@1.1 \
+            protobuf \
+            python@3.8 \
+            thrift \
+            wget
+
+          # overridden by osx-build.sh
+          build_wheel arrow
+
+          # test the built wheels, move Homebrew directory to ensure things
+          # are properly statically-linked
+          CELLAR=$(brew --cellar)
+          sudo mv $CELLAR{,.bak}
+
+          # make a new Cellar, allowing numpy to dynamically link to openblas
+          sudo mkdir $CELLAR
+          sudo ln -s ../Cellar.bak/openblas $CELLAR/openblas
+          # and brew's openblas will need gcc
+          sudo ln -s ../Cellar.bak/gcc $CELLAR/gcc
+
+          # install the built wheel and test dependencies (osx-build.sh)
+          install_wheel arrow
+
+          # run unit tests before removing the system libraries (osx-build.sh)
+          ulimit -S -n 4096 && run_unit_tests arrow
+
+          # run the import tests (osx-build.sh)
+          run_import_tests
+
+          # restore the original Cellar
+          CELLAR=$(brew --cellar)

Review comment:
       Can we remove this because we already have `CELLER=`?




----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754272662


   @kou / @kszucs you may already know but it looks like the crossbow submitter / github actions bot isn't working(?). It doesn't look like multibuild has tasks for GitHub Actions, but I wanted to see how far the Travis OS X commands would get.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754216137


   @github-actions crossbow submit wheel-osx-*-cp39


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] github-actions[bot] commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754951279


   Revision: 28c36b4acd821c70348abba2ceb5e4b5035d1c86
   
   Submitted crossbow builds: [ursa-labs/crossbow @ actions-826](https://github.com/ursa-labs/crossbow/branches/all?query=actions-826)
   
   |Task|Status|
   |----|------|
   |wheel-osx-high-sierra-cp39|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-826-github-wheel-osx-high-sierra-cp39)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-826-github-wheel-osx-high-sierra-cp39)|
   |wheel-osx-mavericks-cp39|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-826-github-wheel-osx-mavericks-cp39)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-826-github-wheel-osx-mavericks-cp39)|


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-755723513


   > FWIW I have a mac with macOS 10.14 and I confirmed that I can install the high sierra wheel that this produced.
   
   Thanks, hopefully this made the cut for the next release and there are no issues with the build system changing :slightly_smiling_face: 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] nealrichardson commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
nealrichardson commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-755665794


   FWIW I have a mac with macOS 10.14 and I confirmed that I can install the high sierra wheel that this produced.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] kszucs commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
kszucs commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-762365058


   You can follow the release process on the development mailing list (https://arrow.apache.org/community/). 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] github-actions[bot] commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754749536


   Revision: 6f13c4c268be10a8c0898d9e297b0303c35dc11f
   
   Submitted crossbow builds: [ursa-labs/crossbow @ actions-823](https://github.com/ursa-labs/crossbow/branches/all?query=actions-823)
   
   |Task|Status|
   |----|------|
   |wheel-osx-high-sierra-cp39|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-823-github-wheel-osx-high-sierra-cp39)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-823-github-wheel-osx-high-sierra-cp39)|
   |wheel-osx-mavericks-cp39|[![Github Actions](https://github.com/ursa-labs/crossbow/workflows/Crossbow/badge.svg?branch=actions-823-github-wheel-osx-mavericks-cp39)](https://github.com/ursa-labs/crossbow/actions?query=branch:actions-823-github-wheel-osx-mavericks-cp39)|


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] terencehonles commented on pull request #8915: ARROW-10904: [Python] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
terencehonles commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-754950870


   @github-actions crossbow submit wheel-osx-*-cp39


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [arrow] aberres commented on pull request #8915: ARROW-10904: [Python][CI][Packaging] Add support for Python 3.9 macOS wheels

Posted by GitBox <gi...@apache.org>.
aberres commented on pull request #8915:
URL: https://github.com/apache/arrow/pull/8915#issuecomment-768301677


   `Downloading pyarrow-3.0.0-cp39-cp39-macosx_10_13_x86_64.whl (14.2 MB)`
   
   Yay, thanks!


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org