You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by we...@apache.org on 2018/12/02 04:25:18 UTC

[arrow] branch master updated: ARROW-3925: [Python] Add autoconf to conda install instructions

This is an automated email from the ASF dual-hosted git repository.

wesm pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/arrow.git


The following commit(s) were added to refs/heads/master by this push:
     new bfedd3a  ARROW-3925: [Python] Add autoconf to conda install instructions
bfedd3a is described below

commit bfedd3af2dadb7bda1348a795b04705d28cefa8f
Author: Krisztián Szűcs <sz...@gmail.com>
AuthorDate: Sat Dec 1 22:25:09 2018 -0600

    ARROW-3925: [Python] Add autoconf to conda install instructions
    
    autoconf is required by the jemalloc build
    
    Author: Krisztián Szűcs <sz...@gmail.com>
    Author: fjetter <fj...@users.noreply.github.com>
    Author: Wes McKinney <we...@apache.org>
    
    Closes #2836 from fjetter/patch-1 and squashes the following commits:
    
    9fba4ebfa <Wes McKinney> Create conda_env_unix.yml and use that in the Python documentation
    dcbff0ffc <Krisztián Szűcs> don't escape within code-block
    cfe3d3fab <Krisztián Szűcs> move autoconf to conda_env_cpp; update development documentation
    7414fad1b <fjetter> Add glog to conda install instruction
    768303ff3 <fjetter> Add autoconf to conda install instructions
---
 cpp/Dockerfile => ci/conda_env_unix.yml | 36 ++-------------------------------
 cpp/Dockerfile                          |  5 ++---
 python/doc/source/development.rst       | 21 ++++++++++++++-----
 3 files changed, 20 insertions(+), 42 deletions(-)

diff --git a/cpp/Dockerfile b/ci/conda_env_unix.yml
similarity index 50%
copy from cpp/Dockerfile
copy to ci/conda_env_unix.yml
index 4ec8f0f..eeb90e4 100644
--- a/cpp/Dockerfile
+++ b/ci/conda_env_unix.yml
@@ -15,38 +15,6 @@
 # specific language governing permissions and limitations
 # under the License.
 
-FROM ubuntu:18.04
+# conda package dependencies specific to Unix-like environments (Linux and macOS)
 
-# install build essentials
-RUN apt-get update -y -q && \
-    apt-get install -y -q --no-install-recommends \
-      autoconf \
-      automake \
-      ca-certificates \
-      ccache \
-      g++ \
-      gcc \
-      git \
-      ninja-build \
-      pkg-config \
-      wget
-
-# install conda and required packages
-ENV PATH=/opt/conda/bin:$PATH \
-    CONDA_PREFIX=/opt/conda
-ADD ci/docker_install_conda.sh \
-    ci/conda_env_cpp.yml \
-    /arrow/ci/
-RUN arrow/ci/docker_install_conda.sh && \
-    conda install -c conda-forge \
-        --file arrow/ci/conda_env_cpp.yml && \
-    conda clean --all
-
-ENV CC=gcc \
-    CXX=g++ \
-    ARROW_BUILD_TESTS=ON
-
-# build and test
-CMD arrow/ci/docker_build_cpp.sh && \
-    cd /build/cpp && \
-    ctest -j2 --output-on-failure -L unittest
+autoconf
diff --git a/cpp/Dockerfile b/cpp/Dockerfile
index 4ec8f0f..4524bac 100644
--- a/cpp/Dockerfile
+++ b/cpp/Dockerfile
@@ -20,8 +20,6 @@ FROM ubuntu:18.04
 # install build essentials
 RUN apt-get update -y -q && \
     apt-get install -y -q --no-install-recommends \
-      autoconf \
-      automake \
       ca-certificates \
       ccache \
       g++ \
@@ -39,7 +37,8 @@ ADD ci/docker_install_conda.sh \
     /arrow/ci/
 RUN arrow/ci/docker_install_conda.sh && \
     conda install -c conda-forge \
-        --file arrow/ci/conda_env_cpp.yml && \
+        --file arrow/ci/conda_env_cpp.yml \
+        --file arrow/ci/conda_env_unix.yml && \
     conda clean --all
 
 ENV CC=gcc \
diff --git a/python/doc/source/development.rst b/python/doc/source/development.rst
index 3bd6689..e86a0be 100644
--- a/python/doc/source/development.rst
+++ b/python/doc/source/development.rst
@@ -76,13 +76,24 @@ Using Conda
 Let's create a conda environment with all the C++ build and Python dependencies
 from conda-forge:
 
+On Linux and OSX:
+
+.. code-block:: shell
+
+    conda create -y -n pyarrow-dev -c conda-forge \
+        --file arrow/ci/conda_env_unix.yml \
+        --file arrow/ci/conda_env_cpp.yml \
+        --file arrow/ci/conda_env_python.yml \
+        python=3.6
+
+On Windows:
+
 .. code-block:: shell
 
-   conda create -y -q -n pyarrow-dev \
-         python=3.6 numpy six setuptools cython pandas pytest \
-         cmake flatbuffers rapidjson boost-cpp thrift-cpp snappy zlib \
-         gflags brotli jemalloc lz4-c zstd -c conda-forge
-   conda activate pyarrow-dev
+    conda create -y -n pyarrow-dev -c conda-forge ^
+        --file arrow\ci\conda_env_cpp.yml ^
+        --file arrow\ci\conda_env_python.yml ^
+        python=3.6
 
 We need to set some environment variables to let Arrow's build system know
 about our build toolchain: