You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@beam.apache.org by "Ahmet Altay (JIRA)" <ji...@apache.org> on 2017/07/11 19:11:00 UTC

[jira] [Created] (BEAM-2587) Build fails due to python sdk

Ahmet Altay created BEAM-2587:
---------------------------------

             Summary: Build fails due to python sdk
                 Key: BEAM-2587
                 URL: https://issues.apache.org/jira/browse/BEAM-2587
             Project: Beam
          Issue Type: Bug
          Components: sdk-py
    Affects Versions: 2.1.0
            Reporter: Ahmet Altay


Build fails with the following errors when {{mvn clean package}} is used on a clean Ubuntu 16.04 LTS machine with pip 8.x. The issue is resolved when pip is upgraded to pip 9.x

"RuntimeError: Not in apache git tree; unable to find proto definitions."
"DistutilsOptionError: can't combine user with prefix, exec_prefix/home, or install_(plat)base​"

We need to understand the issue and maybe add a note about requiring pip 9.x for development. Note that this does not affect end users using prepackaged artifacts from central repositories.

cc: [~robertwb]

Script for reproduction:

{code}
#!/bin/bash

set -e

readonly MACHINE_ID=$(hexdump -n 1 -e '"%x"' /dev/random)
readonly MACHINE="${USER}-beam-build-${MACHINE_ID}"
readonly ZONE="us-central1-c"

# provision building machine
echo "Provisioning Build Machine (Ubuntu 16.04 LTS)"
gcloud compute instances create "$MACHINE" \
  --zone="$ZONE" \
  --image-project="ubuntu-os-cloud" \
  --image-family="ubuntu-1604-lts"

# wait for ssh to be ready
echo "Waiting for machine to finish booting"
sleep 30

# ssh into the machine
# 1. install dependencies as specified by beam readme
# 2. download beam source from github
# 3. build with maven
echo "Downloading and building Apache Beam (release-2.1.0)"
gcloud compute ssh "$MACHINE" --zone="$ZONE" << EOF
sudo apt-get --assume-yes update
sudo apt-get --assume-yes install \
    openjdk-8-jdk \
    maven \
    python-setuptools \
    python-pip
wget https://github.com/apache/beam/archive/release-2.1.0.tar.gz
tar -xzf release-2.1.0.tar.gz
cd beam-release-2.1.0
mvn clean package
EOF
{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)