You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2018/05/09 16:44:10 UTC

Build failed in Jenkins: beam_PostCommit_Python_ValidatesContainer_Dataflow #143

See <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesContainer_Dataflow/143/display/redirect>

------------------------------------------
[...truncated 856.64 MB...]
Requirement already satisfied: gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0 in /usr/local/lib/python2.7/site-packages (from google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.15.4)
Requirement already satisfied: chardet<3.1.0,>=3.0.2 in /usr/local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (3.0.4)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (2018.4.16)
Requirement already satisfied: urllib3<1.23,>=1.21.1 in /usr/local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (1.22)
Requirement already satisfied: idna<2.7,>=2.5 in /usr/local/lib/python2.7/site-packages (from requests>=2.7.0->hdfs<3.0.0,>=2.1.0->apache-beam==2.5.0.dev0) (2.6)
Collecting monotonic>=0.1 (from fasteners>=0.14->google-apitools<=0.5.20,>=0.5.18->apache-beam==2.5.0.dev0)
  Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl
Requirement already satisfied: google-auth-httplib2 in /usr/local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.0.3)
Requirement already satisfied: google-auth<2.0.0dev,>=0.4.0 in /usr/local/lib/python2.7/site-packages (from google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (1.4.1)
Requirement already satisfied: google-gax<0.16dev,>=0.15.7 in /usr/local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.15.16)
Requirement already satisfied: grpc-google-iam-v1<0.12dev,>=0.11.1 in /usr/local/lib/python2.7/site-packages (from gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.11.4)
Requirement already satisfied: cachetools>=2.0.0 in /usr/local/lib/python2.7/site-packages (from google-auth<2.0.0dev,>=0.4.0->google-cloud-core<0.26dev,>=0.25.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (2.0.1)
Requirement already satisfied: ply==3.8 in /usr/local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (3.8)
Requirement already satisfied: future<0.17dev,>=0.16.0 in /usr/local/lib/python2.7/site-packages (from google-gax<0.16dev,>=0.15.7->gapic-google-cloud-pubsub-v1<0.16dev,>=0.15.0->google-cloud-pubsub==0.26.0->apache-beam==2.5.0.dev0) (0.16.0)
Building wheels for collected packages: apache-beam, hdfs, docopt
  Running setup.py bdist_wheel for apache-beam: started
  Running setup.py bdist_wheel for apache-beam: still running...
  Running setup.py bdist_wheel for apache-beam: finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/4b/7d/dd/a19128d4b755625dce0a4a284246bffb9f82e49379d8e9d5f5
  Running setup.py bdist_wheel for hdfs: started
  Running setup.py bdist_wheel for hdfs: finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/8c/89/59/b95e6bf2d5957541862f2cd109a052f26b61dc2fad2f04a1b4
  Running setup.py bdist_wheel for docopt: started
  Running setup.py bdist_wheel for docopt: finished with status 'done'
  Stored in directory: /root/.cache/pip/wheels/9b/04/dd/7daf4150b6d9b12949298737de9431a324d4b797ffd63f526e
Successfully built apache-beam hdfs docopt
Installing collected packages: protobuf, grpcio, docopt, hdfs, monotonic, fasteners, google-apitools, apache-beam
  Found existing installation: protobuf 3.3.0
    Uninstalling protobuf-3.3.0:
      Successfully uninstalled protobuf-3.3.0
  Found existing installation: grpcio 1.3.0
    Uninstalling grpcio-1.3.0:
      Successfully uninstalled grpcio-1.3.0
  Found existing installation: google-apitools 0.5.11
    Uninstalling google-apitools-0.5.11:
      Successfully uninstalled google-apitools-0.5.11
Successfully installed apache-beam-2.5.0.dev0 docopt-0.6.2 fasteners-0.14.1 google-apitools-0.5.20 grpcio-1.11.0 hdfs-2.1.0 monotonic-1.5 protobuf-3.5.2.post1
 ---> 1fc7c3f3bd9e
Removing intermediate container 419339131fdb
Step 7/8 : ADD target/linux_amd64/boot /opt/apache/beam/
 ---> 3efcd6d4c287
Removing intermediate container 8cf8d8def14d
Step 8/8 : ENTRYPOINT /opt/apache/beam/boot
 ---> Running in 6fcaebc760e4
 ---> 50ba550687ba
Removing intermediate container 6fcaebc760e4
Successfully built 50ba550687ba
Successfully tagged us.gcr.io/apache-beam-testing/jenkins/python:20180509-163356
:beam-sdks-python-container:docker (Thread[Task worker for ':',5,main]) completed. Took 7 mins 35.004 secs.

BUILD SUCCESSFUL in 9m 25s
16 actionable tasks: 14 executed, 2 up-to-date

Publishing build scan...
https://gradle.com/s/zkmer7j4h2hm2


# Verify it exists
docker images | grep $TAG
us.gcr.io/apache-beam-testing/jenkins/python   20180509-163356     50ba550687ba        1 second ago        1.59GB

# Push the container
gcloud docker -- push $CONTAINER
The push refers to a repository [us.gcr.io/apache-beam-testing/jenkins/python]
f93a17320bfa: Preparing
7480916748b5: Preparing
29983be2013f: Preparing
a44c2cadb316: Preparing
d447731b3029: Preparing
9e7f313a8c24: Preparing
33cd5f0643d2: Preparing
cbdf08184a1e: Preparing
869f7598b187: Preparing
90b8c3cde875: Preparing
fbbeadfbd3ca: Preparing
0f6f641d80ca: Preparing
76a66da94657: Preparing
0f3a12fef684: Preparing
9e7f313a8c24: Waiting
33cd5f0643d2: Waiting
cbdf08184a1e: Waiting
869f7598b187: Waiting
90b8c3cde875: Waiting
fbbeadfbd3ca: Waiting
0f6f641d80ca: Waiting
76a66da94657: Waiting
0f3a12fef684: Waiting
29983be2013f: Pushed
d447731b3029: Pushed
f93a17320bfa: Pushed
33cd5f0643d2: Pushed
9e7f313a8c24: Pushed
90b8c3cde875: Layer already exists
fbbeadfbd3ca: Layer already exists
0f6f641d80ca: Layer already exists
869f7598b187: Pushed
76a66da94657: Layer already exists
0f3a12fef684: Layer already exists
7480916748b5: Pushed
cbdf08184a1e: Pushed
a44c2cadb316: Pushed
20180509-163356: digest: sha256:36e38a6a27dab4457dbe543d4537759bb431904b4ec6c518bf0f0641131e0aa8 size: 3279

# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
>>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST
. sdks/python/build/gradleenv/bin/activate
# This file must be used with "source bin/activate" *from bash*
# you cannot run it directly

deactivate () {
    unset -f pydoc >/dev/null 2>&1

    # reset old environment variables
    # ! [ -z ${VAR+_} ] returns true if VAR is declared at all
    if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
        PATH="$_OLD_VIRTUAL_PATH"
        export PATH
        unset _OLD_VIRTUAL_PATH
    fi
    if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
        PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
        export PYTHONHOME
        unset _OLD_VIRTUAL_PYTHONHOME
    fi

    # This should detect bash and zsh, which have a hash command that must
    # be called to get it to forget past commands.  Without forgetting
    # past commands the $PATH changes we made may not be respected
    if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
        hash -r 2>/dev/null
    fi

    if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
        PS1="$_OLD_VIRTUAL_PS1"
        export PS1
        unset _OLD_VIRTUAL_PS1
    fi

    unset VIRTUAL_ENV
    if [ ! "${1-}" = "nondestructive" ] ; then
    # Self destruct!
        unset -f deactivate
    fi
}

# unset irrelevant variables
deactivate nondestructive

VIRTUAL_ENV="<https://builds.apache.org/job/beam_PostCommit_Python_ValidatesContainer_Dataflow/ws/src/sdks/python/build/gradleenv">
export VIRTUAL_ENV

_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH

# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
    _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
    unset PYTHONHOME
fi

if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
    _OLD_VIRTUAL_PS1="$PS1"
    if [ "x" != x ] ; then
        PS1="$PS1"
    else
        PS1="(`basename \"$VIRTUAL_ENV\"`) $PS1"
    fi
    export PS1
fi
basename "$VIRTUAL_ENV"

# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc

pydoc () {
    python -m pydoc "$@"
}

# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands.  Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
    hash -r 2>/dev/null
fi
python setup.py nosetests \
  --attr ValidatesContainer \
  --nocapture \
  --processes=1 \
  --process-timeout=900 \
  --test-pipeline-options=" \
    --runner=TestDataflowRunner \
    --project=$PROJECT \
    --worker_harness_container_image=$CONTAINER:$TAG \
    --staging_location=$GCS_LOCATION/staging-validatesrunner-test \
    --temp_location=$GCS_LOCATION/temp-validatesrunner-test \
    --output=$GCS_LOCATION/output \
    --sdk_location=$SDK_LOCATION \
    --num_workers=1"
python: can't open file 'setup.py': [Errno 2] No such file or directory
Build step 'Execute shell' marked build as failure
[Set GitHub commit status (universal)] ERROR on repos [GHRepository@3cfd0a51[description=Apache Beam,homepage=,name=beam,fork=false,size=58730,milestones={},language=Java,commits={},source=<null>,parent=<null>,responseHeaderFields={null=[HTTP/1.1 200 OK], Access-Control-Allow-Origin=[*], Access-Control-Expose-Headers=[ETag, Link, Retry-After, X-GitHub-OTP, X-RateLimit-Limit, X-RateLimit-Remaining, X-RateLimit-Reset, X-OAuth-Scopes, X-Accepted-OAuth-Scopes, X-Poll-Interval], Cache-Control=[private, max-age=60, s-maxage=60], Content-Encoding=[gzip], Content-Security-Policy=[default-src 'none'], Content-Type=[application/json; charset=utf-8], Date=[Wed, 09 May 2018 16:44:07 GMT], ETag=[W/"5c9d6c3689c17a1bcebc550b5488695c"], Last-Modified=[Wed, 09 May 2018 16:41:32 GMT], OkHttp-Received-Millis=[1525884247274], OkHttp-Response-Source=[NETWORK 200], OkHttp-Selected-Protocol=[http/1.1], OkHttp-Sent-Millis=[1525884246905], Referrer-Policy=[origin-when-cross-origin, strict-origin-when-cross-origin], Server=[GitHub.com], Status=[200 OK], Strict-Transport-Security=[max-age=31536000; includeSubdomains; preload], Transfer-Encoding=[chunked], Vary=[Accept, Authorization, Cookie, X-GitHub-OTP], X-Accepted-OAuth-Scopes=[repo], X-Content-Type-Options=[nosniff], X-Frame-Options=[deny], X-GitHub-Media-Type=[github.v3; format=json], X-GitHub-Request-Id=[CDFC:4F41:11813A2:258E92D:5AF32556], X-OAuth-Scopes=[admin:repo_hook, repo, repo:status], X-RateLimit-Limit=[5000], X-RateLimit-Remaining=[4969], X-RateLimit-Reset=[1525886159], X-Runtime-rack=[0.047734], X-XSS-Protection=[1; mode=block]},url=https://api.github.com/repos/apache/beam,id=50904245]] (sha:fbff3d4) with context:beam_PostCommit_Python_ValidatesContainer_Dataflow
Setting commit status on GitHub for https://github.com/apache/beam/commit/fbff3d4350df04345ef08a211560d18dec1e7b35
ERROR: Build step failed with exception
java.io.FileNotFoundException: https://api.github.com/repos/apache/beam/statuses/fbff3d4350df04345ef08a211560d18dec1e7b35
	at com.squareup.okhttp.internal.huc.HttpURLConnectionImpl.getInputStream(HttpURLConnectionImpl.java:243)
	at com.squareup.okhttp.internal.huc.DelegatingHttpsURLConnection.getInputStream(DelegatingHttpsURLConnection.java:210)
	at com.squareup.okhttp.internal.huc.HttpsURLConnectionImpl.getInputStream(HttpsURLConnectionImpl.java:25)
	at org.kohsuke.github.Requester.parse(Requester.java:612)
	at org.kohsuke.github.Requester.parse(Requester.java:594)
	at org.kohsuke.github.Requester._to(Requester.java:272)
Caused: org.kohsuke.github.GHFileNotFoundException: {"message":"Not Found","documentation_url":"https://developer.github.com/v3/repos/statuses/#create-a-status"}
	at org.kohsuke.github.Requester.handleApiError(Requester.java:686)
	at org.kohsuke.github.Requester._to(Requester.java:293)
	at org.kohsuke.github.Requester.to(Requester.java:234)
	at org.kohsuke.github.GHRepository.createCommitStatus(GHRepository.java:1075)
	at org.jenkinsci.plugins.github.status.GitHubCommitStatusSetter.perform(GitHubCommitStatusSetter.java:160)
Caused: org.jenkinsci.plugins.github.common.CombineErrorHandler$ErrorHandlingException
	at org.jenkinsci.plugins.github.common.CombineErrorHandler.handle(CombineErrorHandler.java:74)
	at org.jenkinsci.plugins.github.status.GitHubCommitStatusSetter.perform(GitHubCommitStatusSetter.java:164)
	at com.cloudbees.jenkins.GitHubCommitNotifier.perform(GitHubCommitNotifier.java:151)
	at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
	at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
	at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:744)
	at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:690)
	at hudson.model.Build$BuildExecution.post2(Build.java:186)
	at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:635)
	at hudson.model.Run.execute(Run.java:1749)
	at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
	at hudson.model.ResourceController.execute(ResourceController.java:97)
	at hudson.model.Executor.run(Executor.java:429)
Build step 'Set build status on GitHub commit [deprecated]' marked build as failure
Not sending mail to unregistered user sidhom@google.com
Not sending mail to unregistered user herohde@google.com
Not sending mail to unregistered user wcn@google.com
Not sending mail to unregistered user mariagh@mariagh.svl.corp.google.com
Not sending mail to unregistered user kirpichov@google.com
Not sending mail to unregistered user mairbek@google.com
Not sending mail to unregistered user pgerver@us.ibm.com
Not sending mail to unregistered user github@alasdairhodge.co.uk
Not sending mail to unregistered user aljoscha.krettek@gmail.com
Not sending mail to unregistered user jasonkuster@google.com
Not sending mail to unregistered user axelmagn@gmail.com
Not sending mail to unregistered user swegner@google.com
Not sending mail to unregistered user apilloud@google.com
Not sending mail to unregistered user daniel.o.programmer@gmail.com
Not sending mail to unregistered user ankurgoenka@gmail.com
Not sending mail to unregistered user schroederc@google.com