You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2020/03/02 12:02:46 UTC

Build failed in Jenkins: beam_Dependency_Check #255

See <https://builds.apache.org/job/beam_Dependency_Check/255/display/redirect?page=changes>

Changes:

[amogh.tiwari] lzo-addons

[amogh.tiwari] 3rd dec 2019, 12:43AM

[amogh.tiwari] PR corrections

[amogh.tiwari] PR javaPreCommit update

[amogh.tiwari] PR changes: added testLzopSpilttale()

[amogh.tiwari] updated gradle for supporting optional dependency of lzo- 2:39 AM IST

[jkai] [BEAM-8331] rewrite the calcite JDBC urls

[millsd] Update Dataflow monitoring URL

[amogh.tiwari] update 19/02/2020 2:32 AM added static class, removed wrappers, updated

[heejong] [BEAM-9335] update hard-coded coder id when translating Java external

[github] Update

[github] Update

[github] Update

[github] Update

[github] Update

[github] Update

[github] Update

[github] Update

[shubham.srivastava] finishing touch 20/02/2020 6:43PM

[drubinstein] Bump google cloud bigquery to 1.24.0

[robertwb] Add some standard requirement URNs to the protos.

[kcweaver] [BEAM-9356] reduce Flink test logs to warn

[boyuanz] Clean up and add type-hints to SDF API

[robertwb] [BEAM-9340] Populate requirements for Python DoFn properties.

[hannahjiang] fix postcommit failure

[robertwb] [BEAM-8019] Branch on having multiple environments.

[iemejia] [BEAM-9342] Upgrade vendored bytebuddy to version 1.10.8

[chadrik] Create a class to encapsulate the work required to submit a pipeline to

[iemejia] Add Dataflow Java11 ValidatesRunner badge to the PR template

[github] Merge pull request #10944: [BEAM-7274] optimize oneOf handling

[github] [BEAM-8280] Fix IOTypeHints origin traceback on partials (#10927)

[relax] Support null fields in rows with ByteBuddy generated code.

[robertwb] Allow metrics update to be tolerant to uninitalized metric containers.

[github] [GoSDK] Fix race condition in statemgr & test (#10941)

[rohde.samuel] Move TestStream implementation to replacement transform

[github] [BEAM-9347] Don't overwrite default runner harness for unified worker

[boyuanz] Update docstring of ManualWatermarkEstimator.set_watermark()

[kcweaver] [BEAM-9373] Spark/Flink tests fix string concat

[boyuanz] Address comments

[boyuanz] Address comments again

[github] [BEAM-9228] Support further partition for FnApi ListBuffer (#10847)

[github] [BEAM-7926] Data-centric Interactive Part3 (#10731)

[boyuanz] Use NoOpWatermarkEstimator in sdf_direct_runner

[chamikara] Updates Dataflow client

[github] [BEAM-9240]: Check for Nullability in typesEqual() method of FieldType

[amogh.tiwari] 25/02/2020 updated imports Amogh Tiwari & Shubham Srivastava

[iemejia] [BEAM-8616] Make hadoop-client a provided dependency on ParquetIO

[mxm] [BEAM-9345] Remove workaround to restore stdout/stderr during JobGraph

[iemejia] [BEAM-9364] Refactor KafkaIO to use DeserializerProviders

[mxm] [BEAM-9345] Add end-to-end Flink job submission test

[iemejia] [BEAM-9352] Align version of transitive jackson dependencies with Beam

[michal.walenia] [BEAM-9258] Add integration test for Cloud DLP

[iemejia] [BEAM-9329] Support request of schemas by version on KafkaIO + CSR

[lcwik] [BEAM-9252] Update to vendored gRPC without problematic

[github] Update

[github] Update

[github] Update

[lcwik] [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed

[crites] Changes TestStreamTranscriptTest to only emit two elements so that its

[alex] [BEAM-7274] Add DynamicMessage Schema support

[github] [BEAM-9322] Fix tag output names within Dataflow to be consistent with

[iemejia] [BEAM-9342] Exclude module-info.class from vendored Byte Buddy 1.10.8

[iemejia] Add KafkaIO support for Confluent Schema Registry to the CHANGEs file

[github] [BEAM-9247] Integrate GCP Vision API functionality (#10959)

[github] Fix kotlin warnings (#10976)

[github] Update python sdk container version to beam-master-20200225 (#10965)

[github] [BEAM-9248] Integrate Google Cloud Natural Language functionality for

[iemejia] Refine access level for `sdks/java/extensions/protobuf`

[github] [BEAM-9355] Basic support for NewType (#10928)

[github] [BEAM-8979] reintroduce mypy-protobuf stub generation (#10734)

[github] [BEAM-8335] Background Caching job (#10899)

[github] [BEAM-8458] Add option to set temp dataset in BigQueryIO.Read (#9852)

[iemejia] Make logger naming consistent with Apache Beam LOG standard

[kcweaver] [BEAM-9300] convert struct literal in ZetaSQL

[github] fix breakage (#10934)

[github] Merge pull request #10901 from [BEAM-8965] Remove duplicate sideinputs

[pabloem] Fix formatting

[github] [BEAM-8618] Tear down unused DoFns periodically in Python SDK harness.

[alex] [BEAM-9394] DynamicMessage handling of empty map violates schema

[github] Merge pull request #10854: State timers documentation

[iemejia] [BEAM-9384] Add SchemaRegistry.getSchemaCoder to get SchemaCoders for

[lcwik] [BEAM-5524] Fix minor issue in style guide.

[github] [BEAM-8201] Pass all other endpoints through provisioning service.

[suztomo] Linkage Checker 1.1.4

[kcweaver] [BEAM-9401] bind Flink MiniCluster to localhost

[robinyqiu] Bump Dataflow Java worker container version

[kcweaver] Test schema does not need to be nullable.

[sunjincheng121] [BEAM-9288] Not bundle conscrypt in gRPC vendor

[mxm] [BEAM-9345] Fix source of test flakiness in FlinkSubmissionTest

[github] [BEAM-9396] Match Docker image names in Jenkins jobs with those

[github] [BEAM-9392] Fix Multi TestStream assertion errors (#10982)

[github] Add integration test for AnnotateText transform (#10977)

[chadrik] [BEAM-9405] Fix post-commit error about create_job_service

[chadrik] more typing fixes

[chadrik] Fix typing issue with python 3.5.2

[chadrik] fixes

[chadrik] Address more issues discovered after rebase

[chadrik] Improve the idiom used for conditional imports

[chadrik] Fix more issues

[chadrik] Update to latest mypy version

[amaliujia] Moving to 2.21.0-SNAPSHOT on master branch.

[github] [BEAM-8487] Handle nested forward references (#10932)

[github] [BEAM-9287] Add Postcommit tests for dataflow runner v2  (#10998)

[github] Adds DisplayData for StateSpecs used by stateful ParDos

[iemejia] Fix non correctly formatted class in sdks/java/core

[iemejia] [BEAM-9342[ Update bytebuddy to version 1.10.8


------------------------------------------
[...truncated 33.40 KB...]
 - org.powermock:powermock-api-mockito2 [2.0.2 -> 2.0.5]
     http://www.powermock.org
 - org.powermock:powermock-module-junit4 [2.0.2 -> 2.0.5]
     http://www.powermock.org
 - org.scala-lang:scala-library [2.11.8 -> 2.13.1]
     https://www.scala-lang.org/
 - org.scala-lang:scala-library [2.12.7 -> 2.13.1]
     https://www.scala-lang.org/
 - org.slf4j:jcl-over-slf4j [1.7.25 -> 2.0.0-alpha1]
     http://www.slf4j.org
 - org.slf4j:slf4j-api [1.7.21 -> 2.0.0-alpha1]
     http://www.slf4j.org
 - org.slf4j:slf4j-api [1.7.25 -> 2.0.0-alpha1]
     http://www.slf4j.org
 - org.slf4j:slf4j-jdk14 [1.7.25 -> 2.0.0-alpha1]
     http://www.slf4j.org
 - org.slf4j:slf4j-simple [1.7.25 -> 2.0.0-alpha1]
     http://www.slf4j.org
 - org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 2.8]
 - org.springframework:spring-expression [4.3.18.RELEASE -> 5.2.4.RELEASE]
     https://github.com/spring-projects/spring-framework
 - org.testcontainers:clickhouse [1.10.5 -> 1.12.5]
     https://testcontainers.org
 - org.testcontainers:localstack [1.11.2 -> 1.12.5]
     https://testcontainers.org
 - org.testcontainers:testcontainers [1.11.3 -> 1.12.5]
     https://testcontainers.org
 - org.xerial.snappy:snappy-java [1.1.4 -> 1.1.7.3]
     https://github.com/xerial/snappy-java
 - redis.clients:jedis [3.0.1 -> 3.2.0]
     https://github.com/xetorthio/jedis
 - ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.2.4]
     https://github.com/ClickHouse/clickhouse-jdbc
 - software.amazon.awssdk:apache-client [2.10.61 -> 2.10.76]
     https://aws.amazon.com/sdkforjava
 - software.amazon.awssdk:auth [2.10.61 -> 2.10.76]
     https://aws.amazon.com/sdkforjava
 - software.amazon.awssdk:cloudwatch [2.10.61 -> 2.10.76]
     https://aws.amazon.com/sdkforjava
 - software.amazon.awssdk:dynamodb [2.10.61 -> 2.10.76]
     https://aws.amazon.com/sdkforjava
 - software.amazon.awssdk:sdk-core [2.10.61 -> 2.10.76]
     https://aws.amazon.com/sdkforjava
 - software.amazon.awssdk:sns [2.10.61 -> 2.10.76]
     https://aws.amazon.com/sdkforjava
 - software.amazon.awssdk:sqs [2.10.61 -> 2.10.76]
     https://aws.amazon.com/sdkforjava
 - sqlline:sqlline [1.4.0 -> 1.9.0]
     https://github.com/julianhyde/sqlline

Gradle updates:
 - Gradle: [5.2.1 -> 6.2.1]

Generated report file build/dependencyUpdates/report.txt

> Task :sdks:python:dependencyUpdates

# Virtualenv for the rest of the script to run setup
rm -rf sdks/
virtualenv sdks/python
Using base prefix '/usr'
New python executable in <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin/python3>
Also creating executable in <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin/python>
Installing setuptools, pip, wheel...
done.
. sdks/python/bin/activate
# This file must be used with "source bin/activate" *from bash*
# you cannot run it directly

deactivate () {
    unset -f pydoc >/dev/null 2>&1

    # reset old environment variables
    # ! [ -z ${VAR+_} ] returns true if VAR is declared at all
    if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
        PATH="$_OLD_VIRTUAL_PATH"
        export PATH
        unset _OLD_VIRTUAL_PATH
    fi
    if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
        PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
        export PYTHONHOME
        unset _OLD_VIRTUAL_PYTHONHOME
    fi

    # This should detect bash and zsh, which have a hash command that must
    # be called to get it to forget past commands.  Without forgetting
    # past commands the $PATH changes we made may not be respected
    if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
        hash -r 2>/dev/null
    fi

    if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
        PS1="$_OLD_VIRTUAL_PS1"
        export PS1
        unset _OLD_VIRTUAL_PS1
    fi

    unset VIRTUAL_ENV
    if [ ! "${1-}" = "nondestructive" ] ; then
    # Self destruct!
        unset -f deactivate
    fi
}

# unset irrelevant variables
deactivate nondestructive

VIRTUAL_ENV="<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python">
export VIRTUAL_ENV

_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH

# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
    _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
    unset PYTHONHOME
fi

if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
    _OLD_VIRTUAL_PS1="${PS1-}"
    if [ "x" != x ] ; then
        PS1="${PS1-}"
    else
        PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}"
    fi
    export PS1
fi
basename "$VIRTUAL_ENV"

# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true

pydoc () {
    python -m pydoc "$@"
}

# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands.  Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
    hash -r 2>/dev/null
fi
pip install -e .[gcp,test,docs]
Obtaining file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
    ERROR: Command errored out with exit status 1:
     command: <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin/python3> -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/setup.py'"'"';> __file__='"'"'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/setup.py'"'"';f=getattr(tokenize,> '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' egg_info
         cwd: <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/>
    Complete output (67 lines):
    running egg_info
    <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/lib/python3.5/site-packages/setuptools/dist.py>:476: UserWarning: Normalizing '2.21.0.dev' to '2.21.0.dev0'
      normalized_version,
    <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py>:241: UserWarning: Installing grpcio-tools is recommended for development.
      warnings.warn('Installing grpcio-tools is recommended for development.')
    WARNING:root:Installing grpcio-tools into <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/.eggs/grpcio-wheels>
    Collecting grpcio-tools<=1.14.2,>=1.3.5
      Using cached grpcio_tools-1.14.2-cp35-cp35m-manylinux1_x86_64.whl (22.2 MB)
    Processing /home/jenkins/.cache/pip/wheels/bf/c9/a3/c538d90ef17cf7823fa51fc701a7a7a910a80f6a405bf15b1a/future-0.16.0-cp35-none-any.whl
    Collecting mypy-protobuf==1.18
      Using cached mypy_protobuf-1.18-py3-none-any.whl (7.3 kB)
    Collecting grpcio>=1.14.2
      Using cached grpcio-1.27.2-cp35-cp35m-manylinux2010_x86_64.whl (2.7 MB)
    Collecting protobuf>=3.5.0.post1
      Using cached protobuf-3.11.3-cp35-cp35m-manylinux1_x86_64.whl (1.3 MB)
    Collecting six>=1.5.2
      Using cached six-1.14.0-py2.py3-none-any.whl (10 kB)
    Collecting setuptools
      Using cached setuptools-45.2.0-py3-none-any.whl (584 kB)
    Installing collected packages: six, grpcio, setuptools, protobuf, grpcio-tools, future, mypy-protobuf
    Successfully installed future-0.16.0 grpcio-1.27.2 grpcio-tools-1.14.2 mypy-protobuf-1.18 protobuf-3.11.3 setuptools-45.2.0 six-1.14.0
    WARNING:root:Installing grpcio-tools took 6.24 seconds.
    INFO:gen_protos:Regenerating Python proto definitions (no output files).
    Process Process-1:
    Traceback (most recent call last):
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py",> line 292, in generate_proto_files
        from grpc_tools import protoc
    ImportError: No module named 'grpc_tools'
    
    During handling of the above exception, another exception occurred:
    
    Traceback (most recent call last):
      File "/usr/lib/python3.5/multiprocessing/process.py", line 249, in _bootstrap
        self.run()
      File "/usr/lib/python3.5/multiprocessing/process.py", line 93, in run
        self._target(*self._args, **self._kwargs)
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py",> line 378, in _install_grpcio_tools_and_generate_proto_files
        generate_proto_files(force=force)
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py",> line 315, in generate_proto_files
        protoc_gen_mypy = _find_protoc_gen_mypy()
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py",> line 233, in _find_protoc_gen_mypy
        (fname, ', '.join(search_paths)))
    RuntimeError: Could not find protoc-gen-mypy in <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin,> <https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/bin,> /home/jenkins/tools/java/latest1.8/bin, /usr/local/sbin, /usr/local/bin, /usr/sbin, /usr/bin, /sbin, /bin, /usr/games, /usr/local/games
    Traceback (most recent call last):
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py",> line 292, in generate_proto_files
        from grpc_tools import protoc
    ImportError: No module named 'grpc_tools'
    
    During handling of the above exception, another exception occurred:
    
    Traceback (most recent call last):
      File "<string>", line 1, in <module>
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/setup.py",> line 317, in <module>
        'mypy': generate_protos_first(mypy),
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/sdks/python/lib/python3.5/site-packages/setuptools/__init__.py",> line 144, in setup
        return distutils.core.setup(**attrs)
      File "/usr/lib/python3.5/distutils/core.py", line 148, in setup
        dist.run_commands()
      File "/usr/lib/python3.5/distutils/dist.py", line 955, in run_commands
        self.run_command(cmd)
      File "/usr/lib/python3.5/distutils/dist.py", line 974, in run_command
        cmd_obj.run()
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/setup.py",> line 241, in run
        gen_protos.generate_proto_files()
      File "<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/gen_protos.py",> line 310, in generate_proto_files
        raise ValueError("Proto generation failed (see log for details).")
    ValueError: Proto generation failed (see log for details).
    ----------------------------------------
ERROR: Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.

> Task :sdks:python:dependencyUpdates FAILED

FAILURE: Build failed with an exception.

* Where:
Build file '<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'> line: 94

* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 16s
2 actionable tasks: 2 executed

Publishing build scan...
https://gradle.com/s/7ajby32jfuyrw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org