You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/10/25 12:21:00 UTC

Build failed in Jenkins: beam_Dependency_Check #346

See <https://ci-beam.apache.org/job/beam_Dependency_Check/346/display/redirect?page=changes>

Changes:

[zhoufek] [BEAM-9487] Multiple Trigger.may_lose_data fixes

[zhoufek] [BEAM-9487] Remove CONDITION_NOT_GUARANTEED as potential data loss

[zhoufek] [BEAM-9487] Do AfterAny, AfterAll, and AfterEach checks properly (i.e.

[zhoufek] [BEAM-9487] Remove unused import

[zhoufek] [BEAM-9487] Reintroduce flag but do not use it

[zhoufek] [BEAM-9487] Add test that shows AfterCount finishing

[zhoufek] [BEAM-9487] Make _ParallelTriggerFn.may_finish clearer

[samuelw] [BEAM-13042] Prevent unexpected blocking in

[Robert Bradshaw] Revert "Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work

[Robert Bradshaw] [BEAM-13040] Add some test cases enforcing side input waiting.

[Robert Bradshaw] lint

[brachipa] [BEAM-12393] sql support for Zeta Sql

[aydar.zaynutdinov] [BEAM-12988] [Playground]

[brachipa] [BEAM-12393] package private

[brachipa] [BEAM-12393] returning more generic interface

[noreply] Add -XX:+AlwaysActAsServerClassMachine to Java SDK container

[noreply] [BEAM-13066] Produce abstract iterables from IterableCoder. (#15662)

[noreply] [BEAM-11936] Fix some errorprone warnings (#15648)

[noreply] [BEAM-13068] Add xlangx.DecodeStructPayload (#15741)

[Luke Cwik] [BEAM-13015] Implement a simplified cancellable blocking queue with

[ilya.kozyrev] Implement initial server with grpcweb wrapper

[aydar.zaynutdinov] [BEAM_13077][Playground]

[egalpin] [BEAM-10990] Adds response filtering for ElasticsearchIO

[egalpin] [BEAM-5172] Tries to reduce ES uTest flakiness

[noreply] [BEAM-13068] Add a SQL API in Beam Go SDK (#15746)

[Kyle Weaver] [BEAM-13055] Use unshallow clone to create PR.

[noreply] [BEAM-13079] Updates cross-language transform URNs to use the new

[moritz] adhoc: Minor update to flink runner docs

[noreply] [BEAM-11087] Add default WindowMappingFn from Main to Side Input

[noreply] [BEAM-13082] Re-use dataWriter buffer. (#15762)

[noreply] Merge pull request #15761 from [BEAM-13008] Create gradle tasks for the

[noreply] [BEAM-13096] Double test timeout. (#15774)

[noreply] [BEAM-13019] Add `containsInAnyOrder` with matchers to the

[Daniel Oliveira] Avoiding read-only Go module cache in Gradle config.

[noreply] [BEAM-11758] Update basics page: Pipeline, PCollection, PTransform

[noreply] Test SetState addIfAbsent with no read (#15776)

[noreply] lazy creation of source splits for export-based ReadFromBigQuery

[noreply] [BEAM-11275] Support remote package download from remote filesystems in

[noreply] [BEAM-13015] Create a multiplexer that sends Elements based upon

[noreply] Fixing BigQueryIO request too big corner case for streaming inserts


------------------------------------------
[...truncated 72.83 KB...]
5 actionable tasks: 5 executed

Publishing build scan...
https://gradle.com/s/267z2sdhycll4

Build step 'Invoke Gradle script' changed build result to SUCCESS
[beam_Dependency_Check] $ /bin/bash -xe /tmp/jenkins9103031907167357690.sh
+ cd src
+ bash .test-infra/jenkins/dependency_check/generate_report.sh

REPORT_DESCRIPTION="
<h4> A dependency update is high priority if it satisfies one of following criteria: </h4>
<ul>
<li> It has major versions update available, e.g. org.assertj:assertj-core 2.5.0 -> 3.10.0; </li>
</ul>
<ul>
<li> It is over 3 minor versions behind the latest version, e.g. org.tukaani:xz 1.5 -> 1.8; </li>
</ul>
<ul>
<li> The current version is behind the later version for over 180 days, e.g. com.google.auto.service:auto-service 2014-10-24 -> 2017-12-11. </li>
</ul>
<h4> In Beam, we make a best-effort attempt at keeping all dependencies up-to-date.
     In the future, issues will be filed and tracked for these automatically,
     but in the meantime you can search for existing issues or open a new one.
</h4>
<h4> For more information: <a href=\"https://beam.apache.org/contribute/dependencies/\"> Beam Dependency Guide </a></h4>"


# Virtualenv for the rest of the script to run setup
virtualenv dependency/check
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3>
Also creating executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python>
Installing setuptools, pip, wheel...
done.
. dependency/check/bin/activate
# This file must be used with "source bin/activate" *from bash*
# you cannot run it directly

deactivate () {
    unset -f pydoc >/dev/null 2>&1

    # reset old environment variables
    # ! [ -z ${VAR+_} ] returns true if VAR is declared at all
    if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
        PATH="$_OLD_VIRTUAL_PATH"
        export PATH
        unset _OLD_VIRTUAL_PATH
    fi
    if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
        PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
        export PYTHONHOME
        unset _OLD_VIRTUAL_PYTHONHOME
    fi

    # This should detect bash and zsh, which have a hash command that must
    # be called to get it to forget past commands.  Without forgetting
    # past commands the $PATH changes we made may not be respected
    if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
        hash -r 2>/dev/null
    fi

    if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
        PS1="$_OLD_VIRTUAL_PS1"
        export PS1
        unset _OLD_VIRTUAL_PS1
    fi

    unset VIRTUAL_ENV
    if [ ! "${1-}" = "nondestructive" ] ; then
    # Self destruct!
        unset -f deactivate
    fi
}

# unset irrelevant variables
deactivate nondestructive

VIRTUAL_ENV="<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check">
export VIRTUAL_ENV

_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH

# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
    _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
    unset PYTHONHOME
fi

if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
    _OLD_VIRTUAL_PS1="${PS1-}"
    if [ "x" != x ] ; then
        PS1="${PS1-}"
    else
        PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}"
    fi
    export PS1
fi
basename "$VIRTUAL_ENV"

# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true

pydoc () {
    python -m pydoc "$@"
}

# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands.  Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
    hash -r 2>/dev/null
fi
pip install --upgrade google-cloud-bigquery
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Collecting google-cloud-bigquery
  Downloading google_cloud_bigquery-1.28.0-py2.py3-none-any.whl (187 kB)
Collecting six<2.0.0dev,>=1.13.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting google-api-core<2.0dev,>=1.21.0
  Downloading google_api_core-1.23.0-py2.py3-none-any.whl (91 kB)
Collecting google-resumable-media<2.0dev,>=0.6.0
  Downloading google_resumable_media-1.1.0-py2.py3-none-any.whl (75 kB)
Collecting google-cloud-core<2.0dev,>=1.4.1
  Downloading google_cloud_core-1.4.4-py2.py3-none-any.whl (27 kB)
Requirement already satisfied: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0dev,>=1.21.0->google-cloud-bigquery) (50.3.2)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
  Downloading googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting requests<3.0.0dev,>=2.18.0
  Downloading requests-2.25.1-py2.py3-none-any.whl (61 kB)
Collecting pytz
  Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting protobuf>=3.12.0
  Downloading protobuf-3.19.0-py2.py3-none-any.whl (162 kB)
Collecting google-auth<2.0dev,>=1.21.1
  Downloading google_auth-1.23.0-py2.py3-none-any.whl (114 kB)
Collecting pyasn1-modules>=0.2.1
  Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
  Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting cachetools<5.0,>=2.0.0
  Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-crc32c<2.0dev,>=1.0
  Downloading google_crc32c-1.0.0-cp35-cp35m-manylinux2010_x86_64.whl (39 kB)
Collecting cffi>=1.0.0
  Downloading cffi-1.15.0.tar.gz (484 kB)
Collecting pycparser
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting pyasn1<0.5.0,>=0.4.6
  Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting chardet<5,>=3.0.2
  Downloading chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<3,>=2.5
  Downloading idna-2.10-py2.py3-none-any.whl (58 kB)
Building wheels for collected packages: cffi
  Building wheel for cffi (setup.py): started
  Building wheel for cffi (setup.py): finished with status 'error'
  ERROR: Command errored out with exit status 1:
   command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-t9jvog2j/cffi_486e654dae594bb5a1201e1cff2bf318/setup.py'"'"'; __file__='"'"'/tmp/pip-install-t9jvog2j/cffi_486e654dae594bb5a1201e1cff2bf318/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-c4p2nfx2
       cwd: /tmp/pip-install-t9jvog2j/cffi_486e654dae594bb5a1201e1cff2bf318/
  Complete output (34 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.5
  creating build/lib.linux-x86_64-3.5/cffi
  copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi
  running build_ext
  building '_cffi_backend' extension
  creating build/temp.linux-x86_64-3.5
  creating build/temp.linux-x86_64-3.5/c
  x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o
  c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
  compilation terminated.
  error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for cffi
  Running setup.py clean for cffi
Failed to build cffi
Installing collected packages: pyasn1, urllib3, six, rsa, pycparser, pyasn1-modules, protobuf, idna, chardet, certifi, cachetools, requests, pytz, googleapis-common-protos, google-auth, cffi, google-crc32c, google-api-core, google-resumable-media, google-cloud-core, google-cloud-bigquery
    Running setup.py install for cffi: started
    Running setup.py install for cffi: finished with status 'error'
    ERROR: Command errored out with exit status 1:
     command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-t9jvog2j/cffi_486e654dae594bb5a1201e1cff2bf318/setup.py'"'"'; __file__='"'"'/tmp/pip-install-t9jvog2j/cffi_486e654dae594bb5a1201e1cff2bf318/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-krotsy0d/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi>
         cwd: /tmp/pip-install-t9jvog2j/cffi_486e654dae594bb5a1201e1cff2bf318/
    Complete output (34 lines):
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.5
    creating build/lib.linux-x86_64-3.5/cffi
    copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi
    running build_ext
    building '_cffi_backend' extension
    creating build/temp.linux-x86_64-3.5
    creating build/temp.linux-x86_64-3.5/c
    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o
    c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
    compilation terminated.
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-t9jvog2j/cffi_486e654dae594bb5a1201e1cff2bf318/setup.py'"'"'; __file__='"'"'/tmp/pip-install-t9jvog2j/cffi_486e654dae594bb5a1201e1cff2bf318/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-krotsy0d/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi> Check the logs for full command output.
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Beam Dependency Check Report (2021-11-18)

Posted by Apache Jenkins Server <je...@builds.apache.org>.
## High Priority Dependency Updates Of Beam Python SDK:

**Dependency Name** | **Current Version** | **Latest Version** | **Release
Date Of the Current Used Version** | **Release Date Of The Latest Release** |
**JIRA Issue**  
---|---|---|---|---|---  
[chromedriver-binary](https://pypi.org/project/chromedriver-binary) |
93.0.4577.63.0 | 96.0.4664.45.0 | 2021-09-20 | 2021-11-18|
[BEAM-10426](https://issues.apache.org/jira/browse/BEAM-10426)  
[dill](https://pypi.org/project/dill) | 0.3.1.1 | 0.3.4 | 2019-10-07 |
2021-06-14| [BEAM-11167](https://issues.apache.org/jira/browse/BEAM-11167)  
[google-api-core](https://pypi.org/project/google-api-core) | 1.31.4 | 2.2.2 |
None | 2021-11-18|
[BEAM-12784](https://issues.apache.org/jira/browse/BEAM-12784)  
[google-auth](https://pypi.org/project/google-auth) | 1.35.0 | 2.3.3 |
2021-08-23 | 2021-11-18|
[BEAM-12785](https://issues.apache.org/jira/browse/BEAM-12785)  
[google-cloud-bigtable](https://pypi.org/project/google-cloud-bigtable) |
1.7.0 | 2.4.0 | 2021-04-12 | 2021-10-04|
[BEAM-8127](https://issues.apache.org/jira/browse/BEAM-8127)  
[google-cloud-datastore](https://pypi.org/project/google-cloud-datastore) |
1.15.3 | 2.4.0 | 2020-11-16 | 2021-11-18|
[BEAM-8443](https://issues.apache.org/jira/browse/BEAM-8443)  
[google-cloud-language](https://pypi.org/project/google-cloud-language) |
1.3.0 | 2.3.1 | 2020-10-26 | 2021-11-18|
[BEAM-11118](https://issues.apache.org/jira/browse/BEAM-11118)  
[google-cloud-pubsub](https://pypi.org/project/google-cloud-pubsub) | 1.7.0 |
2.9.0 | 2020-07-20 | 2021-11-18|
[BEAM-5539](https://issues.apache.org/jira/browse/BEAM-5539)  
[google-cloud-recommendations-ai](https://pypi.org/project/google-cloud-
recommendations-ai) | 0.2.0 | 0.5.1 | 2021-07-05 | 2021-11-18|
[BEAM-13273](https://issues.apache.org/jira/browse/BEAM-13273)  
[google-cloud-spanner](https://pypi.org/project/google-cloud-spanner) | 1.19.1
| 3.11.1 | 2020-11-16 | 2021-10-11|
[BEAM-10345](https://issues.apache.org/jira/browse/BEAM-10345)  
[google-cloud-videointelligence](https://pypi.org/project/google-cloud-
videointelligence) | 1.16.1 | 2.5.1 | 2020-11-23 | 2021-11-18|
[BEAM-11319](https://issues.apache.org/jira/browse/BEAM-11319)  
[google-cloud-vision](https://pypi.org/project/google-cloud-vision) | 1.0.0 |
2.6.2 | 2020-03-24 | 2021-11-18|
[BEAM-9581](https://issues.apache.org/jira/browse/BEAM-9581)  
[grpcio-tools](https://pypi.org/project/grpcio-tools) | 1.37.0 | 1.42.0 |
2021-04-12 | 2021-11-18|
[BEAM-9582](https://issues.apache.org/jira/browse/BEAM-9582)  
[ipykernel](https://pypi.org/project/ipykernel) | 5.5.6 | 6.5.0 | 2021-10-11 |
2021-11-18| [BEAM-12575](https://issues.apache.org/jira/browse/BEAM-12575)  
[jupyter-client](https://pypi.org/project/jupyter-client) | 6.1.12 | 7.0.6 |
2021-04-12 | 2021-10-11|
[BEAM-12786](https://issues.apache.org/jira/browse/BEAM-12786)  
[mock](https://pypi.org/project/mock) | 2.0.0 | 4.0.3 | 2019-05-20 |
2020-12-14| [BEAM-7369](https://issues.apache.org/jira/browse/BEAM-7369)  
[mypy-protobuf](https://pypi.org/project/mypy-protobuf) | 1.18 | 3.0.0 |
2020-03-24 | 2021-11-18|
[BEAM-10346](https://issues.apache.org/jira/browse/BEAM-10346)  
[Pillow](https://pypi.org/project/Pillow) | 7.2.0 | 8.4.0 | 2020-10-19 |
2021-11-18| [BEAM-11071](https://issues.apache.org/jira/browse/BEAM-11071)  
[pluggy](https://pypi.org/project/pluggy) | 0.13.1 | 1.0.0 | 2021-08-30 |
2021-08-30| [BEAM-12819](https://issues.apache.org/jira/browse/BEAM-12819)  
[PyHamcrest](https://pypi.org/project/PyHamcrest) | 1.10.1 | 2.0.2 |
2020-01-20 | 2020-07-08|
[BEAM-9155](https://issues.apache.org/jira/browse/BEAM-9155)  
[pyparsing](https://pypi.org/project/pyparsing) | 2.4.7 | 3.0.6 | None |
2021-11-18| [BEAM-13274](https://issues.apache.org/jira/browse/BEAM-13274)  
[pytest](https://pypi.org/project/pytest) | 4.6.11 | 6.2.5 | 2020-07-08 |
2021-09-06| [BEAM-8606](https://issues.apache.org/jira/browse/BEAM-8606)  
[pytest-timeout](https://pypi.org/project/pytest-timeout) | 1.4.2 | 2.0.1 |
2021-10-11 | 2021-11-18|
[BEAM-13029](https://issues.apache.org/jira/browse/BEAM-13029)  
[pytest-xdist](https://pypi.org/project/pytest-xdist) | 1.34.0 | 2.4.0 |
2020-08-17 | 2021-09-27|
[BEAM-10713](https://issues.apache.org/jira/browse/BEAM-10713)  
[selenium](https://pypi.org/project/selenium) | 3.141.0 | 4.0.0 | None |
2021-11-18| [BEAM-13275](https://issues.apache.org/jira/browse/BEAM-13275)  
[setuptools](https://pypi.org/project/setuptools) | 58.3.0 | 59.1.1 | None |
2021-11-18| [BEAM-10714](https://issues.apache.org/jira/browse/BEAM-10714)  
[tenacity](https://pypi.org/project/tenacity) | 5.1.5 | 8.0.1 | 2019-11-11 |
2021-07-19| [BEAM-8607](https://issues.apache.org/jira/browse/BEAM-8607)  
[typing-extensions](https://pypi.org/project/typing-extensions) | 3.10.0.2 |
4.0.0 | None | 2021-11-18|
[BEAM-12267](https://issues.apache.org/jira/browse/BEAM-12267)  
  
## High Priority Dependency Updates Of Beam Java SDK:

**Dependency Name** | **Current Version** | **Latest Version** | **Release
Date Of the Current Used Version** | **Release Date Of The Latest Release** |
**JIRA Issue**  
---|---|---|---|---|---  
[com.alibaba:fastjson](https://mvnrepository.com/artifact/com.alibaba/fastjson)
| 1.2.69 | 1.2.78 | 2020-05-31 | 2021-08-09|
[BEAM-8632](https://issues.apache.org/jira/browse/BEAM-8632)  
[com.azure:azure-core](https://mvnrepository.com/artifact/com.azure/azure-
core) | 1.9.0 | 1.22.0 | 2020-10-02 | 2021-11-05|
[BEAM-11888](https://issues.apache.org/jira/browse/BEAM-11888)  
[com.azure:azure-identity](https://mvnrepository.com/artifact/com.azure/azure-
identity) | 1.0.8 | 1.4.1 | 2020-07-07 | 2021-11-09|
[BEAM-11814](https://issues.apache.org/jira/browse/BEAM-11814)  
[com.azure:azure-storage-
blob](https://mvnrepository.com/artifact/com.azure/azure-storage-blob) |
12.10.0 | 12.15.0-beta.1 | 2021-01-15 | 2021-11-05|
[BEAM-10800](https://issues.apache.org/jira/browse/BEAM-10800)  
[com.azure:azure-storage-
common](https://mvnrepository.com/artifact/com.azure/azure-storage-common) |
12.10.0 | 12.15.0-beta.1 | 2021-01-14 | 2021-11-05|
[BEAM-11889](https://issues.apache.org/jira/browse/BEAM-11889)  
[com.datastax.cassandra:cassandra-driver-
core](https://mvnrepository.com/artifact/com.datastax.cassandra/cassandra-
driver-core) | 3.10.2 | 4.0.0 | 2020-08-26 | 2019-03-18|
[BEAM-8674](https://issues.apache.org/jira/browse/BEAM-8674)  
[com.esotericsoftware:kryo](https://mvnrepository.com/artifact/com.esotericsoftware/kryo)
| 4.0.2 | 5.2.0 | 2018-03-20 | 2021-07-31|
[BEAM-5809](https://issues.apache.org/jira/browse/BEAM-5809)  
[com.esotericsoftware.kryo:kryo](https://mvnrepository.com/artifact/com.esotericsoftware.kryo/kryo)
| 2.21 | 2.24.0 | 2013-02-27 | 2014-05-04|
[BEAM-5574](https://issues.apache.org/jira/browse/BEAM-5574)  
[com.fasterxml.jackson.core:jackson-
databind](https://mvnrepository.com/artifact/com.fasterxml.jackson.core/jackson-
databind) | 2.0.1 | 2.13.0 | 2012-04-24 | 2021-09-30|
[BEAM-13277](https://issues.apache.org/jira/browse/BEAM-13277)  
[com.fasterxml.jackson.dataformat:jackson-dataformat-
yaml](https://mvnrepository.com/artifact/com.fasterxml.jackson.dataformat/jackson-
dataformat-yaml) | 2.11.3 | 2.13.0 | 2020-10-02 | 2021-09-30|
[BEAM-13278](https://issues.apache.org/jira/browse/BEAM-13278)  
[com.github.ben-manes.versions:com.github.ben-
manes.versions.gradle.plugin](https://mvnrepository.com/artifact/com.github.ben-
manes.versions/com.github.ben-manes.versions.gradle.plugin) | 0.33.0 | 0.39.0
| 2020-09-14 | 2021-05-31|
[BEAM-6645](https://issues.apache.org/jira/browse/BEAM-6645)  
[com.github.jk1.dependency-license-report:com.github.jk1.dependency-license-
report.gradle.plugin](https://mvnrepository.com/artifact/com.github.jk1.dependency-
license-report/com.github.jk1.dependency-license-report.gradle.plugin) | 1.16
| 2.0 | 2020-10-26 | 2021-09-06|
[BEAM-11120](https://issues.apache.org/jira/browse/BEAM-11120)  
[com.github.luben:zstd-
jni](https://mvnrepository.com/artifact/com.github.luben/zstd-jni) | 1.4.5-2 |
1.5.0-4 | 2020-05-30 | 2021-07-21|
[BEAM-9194](https://issues.apache.org/jira/browse/BEAM-9194)  
[com.github.spotbugs:spotbugs](https://mvnrepository.com/artifact/com.github.spotbugs/spotbugs)
| 4.0.6 | 4.5.0 | 2020-06-23 | 2021-11-11|
[BEAM-7792](https://issues.apache.org/jira/browse/BEAM-7792)  
[com.github.spotbugs:spotbugs-
annotations](https://mvnrepository.com/artifact/com.github.spotbugs/spotbugs-
annotations) | 4.0.6 | 4.5.0 | 2020-06-23 | 2021-11-11|
[BEAM-6951](https://issues.apache.org/jira/browse/BEAM-6951)  
[com.google.api.grpc:proto-google-cloud-
dlp-v2](https://mvnrepository.com/artifact/com.google.api.grpc/proto-google-
cloud-dlp-v2) | 1.1.4 | 3.0.11 | 2020-05-04 | 2021-10-20|
[BEAM-11892](https://issues.apache.org/jira/browse/BEAM-11892)  
[com.google.api.grpc:proto-google-cloud-
language-v1](https://mvnrepository.com/artifact/com.google.api.grpc/proto-
google-cloud-language-v1) | 1.81.4 | 2.1.3 | 2020-04-10 | 2021-10-20|
[BEAM-12760](https://issues.apache.org/jira/browse/BEAM-12760)  
[com.google.api.grpc:proto-google-cloud-recommendations-
ai-v1beta1](https://mvnrepository.com/artifact/com.google.api.grpc/proto-
google-cloud-recommendations-ai-v1beta1) | 0.3.7 | 0.8.2 | 2020-11-02 |
2021-10-20| [BEAM-12517](https://issues.apache.org/jira/browse/BEAM-12517)  
[com.google.api.grpc:proto-google-cloud-video-
intelligence-v1](https://mvnrepository.com/artifact/com.google.api.grpc/proto-
google-cloud-video-intelligence-v1) | 1.2.0 | 2.0.10 | 2020-03-10 |
2021-10-20| [BEAM-11894](https://issues.apache.org/jira/browse/BEAM-11894)  
[com.google.api.grpc:proto-google-cloud-
vision-v1](https://mvnrepository.com/artifact/com.google.api.grpc/proto-
google-cloud-vision-v1) | 1.81.3 | 2.0.14 | 2020-04-07 | 2021-10-20|
[BEAM-11895](https://issues.apache.org/jira/browse/BEAM-11895)  
[com.google.api.grpc:proto-google-common-
protos](https://mvnrepository.com/artifact/com.google.api.grpc/proto-google-
common-protos) | 2.0.1 | 2.6.0 | 2020-11-02 | 2021-10-14|
[BEAM-6899](https://issues.apache.org/jira/browse/BEAM-6899)  
[com.google.apis:google-api-services-
bigquery](https://mvnrepository.com/artifact/com.google.apis/google-api-
services-bigquery) | v2-rev20211017-1.32.1 | v2-rev20211106-1.32.1 |
2021-10-22 | 2021-11-14|
[BEAM-8684](https://issues.apache.org/jira/browse/BEAM-8684)  
[com.google.apis:google-api-services-
cloudresourcemanager](https://mvnrepository.com/artifact/com.google.apis/google-
api-services-cloudresourcemanager) | v1-rev20211017-1.32.1 |
v3-rev20211107-1.32.1 | 2021-10-19 | 2021-11-09|
[BEAM-8751](https://issues.apache.org/jira/browse/BEAM-8751)  
[com.google.apis:google-api-services-
dataflow](https://mvnrepository.com/artifact/com.google.apis/google-api-
services-dataflow) | v1b3-rev20210818-1.32.1 | v1beta3-rev12-1.20.0 |
2021-08-26 | 2015-04-29|
[BEAM-8752](https://issues.apache.org/jira/browse/BEAM-8752)  
[com.google.apis:google-api-services-
healthcare](https://mvnrepository.com/artifact/com.google.apis/google-api-
services-healthcare) | v1-rev20211016-1.32.1 | v1-rev20211105-1.32.1 |
2021-10-27 | 2021-11-16|
[BEAM-10349](https://issues.apache.org/jira/browse/BEAM-10349)  
[com.google.auto.service:auto-
service](https://mvnrepository.com/artifact/com.google.auto.service/auto-
service) | 1.0-rc6 | 1.0.1 | 2019-07-16 | 2021-11-03|
[BEAM-5541](https://issues.apache.org/jira/browse/BEAM-5541)  
[com.google.auto.service:auto-service-
annotations](https://mvnrepository.com/artifact/com.google.auto.service/auto-
service-annotations) | 1.0-rc6 | 1.0.1 | 2019-07-16 | 2021-11-03|
[BEAM-10350](https://issues.apache.org/jira/browse/BEAM-10350)  
[com.google.cloud:google-cloud-
dlp](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-dlp) |
1.1.4 | 3.0.11 | 2020-05-04 | 2021-10-20|
[BEAM-10352](https://issues.apache.org/jira/browse/BEAM-10352)  
[com.google.cloud:google-cloud-
language](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-
language) | 1.99.4 | 2.1.3 | 2020-04-10 | 2021-10-20|
[BEAM-11974](https://issues.apache.org/jira/browse/BEAM-11974)  
[com.google.cloud:google-cloud-recommendations-
ai](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-
recommendations-ai) | 0.3.7 | 0.8.2 | 2020-11-02 | 2021-10-20|
[BEAM-12518](https://issues.apache.org/jira/browse/BEAM-12518)  
[com.google.cloud:google-cloud-
storage](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-
storage) | 1.102.0 | 2.2.1 | 2019-12-05 | 2021-11-15|
[BEAM-10801](https://issues.apache.org/jira/browse/BEAM-10801)  
[com.google.cloud:google-cloud-video-
intelligence](https://mvnrepository.com/artifact/com.google.cloud/google-
cloud-video-intelligence) | 1.2.0 | 2.0.10 | 2020-03-10 | 2021-10-20|
[BEAM-11011](https://issues.apache.org/jira/browse/BEAM-11011)  
[com.google.cloud:google-cloud-
vision](https://mvnrepository.com/artifact/com.google.cloud/google-cloud-
vision) | 1.99.3 | 2.0.14 | 2020-04-07 | 2021-10-20|
[BEAM-11975](https://issues.apache.org/jira/browse/BEAM-11975)  
[com.google.code.gson:gson](https://mvnrepository.com/artifact/com.google.code.gson/gson)
| 2.8.6 | 2.8.9 | 2019-10-04 | 2021-10-29|
[BEAM-5558](https://issues.apache.org/jira/browse/BEAM-5558)  
[com.google.guava:guava](https://mvnrepository.com/artifact/com.google.guava/guava)
| 30.1-jre | 31.0.1-jre | 2020-12-14 | 2021-09-27|
[BEAM-5559](https://issues.apache.org/jira/browse/BEAM-5559)  
[com.google.http-client:google-http-
client](https://mvnrepository.com/artifact/com.google.http-client/google-http-
client) | 1.37.0 | 1.40.1 | 2020-10-13 | 2021-10-07|
[BEAM-8695](https://issues.apache.org/jira/browse/BEAM-8695)  
[com.google.protobuf:protobuf-java-
util](https://mvnrepository.com/artifact/com.google.protobuf/protobuf-java-
util) | 3.18.1 | 4.0.0-rc-2 | 2021-10-05 | 2020-07-21|
[BEAM-8697](https://issues.apache.org/jira/browse/BEAM-8697)  
[com.google.protobuf:protoc](https://mvnrepository.com/artifact/com.google.protobuf/protoc)
| 3.18.1 | 4.0.0-rc-2 | 2021-10-05 | 2020-07-21|
[BEAM-8634](https://issues.apache.org/jira/browse/BEAM-8634)  
[com.google.zetasql:zetasql-
client](https://mvnrepository.com/artifact/com.google.zetasql/zetasql-client)
| 2020.10.1 | 2021.09.1 | 2020-10-27 | 2021-09-16|
[BEAM-9157](https://issues.apache.org/jira/browse/BEAM-9157)  
[com.google.zetasql:zetasql-jni-
channel](https://mvnrepository.com/artifact/com.google.zetasql/zetasql-jni-
channel) | 2020.10.1 | 2021.09.1 | 2020-10-27 | 2021-09-16|
[BEAM-9158](https://issues.apache.org/jira/browse/BEAM-9158)  
[com.google.zetasql:zetasql-
types](https://mvnrepository.com/artifact/com.google.zetasql/zetasql-types) |
2020.10.1 | 2021.09.1 | 2020-10-27 | 2021-09-16|
[BEAM-9159](https://issues.apache.org/jira/browse/BEAM-9159)  
[com.hazelcast:hazelcast](https://mvnrepository.com/artifact/com.hazelcast/hazelcast)
| 4.0 | 5.0 | 2020-02-04 | 2021-09-22|
[BEAM-8636](https://issues.apache.org/jira/browse/BEAM-8636)  
[com.hazelcast.jet:hazelcast-
jet](https://mvnrepository.com/artifact/com.hazelcast.jet/hazelcast-jet) | 4.0
| 4.5.1 | 2020-03-02 | 2021-09-10|
[BEAM-9586](https://issues.apache.org/jira/browse/BEAM-9586)  
[com.hazelcast.jet:hazelcast-jet-
core](https://mvnrepository.com/artifact/com.hazelcast.jet/hazelcast-jet-core)
| 4.0 | 4.5.1 | 2020-03-02 | 2021-09-10|
[BEAM-9587](https://issues.apache.org/jira/browse/BEAM-9587)  
[com.opencsv:opencsv](https://mvnrepository.com/artifact/com.opencsv/opencsv)
| 5.0 | 5.5.2 | 2019-10-20 | 2021-09-04|
[BEAM-11122](https://issues.apache.org/jira/browse/BEAM-11122)  
[com.pholser:junit-quickcheck-
core](https://mvnrepository.com/artifact/com.pholser/junit-quickcheck-core) |
0.8 | 1.0 | 2018-03-08 | 2020-11-22|
[BEAM-8699](https://issues.apache.org/jira/browse/BEAM-8699)  
[com.rabbitmq:amqp-
client](https://mvnrepository.com/artifact/com.rabbitmq/amqp-client) | 5.7.3 |
5.14.0 | 2019-07-25 | 2021-11-15|
[BEAM-5895](https://issues.apache.org/jira/browse/BEAM-5895)  
[com.squareup.okhttp3:okhttp](https://mvnrepository.com/artifact/com.squareup.okhttp3/okhttp)
| 4.6.0 | 5.0.0-alpha.2 | 2020-04-29 | 2021-01-30|
[BEAM-11897](https://issues.apache.org/jira/browse/BEAM-11897)  
[com.sun.xml.bind:jaxb-
impl](https://mvnrepository.com/artifact/com.sun.xml.bind/jaxb-impl) | 2.3.3 |
3.0.2 | 2020-04-07 | 2021-07-20|
[BEAM-10535](https://issues.apache.org/jira/browse/BEAM-10535)  
[com.tdunning:t-digest](https://mvnrepository.com/artifact/com.tdunning/t-digest)
| 3.2 | 3.3 | 2017-08-07 | 2021-05-31|
[BEAM-12488](https://issues.apache.org/jira/browse/BEAM-12488)  
[commons-cli:commons-cli](https://mvnrepository.com/artifact/commons-
cli/commons-cli) | 1.2 | 20040117.000000 | 2009-03-19 | 2005-11-08|
[BEAM-5545](https://issues.apache.org/jira/browse/BEAM-5545)  
[commons-codec:commons-codec](https://mvnrepository.com/artifact/commons-
codec/commons-codec) | 1.15 | 20041127.091804 | 2020-08-28 | 2005-11-24|
[BEAM-5546](https://issues.apache.org/jira/browse/BEAM-5546)  
[commons-io:commons-io](https://mvnrepository.com/artifact/commons-io/commons-
io) | 2.6 | 20030203.000550 | 2017-10-15 | 2005-11-08|
[BEAM-8701](https://issues.apache.org/jira/browse/BEAM-8701)  
[commons-lang:commons-lang](https://mvnrepository.com/artifact/commons-
lang/commons-lang) | 2.6 | 20030203.000129 | 2011-01-16 | 2005-11-08|
[BEAM-11321](https://issues.apache.org/jira/browse/BEAM-11321)  
[de.flapdoodle.embed:de.flapdoodle.embed.mongo](https://mvnrepository.com/artifact/de.flapdoodle.embed/de.flapdoodle.embed.mongo)
| 2.2.0 | 3.2.0 | 2018-12-09 | 2021-11-01|
[BEAM-5549](https://issues.apache.org/jira/browse/BEAM-5549)  
[de.flapdoodle.embed:de.flapdoodle.embed.process](https://mvnrepository.com/artifact/de.flapdoodle.embed/de.flapdoodle.embed.process)
| 2.1.2 | 3.1.3 | 2018-12-09 | 2021-10-29|
[BEAM-5550](https://issues.apache.org/jira/browse/BEAM-5550)  
[io.airlift:aircompressor](https://mvnrepository.com/artifact/io.airlift/aircompressor)
| 0.18 | 0.21 | 2021-01-14 | 2021-08-31|
[BEAM-11652](https://issues.apache.org/jira/browse/BEAM-11652)  
[io.confluent:kafka-avro-
serializer](https://mvnrepository.com/artifact/io.confluent/kafka-avro-
serializer) | 5.3.2 | 7.0.0 | 2020-02-10 | 2021-11-18|
[BEAM-11013](https://issues.apache.org/jira/browse/BEAM-11013)  
[io.confluent:kafka-schema-registry-
client](https://mvnrepository.com/artifact/io.confluent/kafka-schema-registry-
client) | 5.3.2 | 7.0.0 | 2021-03-01 | 2021-11-18|
[BEAM-11898](https://issues.apache.org/jira/browse/BEAM-11898)  
[io.debezium:debezium-connector-
db2](https://mvnrepository.com/artifact/io.debezium/debezium-connector-db2) |
1.3.1.Final | 1.8.0.Alpha2 | 2020-11-12 | 2021-11-11|
[BEAM-12430](https://issues.apache.org/jira/browse/BEAM-12430)  
[io.debezium:debezium-connector-
mysql](https://mvnrepository.com/artifact/io.debezium/debezium-connector-
mysql) | 1.3.1.Final | 1.8.0.Alpha2 | 2020-11-12 | 2021-11-11|
[BEAM-12318](https://issues.apache.org/jira/browse/BEAM-12318)  
[io.debezium:debezium-connector-
oracle](https://mvnrepository.com/artifact/io.debezium/debezium-connector-
oracle) | 1.3.1.Final | 1.8.0.Alpha2 | 2020-11-12 | 2021-11-11|
[BEAM-12431](https://issues.apache.org/jira/browse/BEAM-12431)  
[io.debezium:debezium-connector-
postgres](https://mvnrepository.com/artifact/io.debezium/debezium-connector-
postgres) | 1.3.1.Final | 1.8.0.Alpha2 | 2020-11-12 | 2021-11-11|
[BEAM-12432](https://issues.apache.org/jira/browse/BEAM-12432)  
[io.debezium:debezium-connector-
sqlserver](https://mvnrepository.com/artifact/io.debezium/debezium-connector-
sqlserver) | 1.3.1.Final | 1.8.0.Alpha2 | 2020-11-12 | 2021-11-11|
[BEAM-12433](https://issues.apache.org/jira/browse/BEAM-12433)  
[io.debezium:debezium-
core](https://mvnrepository.com/artifact/io.debezium/debezium-core) |
1.3.1.Final | 1.8.0.Alpha2 | 2020-11-12 | 2021-11-11|
[BEAM-12319](https://issues.apache.org/jira/browse/BEAM-12319)  
[io.grpc:grpc-testing](https://mvnrepository.com/artifact/io.grpc/grpc-
testing) | 1.36.0 | 1.42.1 | 2021-02-23 | 2021-11-12|
[BEAM-5902](https://issues.apache.org/jira/browse/BEAM-5902)  
[jakarta.xml.bind:jakarta.xml.bind-
api](https://mvnrepository.com/artifact/jakarta.xml.bind/jakarta.xml.bind-api)
| 2.3.3 | 4.0.0-RC2 | 2020-01-27 | 2021-09-17|
[BEAM-10537](https://issues.apache.org/jira/browse/BEAM-10537)  
[javax.servlet:javax.servlet-
api](https://mvnrepository.com/artifact/javax.servlet/javax.servlet-api) |
3.1.0 | 4.0.1 | 2013-04-25 | 2018-04-20|
[BEAM-5750](https://issues.apache.org/jira/browse/BEAM-5750)  
[net.snowflake:snowflake-ingest-
sdk](https://mvnrepository.com/artifact/net.snowflake/snowflake-ingest-sdk) |
0.9.9 | 0.10.3 | 2020-06-03 | 2021-06-01|
[BEAM-12463](https://issues.apache.org/jira/browse/BEAM-12463)  
[net.snowflake:snowflake-
jdbc](https://mvnrepository.com/artifact/net.snowflake/snowflake-jdbc) |
3.12.11 | 3.13.10 | 2020-08-24 | 2021-10-26|
[BEAM-12787](https://issues.apache.org/jira/browse/BEAM-12787)  
[org.antlr:antlr4](https://mvnrepository.com/artifact/org.antlr/antlr4) | 4.7
| 4.9.3 | 2017-03-30 | 2021-11-06|
[BEAM-8707](https://issues.apache.org/jira/browse/BEAM-8707)  
[org.antlr:antlr4-runtime](https://mvnrepository.com/artifact/org.antlr/antlr4-runtime)
| 4.7 | 4.9.3 | 2017-03-30 | 2021-11-06|
[BEAM-8762](https://issues.apache.org/jira/browse/BEAM-8762)  
[org.apache.activemq:activemq-
amqp](https://mvnrepository.com/artifact/org.apache.activemq/activemq-amqp) |
5.14.5 | 5.16.3 | 2017-04-11 | 2021-08-10|
[BEAM-8709](https://issues.apache.org/jira/browse/BEAM-8709)  
[org.apache.activemq:activemq-
broker](https://mvnrepository.com/artifact/org.apache.activemq/activemq-
broker) | 5.14.5 | 5.16.3 | 2017-04-11 | 2021-08-10|
[BEAM-8763](https://issues.apache.org/jira/browse/BEAM-8763)  
[org.apache.activemq:activemq-
client](https://mvnrepository.com/artifact/org.apache.activemq/activemq-
client) | 5.14.5 | 5.16.3 | 2017-04-11 | 2021-08-10|
[BEAM-8764](https://issues.apache.org/jira/browse/BEAM-8764)  
[org.apache.activemq:activemq-
jaas](https://mvnrepository.com/artifact/org.apache.activemq/activemq-jaas) |
5.14.5 | 5.16.3 | 2017-04-11 | 2021-08-10|
[BEAM-8765](https://issues.apache.org/jira/browse/BEAM-8765)  
[org.apache.activemq:activemq-kahadb-
store](https://mvnrepository.com/artifact/org.apache.activemq/activemq-kahadb-
store) | 5.14.5 | 5.16.3 | 2017-04-11 | 2021-08-10|
[BEAM-8766](https://issues.apache.org/jira/browse/BEAM-8766)  
[org.apache.activemq:activemq-
mqtt](https://mvnrepository.com/artifact/org.apache.activemq/activemq-mqtt) |
5.14.5 | 5.16.3 | 2017-04-11 | 2021-08-10|
[BEAM-8767](https://issues.apache.org/jira/browse/BEAM-8767)  
[org.apache.activemq.tooling:activemq-
junit](https://mvnrepository.com/artifact/org.apache.activemq.tooling/activemq-
junit) | 5.14.5 | 5.16.3 | 2017-04-11 | 2021-08-10|
[BEAM-8711](https://issues.apache.org/jira/browse/BEAM-8711)  
[org.apache.avro:avro](https://mvnrepository.com/artifact/org.apache.avro/avro)
| 1.8.2 | 1.11.0 | 2017-05-07 | 2021-10-21|
[BEAM-8715](https://issues.apache.org/jira/browse/BEAM-8715)  
[org.apache.cassandra:cassandra-
all](https://mvnrepository.com/artifact/org.apache.cassandra/cassandra-all) |
3.11.8 | 4.0.1 | 2020-08-28 | 2021-08-30|
[BEAM-5544](https://issues.apache.org/jira/browse/BEAM-5544)  
[org.apache.commons:commons-
lang3](https://mvnrepository.com/artifact/org.apache.commons/commons-lang3) |
3.9 | 3.12.0 | 2019-04-11 | 2021-02-26|
[BEAM-8717](https://issues.apache.org/jira/browse/BEAM-8717)  
[org.apache.derby:derby](https://mvnrepository.com/artifact/org.apache.derby/derby)
| 10.14.2.0 | 10.15.2.0 | 2018-05-03 | 2020-02-22|
[BEAM-9365](https://issues.apache.org/jira/browse/BEAM-9365)  
[org.apache.derby:derbyclient](https://mvnrepository.com/artifact/org.apache.derby/derbyclient)
| 10.14.2.0 | 10.15.2.0 | 2018-05-03 | 2020-02-22|
[BEAM-9366](https://issues.apache.org/jira/browse/BEAM-9366)  
[org.apache.derby:derbynet](https://mvnrepository.com/artifact/org.apache.derby/derbynet)
| 10.14.2.0 | 10.15.2.0 | 2018-05-03 | 2020-02-22|
[BEAM-9367](https://issues.apache.org/jira/browse/BEAM-9367)  
[org.apache.hadoop:hadoop-
client](https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-client) |
3.2.1 | 3.3.1 | 2019-09-10 | 2021-06-01|
[BEAM-8719](https://issues.apache.org/jira/browse/BEAM-8719)  
[org.apache.hadoop:hadoop-
common](https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common) |
3.2.1 | 3.3.1 | 2019-09-10 | 2021-06-01|
[BEAM-8768](https://issues.apache.org/jira/browse/BEAM-8768)  
[org.apache.hadoop:hadoop-
hdfs](https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-hdfs) |
3.2.1 | 3.3.1 | 2019-09-10 | 2021-06-01|
[BEAM-8769](https://issues.apache.org/jira/browse/BEAM-8769)  
[org.apache.hadoop:hadoop-mapreduce-client-
core](https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-mapreduce-
client-core) | 3.2.1 | 3.3.1 | 2019-09-10 | 2021-06-01|
[BEAM-8770](https://issues.apache.org/jira/browse/BEAM-8770)  
[org.apache.hadoop:hadoop-
minicluster](https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-
minicluster) | 3.2.1 | 3.3.1 | 2019-09-10 | 2021-06-01|
[BEAM-8771](https://issues.apache.org/jira/browse/BEAM-8771)  
[org.apache.hbase:hbase-
common](https://mvnrepository.com/artifact/org.apache.hbase/hbase-common) |
1.2.6 | 3.0.0-alpha-1 | 2017-05-29 | 2021-07-04|
[BEAM-5560](https://issues.apache.org/jira/browse/BEAM-5560)  
[org.apache.hbase:hbase-hadoop-
compat](https://mvnrepository.com/artifact/org.apache.hbase/hbase-hadoop-
compat) | 1.2.6 | 3.0.0-alpha-1 | 2017-05-29 | 2021-07-04|
[BEAM-5561](https://issues.apache.org/jira/browse/BEAM-5561)  
[org.apache.hbase:hbase-
hadoop2-compat](https://mvnrepository.com/artifact/org.apache.hbase/hbase-
hadoop2-compat) | 1.2.6 | 2.4.8 | 2017-05-29 | 2021-10-27|
[BEAM-5562](https://issues.apache.org/jira/browse/BEAM-5562)  
[org.apache.hbase:hbase-
server](https://mvnrepository.com/artifact/org.apache.hbase/hbase-server) |
1.2.6 | 3.0.0-alpha-1 | 2017-05-29 | 2021-07-04|
[BEAM-5563](https://issues.apache.org/jira/browse/BEAM-5563)  
[org.apache.hbase:hbase-shaded-
client](https://mvnrepository.com/artifact/org.apache.hbase/hbase-shaded-
client) | 1.2.6 | 3.0.0-alpha-1 | 2017-05-29 | 2021-07-04|
[BEAM-5564](https://issues.apache.org/jira/browse/BEAM-5564)  
[org.apache.hive:hive-
cli](https://mvnrepository.com/artifact/org.apache.hive/hive-cli) | 2.1.0 |
3.1.2 | 2016-06-17 | 2019-08-22|
[BEAM-5566](https://issues.apache.org/jira/browse/BEAM-5566)  
[org.apache.hive:hive-
common](https://mvnrepository.com/artifact/org.apache.hive/hive-common) |
2.1.0 | 3.1.2 | 2016-06-17 | 2019-08-22|
[BEAM-5567](https://issues.apache.org/jira/browse/BEAM-5567)  
[org.apache.hive:hive-
exec](https://mvnrepository.com/artifact/org.apache.hive/hive-exec) | 2.1.0 |
3.1.2 | 2016-06-17 | 2019-08-22|
[BEAM-5568](https://issues.apache.org/jira/browse/BEAM-5568)  
[org.apache.hive.hcatalog:hive-hcatalog-
core](https://mvnrepository.com/artifact/org.apache.hive.hcatalog/hive-
hcatalog-core) | 2.1.0 | 3.1.2 | 2016-06-17 | 2019-08-22|
[BEAM-5569](https://issues.apache.org/jira/browse/BEAM-5569)  
[org.apache.httpcomponents:httpcore-
nio](https://mvnrepository.com/artifact/org.apache.httpcomponents/httpcore-
nio) | 4.4.12 | 4.4.14 | 2019-09-01 | 2020-11-26|
[BEAM-8773](https://issues.apache.org/jira/browse/BEAM-8773)  
[org.apache.kafka:connect-
api](https://mvnrepository.com/artifact/org.apache.kafka/connect-api) | 2.5.0
| 3.0.0 | 2020-04-08 | 2021-09-08|
[BEAM-12183](https://issues.apache.org/jira/browse/BEAM-12183)  
[org.apache.kafka:connect-
json](https://mvnrepository.com/artifact/org.apache.kafka/connect-json) |
2.5.0 | 3.0.0 | 2020-04-08 | 2021-09-08|
[BEAM-12184](https://issues.apache.org/jira/browse/BEAM-12184)  
[org.apache.kafka:kafka-
clients](https://mvnrepository.com/artifact/org.apache.kafka/kafka-clients) |
2.5.1 | 3.0.0 | 2020-07-24 | 2021-09-08|
[BEAM-8639](https://issues.apache.org/jira/browse/BEAM-8639)  
[org.apache.kafka:kafka_2.12](https://mvnrepository.com/artifact/org.apache.kafka/kafka_2.12)
| 2.4.1 | 3.0.0 | 2020-03-03 | 2021-09-08|
[BEAM-11976](https://issues.apache.org/jira/browse/BEAM-11976)  
[org.apache.kudu:kudu-
client](https://mvnrepository.com/artifact/org.apache.kudu/kudu-client) |
1.11.1 | 1.15.0 | 2019-11-16 | 2021-06-10|
[BEAM-5575](https://issues.apache.org/jira/browse/BEAM-5575)  
[org.apache.qpid:proton-j](https://mvnrepository.com/artifact/org.apache.qpid/proton-j)
| 0.16.0 | 0.33.10 | 2016-12-08 | 2021-10-14|
[BEAM-5582](https://issues.apache.org/jira/browse/BEAM-5582)  
[org.apache.solr:solr-
core](https://mvnrepository.com/artifact/org.apache.solr/solr-core) | 8.5.2 |
8.11.0 | 2020-05-26 | 2021-11-13|
[BEAM-5589](https://issues.apache.org/jira/browse/BEAM-5589)  
[org.apache.solr:solr-
solrj](https://mvnrepository.com/artifact/org.apache.solr/solr-solrj) | 8.5.2
| 8.11.0 | 2020-05-26 | 2021-11-13|
[BEAM-5590](https://issues.apache.org/jira/browse/BEAM-5590)  
[org.apache.solr:solr-test-
framework](https://mvnrepository.com/artifact/org.apache.solr/solr-test-
framework) | 8.5.2 | 8.11.0 | 2020-05-26 | 2021-11-13|
[BEAM-5591](https://issues.apache.org/jira/browse/BEAM-5591)  
[org.apache.tika:tika-
core](https://mvnrepository.com/artifact/org.apache.tika/tika-core) | 1.26 |
2.1.0 | 2021-03-24 | 2021-08-18|
[BEAM-8925](https://issues.apache.org/jira/browse/BEAM-8925)  
[org.apache.tika:tika-
parsers](https://mvnrepository.com/artifact/org.apache.tika/tika-parsers) |
1.26 | 2.1.0 | 2021-03-24 | 2021-08-18|
[BEAM-8926](https://issues.apache.org/jira/browse/BEAM-8926)  
[org.apache.zookeeper:zookeeper](https://mvnrepository.com/artifact/org.apache.zookeeper/zookeeper)
| 3.5.6 | 3.7.0 | 2019-10-08 | 2021-03-17|
[BEAM-8640](https://issues.apache.org/jira/browse/BEAM-8640)  
[org.assertj:assertj-
core](https://mvnrepository.com/artifact/org.assertj/assertj-core) | 3.11.1 |
3.21.0 | 2018-08-28 | 2021-09-19|
[BEAM-8641](https://issues.apache.org/jira/browse/BEAM-8641)  
[org.checkerframework:checker](https://mvnrepository.com/artifact/org.checkerframework/checker)
| 3.10.0 | 3.19.0 | 2021-02-01 | 2021-11-01|
[BEAM-11771](https://issues.apache.org/jira/browse/BEAM-11771)  
[org.codehaus.janino:commons-
compiler](https://mvnrepository.com/artifact/org.codehaus.janino/commons-
compiler) | 3.0.11 | 3.1.6 | 2018-11-13 | 2021-07-28|
[BEAM-9591](https://issues.apache.org/jira/browse/BEAM-9591)  
[org.codehaus.janino:janino](https://mvnrepository.com/artifact/org.codehaus.janino/janino)
| 3.0.11 | 3.1.6 | 2018-11-13 | 2021-07-28|
[BEAM-9592](https://issues.apache.org/jira/browse/BEAM-9592)  
[org.eclipse.jetty:jetty-
server](https://mvnrepository.com/artifact/org.eclipse.jetty/jetty-server) |
9.2.10.v20150310 | 11.0.7 | 2015-03-10 | 2021-10-06|
[BEAM-5752](https://issues.apache.org/jira/browse/BEAM-5752)  
[org.eclipse.jetty:jetty-
servlet](https://mvnrepository.com/artifact/org.eclipse.jetty/jetty-servlet) |
9.2.10.v20150310 | 11.0.7 | 2015-03-10 | 2021-10-06|
[BEAM-5753](https://issues.apache.org/jira/browse/BEAM-5753)  
[org.elasticmq:elasticmq-rest-
sqs_2.12](https://mvnrepository.com/artifact/org.elasticmq/elasticmq-rest-
sqs_2.12) | 0.15.6 | 1.3.3 | 2020-04-08 | 2021-11-16|
[BEAM-8643](https://issues.apache.org/jira/browse/BEAM-8643)  
[org.elasticsearch:elasticsearch](https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch)
| 7.12.0 | 8.0.0-beta1 | 2021-03-22 | 2021-11-08|
[BEAM-6090](https://issues.apache.org/jira/browse/BEAM-6090)  
[org.elasticsearch:elasticsearch-
hadoop](https://mvnrepository.com/artifact/org.elasticsearch/elasticsearch-
hadoop) | 7.12.0 | 8.0.0-beta1 | 2021-03-22 | 2021-11-08|
[BEAM-5551](https://issues.apache.org/jira/browse/BEAM-5551)  
[org.elasticsearch.client:elasticsearch-rest-
client](https://mvnrepository.com/artifact/org.elasticsearch.client/elasticsearch-
rest-client) | 7.9.2 | 8.0.0-beta1 | 2020-09-23 | 2021-11-08|
[BEAM-6091](https://issues.apache.org/jira/browse/BEAM-6091)  
[org.elasticsearch.client:elasticsearch-rest-high-level-
client](https://mvnrepository.com/artifact/org.elasticsearch.client/elasticsearch-
rest-high-level-client) | 7.9.2 | 8.0.0-alpha2 | 2020-09-23 | 2021-09-15|
[BEAM-12067](https://issues.apache.org/jira/browse/BEAM-12067)  
[org.elasticsearch.test:framework](https://mvnrepository.com/artifact/org.elasticsearch.test/framework)
| 7.13.4 | 8.0.0-beta1 | 2021-07-20 | 2021-11-08|
[BEAM-6092](https://issues.apache.org/jira/browse/BEAM-6092)  
[org.immutables:value](https://mvnrepository.com/artifact/org.immutables/value)
| 2.8.8 | 2.9.0-rc1 | 2020-05-08 | 2021-09-15|
[BEAM-13280](https://issues.apache.org/jira/browse/BEAM-13280)  
[org.influxdb:influxdb-
java](https://mvnrepository.com/artifact/org.influxdb/influxdb-java) | 2.19 |
2.22 | 2020-05-18 | 2021-09-17|
[BEAM-12917](https://issues.apache.org/jira/browse/BEAM-12917)  
[org.jenkins-ci.plugins:junit](https://mvnrepository.com/artifact/org.jenkins-
ci.plugins/junit) | 1.49 | 1.53 | 2021-04-19 | 2021-09-13|
[BEAM-12186](https://issues.apache.org/jira/browse/BEAM-12186)  
[org.jetbrains:annotations](https://mvnrepository.com/artifact/org.jetbrains/annotations)
| 13.0 | 23.0.0 | 2013-12-17 | 2021-11-10|
[BEAM-11683](https://issues.apache.org/jira/browse/BEAM-11683)  
[org.jetbrains.kotlin:kotlin-scripting-compiler-
embeddable](https://mvnrepository.com/artifact/org.jetbrains.kotlin/kotlin-
scripting-compiler-embeddable) | 1.3.72 | 1.6.0 | 2020-04-14 | 2021-11-13|
[BEAM-9594](https://issues.apache.org/jira/browse/BEAM-9594)  
[org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin](https://mvnrepository.com/artifact/org.jetbrains.kotlin.jvm/org.jetbrains.kotlin.jvm.gradle.plugin)
| 1.3.72 | 1.6.0 | 2020-06-29 | 2021-11-18|
[BEAM-10362](https://issues.apache.org/jira/browse/BEAM-10362)  
[org.json:json](https://mvnrepository.com/artifact/org.json/json) | 20201115 |
20210307 | 2020-11-15 | 2021-03-08|
[BEAM-12520](https://issues.apache.org/jira/browse/BEAM-12520)  
[org.junit.jupiter:junit-jupiter-
api](https://mvnrepository.com/artifact/org.junit.jupiter/junit-jupiter-api) |
5.6.2 | 5.8.1 | 2020-04-10 | 2021-09-22|
[BEAM-12789](https://issues.apache.org/jira/browse/BEAM-12789)  
[org.mockito:mockito-
core](https://mvnrepository.com/artifact/org.mockito/mockito-core) | 3.7.7 |
4.0.0 | 2021-01-16 | 2021-10-07|
[BEAM-9369](https://issues.apache.org/jira/browse/BEAM-9369)  
[org.mongodb:mongo-java-
driver](https://mvnrepository.com/artifact/org.mongodb/mongo-java-driver) |
3.12.7 | 3.12.10 | 2020-08-04 | 2021-08-03|
[BEAM-5577](https://issues.apache.org/jira/browse/BEAM-5577)  
[org.mortbay.jetty:jetty-
util](https://mvnrepository.com/artifact/org.mortbay.jetty/jetty-util) |
6.1.26 | 7.0.0.pre5 | 2010-11-10 | 2008-10-30|
[BEAM-11685](https://issues.apache.org/jira/browse/BEAM-11685)  
[org.postgresql:postgresql](https://mvnrepository.com/artifact/org.postgresql/postgresql)
| 42.2.16 | 42.3.1 | 2020-08-21 | 2021-10-29|
[BEAM-8723](https://issues.apache.org/jira/browse/BEAM-8723)  
[org.rocksdb:rocksdbjni](https://mvnrepository.com/artifact/org.rocksdb/rocksdbjni)
| 6.15.2 | 6.25.3 | 2021-01-06 | 2021-10-26|
[BEAM-11503](https://issues.apache.org/jira/browse/BEAM-11503)  
[org.slf4j:slf4j-log4j12](https://mvnrepository.com/artifact/org.slf4j/slf4j-log4j12)
| 1.7.30 | 2.0.0-alpha5 | 2019-12-16 | 2021-08-30|
[BEAM-10365](https://issues.apache.org/jira/browse/BEAM-10365)  
[org.slf4j:slf4j-simple](https://mvnrepository.com/artifact/org.slf4j/slf4j-simple)
| 1.7.9 | 2.0.0-alpha5 | 2014-12-16 | 2021-08-30|
[BEAM-8724](https://issues.apache.org/jira/browse/BEAM-8724)  
[org.sonarqube:org.sonarqube.gradle.plugin](https://mvnrepository.com/artifact/org.sonarqube/org.sonarqube.gradle.plugin)
| 3.0 | 3.3 | 2020-06-29 | 2021-06-14|
[BEAM-10367](https://issues.apache.org/jira/browse/BEAM-10367)  
[redis.clients:jedis](https://mvnrepository.com/artifact/redis.clients/jedis)
| 3.5.2 | 4.0.0-beta3 | 2021-03-15 | 2021-11-14|
[BEAM-12092](https://issues.apache.org/jira/browse/BEAM-12092)  
[sqlline:sqlline](https://mvnrepository.com/artifact/sqlline/sqlline) | 1.4.0
| 1.12.0 | 2018-05-31 | 2021-11-07|
[BEAM-6901](https://issues.apache.org/jira/browse/BEAM-6901)  
[Gradle:](https://mvnrepository.com/artifact/Gradle/) | 6.9.1 | 7.3 |
2021-09-20 | 2021-11-18|
[BEAM-8002](https://issues.apache.org/jira/browse/BEAM-8002)  
  
####  A dependency update is high priority if it satisfies one of following
criteria:

  * It has major versions update available, e.g. org.assertj:assertj-core 2.5.0 -> 3.10.0; 

  * It is over 3 minor versions behind the latest version, e.g. org.tukaani:xz 1.5 -> 1.8; 

  * The current version is behind the later version for over 180 days, e.g. com.google.auto.service:auto-service 2014-10-24 -> 2017-12-11. 

####  In Beam, we make a best-effort attempt at keeping all dependencies up-
to-date. In the future, issues will be filed and tracked for these
automatically, but in the meantime you can search for existing issues or open
a new one.

####  For more information: [ Beam Dependency Guide
](https://beam.apache.org/contribute/dependencies/)


Jenkins build is back to normal : beam_Dependency_Check #350

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_Dependency_Check/350/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_Dependency_Check #349

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_Dependency_Check/349/display/redirect?page=changes>

Changes:

[Kyle Weaver] [BEAM-12976] Add Java interfaces for projection pushdown.

[Kyle Weaver] fix cast

[Kyle Weaver] [BEAM-12976] Address review comments.

[sergey.kalinin] Initial add for dockerfiles and build scripts

[sergey.kalinin] Initial add for terraform scripts for infra provision

[Kyle Weaver] Hard-code output tag instead of making it public.

[Kyle Weaver] revert MAIN_OUTPUT_TAG to private

[sergey.kalinin] Add licenses

[sergey.kalinin] Add fixes to docker plugin and also build arg for beam sdk image

[sergey.kalinin] Remove wrongly added comments

[sergey.kalinin] Add beam playground applications deploy

[sergey.kalinin] Remove wrongly added log file

[sergey.kalinin] Fix syntax

[sergey.kalinin] Added default values

[sergey.kalinin] Add default value to base image

[Kyle Weaver] Update Beam website to release 2.34.0.

[sergey.kalinin] Added Beam Version as build arg, also changed way of getting tags for

[Kyle Weaver] Remove WITHOUT_FIELD_ORDERING. Field reordering will be a prerequisite

[sergey.kalinin] Added readme file

[msbukal] Minor HL7v2IO Fixes

[sergey.kalinin] Add workflow to build backend application

[sergey.kalinin] Add license

[asottile] remove unused future / futures dependencies

[sergey.kalinin] Add frontend workflow

[aydar.zaynutdinov] [BEAM-13155][Playground]

[dpcollins] Add detection of BundleFinalizers to DoFnSignatures

[dpcollins] Add enable_prime to the unified worker experiment list.

[dpcollins] Raise an exception before trying to launch a pipeline using

[dpcollins] Fix detection to properly null check.

[25622840+adude3141] [BEAM-13157] add regression test for hadoop configuration on

[sergey.kalinin] Add license to README and added reader access to bucket

[sergey.kalinin] Remove trailing whitespace

[noreply] Merge pull request #15873 from [BEAM-13181] Remove Sharding from

[noreply] Merge pull request #15813 from [BEAM-13071] [Playground] Update run code

[Kyle Weaver] [BEAM-5172] Temporary ignore testSplit and testSizes tests waiting for a

[Andrew Pilloud] [BEAM-13056] Expose FieldAccess in DoFnSchemaInformation

[noreply] [BEAM-11097] Create hook to enable cross-bundle side input caching

[noreply] Merge pull request #15804 from [BEAM-13109][Playground] Add processing

[noreply] Improve FhirIO LRO Counters + minor fixes (#15921)

[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if

[mmack] [BEAM-13009] Bugfix: Prevent dataloss in DynamoDBIO write if

[noreply] Merge pull request #15771 from Enable BQ Standard SQL dialect style

[noreply] [BEAM-11217] Metrics querying for Pcol metrics (#15923)

[relax] for existing tables, no need to set a schema

[avilovpavel6] Fix environment_service_test.go

[Alexey Romanenko] [BEAM-8727] Bump software.amazon.awssdk to 2.17.77

[sergey.kalinin] Remove comment from dockerfile

[noreply] [BEAM-13190] Elide trailing nils (#15920)

[noreply] [BEAM-13052] Increment protobuf version to 3.19.0 (#15883)

[noreply] [BEAM-3304] refactoring trigger package in GoSDK (#15933)

[noreply] [BEAM-13001] Hook to configure sampling period for DoFn metric

[noreply] [BEAM-3293] Add MultiMap side input decomposition (#15934)

[noreply] [BEAM-12651] Exclude packages from jacoco report (#15792)

[noreply] [BEAM-13222] Skip spanner integration tests (#15942)

[noreply] BEAM-13189 Python TextIO: add escapechar feature. (#15901)

[noreply] [BEAM-12550] Parallelizable kurtosis Implementation (#15909)

[noreply] [BEAM-13016] Remove avro-python3 dependency from Beam (#15900)

[Kyle Weaver] Prepare docs for 2.34.0 release.

[noreply] [BEAM-13133] Loosen partitioning requirement for sample (#15818)

[noreply] [BEAM-13228] fix data race in metrics.store (#15946)

[noreply] [BEAM-3293] Add binding cases for MultiMap side inputs (#15943)

[noreply] [BEAM-13222] Re-enable Spanner integration tests (#15948)

[noreply] Merge pull request #15926 from [BEAM-13110][Playground] Playground

[noreply] [BEAM-13025] Disable deduplicating messages, as Dedupe is broken on

[noreply] [BEAM-13001] collect DoFn metrics for Combine (#15911)

[aydar.zaynutdinov] [BEAM-13224][Playground]

[Alexey Romanenko] [BEAM-4868] Bump com.amazonaws to 1.12.106

[noreply] [BEAM-13147] Fix nullability issues in aws (SDK v1 + v2) for AwsModule

[noreply] [BEAM-3293] Add encoding of map/multimap side inputs into proto (#15960)

[noreply] [BEAM-13052] Implement ProtoPlusCoder and add it to the default options

[noreply] [BEAM-13193] Add elements field in ProcessBundleRequest and ProcessBu…

[noreply] [BEAM-3304] Refactor trigger API (#15952)

[noreply] [BEAM-3293] Add NewKeyedIterable function to SideInputAdapter interface

[noreply] [BEAM-13223] Documents two new features of cross-language transforms


------------------------------------------
[...truncated 64.60 KB...]
5 actionable tasks: 5 executed

Publishing build scan...
https://gradle.com/s/lebdwpdov37ry

Build step 'Invoke Gradle script' changed build result to SUCCESS
[beam_Dependency_Check] $ /bin/bash -xe /tmp/jenkins5576848517519422018.sh
+ cd src
+ bash .test-infra/jenkins/dependency_check/generate_report.sh

REPORT_DESCRIPTION="
<h4> A dependency update is high priority if it satisfies one of following criteria: </h4>
<ul>
<li> It has major versions update available, e.g. org.assertj:assertj-core 2.5.0 -> 3.10.0; </li>
</ul>
<ul>
<li> It is over 3 minor versions behind the latest version, e.g. org.tukaani:xz 1.5 -> 1.8; </li>
</ul>
<ul>
<li> The current version is behind the later version for over 180 days, e.g. com.google.auto.service:auto-service 2014-10-24 -> 2017-12-11. </li>
</ul>
<h4> In Beam, we make a best-effort attempt at keeping all dependencies up-to-date.
     In the future, issues will be filed and tracked for these automatically,
     but in the meantime you can search for existing issues or open a new one.
</h4>
<h4> For more information: <a href=\"https://beam.apache.org/contribute/dependencies/\"> Beam Dependency Guide </a></h4>"


# Virtualenv for the rest of the script to run setup
virtualenv dependency/check
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3>
Also creating executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python>
Installing setuptools, pip, wheel...
done.
. dependency/check/bin/activate
# This file must be used with "source bin/activate" *from bash*
# you cannot run it directly

deactivate () {
    unset -f pydoc >/dev/null 2>&1

    # reset old environment variables
    # ! [ -z ${VAR+_} ] returns true if VAR is declared at all
    if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
        PATH="$_OLD_VIRTUAL_PATH"
        export PATH
        unset _OLD_VIRTUAL_PATH
    fi
    if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
        PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
        export PYTHONHOME
        unset _OLD_VIRTUAL_PYTHONHOME
    fi

    # This should detect bash and zsh, which have a hash command that must
    # be called to get it to forget past commands.  Without forgetting
    # past commands the $PATH changes we made may not be respected
    if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
        hash -r 2>/dev/null
    fi

    if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
        PS1="$_OLD_VIRTUAL_PS1"
        export PS1
        unset _OLD_VIRTUAL_PS1
    fi

    unset VIRTUAL_ENV
    if [ ! "${1-}" = "nondestructive" ] ; then
    # Self destruct!
        unset -f deactivate
    fi
}

# unset irrelevant variables
deactivate nondestructive

VIRTUAL_ENV="<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check">
export VIRTUAL_ENV

_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH

# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
    _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
    unset PYTHONHOME
fi

if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
    _OLD_VIRTUAL_PS1="${PS1-}"
    if [ "x" != x ] ; then
        PS1="${PS1-}"
    else
        PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}"
    fi
    export PS1
fi
basename "$VIRTUAL_ENV"

# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true

pydoc () {
    python -m pydoc "$@"
}

# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands.  Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
    hash -r 2>/dev/null
fi
pip install --upgrade google-cloud-bigquery
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Collecting google-cloud-bigquery
  Using cached google_cloud_bigquery-1.28.0-py2.py3-none-any.whl (187 kB)
Collecting google-cloud-core<2.0dev,>=1.4.1
  Using cached google_cloud_core-1.4.4-py2.py3-none-any.whl (27 kB)
Collecting google-resumable-media<2.0dev,>=0.6.0
  Using cached google_resumable_media-1.1.0-py2.py3-none-any.whl (75 kB)
Collecting google-api-core<2.0dev,>=1.21.0
  Using cached google_api_core-1.23.0-py2.py3-none-any.whl (91 kB)
Collecting six<2.0.0dev,>=1.13.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting google-auth<2.0dev,>=1.21.1
  Using cached google_auth-1.23.0-py2.py3-none-any.whl (114 kB)
Collecting protobuf>=3.12.0
  Using cached protobuf-3.19.1-py2.py3-none-any.whl (162 kB)
Collecting pytz
  Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
  Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting requests<3.0.0dev,>=2.18.0
  Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
Requirement already satisfied: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0dev,>=1.21.0->google-cloud-bigquery) (50.3.2)
Collecting pyasn1-modules>=0.2.1
  Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting rsa<5,>=3.1.4
  Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting cachetools<5.0,>=2.0.0
  Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting google-crc32c<2.0dev,>=1.0
  Using cached google_crc32c-1.0.0-cp35-cp35m-manylinux2010_x86_64.whl (39 kB)
Collecting cffi>=1.0.0
  Using cached cffi-1.15.0.tar.gz (484 kB)
Collecting pycparser
  Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting pyasn1<0.5.0,>=0.4.6
  Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting chardet<5,>=3.0.2
  Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting idna<3,>=2.5
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Building wheels for collected packages: cffi
  Building wheel for cffi (setup.py): started
  Building wheel for cffi (setup.py): finished with status 'error'
  ERROR: Command errored out with exit status 1:
   command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-xtvn913n/cffi_a9d1b98f038d4ce9ab3c48ba6645fe6f/setup.py'"'"'; __file__='"'"'/tmp/pip-install-xtvn913n/cffi_a9d1b98f038d4ce9ab3c48ba6645fe6f/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-ftrb3g_d
       cwd: /tmp/pip-install-xtvn913n/cffi_a9d1b98f038d4ce9ab3c48ba6645fe6f/
  Complete output (34 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.5
  creating build/lib.linux-x86_64-3.5/cffi
  copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi
  running build_ext
  building '_cffi_backend' extension
  creating build/temp.linux-x86_64-3.5
  creating build/temp.linux-x86_64-3.5/c
  x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o
  c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
  compilation terminated.
  error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for cffi
  Running setup.py clean for cffi
Failed to build cffi
Installing collected packages: pyasn1, urllib3, six, rsa, pycparser, pyasn1-modules, protobuf, idna, chardet, certifi, cachetools, requests, pytz, googleapis-common-protos, google-auth, cffi, google-crc32c, google-api-core, google-resumable-media, google-cloud-core, google-cloud-bigquery
    Running setup.py install for cffi: started
    Running setup.py install for cffi: finished with status 'error'
    ERROR: Command errored out with exit status 1:
     command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-xtvn913n/cffi_a9d1b98f038d4ce9ab3c48ba6645fe6f/setup.py'"'"'; __file__='"'"'/tmp/pip-install-xtvn913n/cffi_a9d1b98f038d4ce9ab3c48ba6645fe6f/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-8tdhn5n8/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi>
         cwd: /tmp/pip-install-xtvn913n/cffi_a9d1b98f038d4ce9ab3c48ba6645fe6f/
    Complete output (34 lines):
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.5
    creating build/lib.linux-x86_64-3.5/cffi
    copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi
    running build_ext
    building '_cffi_backend' extension
    creating build/temp.linux-x86_64-3.5
    creating build/temp.linux-x86_64-3.5/c
    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o
    c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
    compilation terminated.
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-xtvn913n/cffi_a9d1b98f038d4ce9ab3c48ba6645fe6f/setup.py'"'"'; __file__='"'"'/tmp/pip-install-xtvn913n/cffi_a9d1b98f038d4ce9ab3c48ba6645fe6f/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-8tdhn5n8/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi> Check the logs for full command output.
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Beam Dependency Check Report (2021-11-15)

Posted by Apache Jenkins Server <je...@builds.apache.org>.
ERROR: File 'src/build/dependencyUpdates/beam-dependency-check-report.html'
does not exist


Build failed in Jenkins: beam_Dependency_Check #348

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_Dependency_Check/348/display/redirect?page=changes>

Changes:

[noreply] Add missing parentheses for Python test example

[noreply] Update test input and imports

[heejong] [BEAM-13021] Deduplicate Python artifact not only by hash but also by

[heejong] add test

[heejong] rename variables

[stranniknm] [BEAM-13105] playground - add shorcut hint tooltip

[mmack] [BEAM-11440] Add integration test for KinesisIO using Localstack on

[mmack] Bump localstack container version for more robust version with respect

[mmack] Bump localstack container version for DynamoDBIOTest to version used in

[mmack] Apply format

[mmack] Apply format

[mmack] Use vendored guava deps

[Andrew Pilloud] [BEAM-13118] Use branch for nightly "tag", tags are immutable

[aydar.zaynutdinov] [BEAM-13145][Playground]

[avilovpavel6] Added cleanup os env before and after tests

[25622840+adude3141] [BEAM-13157] support hadoop configuration on ParquetIO.Parse

[noreply] [BEAM-11936] Fix errorprone warnings (#15821)

[Luke Cwik] [BEAM-3811] Code clean-up of the CancelleableQueue to not throw

[noreply] [BEAM-13001] fixes Golint issues (#15859)

[Pablo Estrada] JdbcIO has a single WriteFn underlying all implementations

[noreply] Merge pull request #15840 from [Playground][BEAM-13146][Bugfix]

[dmitrii_kuzin] [BEAM-12730] Python. Custom delimiter add corner case

[Alexey Romanenko] [BEAM-12070] ParquetIO: use splittable reading by default

[noreply] [BEAM-13001] fixes nil reference error in Extractor.ExtractFrom (#15865)

[noreply] Merge pull request #15842 from [BEAM-13125][Playground] Update

[noreply] Merge pull request #15838 from [BEAM-13127] [Playground] Implement TCP

[noreply] Merge pull request #15832 from [BEAM-13149] Changing readWithPartitions

[noreply] Minor: add resource key to presentation materials link (#15867)

[dpcollins] Performance improvement to PubSubLiteIO to not use a streaming committer

[noreply] Merge pull request #15854 from [BEAM-13046][Playground] protobuf

[noreply] [BEAM-12550] Parallelizable skew Implementation  (#15809)

[noreply] Merge pull request #15782 from [BEAM-13034] [Playground] add semantics

[hlagosperez] Use BigQuieryIO.loadProjectId  in WriteRename class to create

[noreply] [BEAM-13099] Use vendored Calcite 1.28.0 in SQL extensions (#15836)

[Luke Cwik] [BEAM-13015] Use a network based channel instead of an inmemory one

[Pablo Estrada] Addressing comments

[noreply] Merge pull request #15839 from [BEAM-13041][Playground] Prepare files

[noreply] [BEAM-13001] updated CHANGES.md to include msec counter for Go (#15872)

[noreply] Add window mapping to CHANGES.md (#15871)

[noreply] Merge pull request #15784 from [BEAM-8135]  - Removing

[noreply] [BEAM-13119] Subdirectory prefix tag for Go SDK (#15881)

[heejong] rearrange comparison order

[noreply] Merge pull request #15852 from [BEAM-13102] [Playground] update

[Kyle Weaver] Fix typo: s/spark/twister2

[Luke Cwik] [BEAM-13164] Address most of a race condition between instantiation and

[Robert Bradshaw] Defer filesToStage construction until after full jar resolution.

[heejong] s/pathes/paths/

[noreply] Merge pull request #15835: [BEAM-11205] Google Libraries BOM 24.0.0 and

[noreply] Merge pull request #15810: [BEAM-2791] Support low-latency StorageApi

[noreply] [BEAM-13081] Fixes a compatible issue of decoding null-value bitmap

[noreply] [adhoc] Speedup slow tests for AWS IO modules (#15899)

[noreply] [BEAM-12566] Implement set_axis for DataFrame and Series (#15773)

[noreply] [BEAM-13192] Fix buggy retry tests for AWS SnsIO (#15910)

[noreply] [BEAM-11217] Metrics Query filtering for DoFn metrics. (#15887)

[noreply] [Go SDK] Go SDK Exits Experimental (#15894)

[joseinigo] [BEAM-13080] Fix number of default keys

[relax] remove log statement

[joseinigo] [BEAM-13080] Fix number of default keys


------------------------------------------
[...truncated 69.74 KB...]
5 actionable tasks: 5 executed

Publishing build scan...
https://gradle.com/s/o5htbp4rmkgpa

Build step 'Invoke Gradle script' changed build result to SUCCESS
[beam_Dependency_Check] $ /bin/bash -xe /tmp/jenkins4403059770075433394.sh
+ cd src
+ bash .test-infra/jenkins/dependency_check/generate_report.sh

REPORT_DESCRIPTION="
<h4> A dependency update is high priority if it satisfies one of following criteria: </h4>
<ul>
<li> It has major versions update available, e.g. org.assertj:assertj-core 2.5.0 -> 3.10.0; </li>
</ul>
<ul>
<li> It is over 3 minor versions behind the latest version, e.g. org.tukaani:xz 1.5 -> 1.8; </li>
</ul>
<ul>
<li> The current version is behind the later version for over 180 days, e.g. com.google.auto.service:auto-service 2014-10-24 -> 2017-12-11. </li>
</ul>
<h4> In Beam, we make a best-effort attempt at keeping all dependencies up-to-date.
     In the future, issues will be filed and tracked for these automatically,
     but in the meantime you can search for existing issues or open a new one.
</h4>
<h4> For more information: <a href=\"https://beam.apache.org/contribute/dependencies/\"> Beam Dependency Guide </a></h4>"


# Virtualenv for the rest of the script to run setup
virtualenv dependency/check
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3>
Also creating executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python>
Installing setuptools, pip, wheel...
done.
. dependency/check/bin/activate
# This file must be used with "source bin/activate" *from bash*
# you cannot run it directly

deactivate () {
    unset -f pydoc >/dev/null 2>&1

    # reset old environment variables
    # ! [ -z ${VAR+_} ] returns true if VAR is declared at all
    if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
        PATH="$_OLD_VIRTUAL_PATH"
        export PATH
        unset _OLD_VIRTUAL_PATH
    fi
    if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
        PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
        export PYTHONHOME
        unset _OLD_VIRTUAL_PYTHONHOME
    fi

    # This should detect bash and zsh, which have a hash command that must
    # be called to get it to forget past commands.  Without forgetting
    # past commands the $PATH changes we made may not be respected
    if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
        hash -r 2>/dev/null
    fi

    if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
        PS1="$_OLD_VIRTUAL_PS1"
        export PS1
        unset _OLD_VIRTUAL_PS1
    fi

    unset VIRTUAL_ENV
    if [ ! "${1-}" = "nondestructive" ] ; then
    # Self destruct!
        unset -f deactivate
    fi
}

# unset irrelevant variables
deactivate nondestructive

VIRTUAL_ENV="<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check">
export VIRTUAL_ENV

_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH

# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
    _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
    unset PYTHONHOME
fi

if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
    _OLD_VIRTUAL_PS1="${PS1-}"
    if [ "x" != x ] ; then
        PS1="${PS1-}"
    else
        PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}"
    fi
    export PS1
fi
basename "$VIRTUAL_ENV"

# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true

pydoc () {
    python -m pydoc "$@"
}

# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands.  Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
    hash -r 2>/dev/null
fi
pip install --upgrade google-cloud-bigquery
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Collecting google-cloud-bigquery
  Using cached google_cloud_bigquery-1.28.0-py2.py3-none-any.whl (187 kB)
Collecting google-api-core<2.0dev,>=1.21.0
  Using cached google_api_core-1.23.0-py2.py3-none-any.whl (91 kB)
Collecting google-resumable-media<2.0dev,>=0.6.0
  Using cached google_resumable_media-1.1.0-py2.py3-none-any.whl (75 kB)
Collecting six<2.0.0dev,>=1.13.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting google-cloud-core<2.0dev,>=1.4.1
  Using cached google_cloud_core-1.4.4-py2.py3-none-any.whl (27 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
  Using cached googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Requirement already satisfied: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0dev,>=1.21.0->google-cloud-bigquery) (50.3.2)
Collecting protobuf>=3.12.0
  Using cached protobuf-3.19.1-py2.py3-none-any.whl (162 kB)
Collecting requests<3.0.0dev,>=2.18.0
  Using cached requests-2.25.1-py2.py3-none-any.whl (61 kB)
Collecting pytz
  Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Collecting google-auth<2.0dev,>=1.21.1
  Using cached google_auth-1.23.0-py2.py3-none-any.whl (114 kB)
Collecting pyasn1-modules>=0.2.1
  Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
  Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting rsa<5,>=3.1.4
  Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting google-crc32c<2.0dev,>=1.0
  Using cached google_crc32c-1.0.0-cp35-cp35m-manylinux2010_x86_64.whl (39 kB)
Collecting cffi>=1.0.0
  Using cached cffi-1.15.0.tar.gz (484 kB)
Collecting pycparser
  Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB)
Collecting pyasn1<0.5.0,>=0.4.6
  Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Collecting idna<3,>=2.5
  Using cached idna-2.10-py2.py3-none-any.whl (58 kB)
Collecting chardet<5,>=3.0.2
  Using cached chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Building wheels for collected packages: cffi
  Building wheel for cffi (setup.py): started
  Building wheel for cffi (setup.py): finished with status 'error'
  ERROR: Command errored out with exit status 1:
   command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-wska2ool
       cwd: /tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/
  Complete output (34 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.5
  creating build/lib.linux-x86_64-3.5/cffi
  copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi
  running build_ext
  building '_cffi_backend' extension
  creating build/temp.linux-x86_64-3.5
  creating build/temp.linux-x86_64-3.5/c
  x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o
  c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
  compilation terminated.
  error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for cffi
  Running setup.py clean for cffi
Failed to build cffi
Installing collected packages: pyasn1, urllib3, six, rsa, pycparser, pyasn1-modules, protobuf, idna, chardet, certifi, cachetools, requests, pytz, googleapis-common-protos, google-auth, cffi, google-crc32c, google-api-core, google-resumable-media, google-cloud-core, google-cloud-bigquery
    Running setup.py install for cffi: started
    Running setup.py install for cffi: finished with status 'error'
    ERROR: Command errored out with exit status 1:
     command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-kksjx880/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi>
         cwd: /tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/
    Complete output (34 lines):
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.5
    creating build/lib.linux-x86_64-3.5/cffi
    copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi
    running build_ext
    building '_cffi_backend' extension
    creating build/temp.linux-x86_64-3.5
    creating build/temp.linux-x86_64-3.5/c
    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o
    c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
    compilation terminated.
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"'; __file__='"'"'/tmp/pip-install-lh8j9b4o/cffi_bb01088486134c4b96a5c49ef8b0206e/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-kksjx880/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi> Check the logs for full command output.
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Beam Dependency Check Report (2021-11-08)

Posted by Apache Jenkins Server <je...@builds.apache.org>.
ERROR: File 'src/build/dependencyUpdates/beam-dependency-check-report.html'
does not exist


Build failed in Jenkins: beam_Dependency_Check #347

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_Dependency_Check/347/display/redirect?page=changes>

Changes:

[baeminbo] [BEAM-6721] Set numShards dynamically for TextIO.write()

[Luke Cwik] [BEAM-12522] Enable side inputs on all splittable DoFn execution time

[heejong] [BEAM-12978] Customizable dependency for Java external transform

[melissapa] [BEAM-11758] Update basics page: Splittable DoFn

[heejong] add ConfigT param to getDependencies method

[aydar.zaynutdinov] [BEAM-13062][Playground]

[Alexey Romanenko] [BEAM-13104] ParquetIO: SplitReadFn must read the whole block

[ilya.kozyrev] Add environment_service.go and structures for beam sdk, network envs,

[aydar.zaynutdinov] [BEAM-13062][Playground]

[noreply] Merge pull request #15772 from [BEAM-13032] [Playground] Implement the

[noreply] Merge pull request #15714 from [BEAM-13005] [Playground] Implement local

[noreply] Merge pull request #15770 from [BEAM-13095][Playground] Using working

[noreply] [BEAM-11758] Update basics page: Aggregation, Runner, UDF, Schema

[noreply] Merge pull request #15783 from [BEAM-13048] [Playground] Add shortcuts

[Luke Cwik] [BEAM-8543] Fix test filtering for Dataflow Runner V2 to exclude

[relax] support json

[noreply] Merge pull request #15744 from [BEAM-13072][Playground] Executor builder

[aydar.zaynutdinov] [BEAM-12970][Playground]

[noreply] Change sql.Options to an interface under sqlx. (#15790)

[melissapa] Address review feedback

[Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using

[noreply] [BEAM-4149] Ensure that we always provide and require the worker id.

[Andrew Pilloud] [BEAM-13118] Don't force push to master

[noreply] [BEAM-13098] Fix translation of repeated TableRow fields (#15779)

[aydar.zaynutdinov] [BEAM-12970][Playground]

[eugene.nikolayev] Fix Python docs build pre-commit failures.

[mmack] [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider (AWS

[aydar.zaynutdinov] [BEAM-12970][Playground]

[noreply] Merge pull request #15731: [BEAM-13067]  Mark GroupIntoBatches output as

[noreply] [BEAM-13066, BEAM-13087] Workaround for coder type combiner packing

[noreply] [BEAM-13066] Disable using abstract iterable by default. (#15805)

[aydar.zaynutdinov] [BEAM-12970][Playground]

[artur.khanin] Implemented GetCompileOutput and covered with unit tests

[artur.khanin] Replaced logging library regarding PR comment

[daria.malkova] fix executor tests

[mmack] [BEAM-13138] Update code to retrieve container endpoint

[aydar.zaynutdinov] [BEAM-13120][Playground]

[noreply] Merge pull request #15709 from [BEAM-12967] [Playground] Create Example

[noreply] Merge pull request #15294 from [BEAM-11986] Spanner write metric

[noreply] [BEAM-13130] Remove persistent references to stateKeyReaders (#15815)

[Brian Hulette] [BEAM-13099] Replace call to RelNode.metadata with BeamRelMetadataQuery

[Brian Hulette] [BEAM-13099] Update all rels to use BeamRelMetadataQuery

[Kyle Weaver] [BEAM-13143] Fix python doc generator error.

[Pablo Estrada] Handle runner-provided shards for TextIO

[noreply] Merge pull request #15721 from [BEAM-13023][Playground] Implement Redis

[noreply] Merge pull request #15802 from [BEAM-12970][Playground] Implement gRPC

[noreply] Merge pull request #15800 from [BEAM-12970][Playground] Implement gRPC

[noreply] [BEAM-8958] Use AWS credentials provider with BasicKinesisProvider

[Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0

[Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build

[noreply] [BEAM-13099] Use BlockBuilder.add(..) rather than

[noreply] Minor: Remove broken python compatibility checks (#15828)

[noreply] [BEAM-12047] Updates CHANGES.md to mention the URN convention (#15845)

[noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657)

[noreply] Merge pull request #15753 from [BEAM-13080] Add option in Reshuffle to


------------------------------------------
[...truncated 72.84 KB...]
5 actionable tasks: 5 executed

Publishing build scan...
https://gradle.com/s/qtwbydx2buuek

Build step 'Invoke Gradle script' changed build result to SUCCESS
[beam_Dependency_Check] $ /bin/bash -xe /tmp/jenkins8459596704972431746.sh
+ cd src
+ bash .test-infra/jenkins/dependency_check/generate_report.sh

REPORT_DESCRIPTION="
<h4> A dependency update is high priority if it satisfies one of following criteria: </h4>
<ul>
<li> It has major versions update available, e.g. org.assertj:assertj-core 2.5.0 -> 3.10.0; </li>
</ul>
<ul>
<li> It is over 3 minor versions behind the latest version, e.g. org.tukaani:xz 1.5 -> 1.8; </li>
</ul>
<ul>
<li> The current version is behind the later version for over 180 days, e.g. com.google.auto.service:auto-service 2014-10-24 -> 2017-12-11. </li>
</ul>
<h4> In Beam, we make a best-effort attempt at keeping all dependencies up-to-date.
     In the future, issues will be filed and tracked for these automatically,
     but in the meantime you can search for existing issues or open a new one.
</h4>
<h4> For more information: <a href=\"https://beam.apache.org/contribute/dependencies/\"> Beam Dependency Guide </a></h4>"


# Virtualenv for the rest of the script to run setup
virtualenv dependency/check
Using base prefix '/usr'
New python executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3>
Also creating executable in <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python>
Installing setuptools, pip, wheel...
done.
. dependency/check/bin/activate
# This file must be used with "source bin/activate" *from bash*
# you cannot run it directly

deactivate () {
    unset -f pydoc >/dev/null 2>&1

    # reset old environment variables
    # ! [ -z ${VAR+_} ] returns true if VAR is declared at all
    if ! [ -z "${_OLD_VIRTUAL_PATH+_}" ] ; then
        PATH="$_OLD_VIRTUAL_PATH"
        export PATH
        unset _OLD_VIRTUAL_PATH
    fi
    if ! [ -z "${_OLD_VIRTUAL_PYTHONHOME+_}" ] ; then
        PYTHONHOME="$_OLD_VIRTUAL_PYTHONHOME"
        export PYTHONHOME
        unset _OLD_VIRTUAL_PYTHONHOME
    fi

    # This should detect bash and zsh, which have a hash command that must
    # be called to get it to forget past commands.  Without forgetting
    # past commands the $PATH changes we made may not be respected
    if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
        hash -r 2>/dev/null
    fi

    if ! [ -z "${_OLD_VIRTUAL_PS1+_}" ] ; then
        PS1="$_OLD_VIRTUAL_PS1"
        export PS1
        unset _OLD_VIRTUAL_PS1
    fi

    unset VIRTUAL_ENV
    if [ ! "${1-}" = "nondestructive" ] ; then
    # Self destruct!
        unset -f deactivate
    fi
}

# unset irrelevant variables
deactivate nondestructive

VIRTUAL_ENV="<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check">
export VIRTUAL_ENV

_OLD_VIRTUAL_PATH="$PATH"
PATH="$VIRTUAL_ENV/bin:$PATH"
export PATH

# unset PYTHONHOME if set
if ! [ -z "${PYTHONHOME+_}" ] ; then
    _OLD_VIRTUAL_PYTHONHOME="$PYTHONHOME"
    unset PYTHONHOME
fi

if [ -z "${VIRTUAL_ENV_DISABLE_PROMPT-}" ] ; then
    _OLD_VIRTUAL_PS1="${PS1-}"
    if [ "x" != x ] ; then
        PS1="${PS1-}"
    else
        PS1="(`basename \"$VIRTUAL_ENV\"`) ${PS1-}"
    fi
    export PS1
fi
basename "$VIRTUAL_ENV"

# Make sure to unalias pydoc if it's already there
alias pydoc 2>/dev/null >/dev/null && unalias pydoc || true

pydoc () {
    python -m pydoc "$@"
}

# This should detect bash and zsh, which have a hash command that must
# be called to get it to forget past commands.  Without forgetting
# past commands the $PATH changes we made may not be respected
if [ -n "${BASH-}" ] || [ -n "${ZSH_VERSION-}" ] ; then
    hash -r 2>/dev/null
fi
pip install --upgrade google-cloud-bigquery
DEPRECATION: Python 3.5 reached the end of its life on September 13th, 2020. Please upgrade your Python as Python 3.5 is no longer maintained. pip 21.0 will drop support for Python 3.5 in January 2021. pip 21.0 will remove support for this functionality.
Collecting google-cloud-bigquery
  Downloading google_cloud_bigquery-1.28.0-py2.py3-none-any.whl (187 kB)
Collecting google-api-core<2.0dev,>=1.21.0
  Downloading google_api_core-1.23.0-py2.py3-none-any.whl (91 kB)
Collecting google-cloud-core<2.0dev,>=1.4.1
  Downloading google_cloud_core-1.4.4-py2.py3-none-any.whl (27 kB)
Collecting google-resumable-media<2.0dev,>=0.6.0
  Downloading google_resumable_media-1.1.0-py2.py3-none-any.whl (75 kB)
Collecting six<2.0.0dev,>=1.13.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting googleapis-common-protos<2.0dev,>=1.6.0
  Downloading googleapis_common_protos-1.52.0-py2.py3-none-any.whl (100 kB)
Collecting protobuf>=3.12.0
  Using cached protobuf-3.19.1-py2.py3-none-any.whl (162 kB)
Collecting google-auth<2.0dev,>=1.21.1
  Downloading google_auth-1.23.0-py2.py3-none-any.whl (114 kB)
Collecting requests<3.0.0dev,>=2.18.0
  Downloading requests-2.25.1-py2.py3-none-any.whl (61 kB)
Collecting pytz
  Using cached pytz-2021.3-py2.py3-none-any.whl (503 kB)
Requirement already satisfied: setuptools>=34.0.0 in ./dependency/check/lib/python3.5/site-packages (from google-api-core<2.0dev,>=1.21.0->google-cloud-bigquery) (50.3.2)
Collecting pyasn1-modules>=0.2.1
  Using cached pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
Collecting cachetools<5.0,>=2.0.0
  Using cached cachetools-4.2.4-py3-none-any.whl (10 kB)
Collecting rsa<5,>=3.1.4
  Using cached rsa-4.7.2-py3-none-any.whl (34 kB)
Collecting google-crc32c<2.0dev,>=1.0
  Downloading google_crc32c-1.0.0-cp35-cp35m-manylinux2010_x86_64.whl (39 kB)
Collecting cffi>=1.0.0
  Downloading cffi-1.15.0.tar.gz (484 kB)
Collecting pycparser
  Using cached pycparser-2.20-py2.py3-none-any.whl (112 kB)
Collecting pyasn1<0.5.0,>=0.4.6
  Using cached pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB)
Collecting chardet<5,>=3.0.2
  Downloading chardet-4.0.0-py2.py3-none-any.whl (178 kB)
Collecting urllib3<1.27,>=1.21.1
  Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB)
Collecting idna<3,>=2.5
  Downloading idna-2.10-py2.py3-none-any.whl (58 kB)
Building wheels for collected packages: cffi
  Building wheel for cffi (setup.py): started
  Building wheel for cffi (setup.py): finished with status 'error'
  ERROR: Command errored out with exit status 1:
   command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-i49nunjp/cffi_35e7fd075b1a4f50bc7a3b833cc6bb6d/setup.py'"'"'; __file__='"'"'/tmp/pip-install-i49nunjp/cffi_35e7fd075b1a4f50bc7a3b833cc6bb6d/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' bdist_wheel -d /tmp/pip-wheel-_ljxx7au
       cwd: /tmp/pip-install-i49nunjp/cffi_35e7fd075b1a4f50bc7a3b833cc6bb6d/
  Complete output (34 lines):
  running bdist_wheel
  running build
  running build_py
  creating build
  creating build/lib.linux-x86_64-3.5
  creating build/lib.linux-x86_64-3.5/cffi
  copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi
  copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi
  running build_ext
  building '_cffi_backend' extension
  creating build/temp.linux-x86_64-3.5
  creating build/temp.linux-x86_64-3.5/c
  x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o
  c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
  compilation terminated.
  error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
  ----------------------------------------
  ERROR: Failed building wheel for cffi
  Running setup.py clean for cffi
Failed to build cffi
Installing collected packages: pyasn1, urllib3, six, rsa, pycparser, pyasn1-modules, protobuf, idna, chardet, certifi, cachetools, requests, pytz, googleapis-common-protos, google-auth, cffi, google-crc32c, google-api-core, google-resumable-media, google-cloud-core, google-cloud-bigquery
    Running setup.py install for cffi: started
    Running setup.py install for cffi: finished with status 'error'
    ERROR: Command errored out with exit status 1:
     command: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-i49nunjp/cffi_35e7fd075b1a4f50bc7a3b833cc6bb6d/setup.py'"'"'; __file__='"'"'/tmp/pip-install-i49nunjp/cffi_35e7fd075b1a4f50bc7a3b833cc6bb6d/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-0ua5bq1k/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi>
         cwd: /tmp/pip-install-i49nunjp/cffi_35e7fd075b1a4f50bc7a3b833cc6bb6d/
    Complete output (34 lines):
    running install
    running build
    running build_py
    creating build
    creating build/lib.linux-x86_64-3.5
    creating build/lib.linux-x86_64-3.5/cffi
    copying cffi/verifier.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/model.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/vengine_cpy.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/cffi_opcode.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/api.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/setuptools_ext.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/cparser.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/pkgconfig.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/backend_ctypes.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/recompiler.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/ffiplatform.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/vengine_gen.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/commontypes.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/__init__.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/error.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/lock.py -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_cffi_include.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/parse_c_type.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_embedding.h -> build/lib.linux-x86_64-3.5/cffi
    copying cffi/_cffi_errors.h -> build/lib.linux-x86_64-3.5/cffi
    running build_ext
    building '_cffi_backend' extension
    creating build/temp.linux-x86_64-3.5
    creating build/temp.linux-x86_64-3.5/c
    x86_64-linux-gnu-gcc -pthread -DNDEBUG -g -fwrapv -O2 -Wall -Wstrict-prototypes -g -fstack-protector-strong -Wformat -Werror=format-security -Wdate-time -D_FORTIFY_SOURCE=2 -fPIC -DUSE__THREAD -DHAVE_SYNC_SYNCHRONIZE -I/usr/include/ffi -I/usr/include/libffi -I/usr/include/python3.5m -I<https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/python3.5m> -c c/_cffi_backend.c -o build/temp.linux-x86_64-3.5/c/_cffi_backend.o
    c/_cffi_backend.c:15:17: fatal error: ffi.h: No such file or directory
    compilation terminated.
    error: command 'x86_64-linux-gnu-gcc' failed with exit status 1
    ----------------------------------------
ERROR: Command errored out with exit status 1: <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/bin/python3> -u -c 'import sys, setuptools, tokenize; sys.argv[0] = '"'"'/tmp/pip-install-i49nunjp/cffi_35e7fd075b1a4f50bc7a3b833cc6bb6d/setup.py'"'"'; __file__='"'"'/tmp/pip-install-i49nunjp/cffi_35e7fd075b1a4f50bc7a3b833cc6bb6d/setup.py'"'"';f=getattr(tokenize, '"'"'open'"'"', open)(__file__);code=f.read().replace('"'"'\r\n'"'"', '"'"'\n'"'"');f.close();exec(compile(code, __file__, '"'"'exec'"'"'))' install --record /tmp/pip-record-0ua5bq1k/install-record.txt --single-version-externally-managed --compile --install-headers <https://ci-beam.apache.org/job/beam_Dependency_Check/ws/src/dependency/check/include/site/python3.5/cffi> Check the logs for full command output.
Build step 'Execute shell' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Beam Dependency Check Report (2021-11-01)

Posted by Apache Jenkins Server <je...@builds.apache.org>.
ERROR: File 'src/build/dependencyUpdates/beam-dependency-check-report.html'
does not exist