You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/03/17 12:52:05 UTC

Build failed in Jenkins: beam_PostCommit_XVR_Direct #2416

See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2416/display/redirect>

Changes:


------------------------------------------
[...truncated 1.12 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container eaa5c8a39d44
 ---> 3b35abe8237c
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> 9be642e67d74
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> 33c8ac9a9f14
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> 11de0f92315c
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 3e514605351d
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 888e9a4e110b
Removing intermediate container 888e9a4e110b
 ---> 2212900cd98c
Step 21/31 : FROM beam as third_party_licenses
 ---> 2212900cd98c
Step 22/31 : ARG pull_licenses
 ---> Running in d1d331866e26
Removing intermediate container d1d331866e26
 ---> fd37b965112c
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 0d175c7a05d6
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> d18b2aca2745
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 883a3792ebd7
Removing intermediate container 883a3792ebd7
 ---> c332d5a4abb6
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 2929dfe952dc
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in a4f6d31f4241
Collecting pip-licenses<3.0.0
  Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=c81bc60890fcd1638c100280b824764ede9313e4da7a0cfbc864d6138fe98028
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
    from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/pip-licenses", line 5, in <module>
    from piplicenses import main
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
    from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
Traceback (most recent call last):
  File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
    dependencies = run_pip_licenses()
  File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
    dependencies = run_bash_command(command)
  File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
    return subprocess.check_output(command.split()).decode('utf-8')
  File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py39:docker FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 615673

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 43s
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/3tlv3qxkcqkio

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PostCommit_XVR_Direct #2426

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2426/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2425

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2425/display/redirect>

Changes:


------------------------------------------
[...truncated 1.31 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container f1395f03b356
 ---> 6719367bd56a
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> f695bd51d950
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> 8f6e2f6daced
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> 1bc5ecee1de9
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 0a0fe37854e5
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 5ba555dbade7
Removing intermediate container 5ba555dbade7
 ---> 028b811363fc
Step 21/31 : FROM beam as third_party_licenses
 ---> 028b811363fc
Step 22/31 : ARG pull_licenses
 ---> Running in 5409ba839d29
Removing intermediate container 5409ba839d29
 ---> 8ab7f6058816
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> babb40562db1
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> d24c5708ee88
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in ea5723d8d4b4
Removing intermediate container ea5723d8d4b4
 ---> 3f9215a12b6a
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 61bdd14d2ded
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 28bd0cdb1ec1
Collecting pip-licenses<3.0.0
  Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=bb743887744e12f7776ae7835e1a23e9b10987084cad82c8e268c31b2ab6cf5e
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
    from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/pip-licenses", line 5, in <module>
    from piplicenses import main
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
    from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
Traceback (most recent call last):
  File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
    dependencies = run_pip_licenses()
  File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
    dependencies = run_bash_command(command)
  File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
    return subprocess.check_output(command.split()).decode('utf-8')
  File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py39:docker FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1986672

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 8m 40s
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/mz6pqophswgf4

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2424

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2424/display/redirect>

Changes:


------------------------------------------
[...truncated 1.67 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container 4a558482bdec
 ---> 6d1fe77b839f
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> 439de87a76c6
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> c84243142eb5
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> 386872e7c123
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 511e1a1c995e
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 6c4fb29d5e5f
Removing intermediate container 6c4fb29d5e5f
 ---> cb2d18e1ec75
Step 21/31 : FROM beam as third_party_licenses
 ---> cb2d18e1ec75
Step 22/31 : ARG pull_licenses
 ---> Running in 7a2e168fab29
Removing intermediate container 7a2e168fab29
 ---> b5fd3b2da075
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 976377bc40cc
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> f4c9184d8827
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 5b0d39fc3843
Removing intermediate container 5b0d39fc3843
 ---> 21e925622303
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 65394e61d2d6
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 3eb71015180a
Collecting pip-licenses<3.0.0
  Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=d11b2dd8e19ab66be45ced0444c783e536dc1733d4ed0cbe1a7bb342ae81452d
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
    from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/pip-licenses", line 5, in <module>
    from piplicenses import main
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
    from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
Traceback (most recent call last):
  File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
    dependencies = run_pip_licenses()
  File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
    dependencies = run_bash_command(command)
  File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
    return subprocess.check_output(command.split()).decode('utf-8')
  File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py39:docker FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1463093

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 9m 39s
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/ibo24zbtpflqu

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2423

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2423/display/redirect?page=changes>

Changes:

[yiru] .

[yiru] .

[yiru] .

[yiru] format fix

[yiru] .

[yiru] make DoFn into a separate class

[yiru] .

[yiru] fix setting

[yiru] fix checkstyle

[yiru] spotlessapply

[noreply] [BEAM-3304] documentation for PaneInfo in BPG (#17047)

[noreply] Merge pull request #17016 from [BEAM-14049][Playground] Add new API

[noreply] Merge pull request #17077 from [BEAM-14078] [Website] change link

[noreply] Merge pull request #17085 from [BEAM-14077] [Website] add beam

[noreply] Update Changes.md w/Go pipeline pre-process fix.

[noreply] [BEAM-14098] wrapper for postgres on JDBC IO GO SDK (#17088)

[noreply] Merge pull request #17023 from [BEAM-12164]: Remove child partition


------------------------------------------
[...truncated 1.28 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container 9e371e2f3cbd
 ---> 79677aee1e2e
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> 42a6c6b41a58
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> 34f96ca43a34
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> 607eecf9c698
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 2a68fb265f55
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 3b04b5e88d06
Removing intermediate container 3b04b5e88d06
 ---> 1312b0f861e2
Step 21/31 : FROM beam as third_party_licenses
 ---> 1312b0f861e2
Step 22/31 : ARG pull_licenses
 ---> Running in f6eba9b3d7d4
Removing intermediate container f6eba9b3d7d4
 ---> 3bb2e90d2528
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> e12e7f05a16d
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> 5f691b28207c
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 72f62f6fd9e4
Removing intermediate container 72f62f6fd9e4
 ---> 4580ab14edde
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> b8f724d4fa7f
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 322e40899987
Collecting pip-licenses<3.0.0
  Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=ac1d10f42643a39050e424212f6fd46128aeedc3c33e86ba792a7b1be11a071b
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
    from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/pip-licenses", line 5, in <module>
    from piplicenses import main
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
    from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
Traceback (most recent call last):
  File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
    dependencies = run_pip_licenses()
  File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
    dependencies = run_bash_command(command)
  File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
    return subprocess.check_output(command.split()).decode('utf-8')
  File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py39:docker FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3272015

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 48s
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/wybrihxfxbsio

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2422

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2422/display/redirect?page=changes>

Changes:

[Kiley Sok] Add Java 17 Nexmark metrics to Grafana

[mmack] [BEAM-14125] Update website IO matrix to recommend aws2 IOs

[noreply] [BEAM-14128] Eliminating quadratic behavior of

[noreply] [BEAM-13972] Add RunInference interface (#16917)

[noreply] Merge pull request #17116 from [BEAM-12164] Remove change_stream in

[noreply] Deprecate tags.go (#17025)

[noreply] [BEAM-12753] and [BEAM-12815] Fix Flink Integration Tests (#17067)

[noreply] Merge pull request #16895 from [BEAM-13882][Playground] More tests for

[noreply] [BEAM-13925] Add weekly automation to update our reviewer config

[noreply] Merge pull request #17076 from Beam 14082 update payground for mobile

[noreply] [BEAM-13925] Assign committers in the scheduled action (#17062)

[noreply] Pin setup-gcloud to v0 instead of master (#17123)


------------------------------------------
[...truncated 796.98 KB...]
  Downloading google_cloud_vision-1.0.0-py2.py3-none-any.whl (435 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 435.0/435.0 KB 39.5 MB/s eta 0:00:00
Collecting google-crc32c==1.3.0
  Downloading google_crc32c-1.3.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (36 kB)
Collecting google-pasta==0.2.0
  Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 KB 10.0 MB/s eta 0:00:00
Collecting google-python-cloud-debugger==2.18
  Downloading google_python_cloud_debugger-2.18-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (769 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 769.2/769.2 KB 53.9 MB/s eta 0:00:00
Collecting google-resumable-media==2.3.1
  Downloading google_resumable_media-2.3.1-py2.py3-none-any.whl (76 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76.8/76.8 KB 11.5 MB/s eta 0:00:00
Collecting googleapis-common-protos==1.55.0
  Downloading googleapis_common_protos-1.55.0-py2.py3-none-any.whl (212 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 212.3/212.3 KB 28.9 MB/s eta 0:00:00
Collecting greenlet==1.1.2
  Downloading greenlet-1.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (153 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 153.6/153.6 KB 20.3 MB/s eta 0:00:00
Collecting grpc-google-iam-v1==0.12.3
  Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting grpcio==1.44.0
  Downloading grpcio-1.44.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.3/4.3 MB 83.6 MB/s eta 0:00:00
Collecting grpcio-gcp==0.2.2
  Downloading grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting grpcio-status==1.44.0
  Downloading grpcio_status-1.44.0-py3-none-any.whl (10.0 kB)
Collecting guppy3==3.1.2
  Downloading guppy3-3.1.2-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (638 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 638.4/638.4 KB 53.8 MB/s eta 0:00:00
Collecting h5py==3.6.0
  Downloading h5py-3.6.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (4.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 77.6 MB/s eta 0:00:00
Collecting hdfs==2.6.0
  Downloading hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2==0.19.1
  Downloading httplib2-0.19.1-py3-none-any.whl (95 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.4/95.4 KB 14.2 MB/s eta 0:00:00
Collecting idna==3.3
  Downloading idna-3.3-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 KB 10.7 MB/s eta 0:00:00
Collecting importlib-metadata==4.11.2
  Downloading importlib_metadata-4.11.2-py3-none-any.whl (17 kB)
Collecting joblib==1.1.0
  Downloading joblib-1.1.0-py2.py3-none-any.whl (306 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 307.0/307.0 KB 32.4 MB/s eta 0:00:00
Collecting keras==2.8.0
  Downloading keras-2.8.0-py2.py3-none-any.whl (1.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 67.1 MB/s eta 0:00:00
Collecting Keras-Preprocessing==1.1.2
  Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.6/42.6 KB 639.7 kB/s eta 0:00:00
Collecting libclang==13.0.0
  Downloading libclang-13.0.0-py2.py3-none-manylinux1_x86_64.whl (14.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.5/14.5 MB 77.1 MB/s eta 0:00:00
Collecting libcst==0.4.1
  Downloading libcst-0.4.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.7/2.7 MB 79.7 MB/s eta 0:00:00
Collecting Markdown==3.3.6
  Downloading Markdown-3.3.6-py3-none-any.whl (97 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.8/97.8 KB 14.6 MB/s eta 0:00:00
Collecting mmh3==3.0.0
  Downloading mmh3-3.0.0-cp39-cp39-manylinux2010_x86_64.whl (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.3/49.3 KB 7.7 MB/s eta 0:00:00
Collecting mock==2.0.0
  Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.8/56.8 KB 8.4 MB/s eta 0:00:00
Collecting more-itertools==8.12.0
  Downloading more_itertools-8.12.0-py3-none-any.whl (54 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.3/54.3 KB 8.0 MB/s eta 0:00:00
Collecting mypy-extensions==0.4.3
  Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)
Collecting nltk==3.7
  Downloading nltk-3.7-py3-none-any.whl (1.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 70.9 MB/s eta 0:00:00
Collecting nose==1.3.7
  Downloading nose-1.3.7-py3-none-any.whl (154 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 154.7/154.7 KB 21.8 MB/s eta 0:00:00
Collecting numpy==1.22.2
  Downloading numpy-1.22.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.8/16.8 MB 68.1 MB/s eta 0:00:00
Collecting oauth2client==4.1.3
  Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.2/98.2 KB 15.3 MB/s eta 0:00:00
Collecting oauthlib==3.2.0
  Downloading oauthlib-3.2.0-py3-none-any.whl (151 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.5/151.5 KB 22.3 MB/s eta 0:00:00
Collecting opt-einsum==3.3.0
  Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.5/65.5 KB 9.9 MB/s eta 0:00:00
Collecting orjson==3.6.7
  Downloading orjson-3.6.7-cp39-cp39-manylinux_2_24_x86_64.whl (255 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 255.3/255.3 KB 29.4 MB/s eta 0:00:00
Collecting overrides==6.1.0
  Downloading overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting packaging==21.3
  Downloading packaging-21.3-py3-none-any.whl (40 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.8/40.8 KB 6.4 MB/s eta 0:00:00
Collecting pandas==1.4.1
  Downloading pandas-1.4.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.7/11.7 MB 79.9 MB/s eta 0:00:00
Collecting parameterized==0.7.5
  Downloading parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pbr==5.8.1
  Downloading pbr-5.8.1-py2.py3-none-any.whl (113 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 113.0/113.0 KB 17.0 MB/s eta 0:00:00
Collecting pluggy==0.13.1
  Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting proto-plus==1.20.3
  Downloading proto_plus-1.20.3-py3-none-any.whl (46 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.2/46.2 KB 7.3 MB/s eta 0:00:00
Collecting protobuf==3.19.4
  Downloading protobuf-3.19.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 62.1 MB/s eta 0:00:00
Collecting psycopg2-binary==2.9.3
  Downloading psycopg2_binary-2.9.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 76.5 MB/s eta 0:00:00
Collecting py==1.11.0
  Downloading py-1.11.0-py2.py3-none-any.whl (98 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.7/98.7 KB 12.5 MB/s eta 0:00:00
Collecting pyarrow==6.0.1
  Downloading pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25.6/25.6 MB 52.8 MB/s eta 0:00:00
Collecting pyasn1==0.4.8
  Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.1/77.1 KB 11.9 MB/s eta 0:00:00
Collecting pyasn1-modules==0.2.8
  Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 KB 21.9 MB/s eta 0:00:00
Collecting pycparser==2.21
  Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 KB 18.6 MB/s eta 0:00:00
Collecting pydot==1.4.2
  Downloading pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting PyHamcrest==1.10.1
  Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 KB 365.7 kB/s eta 0:00:00
Collecting pymongo==3.12.3
  Downloading pymongo-3.12.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (516 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 516.3/516.3 KB 41.2 MB/s eta 0:00:00
Collecting PyMySQL==1.0.2
  Downloading PyMySQL-1.0.2-py3-none-any.whl (43 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.8/43.8 KB 6.8 MB/s eta 0:00:00
Collecting pyparsing==2.4.7
  Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.8/67.8 KB 10.1 MB/s eta 0:00:00
Collecting pytest==4.6.11
  Downloading pytest-4.6.11-py2.py3-none-any.whl (231 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 231.6/231.6 KB 23.3 MB/s eta 0:00:00
Collecting pytest-forked==1.4.0
  Downloading pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting pytest-timeout==1.4.2
  Downloading pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting pytest-xdist==1.34.0
  Downloading pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting python-dateutil==2.8.2
  Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 KB 20.0 MB/s eta 0:00:00
Collecting python-snappy==0.6.1
  Downloading python_snappy-0.6.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (55 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.7/55.7 KB 7.8 MB/s eta 0:00:00
Collecting pytz==2021.3
  Downloading pytz-2021.3-py2.py3-none-any.whl (503 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 503.5/503.5 KB 16.5 MB/s eta 0:00:00
Collecting PyYAML==6.0
  Downloading PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 661.8/661.8 KB 55.9 MB/s eta 0:00:00
Collecting regex==2022.3.2
  Downloading regex-2022.3.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (763 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 763.5/763.5 KB 53.1 MB/s eta 0:00:00
Collecting requests==2.27.1
  Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.1/63.1 KB 6.1 MB/s eta 0:00:00
Collecting requests-mock==1.9.3
  Downloading requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting requests-oauthlib==1.3.1
  Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting rsa==4.8
  Downloading rsa-4.8-py3-none-any.whl (39 kB)
Collecting scikit-learn==1.0.2
  Downloading scikit_learn-1.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (26.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26.4/26.4 MB 48.7 MB/s eta 0:00:00
Collecting scipy==1.8.0
  Downloading scipy-1.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (42.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.1/42.1 MB 25.6 MB/s eta 0:00:00
Collecting six==1.16.0
  Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting soupsieve==2.3.1
  Downloading soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting SQLAlchemy==1.4.31
  Downloading SQLAlchemy-1.4.31-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 29.8 MB/s eta 0:00:00
Collecting tenacity==5.1.5
  Downloading tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting tensorboard==2.8.0
  Downloading tensorboard-2.8.0-py3-none-any.whl (5.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.8/5.8 MB 87.7 MB/s eta 0:00:00
Collecting tensorboard-data-server==0.6.1
  Downloading tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.9/4.9 MB 94.3 MB/s eta 0:00:00
Collecting tensorboard-plugin-wit==1.8.1
  Downloading tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 781.3/781.3 KB 38.8 MB/s eta 0:00:00
Collecting tensorflow==2.8.0
  Downloading tensorflow-2.8.0-cp39-cp39-manylinux2010_x86_64.whl (497.6 MB)

> Task :sdks:python:installGcpTest
Successfully installed apache-beam-2.38.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.0 azure-storage-blob-12.10.0 boto3-1.21.22 botocore-1.24.22 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-36.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.10 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-cloud-bigquery-2.34.2 google-cloud-bigquery-storage-2.13.0 google-cloud-bigtable-1.7.0 google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-3.6.2 google-cloud-language-1.3.0 google-cloud-pubsub-2.11.0 google-cloud-pubsublite-1.4.1 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 google-cloud-vision-1.0.0 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.7 overrides-6.1.0 pandas-1.4.1 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-6.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.3 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 sqlalchemy-1.4.32 tenacity-5.1.5 testcontainers-3.4.2 typing-extensions-4.1.1 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.1 wrapt-1.14.0

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup

> Task :sdks:python:container:py39:docker FAILED
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 56s
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/qeysz3lxisszk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2421

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2421/display/redirect?page=changes>

Changes:

[mmack] [adhoc] Minor cleanup for aws2 tests


------------------------------------------
[...truncated 1.47 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container 6e2fc5e50070
 ---> 614d754ad8dd
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> 6cde71caaf55
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> cb3f4db5f7af
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> 1eed7c112d54
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> de1dec94e259
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 88e8e36a6412
Removing intermediate container 88e8e36a6412
 ---> d06dde7ec8ea
Step 21/31 : FROM beam as third_party_licenses
 ---> d06dde7ec8ea
Step 22/31 : ARG pull_licenses
 ---> Running in 5daed5d18ab7
Removing intermediate container 5daed5d18ab7
 ---> edae7070634d
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 7a900107f5dc
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> dcbb674eedb9
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 52c255170ba1
Removing intermediate container 52c255170ba1
 ---> 4b805a1ddcad
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 707aacf1169e
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 3680bfc93ea4
Collecting pip-licenses<3.0.0
  Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=0052a96344a216ba563bba902c40b1d965ddba6545d5c9c18669422b3ca963aa
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
    from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/pip-licenses", line 5, in <module>
    from piplicenses import main
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
    from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
Traceback (most recent call last):
  File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
    dependencies = run_pip_licenses()
  File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
    dependencies = run_bash_command(command)
  File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
    return subprocess.check_output(command.split()).decode('utf-8')
  File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py39:docker FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 206693

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 13m
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/y7wsc4na4mafy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2420

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2420/display/redirect>

Changes:


------------------------------------------
[...truncated 764.05 KB...]
  Downloading google_cloud_spanner-1.19.1-py2.py3-none-any.whl (255 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 255.5/255.5 KB 33.7 MB/s eta 0:00:00
Collecting google-cloud-videointelligence==1.16.1
  Downloading google_cloud_videointelligence-1.16.1-py2.py3-none-any.whl (183 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 183.8/183.8 KB 26.4 MB/s eta 0:00:00
Collecting google-cloud-vision==1.0.0
  Downloading google_cloud_vision-1.0.0-py2.py3-none-any.whl (435 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 435.0/435.0 KB 40.7 MB/s eta 0:00:00
Collecting google-crc32c==1.3.0
  Downloading google_crc32c-1.3.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (36 kB)
Collecting google-pasta==0.2.0
  Downloading google_pasta-0.2.0-py3-none-any.whl (57 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 57.5/57.5 KB 10.2 MB/s eta 0:00:00
Collecting google-python-cloud-debugger==2.18
  Downloading google_python_cloud_debugger-2.18-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (769 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 769.2/769.2 KB 56.7 MB/s eta 0:00:00
Collecting google-resumable-media==2.3.1
  Downloading google_resumable_media-2.3.1-py2.py3-none-any.whl (76 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 76.8/76.8 KB 12.2 MB/s eta 0:00:00
Collecting googleapis-common-protos==1.55.0
  Downloading googleapis_common_protos-1.55.0-py2.py3-none-any.whl (212 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 212.3/212.3 KB 29.9 MB/s eta 0:00:00
Collecting greenlet==1.1.2
  Downloading greenlet-1.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (153 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 153.6/153.6 KB 21.2 MB/s eta 0:00:00
Collecting grpc-google-iam-v1==0.12.3
  Downloading grpc-google-iam-v1-0.12.3.tar.gz (13 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Collecting grpcio==1.44.0
  Downloading grpcio-1.44.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.3/4.3 MB 81.5 MB/s eta 0:00:00
Collecting grpcio-gcp==0.2.2
  Downloading grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting grpcio-status==1.44.0
  Downloading grpcio_status-1.44.0-py3-none-any.whl (10.0 kB)
Collecting guppy3==3.1.2
  Downloading guppy3-3.1.2-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (638 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 638.4/638.4 KB 49.6 MB/s eta 0:00:00
Collecting h5py==3.6.0
  Downloading h5py-3.6.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (4.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.5/4.5 MB 90.2 MB/s eta 0:00:00
Collecting hdfs==2.6.0
  Downloading hdfs-2.6.0-py3-none-any.whl (33 kB)
Collecting httplib2==0.19.1
  Downloading httplib2-0.19.1-py3-none-any.whl (95 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 95.4/95.4 KB 15.0 MB/s eta 0:00:00
Collecting idna==3.3
  Downloading idna-3.3-py3-none-any.whl (61 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 61.2/61.2 KB 9.6 MB/s eta 0:00:00
Collecting importlib-metadata==4.11.2
  Downloading importlib_metadata-4.11.2-py3-none-any.whl (17 kB)
Collecting joblib==1.1.0
  Downloading joblib-1.1.0-py2.py3-none-any.whl (306 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 307.0/307.0 KB 34.7 MB/s eta 0:00:00
Collecting keras==2.8.0
  Downloading keras-2.8.0-py2.py3-none-any.whl (1.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.4/1.4 MB 74.5 MB/s eta 0:00:00
Collecting Keras-Preprocessing==1.1.2
  Downloading Keras_Preprocessing-1.1.2-py2.py3-none-any.whl (42 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.6/42.6 KB 6.3 MB/s eta 0:00:00
Collecting libclang==13.0.0
  Downloading libclang-13.0.0-py2.py3-none-manylinux1_x86_64.whl (14.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.5/14.5 MB 77.5 MB/s eta 0:00:00
Collecting libcst==0.4.1
  Downloading libcst-0.4.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.7/2.7 MB 89.4 MB/s eta 0:00:00
Collecting Markdown==3.3.6
  Downloading Markdown-3.3.6-py3-none-any.whl (97 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 97.8/97.8 KB 15.3 MB/s eta 0:00:00
Collecting mmh3==3.0.0
  Downloading mmh3-3.0.0-cp39-cp39-manylinux2010_x86_64.whl (49 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 49.3/49.3 KB 8.3 MB/s eta 0:00:00
Collecting mock==2.0.0
  Downloading mock-2.0.0-py2.py3-none-any.whl (56 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.8/56.8 KB 9.6 MB/s eta 0:00:00
Collecting more-itertools==8.12.0
  Downloading more_itertools-8.12.0-py3-none-any.whl (54 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 54.3/54.3 KB 9.8 MB/s eta 0:00:00
Collecting mypy-extensions==0.4.3
  Downloading mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB)
Collecting nltk==3.7
  Downloading nltk-3.7-py3-none-any.whl (1.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 78.9 MB/s eta 0:00:00
Collecting nose==1.3.7
  Downloading nose-1.3.7-py3-none-any.whl (154 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 154.7/154.7 KB 23.6 MB/s eta 0:00:00
Collecting numpy==1.22.2
  Downloading numpy-1.22.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (16.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.8/16.8 MB 62.4 MB/s eta 0:00:00
Collecting oauth2client==4.1.3
  Downloading oauth2client-4.1.3-py2.py3-none-any.whl (98 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.2/98.2 KB 12.2 MB/s eta 0:00:00
Collecting oauthlib==3.2.0
  Downloading oauthlib-3.2.0-py3-none-any.whl (151 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 151.5/151.5 KB 16.0 MB/s eta 0:00:00
Collecting opt-einsum==3.3.0
  Downloading opt_einsum-3.3.0-py3-none-any.whl (65 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 65.5/65.5 KB 8.2 MB/s eta 0:00:00
Collecting orjson==3.6.7
  Downloading orjson-3.6.7-cp39-cp39-manylinux_2_24_x86_64.whl (255 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 255.3/255.3 KB 31.4 MB/s eta 0:00:00
Collecting overrides==6.1.0
  Downloading overrides-6.1.0-py3-none-any.whl (14 kB)
Collecting packaging==21.3
  Downloading packaging-21.3-py3-none-any.whl (40 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 40.8/40.8 KB 7.1 MB/s eta 0:00:00
Collecting pandas==1.4.1
  Downloading pandas-1.4.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (11.7 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 11.7/11.7 MB 86.5 MB/s eta 0:00:00
Collecting parameterized==0.7.5
  Downloading parameterized-0.7.5-py2.py3-none-any.whl (17 kB)
Collecting pbr==5.8.1
  Downloading pbr-5.8.1-py2.py3-none-any.whl (113 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 113.0/113.0 KB 16.6 MB/s eta 0:00:00
Collecting pluggy==0.13.1
  Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB)
Collecting proto-plus==1.20.3
  Downloading proto_plus-1.20.3-py3-none-any.whl (46 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 46.2/46.2 KB 6.9 MB/s eta 0:00:00
Collecting protobuf==3.19.4
  Downloading protobuf-3.19.4-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 51.6 MB/s eta 0:00:00
Collecting psycopg2-binary==2.9.3
  Downloading psycopg2_binary-2.9.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 84.5 MB/s eta 0:00:00
Collecting py==1.11.0
  Downloading py-1.11.0-py2.py3-none-any.whl (98 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 98.7/98.7 KB 15.5 MB/s eta 0:00:00
Collecting pyarrow==6.0.1
  Downloading pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 25.6/25.6 MB 52.4 MB/s eta 0:00:00
Collecting pyasn1==0.4.8
  Downloading pyasn1-0.4.8-py2.py3-none-any.whl (77 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 77.1/77.1 KB 11.9 MB/s eta 0:00:00
Collecting pyasn1-modules==0.2.8
  Downloading pyasn1_modules-0.2.8-py2.py3-none-any.whl (155 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.3/155.3 KB 20.3 MB/s eta 0:00:00
Collecting pycparser==2.21
  Downloading pycparser-2.21-py2.py3-none-any.whl (118 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 118.7/118.7 KB 14.8 MB/s eta 0:00:00
Collecting pydot==1.4.2
  Downloading pydot-1.4.2-py2.py3-none-any.whl (21 kB)
Collecting PyHamcrest==1.10.1
  Downloading PyHamcrest-1.10.1-py3-none-any.whl (48 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 48.9/48.9 KB 7.5 MB/s eta 0:00:00
Collecting pymongo==3.12.3
  Downloading pymongo-3.12.3-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (516 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 516.3/516.3 KB 42.7 MB/s eta 0:00:00
Collecting PyMySQL==1.0.2
  Downloading PyMySQL-1.0.2-py3-none-any.whl (43 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 43.8/43.8 KB 6.6 MB/s eta 0:00:00
Collecting pyparsing==2.4.7
  Downloading pyparsing-2.4.7-py2.py3-none-any.whl (67 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 67.8/67.8 KB 10.4 MB/s eta 0:00:00
Collecting pytest==4.6.11
  Downloading pytest-4.6.11-py2.py3-none-any.whl (231 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 231.6/231.6 KB 25.6 MB/s eta 0:00:00
Collecting pytest-forked==1.4.0
  Downloading pytest_forked-1.4.0-py3-none-any.whl (4.9 kB)
Collecting pytest-timeout==1.4.2
  Downloading pytest_timeout-1.4.2-py2.py3-none-any.whl (10 kB)
Collecting pytest-xdist==1.34.0
  Downloading pytest_xdist-1.34.0-py2.py3-none-any.whl (36 kB)
Collecting python-dateutil==2.8.2
  Downloading python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 247.7/247.7 KB 31.1 MB/s eta 0:00:00
Collecting python-snappy==0.6.1
  Downloading python_snappy-0.6.1-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (55 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 55.7/55.7 KB 8.8 MB/s eta 0:00:00
Collecting pytz==2021.3
  Downloading pytz-2021.3-py2.py3-none-any.whl (503 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 503.5/503.5 KB 44.3 MB/s eta 0:00:00
Collecting PyYAML==6.0
  Downloading PyYAML-6.0-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (661 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 661.8/661.8 KB 51.1 MB/s eta 0:00:00
Collecting regex==2022.3.2
  Downloading regex-2022.3.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (763 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 763.5/763.5 KB 49.5 MB/s eta 0:00:00
Collecting requests==2.27.1
  Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.1/63.1 KB 10.1 MB/s eta 0:00:00
Collecting requests-mock==1.9.3
  Downloading requests_mock-1.9.3-py2.py3-none-any.whl (27 kB)
Collecting requests-oauthlib==1.3.1
  Downloading requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Collecting rsa==4.8
  Downloading rsa-4.8-py3-none-any.whl (39 kB)
Collecting scikit-learn==1.0.2
  Downloading scikit_learn-1.0.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (26.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 26.4/26.4 MB 51.0 MB/s eta 0:00:00
Collecting scipy==1.8.0
  Downloading scipy-1.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (42.1 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 42.1/42.1 MB 25.5 MB/s eta 0:00:00
Collecting six==1.16.0
  Downloading six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting soupsieve==2.3.1
  Downloading soupsieve-2.3.1-py3-none-any.whl (37 kB)
Collecting SQLAlchemy==1.4.31
  Downloading SQLAlchemy-1.4.31-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.6 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.6/1.6 MB 60.9 MB/s eta 0:00:00
Collecting tenacity==5.1.5
  Downloading tenacity-5.1.5-py2.py3-none-any.whl (34 kB)
Collecting tensorboard==2.8.0
  Downloading tensorboard-2.8.0-py3-none-any.whl (5.8 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 5.8/5.8 MB 95.5 MB/s eta 0:00:00
Collecting tensorboard-data-server==0.6.1
  Downloading tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)

> Task :sdks:python:installGcpTest
Successfully installed apache-beam-2.38.0.dev0 atomicwrites-1.4.0 attrs-21.4.0 azure-core-1.23.0 azure-storage-blob-12.10.0 boto3-1.21.21 botocore-1.24.21 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.12 cloudpickle-2.0.0 crcmod-1.7 cryptography-36.0.2 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.10 fasteners-0.17.3 freezegun-1.2.1 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-cloud-bigquery-2.34.2 google-cloud-bigquery-storage-2.13.0 google-cloud-bigtable-1.7.0 google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-3.6.2 google-cloud-language-1.3.0 google-cloud-pubsub-2.11.0 google-cloud-pubsublite-1.4.1 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 google-cloud-vision-1.0.0 google-crc32c-1.3.0 google-resumable-media-2.3.2 googleapis-common-protos-1.56.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 grpcio-status-1.44.0 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-1.0.0 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 numpy-1.22.3 oauth2client-4.1.3 oauthlib-3.2.0 orjson-3.6.7 overrides-6.1.0 pandas-1.4.1 parameterized-0.7.5 pbr-5.8.1 pluggy-0.13.1 proto-plus-1.20.3 psycopg2-binary-2.9.3 pyarrow-6.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pymysql-1.0.2 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.3 pyyaml-6.0 requests-2.27.1 requests-oauthlib-1.3.1 requests_mock-1.9.3 rsa-4.8 s3transfer-0.5.2 sqlalchemy-1.4.32 tenacity-5.1.5 testcontainers-3.4.2 typing-extensions-4.1.1 typing-utils-0.1.0 urllib3-1.26.9 wcwidth-0.2.5 websocket-client-1.3.1 wrapt-1.14.0

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerSetup

> Task :sdks:python:container:py39:docker FAILED
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 7m 21s
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/4vry6qhzgppsi

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2419

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2419/display/redirect?page=changes>

Changes:

[Luke Cwik] [BEAM-10212] Clean-up comments, remove rawtypes usage.

[Kyle Weaver] [BEAM-14123] Fix typo in hdfsIntegrationTest task name.

[noreply] [BEAM-13893] improved coverage of jobopts package (#17003)

[noreply] Merge pull request #16977 from [BEAM-12164]  Added integration test for


------------------------------------------
[...truncated 1.12 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container 80e3c6acb6ba
 ---> 0891afd03382
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> 0941ac9b1eae
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> b01ee12fb2a2
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> 7064a7db060d
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 2764c1ecbf74
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in de4add3bcd31
Removing intermediate container de4add3bcd31
 ---> c1f06b7f9c42
Step 21/31 : FROM beam as third_party_licenses
 ---> c1f06b7f9c42
Step 22/31 : ARG pull_licenses
 ---> Running in 6aa8ecf437ba
Removing intermediate container 6aa8ecf437ba
 ---> 5b5a9518490c
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 040395588a60
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> a3ea29cfe355
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 1257355f7bc4
Removing intermediate container 1257355f7bc4
 ---> 180ce8e08e16
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> a97ab78625ad
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in fbc1a4b9968e
Collecting pip-licenses<3.0.0
  Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=ad45964970daea3d05f31f8bb2d7fc98f018b4d5107c10a7e50dfacc7e4de1ce
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
    from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/pip-licenses", line 5, in <module>
    from piplicenses import main
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
    from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
Traceback (most recent call last):
  File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
    dependencies = run_pip_licenses()
  File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
    dependencies = run_bash_command(command)
  File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
    return subprocess.check_output(command.split()).decode('utf-8')
  File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py39:docker FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 1580822

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 8m 2s
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/gzlryxnaqtwhe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2418

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2418/display/redirect?page=changes>

Changes:

[noreply] Populate environment capabilities in v1beta3 protos. (#17042)

[Kyle Weaver] [BEAM-12976] Test a whole pipeline using projection pushdown in BQ IO.

[Kyle Weaver] [BEAM-12976] Enable projection pushdown for Java pipelines on Dataflow,

[noreply] [BEAM-14038] Auto-startup for Python expansion service. (#17035)


------------------------------------------
[...truncated 673.41 KB...]
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
    for message in self._message_stream:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exceeded"
	debug_error_string = "{"created":"@1647563852.065476523","description":"Error received from peer ipv4:127.0.0.1:34727","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>


> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql
Exception in thread wait_until_finish_read:
Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
    for message in self._message_stream:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exceeded"
	debug_error_string = "{"created":"@1647564046.059523600","description":"Error received from peer ipv4:127.0.0.1:34727","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>

Exception in thread wait_until_finish_read:
Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
    for message in self._message_stream:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exceeded"
	debug_error_string = "{"created":"@1647564129.081492736","description":"Error received from peer ipv4:127.0.0.1:34727","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>

Exception in thread wait_until_finish_read:
Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
    for message in self._message_stream:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exceeded"
	debug_error_string = "{"created":"@1647564255.415458520","description":"Error received from peer ipv4:127.0.0.1:34727","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>

Exception in thread wait_until_finish_read:
Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
    for message in self._message_stream:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exceeded"
	debug_error_string = "{"created":"@1647564338.074552437","description":"Error received from peer ipv4:127.0.0.1:34727","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>

Exception in thread wait_until_finish_read:
Traceback (most recent call last):
  File "/usr/lib/python3.6/threading.py", line 916, in _bootstrap_inner
    self.run()
  File "/usr/lib/python3.6/threading.py", line 864, in run
    self._target(*self._args, **self._kwargs)
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py",> line 565, in read_messages
    for message in self._message_stream:
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 426, in __next__
    return self._next()
  File "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages/grpc/_channel.py",> line 826, in _next
    raise self
grpc._channel._MultiThreadedRendezvous: <_MultiThreadedRendezvous of RPC that terminated with:
	status = StatusCode.DEADLINE_EXCEEDED
	details = "Deadline Exceeded"
	debug_error_string = "{"created":"@1647564417.556505999","description":"Error received from peer ipv4:127.0.0.1:34727","file":"src/core/lib/surface/call.cc","file_line":903,"grpc_message":"Deadline Exceeded","grpc_status":4}"
>


> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql FAILED

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CoGroupByKeyTest > test FAILED
    org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:345
        Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:340

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombineGloballyTest > test FAILED
    org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:362
        Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:357

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$CombinePerKeyTest > test FAILED
    org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:379
        Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:374

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$FlattenTest > test FAILED
    org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:396
        Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:391

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$GroupByKeyTest > test FAILED
    org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:327
        Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:322

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$MultiInputOutputWithSideInputTest > test FAILED
    org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:309
        Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:304

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$PartitionTest > test FAILED
    org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:414
        Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:409

org.apache.beam.runners.core.construction.ValidateRunnerXlangTest$SingleInputOutputTest > test FAILED
    org.apache.beam.vendor.grpc.v1p43p2.io.grpc.StatusRuntimeException at ValidateRunnerXlangTest.java:292
        Caused by: org.apache.beam.vendor.grpc.v1p43p2.io.netty.channel.AbstractChannel$AnnotatedConnectException
            Caused by: java.net.ConnectException at Errors.java:155
    java.lang.NullPointerException at ValidateRunnerXlangTest.java:287

8 tests completed, 8 failed

> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython FAILED
> Task :sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerCleanup
> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup

FAILURE: Build completed with 5 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPythonOnly'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPythonOnly/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingPython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

4: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

5: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:direct:xlang:validatesCrossLanguageRunnerJavaUsingPython'.
> There were failing tests. See the report at: file://<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/ws/src/sdks/python/test-suites/direct/xlang/build/reports/tests/validatesCrossLanguageRunnerJavaUsingPython/index.html>

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 46m 48s
233 actionable tasks: 168 executed, 54 from cache, 11 up-to-date

Publishing build scan...
https://gradle.com/s/gpgqi46ctvxoe

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PostCommit_XVR_Direct #2417

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Direct/2417/display/redirect?page=changes>

Changes:

[noreply] [BEAM-11934] Add enable_file_dynamic_sharding to allow DataflowRunner

[noreply] [BEAM-12777] Create symlink for `current` directory (#17105)

[noreply] [BEAM-14020] Adding SchemaTransform, SchemaTransformProvider,

[noreply] [BEAM-13015] Modify metrics to begin and reset to a non-dirty state.

[noreply] [BEAM-14112] Avoid storing a generator in _CustomBigQuerySource (#17100)


------------------------------------------
[...truncated 1.54 MB...]
attrs==21.4.0
beautifulsoup4==4.10.0
bs4==0.0.1
cachetools==4.2.4
certifi==2021.10.8
cffi==1.15.0
charset-normalizer==2.0.12
click==8.0.4
cloudpickle==2.0.0
crcmod==1.7
cryptography==36.0.1
Cython==0.29.28
deprecation==2.1.0
dill==0.3.1.1
docker==5.0.3
docopt==0.6.2
execnet==1.9.0
fastavro==1.4.9
fasteners==0.17.3
flatbuffers==2.0
freezegun==1.2.0
future==0.18.2
gast==0.5.3
google-api-core==1.31.5
google-api-python-client==2.39.0
google-apitools==0.5.31
google-auth==1.35.0
google-auth-httplib2==0.1.0
google-auth-oauthlib==0.4.6
google-cloud-bigquery==2.34.1
google-cloud-bigquery-storage==2.12.0
google-cloud-bigtable==1.7.0
google-cloud-core==1.7.2
google-cloud-datastore==1.15.3
google-cloud-dlp==3.6.1
google-cloud-language==1.3.0
google-cloud-profiler==3.0.7
google-cloud-pubsub==2.9.0
google-cloud-pubsublite==1.4.0
google-cloud-recommendations-ai==0.2.0
google-cloud-spanner==1.19.1
google-cloud-videointelligence==1.16.1
google-cloud-vision==1.0.0
google-crc32c==1.3.0
google-pasta==0.2.0
google-python-cloud-debugger==2.18
google-resumable-media==2.3.1
googleapis-common-protos==1.55.0
greenlet==1.1.2
grpc-google-iam-v1==0.12.3
grpcio==1.44.0
grpcio-gcp==0.2.2
grpcio-status==1.44.0
guppy3==3.1.2
h5py==3.6.0
hdfs==2.6.0
httplib2==0.19.1
idna==3.3
importlib-metadata==4.11.2
joblib==1.1.0
keras==2.8.0
Keras-Preprocessing==1.1.2
libclang==13.0.0
libcst==0.4.1
Markdown==3.3.6
mmh3==3.0.0
mock==2.0.0
more-itertools==8.12.0
mypy-extensions==0.4.3
nltk==3.7
nose==1.3.7
numpy==1.22.2
oauth2client==4.1.3
oauthlib==3.2.0
opt-einsum==3.3.0
orjson==3.6.7
overrides==6.1.0
packaging==21.3
pandas==1.4.1
parameterized==0.7.5
pbr==5.8.1
pip==22.0.4
pluggy==0.13.1
proto-plus==1.20.3
protobuf==3.19.4
psycopg2-binary==2.9.3
py==1.11.0
pyarrow==6.0.1
pyasn1==0.4.8
pyasn1-modules==0.2.8
pycparser==2.21
pydot==1.4.2
PyHamcrest==1.10.1
pymongo==3.12.3
PyMySQL==1.0.2
pyparsing==2.4.7
pytest==4.6.11
pytest-forked==1.4.0
pytest-timeout==1.4.2
pytest-xdist==1.34.0
python-dateutil==2.8.2
python-snappy==0.6.1
pytz==2021.3
PyYAML==6.0
regex==2022.3.2
requests==2.27.1
requests-mock==1.9.3
requests-oauthlib==1.3.1
rsa==4.8
scikit-learn==1.0.2
scipy==1.8.0
setuptools==58.1.0
six==1.16.0
soupsieve==2.3.1
SQLAlchemy==1.4.31
tenacity==5.1.5
tensorboard==2.8.0
tensorboard-data-server==0.6.1
tensorboard-plugin-wit==1.8.1
tensorflow==2.8.0
tensorflow-io-gcs-filesystem==0.24.0
termcolor==1.1.0
testcontainers==3.4.2
tf-estimator-nightly==2.8.0.dev2021122109
threadpoolctl==3.1.0
tqdm==4.63.0
typing-inspect==0.7.1
typing-utils==0.1.0
typing_extensions==4.1.1
uritemplate==4.1.1
urllib3==1.26.8
wcwidth==0.2.5
websocket-client==1.3.1
Werkzeug==2.0.3
wheel==0.37.1
wrapt==1.13.3
zipp==3.7.0
Removing intermediate container ba70c969dac8
 ---> d8e2e14abd88
Step 16/31 : COPY target/LICENSE /opt/apache/beam/
 ---> fa2e3e70d6dd
Step 17/31 : COPY target/LICENSE.python /opt/apache/beam/
 ---> 0c0212d2a545
Step 18/31 : COPY target/NOTICE /opt/apache/beam/
 ---> 6dc544049294
Step 19/31 : COPY target/launcher/linux_amd64/boot /opt/apache/beam/
 ---> 79828de85a1a
Step 20/31 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in ed1b0f496ed9
Removing intermediate container ed1b0f496ed9
 ---> 00ffd22558ef
Step 21/31 : FROM beam as third_party_licenses
 ---> 00ffd22558ef
Step 22/31 : ARG pull_licenses
 ---> Running in b5e8aec4fb8d
Removing intermediate container b5e8aec4fb8d
 ---> c448aac77982
Step 23/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 4d53b7aa5b2a
Step 24/31 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> 355ed2dd81b8
Step 25/31 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in 532aeb78400d
Removing intermediate container 532aeb78400d
 ---> f39d653665fb
Step 26/31 : COPY target/license_scripts /tmp/license_scripts/
 ---> 5077fed5c007
Step 27/31 : RUN if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi
 ---> Running in 7668ee833ca1
Collecting pip-licenses<3.0.0
  Downloading pip_licenses-2.3.0-py3-none-any.whl (14 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.9/site-packages (6.0)
Requirement already satisfied: tenacity in /usr/local/lib/python3.9/site-packages (5.1.5)
Collecting PTable
  Downloading PTable-0.9.2.tar.gz (31 kB)
  Preparing metadata (setup.py): started
  Preparing metadata (setup.py): finished with status 'done'
Requirement already satisfied: six>=1.9.0 in /usr/local/lib/python3.9/site-packages (from tenacity) (1.16.0)
Building wheels for collected packages: PTable
  Building wheel for PTable (setup.py): started
  Building wheel for PTable (setup.py): finished with status 'done'
  Created wheel for PTable: filename=PTable-0.9.2-py3-none-any.whl size=22925 sha256=038bc3df5e29b1ab02abd1c954a1dcaa16fe0c659c381ade5ece97153ff8e794
  Stored in directory: /root/.cache/pip/wheels/b8/d5/8b/e0c9765594e0dc8093aae5f67eacc08b9b533da598c710b54a
Successfully built PTable
Installing collected packages: PTable, pip-licenses
Successfully installed PTable-0.9.2 pip-licenses-2.3.0
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager. It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv
Traceback (most recent call last):
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 40, in <module>
    from pip._internal.utils.misc import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip._internal.utils.misc' (/usr/local/lib/python3.9/site-packages/pip/_internal/utils/misc.py)

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/bin/pip-licenses", line 5, in <module>
    from piplicenses import main
  File "/usr/local/lib/python3.9/site-packages/piplicenses.py", line 42, in <module>
    from pip import get_installed_distributions
ImportError: cannot import name 'get_installed_distributions' from 'pip' (/usr/local/lib/python3.9/site-packages/pip/__init__.py)
Traceback (most recent call last):
  File "/tmp/license_scripts/pull_licenses_py.py", line 166, in <module>
    dependencies = run_pip_licenses()
  File "/tmp/license_scripts/pull_licenses_py.py", line 49, in run_pip_licenses
    dependencies = run_bash_command(command)
  File "/tmp/license_scripts/pull_licenses_py.py", line 44, in run_bash_command
    return subprocess.check_output(command.split()).decode('utf-8')
  File "/usr/local/lib/python3.9/subprocess.py", line 424, in check_output
    return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
  File "/usr/local/lib/python3.9/subprocess.py", line 528, in run
    raise CalledProcessError(retcode, process.args,
subprocess.CalledProcessError: Command '['pip-licenses', '--with-license-file', '--with-urls', '--from=mixed', '--ignore', 'apache-beam', '--format=json']' returned non-zero exit status 1.
The command '/bin/sh -c if [ "$pull_licenses" = "true" ] ; then       pip install 'pip-licenses<3.0.0' pyyaml tenacity &&       python /tmp/license_scripts/pull_licenses_py.py ;     fi' returned a non-zero code: 1

> Task :sdks:python:container:py39:docker FAILED

> Task :sdks:python:test-suites:direct:xlang:fnApiJobServerCleanup
Killing process at 3030546

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:container:py39:docker'.
> Process 'command 'docker'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 9m 11s
209 actionable tasks: 26 executed, 183 up-to-date

Publishing build scan...
https://gradle.com/s/vqrrmnhzjrft2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org