You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2023/03/27 15:04:40 UTC

Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #80

See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/80/display/redirect?page=changes>

Changes:

[noreply] Bump webpack (#25846)


------------------------------------------
[...truncated 33.64 KB...]
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 585.9/585.9 MB 1.3 MB/s eta 0:00:00
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Downloading tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 588.3/588.3 MB 1.2 MB/s eta 0:00:00
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.8)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.51.3)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.2)
Collecting apache-beam[gcp]<3,>=2.40
  Downloading apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.5/14.5 MB 71.9 MB/s eta 0:00:00
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.0)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.0)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.29.0)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.16.3)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.0)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.31.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.0)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.51.3)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.51.3
    Uninstalling grpcio-status-1.51.3:
      Successfully uninstalled grpcio-status-1.51.3
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.2
    Uninstalling google-cloud-recommendations-ai-0.10.2:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.2
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.0
    Uninstalling google-cloud-language-2.9.0:
      Successfully uninstalled google-cloud-language-2.9.0
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.0
    Uninstalling google-cloud-bigquery-storage-2.19.0:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.0
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.31.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 394

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 4m 7s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/vopx6exdgs32g

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_CloudML_Benchmarks_Dataflow #97

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/97/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #96

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/96/display/redirect>

Changes:


------------------------------------------
[...truncated 33.52 KB...]
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Downloading tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.48.0.dev0)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 588.3/588.3 MB 1.6 MB/s eta 0:00:00
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.10)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Collecting apache-beam[gcp]<3,>=2.40
  Downloading apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.5/14.5 MB 47.1 MB/s eta 0:00:00
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.31.0)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.3)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.16.0)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Downloading tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 47.1 MB/s eta 0:00:00
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.1)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.3.0-py3-none-any.whl (22 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 11.0.0
    Uninstalling pyarrow-11.0.0:
      Successfully uninstalled pyarrow-11.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.3
    Uninstalling protobuf-4.22.3:
      Successfully uninstalled protobuf-4.22.3
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.48.0.dev0
    Uninstalling apache-beam-2.48.0.dev0:
      Successfully uninstalled apache-beam-2.48.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.3.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:87: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 422

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 46s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/js4tsrn7yflpc

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #95

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/95/display/redirect>

Changes:


------------------------------------------
[...truncated 33.11 KB...]
  Using cached tfx_bsl-1.12.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (21.6 MB)
Collecting tensorflow-transform
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.48.0.dev0)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.10)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.2)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.16.0)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.3.0-py3-none-any.whl (22 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 11.0.0
    Uninstalling pyarrow-11.0.0:
      Successfully uninstalled pyarrow-11.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.48.0.dev0
    Uninstalling apache-beam-2.48.0.dev0:
      Successfully uninstalled apache-beam-2.48.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.3.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:87: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 422

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 48s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/bikixlvti4ntm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #94

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/94/display/redirect>

Changes:


------------------------------------------
[...truncated 33.50 KB...]
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.48.0.dev0)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Downloading tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 588.3/588.3 MB 1.5 MB/s eta 0:00:00
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.10)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Collecting apache-beam[gcp]<3,>=2.40
  Downloading apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.5/14.5 MB 78.9 MB/s eta 0:00:00
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.2)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.16.0)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Downloading tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 74.3 MB/s eta 0:00:00
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.3.0-py3-none-any.whl (22 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 11.0.0
    Uninstalling pyarrow-11.0.0:
      Successfully uninstalled pyarrow-11.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.48.0.dev0
    Uninstalling apache-beam-2.48.0.dev0:
      Successfully uninstalled apache-beam-2.48.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.3.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:87: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 422

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 50s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ya25hxsgzhgqw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #93

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/93/display/redirect>

Changes:


------------------------------------------
[...truncated 33.03 KB...]
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.48.0.dev0)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.16.0)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.2)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.2.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 11.0.0
    Uninstalling pyarrow-11.0.0:
      Successfully uninstalled pyarrow-11.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.48.0.dev0
    Uninstalling apache-beam-2.48.0.dev0:
      Successfully uninstalled apache-beam-2.48.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.2.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:87: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 422

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 32s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gwbxdogwzcz6i

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #92

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/92/display/redirect>

Changes:


------------------------------------------
[...truncated 32.93 KB...]
  Using cached tfx_bsl-1.12.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (21.6 MB)
Collecting tensorflow-transform
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.48.0.dev0)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.2)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.16.0)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.2.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 11.0.0
    Uninstalling pyarrow-11.0.0:
      Successfully uninstalled pyarrow-11.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.48.0.dev0
    Uninstalling apache-beam-2.48.0.dev0:
      Successfully uninstalled apache-beam-2.48.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.2.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:87: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 422

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 39s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dn6557p2esg5m

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #91

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/91/display/redirect>

Changes:


------------------------------------------
[...truncated 33.03 KB...]
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.48.0.dev0)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.16.0)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.2)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 11.0.0
    Uninstalling pyarrow-11.0.0:
      Successfully uninstalled pyarrow-11.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.48.0.dev0
    Uninstalling apache-beam-2.48.0.dev0:
      Successfully uninstalled apache-beam-2.48.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:87: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 422

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 48s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/xm356c7z5nnfk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #90

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/90/display/redirect>

Changes:


------------------------------------------
[...truncated 33.40 KB...]
Collecting tensorflow-transform
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.48.0.dev0)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.2)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 11.0.0
    Uninstalling pyarrow-11.0.0:
      Successfully uninstalled pyarrow-11.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.48.0.dev0
    Uninstalling apache-beam-2.48.0.dev0:
      Successfully uninstalled apache-beam-2.48.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:87: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 5s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7cpiddxaybh2i

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #89

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/89/display/redirect>

Changes:


------------------------------------------
[...truncated 33.49 KB...]
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 585.9/585.9 MB 875.4 kB/s eta 0:00:00
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Downloading tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.1)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Downloading tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 5.3 MB/s eta 0:00:00
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:87: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 3m 32s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/gwlxzs6hatdie

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #88

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/88/display/redirect>

Changes:


------------------------------------------
[...truncated 33.18 KB...]
  Downloading tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 585.9/585.9 MB 1.4 MB/s eta 0:00:00
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 588.3/588.3 MB 1.6 MB/s eta 0:00:00
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Collecting apache-beam[gcp]<3,>=2.40
  Downloading apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.5/14.5 MB 66.9 MB/s eta 0:00:00
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.1)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Downloading tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 66.9 MB/s eta 0:00:00
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 37s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/w27g55m4gx33a

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #87

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/87/display/redirect>

Changes:


------------------------------------------
[...truncated 32.75 KB...]
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.30.0)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.1)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 51s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/qdrdo52nhflcq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #86

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/86/display/redirect?page=changes>

Changes:

[noreply] Merge pull request #26006: Google Cloud libraries BOM 26.11.0


------------------------------------------
[...truncated 32.65 KB...]
Collecting tensorflow-transform
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.29.0)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.1)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 40s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/psobedsevorbw

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #85

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/85/display/redirect>

Changes:


------------------------------------------
[...truncated 32.70 KB...]
Collecting tensorflow-transform
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.29.0)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.1)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 36s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/7trj3laafmfjy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #84

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/84/display/redirect>

Changes:


------------------------------------------
[...truncated 32.81 KB...]
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.29.0)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.1)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 36s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/f3o4fmlrvx7nm

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #83

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/83/display/redirect>

Changes:


------------------------------------------
[...truncated 32.79 KB...]
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.29.0)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.0)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Downloading tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 15.5 MB/s eta 0:00:00
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 54s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/ruwlfhaauwbnk

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #82

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/82/display/redirect>

Changes:


------------------------------------------
[...truncated 33.14 KB...]
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 585.9/585.9 MB 1.4 MB/s eta 0:00:00
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Collecting tensorflow<3,>=2.11
  Downloading tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 588.3/588.3 MB 1.6 MB/s eta 0:00:00
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Collecting apache-beam[gcp]<3,>=2.40
  Downloading apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 14.5/14.5 MB 81.7 MB/s eta 0:00:00
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.9)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.17.0)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.29.0)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.9.0)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Downloading tensorflow_io_gcs_filesystem-0.32.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.4/2.4 MB 68.3 MB/s eta 0:00:00
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.32.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 42s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/jjust3zkmcv7e

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_CloudML_Benchmarks_Dataflow #81

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/81/display/redirect>

Changes:


------------------------------------------
[...truncated 32.88 KB...]
  Using cached tensorflow_transform-1.12.0-py3-none-any.whl (439 kB)
Collecting tensorflow-serving-api!=2.0.*,!=2.1.*,!=2.2.*,!=2.3.*,!=2.4.*,!=2.5.*,!=2.6.*,!=2.7.*,!=2.8.*,<3,>=1.15
  Using cached tensorflow_serving_api-2.11.1-py2.py3-none-any.whl (37 kB)
Requirement already satisfied: pandas<2,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.5.3)
Collecting google-api-python-client<2,>=1.7.11
  Using cached google_api_python_client-1.12.11-py2.py3-none-any.whl (62 kB)
Requirement already satisfied: apache-beam[gcp]<3,>=2.40 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (2.47.0.dev0)
Collecting tensorflow-metadata<1.13.0,>=1.12.0
  Using cached tensorflow_metadata-1.12.0-py3-none-any.whl (52 kB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.12.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (585.9 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.20.3-cp39-cp39-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB)
Collecting absl-py<2.0.0,>=0.9
  Using cached absl_py-1.4.0-py3-none-any.whl (126 kB)
Requirement already satisfied: numpy<2,>=1.16 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tfx_bsl->-r requirements.txt (line 18)) (1.24.2)
Collecting pyarrow<7,>=6
  Using cached pyarrow-6.0.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25.6 MB)
Collecting tensorflow<3,>=2.11
  Using cached tensorflow-2.11.1-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (588.3 MB)
Requirement already satisfied: pydot<2,>=1.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-transform->-r requirements.txt (line 19)) (1.4.2)
Requirement already satisfied: objsize<0.7.0,>=0.6.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.1)
Requirement already satisfied: typing-extensions>=3.7.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.5.0)
Requirement already satisfied: hdfs<3.0.0,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.7.0)
Requirement already satisfied: orjson<4.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.8)
Requirement already satisfied: fastavro<2,>=0.23.6 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7.3)
Requirement already satisfied: grpcio!=1.48.0,<2,>=1.33.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: zstandard<1,>=0.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.20.0)
Requirement already satisfied: httplib2<0.22.0,>=0.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.21.0)
Requirement already satisfied: pymongo<5.0.0,>=3.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.3.3)
Requirement already satisfied: dill<0.3.2,>=0.3.1.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.3.1.1)
Collecting apache-beam[gcp]<3,>=2.40
  Using cached apache_beam-2.46.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (14.5 MB)
Collecting pymongo<4.0.0,>=3.8.0
  Using cached pymongo-3.13.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (515 kB)
Requirement already satisfied: python-dateutil<3,>=2.8.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.8.2)
Requirement already satisfied: regex>=2020.6.8 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.3.23)
Requirement already satisfied: crcmod<2.0,>=1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.7)
Requirement already satisfied: fasteners<1.0,>=0.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.18)
Requirement already satisfied: proto-plus<2,>=1.7.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.22.2)
Requirement already satisfied: pytz>=2018.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2023.2)
Requirement already satisfied: cloudpickle~=2.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.2.1)
Requirement already satisfied: requests<3.0.0,>=2.24.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.28.2)
Requirement already satisfied: google-auth<3,>=1.18.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.16.3)
Collecting google-cloud-videointelligence<2,>=1.8.0
  Using cached google_cloud_videointelligence-1.16.3-py2.py3-none-any.whl (183 kB)
Requirement already satisfied: google-cloud-vision<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4.1)
Requirement already satisfied: google-cloud-pubsublite<2,>=1.2.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.8.1)
Requirement already satisfied: google-cloud-dlp<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.12.1)
Collecting google-cloud-recommendations-ai<0.8.0,>=0.1.0
  Using cached google_cloud_recommendations_ai-0.7.1-py2.py3-none-any.whl (148 kB)
Requirement already satisfied: google-cloud-bigquery<4,>=1.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.8.0)
Collecting google-cloud-language<2,>=1.3.0
  Using cached google_cloud_language-1.3.2-py2.py3-none-any.whl (83 kB)
Requirement already satisfied: cachetools<5,>=3.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.2.4)
Requirement already satisfied: google-apitools<0.5.32,>=0.5.31 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.5.31)
Collecting google-cloud-bigquery-storage<2.17,>=2.6.3
  Using cached google_cloud_bigquery_storage-2.16.2-py2.py3-none-any.whl (185 kB)
Collecting google-cloud-datastore<2,>=1.8.0
  Using cached google_cloud_datastore-1.15.5-py2.py3-none-any.whl (134 kB)
Requirement already satisfied: google-cloud-spanner<4,>=3.0.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.29.0)
Collecting google-cloud-bigtable<2,>=0.31.1
  Using cached google_cloud_bigtable-1.7.3-py2.py3-none-any.whl (268 kB)
Requirement already satisfied: google-cloud-core<3,>=0.28.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.3.2)
Requirement already satisfied: google-auth-httplib2<0.2.0,>=0.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.1.0)
Requirement already satisfied: google-cloud-pubsub<3,>=2.1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.15.2)
Requirement already satisfied: six<2dev,>=1.13.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (1.16.0)
Collecting uritemplate<4dev,>=3.0.0
  Using cached uritemplate-3.0.1-py2.py3-none-any.whl (15 kB)
Requirement already satisfied: google-api-core<3dev,>=1.21.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-api-python-client<2,>=1.7.11->tfx_bsl->-r requirements.txt (line 18)) (2.11.0)
Requirement already satisfied: pyparsing>=2.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from pydot<2,>=1.2->tensorflow-transform->-r requirements.txt (line 19)) (3.0.9)
Collecting tensorflow-estimator<2.12,>=2.11.0
  Using cached tensorflow_estimator-2.11.0-py2.py3-none-any.whl (439 kB)
Collecting flatbuffers>=2.0
  Using cached flatbuffers-23.3.3-py2.py3-none-any.whl (26 kB)
Requirement already satisfied: setuptools in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (67.6.1)
Collecting google-pasta>=0.1.1
  Using cached google_pasta-0.2.0-py3-none-any.whl (57 kB)
Collecting gast<=0.4.0,>=0.2.1
  Using cached gast-0.4.0-py3-none-any.whl (9.8 kB)
Collecting opt-einsum>=2.3.2
  Using cached opt_einsum-3.3.0-py3-none-any.whl (65 kB)
Requirement already satisfied: wrapt>=1.11.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (1.15.0)
Collecting termcolor>=1.1.0
  Using cached termcolor-2.2.0-py3-none-any.whl (6.6 kB)
Collecting astunparse>=1.6.0
  Using cached astunparse-1.6.3-py2.py3-none-any.whl (12 kB)
Requirement already satisfied: packaging in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (23.0)
Collecting tensorboard<2.12,>=2.11
  Using cached tensorboard-2.11.2-py3-none-any.whl (6.0 MB)
Collecting libclang>=13.0.0
  Using cached libclang-16.0.0-py2.py3-none-manylinux2010_x86_64.whl (22.9 MB)
Collecting tensorflow-io-gcs-filesystem>=0.23.1
  Using cached tensorflow_io_gcs_filesystem-0.31.0-cp39-cp39-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (2.4 MB)
Collecting protobuf<4,>=3.13
  Using cached protobuf-3.19.6-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.1 MB)
Collecting h5py>=2.9.0
  Using cached h5py-3.8.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)
Collecting keras<2.12,>=2.11.0
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Requirement already satisfied: googleapis-common-protos<2,>=1.52.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from tensorflow-metadata<1.13.0,>=1.12.0->tfx_bsl->-r requirements.txt (line 18)) (1.59.0)
Requirement already satisfied: wheel<1.0,>=0.23.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from astunparse>=1.6.0->tensorflow<3,>=2.11->tfx_bsl->-r requirements.txt (line 18)) (0.40.0)
Requirement already satisfied: oauth2client>=1.4.12 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.1.3)
Requirement already satisfied: rsa<5,>=3.1.4 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (4.9)
Requirement already satisfied: pyasn1-modules>=0.2.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-auth<3,>=1.18.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.2.8)
Requirement already satisfied: google-resumable-media<3.0dev,>=0.6.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2.4.1)
Requirement already satisfied: grpc-google-iam-v1<0.13dev,>=0.12.3 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-bigtable<2,>=0.31.1->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.12.6)
Requirement already satisfied: grpcio-status>=1.33.2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsub<3,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.53.0)
Requirement already satisfied: overrides<7.0.0,>=6.0.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-pubsublite<2,>=1.2.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (6.5.0)
Requirement already satisfied: sqlparse>=0.3.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-cloud-spanner<4,>=3.0.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.3)
Requirement already satisfied: docopt in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from hdfs<3.0.0,>=2.1.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.6.2)
Requirement already satisfied: certifi>=2017.4.17 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (2022.12.7)
Requirement already satisfied: charset-normalizer<4,>=2 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.1.0)
Requirement already satisfied: urllib3<1.27,>=1.21.1 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.26.15)
Requirement already satisfied: idna<4,>=2.5 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from requests<3.0.0,>=2.24.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (3.4)
Collecting werkzeug>=1.0.1
  Using cached Werkzeug-2.2.3-py3-none-any.whl (233 kB)
Collecting markdown>=2.6.8
  Using cached Markdown-3.4.3-py3-none-any.whl (93 kB)
Collecting tensorboard-data-server<0.7.0,>=0.6.0
  Using cached tensorboard_data_server-0.6.1-py3-none-manylinux2010_x86_64.whl (4.9 MB)
Collecting tensorboard-plugin-wit>=1.6.0
  Using cached tensorboard_plugin_wit-1.8.1-py3-none-any.whl (781 kB)
Collecting google-auth-oauthlib<0.5,>=0.4.1
  Using cached google_auth_oauthlib-0.4.6-py2.py3-none-any.whl (18 kB)
Collecting requests-oauthlib>=0.7.0
  Using cached requests_oauthlib-1.3.1-py2.py3-none-any.whl (23 kB)
Requirement already satisfied: google-crc32c<2.0dev,>=1.0 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from google-resumable-media<3.0dev,>=0.6.0->google-cloud-bigquery<4,>=1.6.0->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (1.5.0)
Collecting grpcio-status>=1.33.2
  Using cached grpcio_status-1.51.3-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.51.1-py3-none-any.whl (5.1 kB)
  Using cached grpcio_status-1.50.0-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.49.1-py3-none-any.whl (14 kB)
  Using cached grpcio_status-1.48.2-py3-none-any.whl (14 kB)
Collecting importlib-metadata>=4.4
  Using cached importlib_metadata-6.1.0-py3-none-any.whl (21 kB)
Requirement already satisfied: pyasn1>=0.1.7 in <https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages> (from oauth2client>=1.4.12->google-apitools<0.5.32,>=0.5.31->apache-beam[gcp]<3,>=2.40->tfx_bsl->-r requirements.txt (line 18)) (0.4.8)
Collecting MarkupSafe>=2.1.1
  Using cached MarkupSafe-2.1.2-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (25 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
Collecting oauthlib>=3.0.0
  Using cached oauthlib-3.2.2-py3-none-any.whl (151 kB)
Installing collected packages: tensorboard-plugin-wit, libclang, flatbuffers, zipp, uritemplate, termcolor, tensorflow-io-gcs-filesystem, tensorflow-estimator, tensorboard-data-server, pymongo, pyarrow, protobuf, opt-einsum, oauthlib, MarkupSafe, keras, h5py, google-pasta, gast, astunparse, absl-py, werkzeug, requests-oauthlib, importlib-metadata, tensorflow-metadata, markdown, grpcio-status, google-auth-oauthlib, apache-beam, tensorboard, google-api-python-client, tensorflow, google-cloud-videointelligence, google-cloud-recommendations-ai, google-cloud-language, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, tensorflow-serving-api, tfx_bsl, tensorflow-transform
  Attempting uninstall: pymongo
    Found existing installation: pymongo 4.3.3
    Uninstalling pymongo-4.3.3:
      Successfully uninstalled pymongo-4.3.3
  Attempting uninstall: pyarrow
    Found existing installation: pyarrow 9.0.0
    Uninstalling pyarrow-9.0.0:
      Successfully uninstalled pyarrow-9.0.0
  Attempting uninstall: protobuf
    Found existing installation: protobuf 4.22.1
    Uninstalling protobuf-4.22.1:
      Successfully uninstalled protobuf-4.22.1
  Attempting uninstall: grpcio-status
    Found existing installation: grpcio-status 1.53.0
    Uninstalling grpcio-status-1.53.0:
      Successfully uninstalled grpcio-status-1.53.0
  Attempting uninstall: apache-beam
    Found existing installation: apache-beam 2.47.0.dev0
    Uninstalling apache-beam-2.47.0.dev0:
      Successfully uninstalled apache-beam-2.47.0.dev0
  Attempting uninstall: google-cloud-videointelligence
    Found existing installation: google-cloud-videointelligence 2.11.1
    Uninstalling google-cloud-videointelligence-2.11.1:
      Successfully uninstalled google-cloud-videointelligence-2.11.1
  Attempting uninstall: google-cloud-recommendations-ai
    Found existing installation: google-cloud-recommendations-ai 0.10.3
    Uninstalling google-cloud-recommendations-ai-0.10.3:
      Successfully uninstalled google-cloud-recommendations-ai-0.10.3
  Attempting uninstall: google-cloud-language
    Found existing installation: google-cloud-language 2.9.1
    Uninstalling google-cloud-language-2.9.1:
      Successfully uninstalled google-cloud-language-2.9.1
  Attempting uninstall: google-cloud-datastore
    Found existing installation: google-cloud-datastore 2.15.1
    Uninstalling google-cloud-datastore-2.15.1:
      Successfully uninstalled google-cloud-datastore-2.15.1
  Attempting uninstall: google-cloud-bigtable
    Found existing installation: google-cloud-bigtable 2.17.0
    Uninstalling google-cloud-bigtable-2.17.0:
      Successfully uninstalled google-cloud-bigtable-2.17.0
  Attempting uninstall: google-cloud-bigquery-storage
    Found existing installation: google-cloud-bigquery-storage 2.19.1
    Uninstalling google-cloud-bigquery-storage-2.19.1:
      Successfully uninstalled google-cloud-bigquery-storage-2.19.1
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
mypy-protobuf 3.4.0 requires protobuf>=4.21.8, but you have protobuf 3.19.6 which is incompatible.
grpcio-tools 1.51.3 requires protobuf<5.0dev,>=4.21.6, but you have protobuf 3.19.6 which is incompatible.
Successfully installed MarkupSafe-2.1.2 absl-py-1.4.0 apache-beam-2.46.0 astunparse-1.6.3 flatbuffers-23.3.3 gast-0.4.0 google-api-python-client-1.12.11 google-auth-oauthlib-0.4.6 google-cloud-bigquery-storage-2.16.2 google-cloud-bigtable-1.7.3 google-cloud-datastore-1.15.5 google-cloud-language-1.3.2 google-cloud-recommendations-ai-0.7.1 google-cloud-videointelligence-1.16.3 google-pasta-0.2.0 grpcio-status-1.48.2 h5py-3.8.0 importlib-metadata-6.1.0 keras-2.11.0 libclang-16.0.0 markdown-3.4.3 oauthlib-3.2.2 opt-einsum-3.3.0 protobuf-3.19.6 pyarrow-6.0.1 pymongo-3.13.0 requests-oauthlib-1.3.1 tensorboard-2.11.2 tensorboard-data-server-0.6.1 tensorboard-plugin-wit-1.8.1 tensorflow-2.11.1 tensorflow-estimator-2.11.0 tensorflow-io-gcs-filesystem-0.31.0 tensorflow-metadata-1.12.0 tensorflow-serving-api-2.11.1 tensorflow-transform-1.12.0 termcolor-2.2.0 tfx_bsl-1.12.0 uritemplate-3.0.1 werkzeug-2.2.3 zipp-3.15.0

> Task :sdks:python:test-suites:dataflow:py39:tftTests FAILED
>>> RUNNING integration tests with pipeline options: --influx_db_name=beam_test_metrics --influx_hostname=http://10.128.0.96:8086 --metrics_dataset=beam_cloudml --publish_to_big_query=true --project=apache-beam-testing --region=us-central1 --staging_location=gs://temp-storage-for-perf-tests/loadtests --temp_location=gs://temp-storage-for-perf-tests/loadtests --runner=DataflowRunner --requirements_file=apache_beam/testing/benchmarks/cloudml/requirements.txt --sdk_location=<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/build/apache-beam.tar.gz>
>>>   pytest options: --capture=no --timeout=4500 --color=yes --log-cli-level=INFO --numprocesses=8 --dist=loadfile
>>>   collect markers: -m=uses_tft
ImportError while loading conftest '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/conftest.py'.>
conftest.py:22: in <module>
    from apache_beam.options import pipeline_options
apache_beam/__init__.py:92: in <module>
    from apache_beam import coders
apache_beam/coders/__init__.py:17: in <module>
    from apache_beam.coders.coders import *
apache_beam/coders/coders.py:59: in <module>
    from apache_beam.coders import coder_impl
apache_beam/coders/coder_impl.py:63: in <module>
    from apache_beam.typehints.schemas import named_tuple_from_schema
apache_beam/typehints/__init__.py:38: in <module>
    from apache_beam.typehints.arrow_type_compatibility import *
apache_beam/typehints/arrow_type_compatibility.py:32: in <module>
    from apache_beam.portability.api import schema_pb2
apache_beam/portability/api/__init__.py:21: in <module>
    from .org.apache.beam.model.interactive import v1
apache_beam/portability/api/org/apache/beam/model/interactive/v1/__init__.py:18: in <module>
    from . import beam_interactive_api_pb2
apache_beam/portability/api/org/apache/beam/model/interactive/v1/beam_interactive_api_pb2.py:5: in <module>
    from google.protobuf.internal import builder as _builder
E   ImportError: cannot import name 'builder' from 'google.protobuf.internal' (<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/build/gradleenv/-1734967050/lib/python3.9/site-packages/google/protobuf/internal/__init__.py)>

FAILURE: Build failed with an exception.

* Where:
Script '<https://ci-beam.apache.org/job/beam_CloudML_Benchmarks_Dataflow/ws/src/sdks/python/test-suites/dataflow/common.gradle'> line: 395

* What went wrong:
Execution failed for task ':sdks:python:test-suites:dataflow:py39:tftTests'.
> Process 'command 'sh'' finished with non-zero exit value 4

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 2m 36s
16 actionable tasks: 10 executed, 4 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fbib7bb4y4cnq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org