You are viewing a plain text version of this content. The canonical link for it is here.

Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/07/28 04:22:24 UTC

Build failed in Jenkins: beam_PreCommit_Python_PVR_Flink_Cron #2653

See <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/2653/display/redirect?page=changes>

Changes:

[samuelw] Fixes #22438. Ensure that WindmillStateReader completes all batched read

[Valentyn Tymofieiev] Restrict google-api-core

[Valentyn Tymofieiev] Regenerate the container dependencies.

[noreply] Replace distutils with supported modules. (#22456)

[noreply] [22369] Default Metrics for Executable Stages in Samza Runner (#22370)

[Kiley Sok] Moving to 2.42.0-SNAPSHOT on master branch.

[noreply] Remove stripping of step name. Replace removing only suffix step name


------------------------------------------
[...truncated 66.96 KB...]
  File "/usr/lib/python3.8/http/client.py", line 922, in connect
    self.sock = self._create_connection(
  File "/usr/lib/python3.8/socket.py", line 787, in create_connection
    for res in getaddrinfo(host, port, 0, SOCK_STREAM):
  File "/usr/lib/python3.8/socket.py", line 918, in getaddrinfo
    for res in _socket.getaddrinfo(host, port, family, type, proto, flags):
socket.gaierror: [Errno -3] Temporary failure in name resolution

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/license_scripts/pull_licenses_java.py",> line 58, in pull_from_url
    url_read = urlopen(Request(url, headers={
  File "/usr/lib/python3.8/urllib/request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "/usr/lib/python3.8/urllib/request.py", line 525, in open
    response = self._open(req, data)
  File "/usr/lib/python3.8/urllib/request.py", line 542, in _open
    result = self._call_chain(self.handle_open, protocol, protocol +
  File "/usr/lib/python3.8/urllib/request.py", line 502, in _call_chain
    result = func(*args)
  File "/usr/lib/python3.8/urllib/request.py", line 1397, in https_open
    return self.do_open(http.client.HTTPSConnection, req,
  File "/usr/lib/python3.8/urllib/request.py", line 1357, in do_open
    raise URLError(err)
urllib.error.URLError: <urlopen error [Errno -3] Temporary failure in name resolution>
ERROR:root:Invalid url for grpc-xds-1.45.1: https://opensource.org/licenses/Apache-2.0. Retrying...
INFO:root:pull_licenses_java.py succeed. It took 12.554123 seconds with 16 threads.
Copying licenses from <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/java_third_party_licenses> to <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target/third_party_licenses.>
Finished license_scripts.sh

> Task :sdks:java:container:goPrepare UP-TO-DATE
> Task :sdks:java:container:java8:copyJavaThirdPartyLicenses

> Task :sdks:java:container:goBuild
/home/jenkins/go/bin/go1.18.1 build -o ./build/target/linux_amd64/boot boot.go boot_test.go

> Task :sdks:java:container:java8:copySdkHarnessLauncher
Execution optimizations have been disabled for task ':sdks:java:container:java8:copySdkHarnessLauncher' to ensure correctness due to the following reasons:
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:downloadCloudProfilerAgent' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.
  - Gradle detected a problem with the following location: '<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/container/build/target'.> Reason: Task ':sdks:java:container:java8:copySdkHarnessLauncher' uses this output of task ':sdks:java:container:pullLicenses' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed. Please refer to https://docs.gradle.org/7.4/userguide/validation_problems.html#implicit_dependency for more details about this problem.

> Task :sdks:java:container:java8:dockerPrepare

> Task :sdks:java:io:amazon-web-services2:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :sdks:java:io:amazon-web-services2:classes
> Task :sdks:java:io:amazon-web-services2:jar

> Task :sdks:java:container:java8:docker
 ---> Running in 1549b2da2f72
Removing intermediate container 1549b2da2f72
 ---> b96d4377dabc
Step 4/21 : ARG pull_licenses
 ---> Running in 8e1cc4b7aede
Removing intermediate container 8e1cc4b7aede
 ---> 249d57b077a8
Step 5/21 : ADD target/slf4j-api.jar /opt/apache/beam/jars/
 ---> 3c2c78785a78
Step 6/21 : ADD target/slf4j-jdk14.jar /opt/apache/beam/jars/
 ---> 4b349c9944a0
Step 7/21 : ADD target/beam-sdks-java-harness.jar /opt/apache/beam/jars/
 ---> 3c563ac284bf
Step 8/21 : ADD target/beam-sdks-java-io-kafka.jar /opt/apache/beam/jars/
 ---> 064a34048152
Step 9/21 : ADD target/kafka-clients.jar /opt/apache/beam/jars/
 ---> ddc410339c30
Step 10/21 : ADD target/jamm.jar /opt/apache/beam/jars/
 ---> d708e883bcb1
Step 11/21 : ADD target/linux_amd64/boot /opt/apache/beam/
 ---> 8303c865526a
Step 12/21 : COPY target/LICENSE /opt/apache/beam/
 ---> 0b29632b9a1f
Step 13/21 : COPY target/NOTICE /opt/apache/beam/
 ---> 1d1b3d1161df
Step 14/21 : ADD target/third_party_licenses /opt/apache/beam/third_party_licenses/
 ---> f5cb5e522e37
Step 15/21 : COPY target/LICENSE target/options/* /opt/apache/beam/options/
 ---> 6f62606ba807
Step 16/21 : RUN rm /opt/apache/beam/options/LICENSE
 ---> Running in fa966cfcf5b2

> Task :sdks:java:extensions:sql:compileJava

> Task :sdks:java:container:java8:docker
Removing intermediate container fa966cfcf5b2
 ---> e0224a18ada0
Step 17/21 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/
 ---> 2ca435b80619
Step 18/21 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE
 ---> Running in fa572ff3d19b
Removing intermediate container fa572ff3d19b
 ---> 2b3c6b4f9612
Step 19/21 : RUN if [ "${pull_licenses}" = "false" ] ; then     rm -rf /opt/apache/beam/third_party_licenses ;    fi
 ---> Running in 0370689b823a
Removing intermediate container 0370689b823a
 ---> 268826c38524
Step 20/21 : COPY target/profiler/* /opt/google_cloud_profiler/
 ---> d0d3e519d797
Step 21/21 : ENTRYPOINT ["/opt/apache/beam/boot"]
 ---> Running in 3991a4bdfafc
Removing intermediate container 3991a4bdfafc
 ---> 8dd865055e56
Successfully built 8dd865055e56
Successfully tagged apache/beam_java8_sdk:2.42.0.dev

> Task :sdks:java:extensions:sql:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :runners:flink:1.15:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :runners:flink:1.15:classes
> Task :runners:flink:1.15:jar
> Task :runners:flink:1.15:job-server:compileJava NO-SOURCE
> Task :runners:flink:1.15:job-server:classes UP-TO-DATE
> Task :sdks:java:extensions:sql:classes
> Task :sdks:java:extensions:sql:jar

> Task :sdks:java:extensions:sql:zetasql:compileJava
Note: Some input files use or override a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
Note: Some input files use unchecked or unsafe operations.
Note: Recompile with -Xlint:unchecked for details.

> Task :sdks:java:extensions:sql:zetasql:classes
> Task :sdks:java:extensions:sql:zetasql:jar

> Task :sdks:java:extensions:sql:expansion-service:compileJava
Note: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/java/extensions/sql/expansion-service/src/main/java/org/apache/beam/sdk/extensions/sql/expansion/ExternalSqlTransformRegistrar.java> uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.

> Task :sdks:java:extensions:sql:expansion-service:classes
> Task :sdks:java:extensions:sql:expansion-service:jar
> Task :sdks:java:extensions:sql:expansion-service:shadowJar
> Task :runners:flink:1.15:job-server:shadowJar

> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK
[1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
[0m[1mflink-runner-test installdeps: -rbuild-requirements.txt
[0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,atomicwrites==1.4.1,attrs==21.4.0,certifi==2022.6.15,cffi==1.15.1,charset-normalizer==2.1.0,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.4,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.3,freezegun==1.2.1,greenlet==1.1.2,grpcio==1.47.0,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,orjson==3.7.8,packaging==21.3,pandas==1.4.3,parameterized==0.8.1,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.6,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.1,requests-mock==1.9.3,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.39,tenacity==5.1.5,testcontainers==3.6.0,threadpoolctl==3.1.0,typing_extensions==4.3.0,urllib3==1.26.11,wcwidth==0.2.5,websocket-client==1.3.3,wrapt==1.14.1>
[0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='2305183756'
[0m[1mflink-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.9.10
[1mflink-runner-test run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/pip> (python 3.9)
[1mflink-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mflink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.42.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
[0m============================= test session starts ==============================
platform linux -- Python 3.9.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 210 items

apache_beam/runners/portability/flink_runner_test.py ......s...s...ss... [  9%]
..........s....s...s..s............s..ss.....ss.s..F.....s...s...ss...ss [ 43%]
s.......s....s...s..s............s..ss.....ssss........s...s...ss....... [ 77%]
......s....s...s..s............s..ss.....ss.s..                          [100%]

=================================== FAILURES ===================================
__________________ FlinkRunnerTestOptimized.test_assert_that ___________________
RuntimeError: Pipeline timed out waiting for job service subprocess.

During handling of the above exception, another exception occurred:

self = <apache_beam.runners.portability.flink_runner_test.FlinkRunnerTestOptimized testMethod=test_assert_that>

    def test_assert_that(self):
      # TODO: figure out a way for fn_api_runner to parse and raise the
      # underlying exception.
      with self.assertRaisesRegex(Exception, 'Failed assert'):
        with self.create_pipeline() as p:
>         assert_that(p | beam.Create(['a', 'b']), equal_to(['a']))
E         AssertionError: "Failed assert" does not match "Pipeline timed out waiting for job service subprocess."

apache_beam/runners/portability/fn_api_runner/fn_runner_test.py:113: AssertionError
----------------------------- Captured stderr call -----------------------------
Jul 28, 2022 4:13:45 AM software.amazon.awssdk.regions.internal.util.EC2MetadataUtils getItems
WARNING: Unable to retrieve the requested metadata.
Jul 28, 2022 4:13:45 AM org.apache.beam.runners.jobsubmission.JobServerDriver createArtifactStagingService
INFO: ArtifactStagingService started on localhost:36141
Jul 28, 2022 4:13:45 AM org.apache.beam.runners.jobsubmission.JobServerDriver createExpansionService
INFO: Java ExpansionService started on localhost:55257
Jul 28, 2022 4:13:45 AM org.apache.beam.runners.jobsubmission.JobServerDriver createJobServer
INFO: JobService started on localhost:60731
Jul 28, 2022 4:13:45 AM org.apache.beam.runners.jobsubmission.JobServerDriver run
INFO: Job server now running, terminate with Ctrl+C
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.9/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
======== 1 failed, 163 passed, 46 skipped, 1 warnings in 825.20 seconds ========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/runners/flink/1.15/job-server/build/libs/beam-runners-flink-1.15-job-server-2.42.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/ws/src/sdks/python/test-suites/portable/py39/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR:   flink-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK FAILED

FAILURE: Build failed with an exception.

* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py39:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness.
Please consult deprecation warnings for more details.

BUILD FAILED in 19m 57s
147 actionable tasks: 110 executed, 33 from cache, 4 up-to-date

Publishing build scan...
https://gradle.com/s/yhj436xdaifci

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org

Jenkins build is back to normal : beam_PreCommit_Python_PVR_Flink_Cron #2654

Posted by Apache Jenkins Server <je...@builds.apache.org>.

See <https://ci-beam.apache.org/job/beam_PreCommit_Python_PVR_Flink_Cron/2654/display/redirect>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org