You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2021/08/06 01:32:53 UTC
Build failed in Jenkins: beam_PostCommit_Python_VR_Flink #1243
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/1243/display/redirect?page=changes>
Changes:
[noreply] Revert "[BEAM-11934] Remove Dataflow override of streaming WriteFiles
------------------------------------------
[...truncated 242.07 KB...]
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_5:0"
}
}, {
"urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_5:0"
}
}, {
"urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PTRANSFORM": "transform_0"
}
}, {
"urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PTRANSFORM": "transform_3"
}
}, {
"urn": "beam:metric:ptransform_execution_time:total_msecs:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PTRANSFORM": "fn/write/ref_PCollection_PCollection_9:0"
}
}, {
"urn": "beam:metric:data_channel:read_index:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "bg==",
"labels": {
"PTRANSFORM": "fn/read/ref_PCollection_PCollection_5:0"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "bg==",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_5"
}
}, {
"urn": "beam:metric:element_count:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "bg==",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_7"
}
}, {
"urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PTRANSFORM": "transform_2"
}
}, {
"urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PTRANSFORM": "transform_1"
}
}, {
"urn": "beam:metric:pardo_execution_time:process_bundle_msecs:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PTRANSFORM": "transform_0"
}
}, {
"urn": "beam:metric:pardo_execution_time:start_bundle_msecs:v1",
"type": "beam:metrics:sum_int64:v1",
"payload": "AA==",
"labels": {
"PTRANSFORM": "fn/write/ref_PCollection_PCollection_9:0"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "JfQIHh8=",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_5"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "JpQEDg4=",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_7"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "KYQGEhM=",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_6"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "J5cFERE=",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_9"
}
}, {
"urn": "beam:metric:sampled_byte_size:v1",
"type": "beam:metrics:distribution_int64:v1",
"payload": "J6IEDg4=",
"labels": {
"PCOLLECTION": "ref_PCollection_PCollection_8"
}
}]
}
}
Aug 06, 2021 12:27:08 AM org.apache.flink.runtime.taskexecutor.TaskExecutor disconnectJobManagerConnection
INFO: Close JobManager connection for job 110f4296a0b7f8e4869a0aae38aa9bd3.
------------------------------ Captured log call -------------------------------
WARNING root:environments.py:374 Make sure that locally built Python SDK docker image has Python 3.6 interpreter.
WARNING apache_beam.options.pipeline_options:pipeline_options.py:324 Discarding invalid overrides: {'max_bundle_time_millis': 95130590130}
--------------------------- Captured stderr teardown ---------------------------
Aug 06, 2021 12:27:08 AM org.apache.flink.runtime.jobmaster.JobMaster onStop
INFO: Stopping the JobMaster for job test_flink_metrics_1628209610.0006237(110f4296a0b7f8e4869a0aae38aa9bd3).
Aug 06, 2021 12:27:08 AM org.apache.flink.runtime.jobmaster.slotpool.DefaultDeclarativeSlotPool releaseSlots
INFO: Releasing slot [29185085a9640f8a9cb632c07e34f101].
Aug 06, 2021 12:27:08 AM org.apache.flink.runtime.jobmaster.JobMaster dissolveResourceManagerConnection
INFO: Close ResourceManager connection 73826f40579ba7b46f6b3751aad40b8c: Stopping JobMaster for job test_flink_metrics_1628209610.0006237(110f4296a0b7f8e4869a0aae38aa9bd3)..
Aug 06, 2021 12:27:08 AM org.apache.flink.runtime.resourcemanager.slotmanager.DeclarativeSlotManager processResourceRequirements
INFO: Clearing resource requirements of job 110f4296a0b7f8e4869a0aae38aa9bd3
Aug 06, 2021 12:27:08 AM org.apache.flink.runtime.resourcemanager.ResourceManager closeJobManagerConnection
INFO: Disconnect job manager a8f9703360df33454d5b13040c6c4ba5@akka://flink/user/rpc/jobmanager_39 for job 110f4296a0b7f8e4869a0aae38aa9bd3 from the resource manager.
Aug 06, 2021 12:27:08 AM org.apache.flink.runtime.taskexecutor.slot.TaskSlotTableImpl freeSlotInternal
INFO: Free slot TaskSlot(index:0, state:ALLOCATED, resource profile: ResourceProfile{taskHeapMemory=1024.000gb (1099511627776 bytes), taskOffHeapMemory=1024.000gb (1099511627776 bytes), managedMemory=9.079gb (9748006912 bytes), networkMemory=64.000mb (67108864 bytes)}, allocationId: 29185085a9640f8a9cb632c07e34f101, jobId: 110f4296a0b7f8e4869a0aae38aa9bd3).
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
============= 1 failed, 129 passed, 35 skipped in 2447.60 seconds ==============
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test apache_beam/runners/portability/flink_runner_test.py '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.33.0-SNAPSHOT.jar> --environment_type=LOOPBACK' (exited with code 1)
[0m[1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py36/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: flink-runner-test: commands failed
[0m
> Task :sdks:python:test-suites:portable:py36:flinkCompatibilityMatrixLOOPBACK FAILED
> Task :sdks:python:test-suites:portable:py37:flinkCompatibilityMatrixLOOPBACK
[1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
[0m[1mflink-runner-test installdeps: -rbuild-requirements.txt
[0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,atomicwrites==1.4.0,attrs==21.2.0,avro-python3==1.9.2.1,certifi==2021.5.30,charset-normalizer==2.0.4,crcmod==1.7,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.0,docopt==0.6.2,execnet==1.9.0,fastavro==1.4.4,freezegun==1.1.0,future==0.18.2,greenlet==1.1.0,grpcio==1.39.0,grpcio-tools==1.37.0,hdfs==2.6.0,httplib2==0.19.1,idna==3.2,importlib-metadata==4.6.3,mock==2.0.0,more-itertools==8.8.0,mypy-protobuf==1.18,nose==1.3.7,nose-xunitmp==0.4.1,numpy==1.20.3,oauth2client==4.1.3,orjson==3.6.1,packaging==21.0,pandas==1.2.5,parameterized==0.7.5,pbr==5.6.0,pluggy==0.13.1,protobuf==3.17.3,psycopg2-binary==2.9.1,py==1.10.0,pyarrow==4.0.1,pyasn1==0.4.8,pyasn1-modules==0.2.8,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.0,pyparsing==2.4.7,pytest==4.6.11,pytest-forked==1.3.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2021.1,PyYAML==5.4.1,requests==2.26.0,requests-mock==1.9.3,rsa==4.7.2,six==1.16.0,SQLAlchemy==1.4.22,tenacity==5.1.5,testcontainers==3.4.1,typing-extensions==3.7.4.3,urllib3==1.26.6,wcwidth==0.2.5,websocket-client==1.1.0,wrapt==1.12.1,zipp==3.5.0>
[0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='2992213357'
[0m[1mflink-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.7.3
[1mflink-runner-test run-test-pre: commands[1] | pip --version
[0mpip 21.1.3 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.7/site-packages/pip> (python 3.7)
[1mflink-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mflink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.33.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
[0m============================= test session starts ==============================
platform linux -- Python 3.7.3, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 165 items
apache_beam/runners/portability/flink_runner_test.py .s...ss...........s [ 11%]
....s...............s..ss.....ss.s...s...ss..sss......s....s............ [ 55%]
...s..ss.....ssss.......ss...........s....s..................ss.....ss.s [ 98%]
.. [100%]
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
================== 130 passed, 35 skipped in 1344.88 seconds ===================
[1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py37/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m flink-runner-test: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:portable:py37:flinkValidatesRunner
> Task :sdks:python:test-suites:portable:py38:flinkCompatibilityMatrixLOOPBACK
[1mflink-runner-test create: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test>
[0m[1mflink-runner-test installdeps: -rbuild-requirements.txt
[0m[1mflink-runner-test inst: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz>
[0m[1mflink-runner-test installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/.tmp/package/1/apache-beam.tar.gz,atomicwrites==1.4.0,attrs==21.2.0,avro-python3==1.9.2.1,certifi==2021.5.30,charset-normalizer==2.0.4,crcmod==1.7,deprecation==2.1.0,dill==0.3.1.1,distlib==0.3.1,docker==5.0.0,docopt==0.6.2,execnet==1.9.0,fastavro==1.4.4,freezegun==1.1.0,future==0.18.2,greenlet==1.1.0,grpcio==1.39.0,grpcio-tools==1.37.0,hdfs==2.6.0,httplib2==0.19.1,idna==3.2,mock==2.0.0,more-itertools==8.8.0,mypy-protobuf==1.18,nose==1.3.7,nose-xunitmp==0.4.1,numpy==1.20.3,oauth2client==4.1.3,orjson==3.6.1,packaging==21.0,pandas==1.2.5,parameterized==0.7.5,pbr==5.6.0,pluggy==0.13.1,protobuf==3.17.3,psycopg2-binary==2.9.1,py==1.10.0,pyarrow==4.0.1,pyasn1==0.4.8,pyasn1-modules==0.2.8,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.0,pyparsing==2.4.7,pytest==4.6.11,pytest-forked==1.3.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2021.1,PyYAML==5.4.1,requests==2.26.0,requests-mock==1.9.3,rsa==4.7.2,six==1.16.0,SQLAlchemy==1.4.22,tenacity==5.1.5,testcontainers==3.4.1,typing-extensions==3.7.4.3,urllib3==1.26.6,wcwidth==0.2.5,websocket-client==1.1.0,wrapt==1.12.1>
[0m[1mflink-runner-test run-test-pre: PYTHONHASHSEED='1878874055'
[0m[1mflink-runner-test run-test-pre: commands[0] | python --version
[0mPython 3.8.5
[1mflink-runner-test run-test-pre: commands[1] | pip --version
[0mpip 21.2.2 from <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/pip> (python 3.8)
[1mflink-runner-test run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mflink-runner-test run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mflink-runner-test run-test: commands[0] | <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/pytest_validates_runner.sh> flink-runner-test <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/apache_beam/runners/portability/flink_runner_test.py> '--flink_job_server_jar=<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/runners/flink/1.13/job-server/build/libs/beam-runners-flink-1.13-job-server-2.33.0-SNAPSHOT.jar> --environment_type=LOOPBACK'
[0m============================= test session starts ==============================
platform linux -- Python 3.8.5, pytest-4.6.11, py-1.10.0, pluggy-0.13.1
cachedir: target/.tox-flink-runner-test/flink-runner-test/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
collected 165 items
apache_beam/runners/portability/flink_runner_test.py .s...ss...........s [ 11%]
....s...............s..ss.....ss.s...s...ss..sss......s....s............ [ 55%]
...s..ss.....ssss.......ss...........s....s..................ss.....ss.s [ 98%]
.. [100%]
=============================== warnings summary ===============================
target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/target/.tox-flink-runner-test/flink-runner-test/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/pytest_flink-runner-test.xml> -
============ 130 passed, 35 skipped, 1 warnings in 1059.50 seconds =============
[1mflink-runner-test run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/ws/src/sdks/python/test-suites/portable/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m flink-runner-test: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:portable:py38:flinkValidatesRunner
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':sdks:python:test-suites:portable:py36:flinkCompatibilityMatrixLOOPBACK'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 32m 24s
146 actionable tasks: 104 executed, 40 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/hcwao32xer5xi
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PostCommit_Python_VR_Flink
#1244
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PostCommit_Python_VR_Flink/1244/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org