You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/06/11 00:39:18 UTC
Build failed in Jenkins: beam_PreCommit_Python_Cron #5740
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5740/display/redirect?page=changes>
Changes:
[noreply] [BEAM-13769]Add no_xdist marker for cloudpickle test (#17538)
[noreply] [BEAM-14533] Bump cloudpickle to 2.1.0 (#17780)
[noreply] Add basic byte size estimation for batches (#17771)
[noreply] Add @yields_batches and @yields_elements (#19268)
[noreply] [BEAM-14535] Added support for pandas in sklearn inference runner
[noreply] Merge ModelLoader and InferenceRunner into same class. (#21795)
[noreply] Merge pull request #17589 from [BEAM-14422] Exception testing for
[noreply] Add README for image classification example (#21758)
[anandinguva98] fixup: bug
[noreply] Fix every PR linking to PR 123 (#21802)
[noreply] Add native PubSub IO prototype to Go (#17955)
[noreply] Allow creation of dynamically defined transforms in the Python expansion
[noreply] Make keying of examples explicit. (#21777)
------------------------------------------
[...truncated 1.02 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 44.84 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='29713671'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
..s.....F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.87 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='3933971503'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.70 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 39s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/kfsrrvr2jfbfu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Jenkins build is back to normal : beam_PreCommit_Python_Cron #5752
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5752/display/redirect?page=changes>
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5751
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5751/display/redirect>
Changes:
------------------------------------------
[...truncated 1002.37 KB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 38.76 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='84115483'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.....s..F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.47 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='2773875797'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.58 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 59m 6s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/fqmdb6v44mxfs
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5750
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5750/display/redirect>
Changes:
------------------------------------------
[...truncated 1.01 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 36.48 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='1533659614'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw5] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 23.20 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='1050700237'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.16 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 58m 3s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/girz3f3ntgupy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5749
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5749/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 37.16 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='3389396532'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.79 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='1978588568'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.26 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 39s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/p3rmqs2ljpl66
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5748
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5748/display/redirect>
Changes:
------------------------------------------
[...truncated 1.02 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 37.20 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='4050549564'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.....s..F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.13 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='1497175449'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.90 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 59m
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/txq4svqpi5ona
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5747
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5747/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 38.71 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='1044486685'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.32 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='3803608374'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 22.91 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 59m 2s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/dggmz62fefxfq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5746
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5746/display/redirect>
Changes:
------------------------------------------
[...truncated 1020.21 KB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 36.48 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='2990814551'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 23.41 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='1909262920'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.01 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 57m 53s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sjstl7lnjarty
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5745
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5745/display/redirect>
Changes:
------------------------------------------
[...truncated 1.01 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 36.92 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='3612791683'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.86 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='2126424198'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw2] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.86 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 57m 20s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/tzinabkrs6gpa
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5744
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5744/display/redirect>
Changes:
------------------------------------------
[...truncated 1.07 MB...]
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 37.48 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='1004340508'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
...s....F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.26 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='824394760'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw4] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.42 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py37:testPy37Cython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 29s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/5imawlkcnlxk2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5743
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5743/display/redirect>
Changes:
------------------------------------------
[...truncated 1.03 MB...]
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 38.96 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='563199793'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.80 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='3859596514'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.00 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py37:testPy37Cython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 59m 15s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/i6rjip55fspd2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5742
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5742/display/redirect>
Changes:
------------------------------------------
[...truncated 1.04 MB...]
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 39.81 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='3527553162'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 22.02 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='3196366569'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.57 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 3 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py39:testPy39Cython'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 59m 31s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/sgcypc47d3awk
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org
Build failed in Jenkins: beam_PreCommit_Python_Cron #5741
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5741/display/redirect>
Changes:
------------------------------------------
[...truncated 986.15 KB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]
.............................. [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
return pcoll | fileio.WriteToFiles(
apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
p.options.view_as(GoogleCloudOptions).temp_location or
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 38.59 seconds ==============
[1mpy38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[32m py38-pyarrow-7: commands succeeded
[0m[32m congratulations :)
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
[0m[1mpy38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
[0m[1mpy38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-110 run-test-pre: PYTHONHASHSEED='313543591'
[0m[1mpy38-pytorch-110 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-110 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-110 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
[1mpy38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
s.......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.94 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-110: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
[1mGLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
[0m[1mpy38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
[0m[1mpy38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
[0m[1mpy38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
[0m[1mpy38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
[0m[1mpy38-pytorch-19 run-test-pre: PYTHONHASHSEED='3566739136'
[0m[1mpy38-pytorch-19 run-test-pre: commands[0] | python --version
[0mPython 3.8.10
[1mpy38-pytorch-19 run-test-pre: commands[1] | pip --version
[0mpip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
[1mpy38-pytorch-19 run-test-pre: commands[2] | pip check
[0mNo broken requirements found.
[1mpy38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m[1mpy38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
[0mapache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
[1mpy38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
[0m============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]
.s......F.. [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>
self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>
def test_pipeline_local_model_kwargs_prediction_params(self):
with TestPipeline() as pipeline:
prediction_params = {
'prediction_param_array': torch.from_numpy(
np.array([1, 2], dtype="float32")),
'prediction_param_bool': True
}
state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
('linear.bias', torch.Tensor([0.5]))])
path = os.path.join(self.tmpdir, 'my_state_dict_path')
torch.save(state_dict, path)
model_loader = PytorchModelHandler(
state_dict_path=path,
model_class=PytorchLinearRegressionKwargsPredictionParams,
model_params={
'input_dim': 1, 'output_dim': 1
})
pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
prediction_params_side_input = (
pipeline | 'create side' >> beam.Create(prediction_params))
> predictions = pcoll | RunInference(
model_loader=model_loader,
prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E TypeError: __init__() missing 1 required positional argument: 'model_handler'
apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
def call(self, fn, *args, **kwargs):
-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.94 seconds ==========
[31mERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
[0m[1mpy38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
[0m___________________________________ summary ____________________________________
[31mERROR: py38-pytorch-19: commands failed
[0m
> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.
See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 3m 17s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/7okd6lifpmoxu
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org