You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@beam.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2022/06/11 19:59:59 UTC

Build failed in Jenkins: beam_PreCommit_Python_Cron #5744

See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5744/display/redirect>

Changes:


------------------------------------------
[...truncated 1.07 MB...]
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 37.48 seconds ==============
py38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py38-pyarrow-7: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
py38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
py38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-110 run-test-pre: PYTHONHASHSEED='1004340508'
py38-pytorch-110 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-110 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-110 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
py38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

...s....F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.26 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-110: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
py38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
py38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-19 run-test-pre: PYTHONHASHSEED='824394760'
py38-pytorch-19 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-19 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-19 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
py38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

s.......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw4] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.42 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-19: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED

FAILURE: Build completed with 3 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py37:testPy37Cython'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

3: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 29s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/5imawlkcnlxk2

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Jenkins build is back to normal : beam_PreCommit_Python_Cron #5752

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5752/display/redirect?page=changes>


---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PreCommit_Python_Cron #5751

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5751/display/redirect>

Changes:


------------------------------------------
[...truncated 1002.37 KB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]

..............................                                           [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 38.76 seconds ==============
py38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py38-pyarrow-7: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
py38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
py38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-110 run-test-pre: PYTHONHASHSEED='84115483'
py38-pytorch-110 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-110 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-110 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
py38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

.....s..F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.47 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-110: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
py38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
py38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-19 run-test-pre: PYTHONHASHSEED='2773875797'
py38-pytorch-19 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-19 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-19 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
py38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

.s......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.58 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-19: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 59m 6s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/fqmdb6v44mxfs

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PreCommit_Python_Cron #5750

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5750/display/redirect>

Changes:


------------------------------------------
[...truncated 1.01 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]

..............................                                           [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 36.48 seconds ==============
py38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py38-pyarrow-7: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
py38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
py38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-110 run-test-pre: PYTHONHASHSEED='1533659614'
py38-pytorch-110 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-110 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-110 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
py38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

.s......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw5] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 23.20 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-110: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
py38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
py38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-19 run-test-pre: PYTHONHASHSEED='1050700237'
py38-pytorch-19 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-19 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-19 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
py38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

s.......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.16 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-19: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 58m 3s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/girz3f3ntgupy

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PreCommit_Python_Cron #5749

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5749/display/redirect>

Changes:


------------------------------------------
[...truncated 1.03 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]

..............................                                           [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 37.16 seconds ==============
py38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py38-pyarrow-7: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
py38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
py38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-110 run-test-pre: PYTHONHASHSEED='3389396532'
py38-pytorch-110 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-110 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-110 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
py38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

.s......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.79 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-110: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
py38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
py38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-19 run-test-pre: PYTHONHASHSEED='1978588568'
py38-pytorch-19 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-19 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-19 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
py38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

.s......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.26 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-19: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 1h 39s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/p3rmqs2ljpl66

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PreCommit_Python_Cron #5748

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5748/display/redirect>

Changes:


------------------------------------------
[...truncated 1.02 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]

..............................                                           [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 37.20 seconds ==============
py38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py38-pyarrow-7: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
py38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
py38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-110 run-test-pre: PYTHONHASHSEED='4050549564'
py38-pytorch-110 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-110 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-110 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
py38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

.....s..F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.13 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-110: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
py38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
py38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-19 run-test-pre: PYTHONHASHSEED='1497175449'
py38-pytorch-19 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-19 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-19 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
py38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

s.......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.90 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-19: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 59m
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/txq4svqpi5ona

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PreCommit_Python_Cron #5747

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5747/display/redirect>

Changes:


------------------------------------------
[...truncated 1.03 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]

..............................                                           [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 38.71 seconds ==============
py38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py38-pyarrow-7: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
py38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
py38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-110 run-test-pre: PYTHONHASHSEED='1044486685'
py38-pytorch-110 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-110 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-110 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
py38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

s.......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.32 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-110: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
py38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
py38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-19 run-test-pre: PYTHONHASHSEED='3803608374'
py38-pytorch-19 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-19 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-19 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
py38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

s.......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 22.91 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-19: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 59m 2s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/dggmz62fefxfq

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PreCommit_Python_Cron #5746

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5746/display/redirect>

Changes:


------------------------------------------
[...truncated 1020.21 KB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]

..............................                                           [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 36.48 seconds ==============
py38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py38-pyarrow-7: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
py38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
py38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-110 run-test-pre: PYTHONHASHSEED='2990814551'
py38-pytorch-110 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-110 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-110 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
py38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

.s......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 23.41 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-110: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
py38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
py38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-19 run-test-pre: PYTHONHASHSEED='1909262920'
py38-pytorch-19 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-19 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-19 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
py38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

s.......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 21.01 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-19: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 57m 53s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/sjstl7lnjarty

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org


Build failed in Jenkins: beam_PreCommit_Python_Cron #5745

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/5745/display/redirect>

Changes:


------------------------------------------
[...truncated 1.01 MB...]
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [30] / gw1 [30] / gw2 [30] / gw3 [30] / gw4 [30] / gw5 [30]

..............................                                           [100%]
=============================== warnings summary ===============================
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pyarrow-7/py38-pyarrow-7/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

apache_beam/dataframe/io.py:629
apache_beam/dataframe/io.py:629
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/dataframe/io.py>:629: FutureWarning: WriteToFiles is experimental.
    return pcoll | fileio.WriteToFiles(

apache_beam/io/fileio.py:554
apache_beam/io/fileio.py:554
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/apache_beam/io/fileio.py>:554: BeamDeprecationWarning: options is deprecated since First stable release. References to <pipeline>.options will not be supported
    p.options.view_as(GoogleCloudOptions).temp_location or

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pyarrow-7.xml> -
============== 30 passed, 2 skipped, 10 warnings in 36.92 seconds ==============
py38-pyarrow-7 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
  py38-pyarrow-7: commands succeeded
  congratulations :)

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-110 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110>
py38-pytorch-110 installdeps: -rbuild-requirements.txt, torch>=1.10.0,<1.11.0
py38-pytorch-110 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-110 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.10.2,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-110 run-test-pre: PYTHONHASHSEED='3612791683'
py38-pytorch-110 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-110 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-110 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-110 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-110 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.10.2
py38-pytorch-110 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-110/py38-pytorch-110/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

s.......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw3] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-110.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.86 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-110/py38-pytorch-110/bin/pytest> -o junit_suite_name=py38-pytorch-110 --junitxml=pytest_py38-pytorch-110.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-110 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-110: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-110 FAILED

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19
GLOB sdist-make: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/setup.py>
py38-pytorch-19 create: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19>
py38-pytorch-19 installdeps: -rbuild-requirements.txt, torch>=1.9.0,<1.10.0
py38-pytorch-19 inst: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
py38-pytorch-19 installed: apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip,atomicwrites==1.4.0,attrs==21.4.0,cachetools==4.2.4,certifi==2022.5.18.1,cffi==1.15.0,charset-normalizer==2.0.12,cloudpickle==2.1.0,crcmod==1.7,cryptography==37.0.2,deprecation==2.1.0,dill==0.3.5.1,distlib==0.3.1,docker==5.0.3,docopt==0.6.2,execnet==1.9.0,fastavro==1.5.1,fasteners==0.17.3,freezegun==1.2.1,google-api-core==1.31.6,google-apitools==0.5.31,google-auth==1.35.0,google-auth-httplib2==0.1.0,google-cloud-bigquery==2.34.4,google-cloud-bigquery-storage==2.13.2,google-cloud-bigtable==1.7.2,google-cloud-core==1.7.2,google-cloud-datastore==1.15.5,google-cloud-dlp==3.7.1,google-cloud-language==1.3.2,google-cloud-pubsub==2.13.0,google-cloud-pubsublite==1.4.2,google-cloud-recommendations-ai==0.2.0,google-cloud-spanner==1.19.3,google-cloud-videointelligence==1.16.3,google-cloud-vision==1.0.2,google-crc32c==1.3.0,google-resumable-media==2.3.3,googleapis-common-protos==1.56.2,greenlet==1.1.2,grpc-google-iam-v1==0.12.4,grpcio==1.46.3,grpcio-gcp==0.2.2,grpcio-status==1.46.3,grpcio-tools==1.37.0,hdfs==2.7.0,httplib2==0.20.4,idna==3.3,joblib==1.1.0,mock==2.0.0,more-itertools==8.13.0,mypy-protobuf==1.18,numpy==1.22.4,oauth2client==4.1.3,orjson==3.7.2,overrides==6.1.0,packaging==21.3,pandas==1.4.2,parameterized==0.7.5,pbr==5.9.0,pluggy==0.13.1,proto-plus==1.20.5,protobuf==3.20.1,psycopg2-binary==2.9.3,py==1.11.0,pyarrow==7.0.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.21,pydot==1.4.2,PyHamcrest==1.10.1,pymongo==3.12.3,PyMySQL==1.0.2,pyparsing==3.0.9,pytest==4.6.11,pytest-forked==1.4.0,pytest-timeout==1.4.2,pytest-xdist==1.34.0,python-dateutil==2.8.2,pytz==2022.1,PyYAML==6.0,requests==2.28.0,requests-mock==1.9.3,rsa==4.8,scikit-learn==1.1.1,scipy==1.8.1,six==1.16.0,SQLAlchemy==1.4.37,tenacity==5.1.5,testcontainers==3.5.4,threadpoolctl==3.1.0,torch==1.9.1,typing-utils==0.1.0,typing_extensions==4.2.0,urllib3==1.26.9,wcwidth==0.2.5,websocket-client==1.3.2,wrapt==1.14.1>
py38-pytorch-19 run-test-pre: PYTHONHASHSEED='2126424198'
py38-pytorch-19 run-test-pre: commands[0] | python --version
Python 3.8.10
py38-pytorch-19 run-test-pre: commands[1] | pip --version
pip 22.1.2 from <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/pip> (python 3.8)
py38-pytorch-19 run-test-pre: commands[2] | pip check
No broken requirements found.
py38-pytorch-19 run-test-pre: commands[3] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
py38-pytorch-19 run-test: commands[0] | /bin/sh -c 'pip freeze | grep -E torch'
apache-beam @ file://<https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/.tmp/package/1/apache-beam-2.40.0.dev0.zip>
torch==1.9.1
py38-pytorch-19 run-test: commands[1] | pytest -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch
============================= test session starts ==============================
platform linux -- Python 3.8.10, pytest-4.6.11, py-1.11.0, pluggy-0.13.1
cachedir: target/.tox-py38-pytorch-19/py38-pytorch-19/.pytest_cache
rootdir: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python,> inifile: pytest.ini
plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3
timeout: 600.0s
timeout method: signal
timeout func_only: False
gw0 I / gw1 I / gw2 I / gw3 I / gw4 I / gw5 I
gw0 [11] / gw1 [11] / gw2 [11] / gw3 [11] / gw4 [11] / gw5 [11]

.s......F..                                                              [100%]
=================================== FAILURES ===================================
_ PytorchRunInferencePipelineTest.test_pipeline_local_model_kwargs_prediction_params _
[gw2] linux -- Python 3.8.10 <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/python>

self = <apache_beam.ml.inference.pytorch_inference_test.PytorchRunInferencePipelineTest testMethod=test_pipeline_local_model_kwargs_prediction_params>

    def test_pipeline_local_model_kwargs_prediction_params(self):
      with TestPipeline() as pipeline:
        prediction_params = {
            'prediction_param_array': torch.from_numpy(
                np.array([1, 2], dtype="float32")),
            'prediction_param_bool': True
        }
    
        state_dict = OrderedDict([('linear.weight', torch.Tensor([[2.0]])),
                                  ('linear.bias', torch.Tensor([0.5]))])
        path = os.path.join(self.tmpdir, 'my_state_dict_path')
        torch.save(state_dict, path)
    
        model_loader = PytorchModelHandler(
            state_dict_path=path,
            model_class=PytorchLinearRegressionKwargsPredictionParams,
            model_params={
                'input_dim': 1, 'output_dim': 1
            })
    
        pcoll = pipeline | 'start' >> beam.Create(KWARGS_TORCH_EXAMPLES)
        prediction_params_side_input = (
            pipeline | 'create side' >> beam.Create(prediction_params))
>       predictions = pcoll | RunInference(
            model_loader=model_loader,
            prediction_params=beam.pvalue.AsDict(prediction_params_side_input))
E       TypeError: __init__() missing 1 required positional argument: 'model_handler'

apache_beam/ml/inference/pytorch_inference_test.py:314: TypeError
=============================== warnings summary ===============================
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py:42
  <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/lib/python3.8/site-packages/tenacity/_asyncio.py>:42: DeprecationWarning: "@coroutine" decorator is deprecated since Python 3.8, use "async def" instead
    def call(self, fn, *args, **kwargs):

-- Docs: https://docs.pytest.org/en/latest/warnings.html
- generated xml file: <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/pytest_py38-pytorch-19.xml> -
========== 1 failed, 9 passed, 1 skipped, 6 warnings in 20.86 seconds ==========
ERROR: InvocationError for command <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/target/.tox-py38-pytorch-19/py38-pytorch-19/bin/pytest> -o junit_suite_name=py38-pytorch-19 --junitxml=pytest_py38-pytorch-19.xml -n 6 -m uses_pytorch (exited with code 1)
py38-pytorch-19 run-test-post: commands[0] | bash <https://ci-beam.apache.org/job/beam_PreCommit_Python_Cron/ws/src/sdks/python/test-suites/tox/py38/build/srcs/sdks/python/scripts/run_tox_cleanup.sh>
___________________________________ summary ____________________________________
ERROR:   py38-pytorch-19: commands failed

> Task :sdks:python:test-suites:tox:py38:testPy38pytorch-19 FAILED

FAILURE: Build completed with 2 failures.

1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-110'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:python:test-suites:tox:py38:testPy38pytorch-19'.
> Process 'command 'sh'' finished with non-zero exit value 1

* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
==============================================================================

* Get more help at https://help.gradle.org

Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0.

You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins.

See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings

BUILD FAILED in 57m 20s
124 actionable tasks: 89 executed, 33 from cache, 2 up-to-date

Publishing build scan...
https://gradle.com/s/tzinabkrs6gpa

Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure

---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscribe@beam.apache.org
For additional commands, e-mail: builds-help@beam.apache.org