You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "Luke Cwik (Jira)" <ji...@apache.org> on 2021/10/20 20:08:00 UTC

[jira] [Created] (BEAM-13087) apache_beam.runners.portability.fn_api_runner.translations_test.TranslationsTest.test_run_packable_combine_globally 'apache_beam.coders.coder_impl._AbstractIterable' object is not reversible

Luke Cwik created BEAM-13087:
--------------------------------

             Summary: apache_beam.runners.portability.fn_api_runner.translations_test.TranslationsTest.test_run_packable_combine_globally 'apache_beam.coders.coder_impl._AbstractIterable' object is not reversible
                 Key: BEAM-13087
                 URL: https://issues.apache.org/jira/browse/BEAM-13087
             Project: Beam
          Issue Type: Bug
          Components: sdk-py-core, test-failures
            Reporter: Luke Cwik
            Assignee: Robert Bradshaw


Suspected cause: https://github.com/apache/beam/pull/15662

Example failure:
https://ci-beam.apache.org/job/beam_PostCommit_Py_VR_Dataflow/8524/testReport/junit/apache_beam.runners.portability.fn_api_runner.translations_test/TranslationsTest/test_run_packable_combine_globally/

{noformat}
E         apache_beam.runners.dataflow.dataflow_runner.DataflowRuntimeException: Dataflow pipeline failed. State: FAILED, Error:
E         Traceback (most recent call last):
E           File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
E           File "apache_beam/runners/common.py", line 536, in apache_beam.runners.common.SimpleInvoker.invoke_process
E           File "apache_beam/runners/common.py", line 1334, in apache_beam.runners.common._OutputProcessor.process_outputs
E           File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/combiners.py", line 383, in process
E             for element in reversed(bundle):
E         TypeError: 'apache_beam.coders.coder_impl._AbstractIterable' object is not reversible
E         
E         During handling of the above exception, another exception occurred:
E         
E         Traceback (most recent call last):
E           File "/usr/local/lib/python3.6/site-packages/dataflow_worker/batchworker.py", line 651, in do_work
E             work_executor.execute()
E           File "/usr/local/lib/python3.6/site-packages/dataflow_worker/executor.py", line 213, in execute
E             op.start()
E           File "dataflow_worker/shuffle_operations.py", line 63, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
E           File "dataflow_worker/shuffle_operations.py", line 64, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
E           File "dataflow_worker/shuffle_operations.py", line 79, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
E           File "dataflow_worker/shuffle_operations.py", line 80, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
E           File "dataflow_worker/shuffle_operations.py", line 84, in dataflow_worker.shuffle_operations.GroupedShuffleReadOperation.start
E           File "apache_beam/runners/worker/operations.py", line 349, in apache_beam.runners.worker.operations.Operation.output
E           File "apache_beam/runners/worker/operations.py", line 216, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
E           File "dataflow_worker/shuffle_operations.py", line 261, in dataflow_worker.shuffle_operations.BatchGroupAlsoByWindowsOperation.process
E           File "dataflow_worker/shuffle_operations.py", line 268, in dataflow_worker.shuffle_operations.BatchGroupAlsoByWindowsOperation.process
E           File "apache_beam/runners/worker/operations.py", line 349, in apache_beam.runners.worker.operations.Operation.output
E           File "apache_beam/runners/worker/operations.py", line 216, in apache_beam.runners.worker.operations.SingletonConsumerSet.receive
E           File "apache_beam/runners/worker/operations.py", line 708, in apache_beam.runners.worker.operations.DoOperation.process
E           File "apache_beam/runners/worker/operations.py", line 709, in apache_beam.runners.worker.operations.DoOperation.process
E           File "apache_beam/runners/common.py", line 1200, in apache_beam.runners.common.DoFnRunner.process
E           File "apache_beam/runners/common.py", line 1281, in apache_beam.runners.common.DoFnRunner._reraise_augmented
E           File "apache_beam/runners/common.py", line 1198, in apache_beam.runners.common.DoFnRunner.process
E           File "apache_beam/runners/common.py", line 536, in apache_beam.runners.common.SimpleInvoker.invoke_process
E           File "apache_beam/runners/common.py", line 1334, in apache_beam.runners.common._OutputProcessor.process_outputs
E           File "/usr/local/lib/python3.6/site-packages/apache_beam/transforms/combiners.py", line 383, in process
E             for element in reversed(bundle):
E         TypeError: 'apache_beam.coders.coder_impl._AbstractIterable' object is not reversible [while running 'multiple-combines/largest-globally/Top(2)/ParDo(_MergeTopPerBundle)']

apache_beam/runners/dataflow/dataflow_runner.py:1643: DataflowRuntimeException
{noformat}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)