[GitHub] [beam] Vidyats1 commented on issue #21229: Error running Top transform in Dataflow

[GitBox <gi...@apache.org>]

Vidyats1 commented on issue #21229:
URL: https://github.com/apache/beam/issues/21229#issuecomment-1176848520

   Even I am getting the same error while running below code in dataflow. I am using apache-beam==2.40.0
   
   `beam.CombineGlobally(beam.combiners.TopCombineFn(5,lambda a: a['count'] )).without_defaults()`
   
   ```
    severity: "ERROR"
   textPayload: "Error message from worker: generic::unknown: Traceback (most recent call last):
     File "/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py", line 284, in _execute
       response = task()
     File "/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py", line 357, in <lambda>
       lambda: self.create_worker().do_instruction(request), request)
     File "/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py", line 597, in do_instruction
       return getattr(self, request_type)(
     File "/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/sdk_worker.py", line 635, in process_bundle
       bundle_processor.process_bundle(instruction_id))
     File "/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py", line 1003, in process_bundle
       input_op_by_transform_id[element.transform_id].process_encoded(
     File "/usr/local/lib/python3.9/site-packages/apache_beam/runners/worker/bundle_processor.py", line 227, in process_encoded
       self.output(decoded_value)
     File "apache_beam/runners/worker/operations.py", line 526, in apache_beam.runners.worker.operations.Operation.output
     File "apache_beam/runners/worker/operations.py", line 528, in apache_beam.runners.worker.operations.Operation.output
     File "apache_beam/runners/worker/operations.py", line 237, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
     File "apache_beam/runners/worker/operations.py", line 240, in apache_beam.runners.worker.operations.SingletonElementConsumerSet.receive
     File "apache_beam/runners/worker/operations.py", line 1119, in apache_beam.runners.worker.operations.CombineOperation.process
     File "apache_beam/runners/worker/operations.py", line 1123, in apache_beam.runners.worker.operations.CombineOperation.process
     File "/usr/local/lib/python3.9/site-packages/apache_beam/transforms/combiners.py", line 889, in extract_only
       return self.combine_fn.extract_output(accumulator)
     File "/usr/local/lib/python3.9/site-packages/apache_beam/transforms/combiners.py", line 526, in extract_output
       heap.sort(reverse=True)
     File "apache_beam/transforms/cy_combiners.py", line 421, in apache_beam.transforms.cy_combiners.ComparableValue.__lt__
   AssertionError
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org