You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/07/22 14:14:08 UTC

[GitHub] [beam] alex4adeo opened a new issue, #22411: [Feature Request]: Allow sideinput for batch DoFn

alex4adeo opened a new issue, #22411:
URL: https://github.com/apache/beam/issues/22411

   ### What would you like to happen?
   
   When using `.side_inputs(...)` in a ParDo with a DoFn using process_batch, we get : 
   
   `DoFn <__main__....> has unsupported process_batch method parameter SideInputParam`
   
   Why can't we get access to the sideinput from inside the process_batch function ?
   
   in sdks/python/apache_beam/runners/common.py
   in _validate_process_batch
   
     # Fallback to catch anything not explicitly supported
         if not d in (core.DoFn.WindowParam,
                      core.DoFn.TimestampParam,
                      core.DoFn.PaneInfoParam):
           raise ValueError(
               f"DoFn {self.do_fn!r} has unsupported process_batch "
               f"method parameter {d}")
   
   ### Issue Priority
   
   Priority: 2
   
   ### Issue Component
   
   Component: sdk-py-core


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] TheNeuralBit commented on issue #22411: [Feature Request]: Allow sideinput for batch DoFn

Posted by GitBox <gi...@apache.org>.
TheNeuralBit commented on issue #22411:
URL: https://github.com/apache/beam/issues/22411#issuecomment-1205591674

   Thanks for feedback @alex4adeo, it's good to know what users are trying to do. Let's track this under #21653 (SideInputs are a per-key param).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] TheNeuralBit closed issue #22411: [Feature Request]: Allow sideinput for batch DoFn

Posted by GitBox <gi...@apache.org>.
TheNeuralBit closed issue #22411: [Feature Request]: Allow sideinput for batch DoFn
URL: https://github.com/apache/beam/issues/22411


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] tvalentyn commented on issue #22411: [Feature Request]: Allow sideinput for batch DoFn

Posted by GitBox <gi...@apache.org>.
tvalentyn commented on issue #22411:
URL: https://github.com/apache/beam/issues/22411#issuecomment-1205320370

   over to @TheNeuralBit to triage.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org