You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by "Lizzfox (via GitHub)" <gi...@apache.org> on 2023/03/28 13:10:08 UTC

[GitHub] [beam] Lizzfox opened a new issue, #26011: [Bug]: SparkRecieverIO doesn't support Dataflow runner v2

Lizzfox opened a new issue, #26011:
URL: https://github.com/apache/beam/issues/26011

   ### What happened?
   
   #### Steps to reproduce
   Run pipeline using SparkReceiverIO on Dataflow Runner V2. 
   #### Actual result
   The pipeline gets stuck processing the [0,0] restriction. 
   #### Reason
   The initial restriction is set to [0, +infinity). SparkReceiverIO tries to split restrictions before processing data to [0,0] and [0, +infinity). That leads to already processed [0,0] being empty and the pipeline hung there.
   
   ### Issue Priority
   
   Priority: 3 (minor)
   
   ### Issue Components
   
   - [ ] Component: Python SDK
   - [ ] Component: Java SDK
   - [ ] Component: Go SDK
   - [ ] Component: Typescript SDK
   - [ ] Component: IO connector
   - [ ] Component: Beam examples
   - [ ] Component: Beam playground
   - [ ] Component: Beam katas
   - [ ] Component: Website
   - [ ] Component: Spark Runner
   - [ ] Component: Flink Runner
   - [ ] Component: Samza Runner
   - [ ] Component: Twister2 Runner
   - [ ] Component: Hazelcast Jet Runner
   - [ ] Component: Google Cloud Dataflow Runner


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] aromanenko-dev closed issue #26011: [Bug]: SparkRecieverIO doesn't support Dataflow runner v2

Posted by "aromanenko-dev (via GitHub)" <gi...@apache.org>.
aromanenko-dev closed issue #26011: [Bug]: SparkRecieverIO doesn't support Dataflow runner v2
URL: https://github.com/apache/beam/issues/26011


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] Lizzfox commented on issue #26011: [Bug]: SparkRecieverIO doesn't support Dataflow runner v2

Posted by "Lizzfox (via GitHub)" <gi...@apache.org>.
Lizzfox commented on issue #26011:
URL: https://github.com/apache/beam/issues/26011#issuecomment-1486865120

   .remove-labels 'awaiting triage'


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org