[GitHub] [arrow] westonpace opened a new issue, #35837: [C++] Acero will hang if StopProducing is called while backpressure is applied on the source node

["westonpace (via GitHub)" <gi...@apache.org>]

westonpace opened a new issue, #35837:
URL: https://github.com/apache/arrow/issues/35837

   ### Describe the bug, including details regarding any error messages, version, and platform.
   
   The source node creates an external task called `SourceNode::DatasetScan` which is managed outside the exec plan.  This task is actually an `arrow::Loop` call which is iterating the source async generator.  That loop can be paused and resumed to apply backpressure.
   
   When StopProducing arrives the source node sets `stop_requested_=true`.  However, `stop_requested_` is not processed until the next iteration through the loop.  If the plan is paused then the loop is not iterating and nothing notices that `stop_requested_` changed and the external task never completes and the plan then never completes.
   
   ### Component(s)
   
   C++


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] icexelloss closed issue #35837: [C++] Acero will hang if StopProducing is called while backpressure is applied on the source node

["icexelloss (via GitHub)" <gi...@apache.org>]

icexelloss closed issue #35837: [C++] Acero will hang if StopProducing is called while backpressure is applied on the source node
URL: https://github.com/apache/arrow/issues/35837


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [arrow] rtpsw commented on issue #35837: [C++] Acero will hang if StopProducing is called while backpressure is applied on the source node

["rtpsw (via GitHub)" <gi...@apache.org>]

rtpsw commented on issue #35837:
URL: https://github.com/apache/arrow/issues/35837#issuecomment-1575624301

   take


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org