[jira] [Updated] (ARROW-14367) [C++][Python] Add some kind of user-visible signal when backpressure is applied

["Jacob Wujciak-Jens (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/ARROW-14367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Jacob Wujciak-Jens updated ARROW-14367:
---------------------------------------
    Component/s: C++
                 Python

> [C++][Python] Add some kind of user-visible signal when backpressure is applied
> -------------------------------------------------------------------------------
>
>                 Key: ARROW-14367
>                 URL: https://issues.apache.org/jira/browse/ARROW-14367
>             Project: Apache Arrow
>          Issue Type: Improvement
>          Components: C++, Python
>            Reporter: Weston Pace
>            Priority: Major
>
> Initially this will be specific to datasets (since we have don't have well defined backpressure in the plan itself yet) but there should be a way for a consumer to inspect an executing datasets operation to know if backpressure is being applied because they are consuming the data too slowly.
> A simple implementation might be a callback that is triggered each time backpressure is applied.  Longer term we might want something with more extensive visibility into a running query that is integrated with any tracing utilities.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)