You are viewing a plain text version of this content. The canonical link for it is here.

Posted to jira@arrow.apache.org by "Antoine Pitrou (Jira)" <ji...@apache.org> on 2021/02/11 13:52:00 UTC

[jira] [Commented] (ARROW-11588) [C++] Add traceable general purpose queue

    [ https://issues.apache.org/jira/browse/ARROW-11588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17283034#comment-17283034 ] 

Antoine Pitrou commented on ARROW-11588:
----------------------------------------

Sounds good to me. On a general basis, we try to minimize the Boost dependencies, but that's only a guideline (especially if header-only).

> [C++] Add traceable general purpose queue
> -----------------------------------------
>
>                 Key: ARROW-11588
>                 URL: https://issues.apache.org/jira/browse/ARROW-11588
>             Project: Apache Arrow
>          Issue Type: Task
>          Components: C++
>            Reporter: Weston Pace
>            Assignee: Weston Pace
>            Priority: Major
>
> There are a few places we queue data/jobs today (e.g. readahead, thread pool).   In order to reduce complexity (adopt a single implementation where we have multiple) and add traceability (so we can tell where queues are filling up)  we should adopt a general purpose queue (e.g. the boost lockfree one) and add some basic performance counters/events (queue size, queue full, queue starved).



--
This message was sent by Atlassian Jira
(v8.3.4#803005)