You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@orc.apache.org by "Quanlong Huang (Jira)" <ji...@apache.org> on 2021/08/23 02:52:00 UTC

[jira] [Created] (ORC-961) Expose metrics of the reader

Quanlong Huang created ORC-961:
----------------------------------

             Summary: Expose metrics of the reader
                 Key: ORC-961
                 URL: https://issues.apache.org/jira/browse/ORC-961
             Project: ORC
          Issue Type: New Feature
          Components: C++
    Affects Versions: 1.7.0
            Reporter: Quanlong Huang


It'd be useful for clients to collect metrics of the evaluation of the pushed down predicates. Currently SargsApplier keeps track of the selected RowGroups and evaluated RowGroups: [https://github.com/apache/orc/blob/40ee321b209cad1de73fc97b653636aa0fff28f6/c++/src/sargs/SargsApplier.hh#L79-L81]

However, we are lack of an interface in RowReader to expose the metrics. Note that sargsApplier is a private member inside RowReaderImpl. We need an interface to expose it or only its stats.

It'd also be useful if we expose other metrics of a RowReader, e.g. acutal mem usage, time elapsed in decoding/decompression, time elapsed in evaluating SearchArguments.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)