[jira] [Created] (DRILL-7730) Reduce overhead of web queries displayed in HTML

["Paul Rogers (Jira)" <ji...@apache.org>]

Paul Rogers created DRILL-7730:
----------------------------------

             Summary: Reduce overhead of web queries displayed in HTML
                 Key: DRILL-7730
                 URL: https://issues.apache.org/jira/browse/DRILL-7730
             Project: Apache Drill
          Issue Type: Improvement
    Affects Versions: 1.17.0
            Reporter: Paul Rogers
            Assignee: Paul Rogers
             Fix For: 1.18.0


Drill provides a web console to run queries. Query results appear as HTML pages. Drill buffers the query results in-memory to build the page. The current approach has two problems (in addition to the overhead of buffering):

* To move each batch from Screen to the REST client, we serialize all vectors into a single large buffer, then recreate the individual vectors.
* The code appends column names and metadata for each batch. For a multi-batch query, we end up with lists that contain many copies of the same data.

This change modifies the internal plumbing to transfer a record batch from Screen to REST without copying.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)