You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Paul Rogers (Jira)" <ji...@apache.org> on 2020/03/31 18:58:00 UTC

[jira] [Created] (DRILL-7683) Add "message parsing" to new JSON loader

Paul Rogers created DRILL-7683:
----------------------------------

             Summary: Add "message parsing" to new JSON loader
                 Key: DRILL-7683
                 URL: https://issues.apache.org/jira/browse/DRILL-7683
             Project: Apache Drill
          Issue Type: Improvement
    Affects Versions: 1.18.0
            Reporter: Paul Rogers
            Assignee: Paul Rogers
             Fix For: 1.18.0


Worked on a project that uses the new JSON loader to parse a REST response that includes a set of "wrapper" fields around the JSON payload. Example:

{code:json}
{ "status": "ok", "results: [ data here ]}
{code}

To solve this cleanly, added the ability to specify a "message parser" to consume JSON tokens up to the start of the data. This parser can be written as needed for each different data source.

Since this change adds one more parameter to the JSON structure parser, added builders to gather the needed parameters rather than making the constructor even larger.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)