You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Charles Givre (Jira)" <ji...@apache.org> on 2022/06/01 12:30:00 UTC
[jira] [Updated] (DRILL-8241) Remove Deprecated JSON Reader
[ https://issues.apache.org/jira/browse/DRILL-8241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Charles Givre updated DRILL-8241:
---------------------------------
Description:
This is a master ticket to remove the deprecated v1 JSON reader from Drill. This JSON reader is used in several places and removing it will ensure consistent behavior across all data sources.
The V2, EVF based JSON reader has several advantages, including the possibility of schema provisioning, limit pushdowns and others.
Here are the tasks which need to be completed to fully remove the v1 JSON reader.
* Complete DRILL-5955 which adds support for the UNION vector to the EVF Json reader.
* Convert the convert_fromJSON functions to V2
* Convert the Druid Storage Plugin to V2
* Convert MongoDB Storage Plugin to V2. (Note the MongoDB plugin uses an EVF-based BSON reader as well as the V1 JSON reader)
* Remove all V1-based unit tests
* Migrate the JsonOptions from the HTTP Storage Plugin to global location to allow other plugins and users of JSON to set JSON configuration at a more granular level.
* Remove extraneous configuration options.
was:
This is a master ticket to remove the deprecated v1 JSON reader from Drill. This JSON reader is used in several places and removing it will ensure consistent behavior across all data sources.
The V2, EVF based JSON reader has several advantages, including the possibility of schema provisioning, limit pushdowns and others.
Here are the tasks which need to be completed to fully remove the v1 JSON reader.
* Convert the convert_fromJSON functions to V2
* Convert the Druid Storage Plugin to V2
* Convert MongoDB Storage Plugin to V2. (Note the MongoDB plugin uses an EVF-based BSON reader as well as the V1 JSON reader)
* Remove all V1-based unit tests
* Migrate the JsonOptions from the HTTP Storage Plugin to global location to allow other plugins and users of JSON to set JSON configuration at a more granular level.
* Remove extraneous configuration options.
> Remove Deprecated JSON Reader
> -----------------------------
>
> Key: DRILL-8241
> URL: https://issues.apache.org/jira/browse/DRILL-8241
> Project: Apache Drill
> Issue Type: Improvement
> Components: Storage - JSON
> Affects Versions: 1.20.1
> Reporter: Charles Givre
> Priority: Major
> Fix For: 2.0.0
>
>
> This is a master ticket to remove the deprecated v1 JSON reader from Drill. This JSON reader is used in several places and removing it will ensure consistent behavior across all data sources.
> The V2, EVF based JSON reader has several advantages, including the possibility of schema provisioning, limit pushdowns and others.
> Here are the tasks which need to be completed to fully remove the v1 JSON reader.
> * Complete DRILL-5955 which adds support for the UNION vector to the EVF Json reader.
> * Convert the convert_fromJSON functions to V2
> * Convert the Druid Storage Plugin to V2
> * Convert MongoDB Storage Plugin to V2. (Note the MongoDB plugin uses an EVF-based BSON reader as well as the V1 JSON reader)
> * Remove all V1-based unit tests
> * Migrate the JsonOptions from the HTTP Storage Plugin to global location to allow other plugins and users of JSON to set JSON configuration at a more granular level.
> * Remove extraneous configuration options.
>
>
--
This message was sent by Atlassian Jira
(v8.20.7#820007)