You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by "Charles Givre (Jira)" <ji...@apache.org> on 2021/10/25 15:47:00 UTC
[jira] [Created] (DRILL-8020) Add JSON Configuration Options to
HTTP Rest Plugin
Charles Givre created DRILL-8020:
------------------------------------
Summary: Add JSON Configuration Options to HTTP Rest Plugin
Key: DRILL-8020
URL: https://issues.apache.org/jira/browse/DRILL-8020
Project: Apache Drill
Issue Type: Improvement
Components: Storage - Other
Affects Versions: 1.19.0
Reporter: Charles Givre
Assignee: Charles Givre
Fix For: 1.20.0
Drill has a collection of JSON configuration options to allow you to configure how Drill interprets JSON files. These are set at the global level, however the HTTP plugin
allows you to configure these options individually per connection and override the Drill defaults. The options are:
* `allowNanInf`: Configures the connection to interpret `NaN` and `Inf` values
* `allTextMode`: By default, Drill attempts to infer data types from JSON data. If the data is malformed, Drill may throw schema change exceptions. If your data is
inconsistent, you can enable `allTextMode` which when true, Drill will read all JSON values as strings, rather than try to infer the data type.
* `readNumbersAsDouble`: By default Drill will attempt to interpret integers, floating point number types and strings. One challenge is when data is consistent, Drill may
throw schema change exceptions. In addition to `allTextMode`, you can make Drill less sensitive by setting the `readNumbersAsDouble` to `true` which causes Drill to read all
numeric fields in JSON data as `double` data type rather than trying to distinguish between ints and doubles.
* `enableEscapeAnyChar`: Allows a user to escape any character with a \
All of these can be set by adding the `jsonOptions` to your connection configuration as shown below:
```json
"jsonOptions": {
"allTextMode": true,
"readNumbersAsDouble": true
}
```
--
This message was sent by Atlassian Jira
(v8.3.4#803005)