[jira] [Created] (DRILL-7398) dfs avro file support to treat non existent fields as null

["Dan Schmitt (Jira)" <ji...@apache.org>]

Dan Schmitt created DRILL-7398:
----------------------------------

             Summary: dfs avro file support to treat non existent fields as null
                 Key: DRILL-7398
                 URL: https://issues.apache.org/jira/browse/DRILL-7398
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - Avro
            Reporter: Dan Schmitt


It would be nice to have an option to return null for non existing fields.

Currently we have a use case of evolving avro file schemas where things get added.

It would be nice to be able to query old and new data without having to rewrite the old data with a new schema with null/optional/default values.

A short term fix would be to provide an option to return null with dfs for avro fields that aren't found in a file.

A nicer fix would be to support a resolving schema that can be given to dfs to read the avro files to present a uniform interface (so aliases, defaults, etc. could be utilized without rewriting each avro file.)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)