You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@drill.apache.org by "Paul Rogers (Jira)" <ji...@apache.org> on 2020/02/25 00:06:00 UTC

[jira] [Created] (DRILL-7601) Shift column conversion to reader from scan framework

Paul Rogers created DRILL-7601:
----------------------------------

             Summary: Shift column conversion to reader from scan framework
                 Key: DRILL-7601
                 URL: https://issues.apache.org/jira/browse/DRILL-7601
             Project: Apache Drill
          Issue Type: Improvement
    Affects Versions: 1.17.0
            Reporter: Paul Rogers
            Assignee: Paul Rogers
             Fix For: 1.18.0


At the time we implemented provided schemas with the text reader, the best path forward appeared to be to perform column type conversions within the scan framework including deep in the column writer structure.

Experience with other readers has shown that the text reader is a special case: it always writes strings, which Drill-provided converters can parse into other types. Other readers, however are not so simple: they often have their own source structures which must be mated to a column reader, and so conversion is generally best done in the reader where it can be specific to the nuances of each reader.

This ticket asks to restructure the conversion code to fit the reader-does-conversion pattern.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)