You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "ASF GitHub Bot (JIRA)" <ji...@apache.org> on 2019/05/26 03:50:00 UTC

[jira] [Commented] (DRILL-7261) Simplify Easy format config for new scan framework

    [ https://issues.apache.org/jira/browse/DRILL-7261?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16848328#comment-16848328 ] 

ASF GitHub Bot commented on DRILL-7261:
---------------------------------------

paul-rogers commented on pull request #1796: DRILL-7261: Simplify Easy framework config for new scan
URL: https://github.com/apache/drill/pull/1796
 
 
   Most format plugins are created using the Easy format plugin. A recent
   change added support for the "row set" scan framework. After converting
   the text and log reader plugins, it became clear that the setup code
   could be made simpler.
   
   * Add the user name to the "file scan" framework.
   * Pass the file system, split and user name to the batch reader via
    the "schema negotiator" rather than via the constructor.
   * Create the traditional "scan batch" scan or the new row-set scan via
   functions instead of classes.
   * Add Easy config option and method to choose the kind of scan
   framework.
   * Add Easy config options for some newer options such as whether the
   plugin supports statistics.
   
   Tested by running all unit tests for the CSV reader which is based on
   the new framework, and by testing the converted log reader (that reader
   is not part of this commit.)
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Simplify Easy format config for new scan framework
> --------------------------------------------------
>
>                 Key: DRILL-7261
>                 URL: https://issues.apache.org/jira/browse/DRILL-7261
>             Project: Apache Drill
>          Issue Type: Improvement
>    Affects Versions: 1.16.0
>            Reporter: Paul Rogers
>            Assignee: Paul Rogers
>            Priority: Major
>             Fix For: 1.17.0
>
>
> Rollup of related CSV V3 fixes along with supporting row set framework fixes.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)