[jira] [Commented] (DRILL-7377) Can't Create Nested List using EVF with Late Schema

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/DRILL-7377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16945593#comment-16945593 ] 

ASF GitHub Bot commented on DRILL-7377:
---------------------------------------

paul-rogers commented on pull request #1868: DRILL-7377: Nested schemas for dynamic EVF columns
URL: https://github.com/apache/drill/pull/1868
 
 
   The Result Set Loader (part of EVF) allows adding columns up-front
   before reading rows (so-called "early schema.") Such schemas allow
   nested columns (maps with members, repeated lists with a type, etc.)
   
   The Result Set Loader also allows adding columns dynamically
   while loading data (so-called "late schema".) Previously, the code
   assumed that columns would be added top-down: first the map, then
   the map's contents, etc.
   
   Charles found a need to allow adding a nested column (a repeated
   list with a declared list type.)
   
   This patch revises the code to use the same mechanism in both the
   early- and late-schema cases, allowing adding nested columns at
   any time.
   
   Testing: Added a new unit test case for the repeated list late
   schema with content case.
 
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


> Can't Create Nested List using EVF with Late Schema
> ---------------------------------------------------
>
>                 Key: DRILL-7377
>                 URL: https://issues.apache.org/jira/browse/DRILL-7377
>             Project: Apache Drill
>          Issue Type: Bug
>    Affects Versions: 1.16.0
>            Reporter: Charles Givre
>            Assignee: Paul Rogers
>            Priority: Major
>             Fix For: 1.17.0
>
>
> Looks like the bug is that the code that adds columns on the fly (late schema) skips calling the BuildFromSchema step:
> 	at org.apache.drill.exec.physical.resultSet.impl.ColumnBuilder.buildRepeatedList(ColumnBuilder.java:487) ~[classes/:na]
> 	at org.apache.drill.exec.physical.resultSet.impl.ColumnBuilder.buildColumn(ColumnBuilder.java:110) ~[classes/:na]
> 	at org.apache.drill.exec.physical.resultSet.impl.ContainerState.addColumn(ContainerState.java:93) ~[classes/:na]
> 	at org.apache.drill.exec.physical.resultSet.impl.TupleState.addColumn(TupleState.java:505) ~[classes/:na]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)