[GitHub] [drill] paul-rogers commented on issue #1830: DRILL-7333: Set container record count where missing

[GitBox <gi...@apache.org>]

paul-rogers commented on issue #1830: DRILL-7333: Set container record count where missing
URL: https://github.com/apache/drill/pull/1830#issuecomment-517974512
 
 
   Going to abandon this. Turns out that Drill has many, many interlocking vector count and size errors. I've not found a good way to work on them in chunks, and the problem is too large to do in one go. (I now understand what Jinfeng was facing a couple of years ago in his "empty batches" project!) Since I'm running out of time to work on this, we'll just leave well enough alone.
   
   Started down this route because the revised JSON reader hit a number of these problems as it used the "right" values which broke code that expected the wrong values. Since there is no time to work on fixing this, it means that the JSON reader can't be offered. Will revisit later if time becomes available.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services