You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@drill.apache.org by "Stefán Baxter (JIRA)" <ji...@apache.org> on 2015/07/18 01:09:04 UTC

[jira] [Created] (DRILL-3512) json queries fails on unexpected EOL

Stefán Baxter created DRILL-3512:
------------------------------------

             Summary: json queries fails on unexpected EOL
                 Key: DRILL-3512
                 URL: https://issues.apache.org/jira/browse/DRILL-3512
             Project: Apache Drill
          Issue Type: Improvement
          Components: Storage - JSON
    Affects Versions: 1.1.0
            Reporter: Stefán Baxter
            Assignee: Steven Phillips
            Priority: Minor


querying directories or files that are open by some writer is a create way to keep up with data (csv/tsv) being logged out by servers, processes etc.

We did a small test where we appended a copy of our message stream (1k msg./sec.) to a json file and queried it with Drill. This worked just fine but every once in a while we would get Unexpected End of Line errors as the writer was appending to the file as Drill was reading it.

It would be great if an incomplete entry at the end of the file would simply be ignored. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)