You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Hao Zhu (JIRA)" <ji...@apache.org> on 2014/11/06 18:27:33 UTC

[jira] [Created] (DRILL-1645) Can not query any column if the row size is larger than 128K

Hao Zhu created DRILL-1645:
------------------------------

             Summary: Can not query any column if the row size is larger than 128K
                 Key: DRILL-1645
                 URL: https://issues.apache.org/jira/browse/DRILL-1645
             Project: Apache Drill
          Issue Type: Bug
          Components: Query Planning & Optimization
    Affects Versions: 0.6.0
            Reporter: Hao Zhu
         Attachments: wrapper.json

If the row size is larger than 128K, drill can not query any column no matter how small the column is.
So once the top level row of the json file is larger than 128K, then we can not query anything from this file.

We need drill can query small columns which is below the limitation at least.

Reproduce:
{code}
0: jdbc:drill:> select * from `wrapper.json`;
Query failed: Failure while running fragment. Record is too long. Max allowed record size is 131072 bytes. [7894614e-9928-4aa5-b649-2d085d01a55b]

Error: exception while executing query: Failure while trying to get next result batch. (state=,code=0)
0: jdbc:drill:> select id from `wrapper.json`;
Query failed: Failure while running fragment. Record is too long. Max allowed record size is 131072 bytes. [ed61693e-d4da-478e-b85d-1fb7d9621243]

Error: exception while executing query: Failure while trying to get next result batch. (state=,code=0)
{code}

The sample data format is like below(Complete sample data is attached.):
In above test case, the "id" column should be fetched since it is very small.
{code}
[root@maprdemo data]# more wrapper.json 
{"id": 1,"supercolumn": {"content":testtesttesttesttesttestt......."}}
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)