You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@drill.apache.org by "Aditya Kishore (JIRA)" <ji...@apache.org> on 2014/07/22 13:02:47 UTC
[jira] [Updated] (DRILL-1095) Add support for large number of
columns in queries
[ https://issues.apache.org/jira/browse/DRILL-1095?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Aditya Kishore updated DRILL-1095:
----------------------------------
Description:
git.commit.id.abbrev=a1a6144
Build# 26246
The 'create table as' statement starts to break when the column count is somewhere around 125-150. I attached the error log. Let me know if you have any questions.
The root cause of this (and similar failures) is that when a Drill operator needs to process (evaluate/copy/spool) a large number of expressions (columns), the resultant runtime generated code can exceed the [64 KB byte code limit|http://docs.oracle.com/javase/specs/jvms/se7/html/jvms-4.html#jvms-4.9.1-110-B] imposed on the size of a function by Java class file specifications, resulting in compilation failure.
This umbrella JIRA will serve as a container for various sub-tasks to address this issue.
was:
git.commit.id.abbrev=a1a6144
Build# 26246
The 'create table as' statement starts to break when the column count is somewhere around 125-150. I attached the error log. Let me know if you have any questions.
Summary: Add support for large number of columns in queries (was: Drill Parquet Writer fails when we have more than 150 columns)
Updating JIRA summary and description to reflect the root cause.
> Add support for large number of columns in queries
> --------------------------------------------------
>
> Key: DRILL-1095
> URL: https://issues.apache.org/jira/browse/DRILL-1095
> Project: Apache Drill
> Issue Type: Bug
> Components: Execution - Codegen, Metadata, Storage - Writer
> Reporter: Rahul Challapalli
> Assignee: Aditya Kishore
> Priority: Blocker
> Attachments: error.log
>
>
> git.commit.id.abbrev=a1a6144
> Build# 26246
> The 'create table as' statement starts to break when the column count is somewhere around 125-150. I attached the error log. Let me know if you have any questions.
> The root cause of this (and similar failures) is that when a Drill operator needs to process (evaluate/copy/spool) a large number of expressions (columns), the resultant runtime generated code can exceed the [64 KB byte code limit|http://docs.oracle.com/javase/specs/jvms/se7/html/jvms-4.html#jvms-4.9.1-110-B] imposed on the size of a function by Java class file specifications, resulting in compilation failure.
> This umbrella JIRA will serve as a container for various sub-tasks to address this issue.
--
This message was sent by Atlassian JIRA
(v6.2#6252)