[jira] [Created] (SPARK-13255) Integrate vectorized parquet scan with whole stage codegen.

["Nong Li (JIRA)" <ji...@apache.org>]

Nong Li created SPARK-13255:
-------------------------------

             Summary: Integrate vectorized parquet scan with whole stage codegen.
                 Key: SPARK-13255
                 URL: https://issues.apache.org/jira/browse/SPARK-13255
             Project: Spark
          Issue Type: Task
          Components: SQL
            Reporter: Nong Li


The generated whole stage codegen is intended to be run over batches of rows. This task is to integrate ColumnarBatches with whole stage codegen.

The resulting generated code should look something like:

{code}

Iterator<ColumnarBatch> input;

void process() {
  while (input.hasNext()) {
    ColumnarBatch batch = input.next();
    for (Row: batch) {
      // Current function
    }
  }
}


{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org