[jira] [Created] (SPARK-2135) InMemoryColumnarScan does not get planned correctly

["Michael Armbrust (JIRA)" <ji...@apache.org>]

Michael Armbrust created SPARK-2135:
---------------------------------------

             Summary: InMemoryColumnarScan does not get planned correctly
                 Key: SPARK-2135
                 URL: https://issues.apache.org/jira/browse/SPARK-2135
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.0.0
            Reporter: Michael Armbrust
            Assignee: Michael Armbrust


Right now we do not have a logical concept for in memory data.  This breaks planning in several ways:

This sort of query fails to analyze:
{code}
    TestSQLContext.sql("SELECT * FROM testData").registerAsTable("selectStar")
    TestSQLContext.cacheTable("selectStar")
    TestSQLContext.sql("SELECT * FROM selectStar WHERE key = 1").collect()
{code}

Also, we read all of the columns even when we don't need to.



--
This message was sent by Atlassian JIRA
(v6.2#6252)