[jira] [Created] (SPARK-12930) NullPointerException running hive query with array dereference in select and where clause

["Thomas Graves (JIRA)" <ji...@apache.org>]

Thomas Graves created SPARK-12930:
-------------------------------------

             Summary: NullPointerException running hive query with array dereference in select and where clause
                 Key: SPARK-12930
                 URL: https://issues.apache.org/jira/browse/SPARK-12930
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.5.2
            Reporter: Thomas Graves


I had a user doing a hive query from spark where they had a array dereference in the select clause and in the where clause, it gave the user a NullPointerException when the where clause should have filtered it out.  Its like spark is evaluating the select part before running the where clause.  The info['pos'] below is what caused the issue:

Query looked like:
SELECT foo, 
info['pos'] AS pos 
FROM db.table
WHERE date >= '$initialDate' AND
date <= '$finalDate' AND
info is not null AND
info['pos'] is not null
LIMIT 10 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org