You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Josh Rosen (JIRA)" <ji...@apache.org> on 2016/01/31 02:57:39 UTC

[jira] [Created] (SPARK-13105) Spark 1.6 and earlier should reject NATURAL JOIN queries instead of returning wrong answers

Josh Rosen created SPARK-13105:
----------------------------------

             Summary: Spark 1.6 and earlier should reject NATURAL JOIN queries instead of returning wrong answers
                 Key: SPARK-13105
                 URL: https://issues.apache.org/jira/browse/SPARK-13105
             Project: Spark
          Issue Type: Bug
          Components: SQL
    Affects Versions: 1.6.0, 1.5.2, 1.4.1
            Reporter: Josh Rosen
            Assignee: Josh Rosen


In Spark 1.6 and earlier, Spark SQL does not support {{NATURAL JOIN}} queries. However, its SQL parser does not consider {{NATURAL}} to be a reserved word, which causes natural joins to be parsed as regular joins where the left table has been aliased. For instance,

{code}
SELECT * FROM foo NATURAL JOIN bar
{code}

gets interpreted as "foo JOIN bar" where "foo" is aliased to "natural".

Rather than doing this, which leads to confusing / wrong results for users who expect NATURAL JOIN behavior, Spark should immediately reject these queries at analysis time and should provide an informative error message.

We're going to add natural join support in Spark 2.0, but for earlier versions we should add a bugfix to throw errors.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org