[jira] [Updated] (SPARK-15712) Proper temp table support

["Hyukjin Kwon (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-15712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon updated SPARK-15712:
---------------------------------
    Labels: bulk-closed  (was: )

> Proper temp table support
> -------------------------
>
>                 Key: SPARK-15712
>                 URL: https://issues.apache.org/jira/browse/SPARK-15712
>             Project: Spark
>          Issue Type: Bug
>          Components: SQL
>            Reporter: Yin Huai
>            Priority: Major
>              Labels: bulk-closed
>
> For proper temp table support, I am proposing to create a temp dir for every {{SparkSession}}. This can be done through the following changes:
> # We add a root temp dir (the path is configurable).
> # For every {{SparkSession}}, we create a temp dir for this {{SparkSession}} in the root temp dir.
> To make the semantic of {{CREATE TEMP TABLE ... USING ... OPTIONS ... AS SELECT}} easier to understand, I am proposing the following changes:
> # We only allow {{FileFormat}} data sources used by this command.
> # We make {{USING}} clause optional and by default we use the data source set in {{spark.sql.sources.default}}.
> # We do not allow users to add path in the {{OPTIONS}}
> # We save the temp table in the temp location associated with the current {{SparkSession}}.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org