You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenchen Fan (Jira)" <ji...@apache.org> on 2019/09/03 05:43:00 UTC
[jira] [Resolved] (SPARK-28573) Convert
InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned
table
[ https://issues.apache.org/jira/browse/SPARK-28573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenchen Fan resolved SPARK-28573.
---------------------------------
Fix Version/s: 3.0.0
Resolution: Fixed
Issue resolved by pull request 25306
[https://github.com/apache/spark/pull/25306]
> Convert InsertIntoTable(HiveTableRelation) to Datasource inserting for partitioned table
> ----------------------------------------------------------------------------------------
>
> Key: SPARK-28573
> URL: https://issues.apache.org/jira/browse/SPARK-28573
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 3.0.0
> Reporter: Xianjin YE
> Assignee: Xianjin YE
> Priority: Major
> Fix For: 3.0.0
>
>
> Currently we don't translate InsertInto(HiveTableRelation) to DataSource insertion when partitioned table is involved, the reason is that, quote from the comments:
> {quote}// Inserting into partitioned table is not supported in Parquet/Orc data source (yet).
> {quote}
>
> which doesn't hold any more. Since datasource table dynamic partition insert now supports
> dynamic mode (SPARK-20236). I think it's worthy to translate InsertIntoTable(HiveTableRelation) to datasource table.
--
This message was sent by Atlassian Jira
(v8.3.2#803003)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org