You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yash Datta (JIRA)" <ji...@apache.org> on 2015/12/29 11:18:49 UTC
[jira] [Comment Edited] (SPARK-5948) Support writing to partitioned
table for the Parquet data source
[ https://issues.apache.org/jira/browse/SPARK-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15073755#comment-15073755 ]
Yash Datta edited comment on SPARK-5948 at 12/29/15 10:18 AM:
--------------------------------------------------------------
oh i see,
So does it mean that when using hive commands that use dynamic partitioning like :
insert overwrite table <tablename> partition (a, b)
select * from <sourcetable>
spark will use this modified path ?
Thanks for the prompt reply
was (Author: saucam):
oh i see,
So does it mean that when using hive commands that use dynamic partitioning like :
insert verwrite table <tablename> partition (a, b)
select * from <sourcetable>
spark will use this modified path ?
Thanks for the prompt reply
> Support writing to partitioned table for the Parquet data source
> ----------------------------------------------------------------
>
> Key: SPARK-5948
> URL: https://issues.apache.org/jira/browse/SPARK-5948
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Cheng Lian
> Assignee: Michael Armbrust
> Priority: Blocker
> Fix For: 1.4.0
>
>
> In 1.3.0, we added support for reading partitioned tables declared in Hive metastore for the Parquet data source. However, writing to partitioned tables is not supported yet. This feature should probably built upon SPARK-5947.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org