You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "German Schiavon Matteo (Jira)" <ji...@apache.org> on 2019/12/02 07:52:00 UTC

[jira] [Updated] (SPARK-30097) Adding support for core writers

     [ https://issues.apache.org/jira/browse/SPARK-30097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

German Schiavon Matteo updated SPARK-30097:
-------------------------------------------
    Environment: 
{code:java}
// writeStream
 .outputMode("append")
 .partitionBy("id")
 .parquet(path)
{code}
 

  was:
{code:java}
// code placeholder
{code}
writeStream
 .outputMode("append")
 .partitionBy("id")
 .parquet(path)


> Adding support for core writers 
> --------------------------------
>
>                 Key: SPARK-30097
>                 URL: https://issues.apache.org/jira/browse/SPARK-30097
>             Project: Spark
>          Issue Type: Improvement
>          Components: SQL, Structured Streaming
>    Affects Versions: 3.0.0
>         Environment: {code:java}
> // writeStream
>  .outputMode("append")
>  .partitionBy("id")
>  .parquet(path)
> {code}
>  
>            Reporter: German Schiavon Matteo
>            Priority: Minor
>
> When using `writeStream` we always have to use `format("xxx")` in order to target the selected sink while in `readStream` you can use directly `.parquet`. 
> Basically this is to add the support to the core writers for `writeStream`
> Example:



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org