[jira] [Commented] (SPARK-17264) DataStreamWriter does not support "json" format

["Bill Reed (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15439152#comment-15439152 ] 

Bill Reed commented on SPARK-17264:
-----------------------------------

so "parquet" will be the only supported output format?

> DataStreamWriter does not support "json" format
> -----------------------------------------------
>
>                 Key: SPARK-17264
>                 URL: https://issues.apache.org/jira/browse/SPARK-17264
>             Project: Spark
>          Issue Type: Bug
>          Components: Documentation, Input/Output
>    Affects Versions: 2.0.0
>         Environment: Mac OSX
>            Reporter: Bill Reed
>            Priority: Minor
>
> The API documentations for DataStreamWriter.format states "Specifies the underlying output data source. Built-in options include "parquet", "json", etc." but when specifying "json" or "text" for the format. the following exception is thrown:
> Exception in thread "main" java.lang.UnsupportedOperationException: Data source json does not support streamed writing
> 	at org.apache.spark.sql.execution.datasources.DataSource.createSink(DataSource.scala:273)
> 	at org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:291)
> The only format that works is .format("parquet")



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org