You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Bill Reed (JIRA)" <ji...@apache.org> on 2016/08/26 14:15:21 UTC

[jira] [Created] (SPARK-17264) DataStreamWriter does not support "json" format

Bill Reed created SPARK-17264:
---------------------------------

             Summary: DataStreamWriter does not support "json" format
                 Key: SPARK-17264
                 URL: https://issues.apache.org/jira/browse/SPARK-17264
             Project: Spark
          Issue Type: Bug
          Components: Input/Output
    Affects Versions: 2.0.0
         Environment: Mac OSX
            Reporter: Bill Reed
             Fix For: 2.0.0


The API documentations for DataStreamWriter.format states "Specifies the underlying output data source. Built-in options include "parquet", "json", etc." but when specifying "json" or "text" for the format. the following exception is thrown:
Exception in thread "main" java.lang.UnsupportedOperationException: Data source json does not support streamed writing
	at org.apache.spark.sql.execution.datasources.DataSource.createSink(DataSource.scala:273)
	at org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:291)

The only format that works is .format("parquet")



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org