You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2016/08/29 08:52:20 UTC
[jira] [Updated] (SPARK-17264) DataStreamWriter should document
that it only supports Parquet for now
[ https://issues.apache.org/jira/browse/SPARK-17264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen updated SPARK-17264:
------------------------------
Priority: Trivial (was: Minor)
Summary: DataStreamWriter should document that it only supports Parquet for now (was: DataStreamWriter does not support "json" format)
> DataStreamWriter should document that it only supports Parquet for now
> ----------------------------------------------------------------------
>
> Key: SPARK-17264
> URL: https://issues.apache.org/jira/browse/SPARK-17264
> Project: Spark
> Issue Type: Bug
> Components: Documentation, Input/Output
> Affects Versions: 2.0.0
> Environment: Mac OSX
> Reporter: Bill Reed
> Priority: Trivial
>
> The API documentations for DataStreamWriter.format states "Specifies the underlying output data source. Built-in options include "parquet", "json", etc." but when specifying "json" or "text" for the format. the following exception is thrown:
> Exception in thread "main" java.lang.UnsupportedOperationException: Data source json does not support streamed writing
> at org.apache.spark.sql.execution.datasources.DataSource.createSink(DataSource.scala:273)
> at org.apache.spark.sql.streaming.DataStreamWriter.start(DataStreamWriter.scala:291)
> The only format that works is .format("parquet")
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org