You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by cloud-fan <gi...@git.apache.org> on 2018/10/25 07:26:29 UTC
[GitHub] spark pull request #22814: [SPARK-25819][SQL] Support parse mode option for ...
Github user cloud-fan commented on a diff in the pull request:
https://github.com/apache/spark/pull/22814#discussion_r228059940
--- Diff: docs/sql-data-sources-avro.md ---
@@ -177,6 +180,18 @@ Data source options of Avro can be set using the `.option` method on `DataFrameR
Currently supported codecs are <code>uncompressed</code>, <code>snappy</code>, <code>deflate</code>, <code>bzip2</code> and <code>xz</code>.<br> If the option is not set, the configuration <code>spark.sql.avro.compression.codec</code> config is taken into account.</td>
<td>write</td>
</tr>
+ <tr>
+ <td><code>mode</code></td>
+ <td>PERMISSIVE</td>
+ <td>The <code>mode</code> option allows to specify parse mode for function <code>from_avro</code>.<br>
+ Currently supported modes are:
+ <ul>
+ <li><code>PERMISSIVE</code>: Corrupt records are processed as null result.</li>
--- End diff --
not null result, but a row with all columns null.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org