You are viewing a plain text version of this content. The canonical link for it is here.
Posted to reviews@spark.apache.org by cloud-fan <gi...@git.apache.org> on 2018/10/25 07:26:29 UTC

[GitHub] spark pull request #22814: [SPARK-25819][SQL] Support parse mode option for ...

Github user cloud-fan commented on a diff in the pull request:

    https://github.com/apache/spark/pull/22814#discussion_r228059940
  
    --- Diff: docs/sql-data-sources-avro.md ---
    @@ -177,6 +180,18 @@ Data source options of Avro can be set using the `.option` method on `DataFrameR
       Currently supported codecs are <code>uncompressed</code>, <code>snappy</code>, <code>deflate</code>, <code>bzip2</code> and <code>xz</code>.<br> If the option is not set, the configuration <code>spark.sql.avro.compression.codec</code> config is taken into account.</td>
         <td>write</td>
       </tr>
    +  <tr>
    +    <td><code>mode</code></td>
    +    <td>PERMISSIVE</td>
    +    <td>The <code>mode</code> option allows to specify parse mode for function <code>from_avro</code>.<br>
    +      Currently supported modes are:
    +      <ul>
    +        <li><code>PERMISSIVE</code>: Corrupt records are processed as null result.</li>
    --- End diff --
    
    not null result, but a row with all columns null.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org