[spark] branch master updated: [SPARK-40983][DOC] Remove Hadoop requirements for zstd mentioned in Parquet compression codec

[yu...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

yumwang pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/master by this push:
     new 9c1bb41ca34 [SPARK-40983][DOC] Remove Hadoop requirements for zstd mentioned in Parquet compression codec
9c1bb41ca34 is described below

commit 9c1bb41ca34229c87b463b4941b4e9c829a0e396
Author: Cheng Pan <ch...@apache.org>
AuthorDate: Tue Nov 1 20:32:37 2022 +0800

    [SPARK-40983][DOC] Remove Hadoop requirements for zstd mentioned in Parquet compression codec
    
    ### What changes were proposed in this pull request?
    
    Change the doc to remove Hadoop requirements for zstd mentioned in Parquet compression codec.
    
    ### Why are the changes needed?
    
    This requirement is removed after https://issues.apache.org/jira/browse/PARQUET-1866, and Spark uses Parquet 1.12.3 now.
    
    ### Does this PR introduce _any_ user-facing change?
    
    Yes, doc updated.
    
    ### How was this patch tested?
    
    <img width="1144" alt="image" src="https://user-images.githubusercontent.com/26535726/199180625-4e3a2ee1-3e4d-4d61-8842-f1d5b7b9321d.png">
    
    Closes #38458 from pan3793/SPARK-40983.
    
    Authored-by: Cheng Pan <ch...@apache.org>
    Signed-off-by: Yuming Wang <yu...@ebay.com>
---
 docs/sql-data-sources-parquet.md | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

diff --git a/docs/sql-data-sources-parquet.md b/docs/sql-data-sources-parquet.md
index de339c21ef2..d71d3b4a424 100644
--- a/docs/sql-data-sources-parquet.md
+++ b/docs/sql-data-sources-parquet.md
@@ -484,8 +484,7 @@ Configuration of Parquet can be done using the `setConf` method on `SparkSession
     <code>parquet.compression</code> is specified in the table-specific options/properties, the precedence would be
     <code>compression</code>, <code>parquet.compression</code>, <code>spark.sql.parquet.compression.codec</code>. Acceptable values include:
     none, uncompressed, snappy, gzip, lzo, brotli, lz4, zstd.
-    Note that <code>zstd</code> requires <code>ZStandardCodec</code> to be installed before Hadoop 2.9.0, <code>brotli</code> requires
-    <code>BrotliCodec</code> to be installed.
+    Note that <code>brotli</code> requires <code>BrotliCodec</code> to be installed.
   </td>
   <td>1.1.1</td>
 </tr>


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org