You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by ya...@apache.org on 2024/08/09 16:39:45 UTC

(spark) branch branch-3.5 updated: [SPARK-49182][DOCS][PYTHON] Stop publish site/docs/{version}/api/python/_sources dir

This is an automated email from the ASF dual-hosted git repository.

yao pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git


The following commit(s) were added to refs/heads/branch-3.5 by this push:
     new 0e2d75766021 [SPARK-49182][DOCS][PYTHON] Stop publish site/docs/{version}/api/python/_sources dir
0e2d75766021 is described below

commit 0e2d757660212d679118e587f921e640720f9245
Author: Kent Yao <ya...@apache.org>
AuthorDate: Sat Aug 10 00:34:34 2024 +0800

    [SPARK-49182][DOCS][PYTHON] Stop publish site/docs/{version}/api/python/_sources dir
    
    Remove dangling links like:
    https://spark.apache.org/docs/3.5.1/api/python/_sources/user_guide/sql/index.rst.txt
    
    reduce the size of documentation publication
    
    ```
    $ du -h 3.5.1/api/python/_sources
     68K    3.5.1/api/python/_sources/development
    148K    3.5.1/api/python/_sources/user_guide/pandas_on_spark
     40K    3.5.1/api/python/_sources/user_guide/sql
    208K    3.5.1/api/python/_sources/user_guide
     20K    3.5.1/api/python/_sources/migration_guide
    2.9M    3.5.1/api/python/_sources/reference/pyspark.sql/api
    3.0M    3.5.1/api/python/_sources/reference/pyspark.sql
    180K    3.5.1/api/python/_sources/reference/pyspark.ss/api
    196K    3.5.1/api/python/_sources/reference/pyspark.ss
    2.5M    3.5.1/api/python/_sources/reference/api
    3.0M    3.5.1/api/python/_sources/reference/pyspark.pandas/api
    3.1M    3.5.1/api/python/_sources/reference/pyspark.pandas
    8.8M    3.5.1/api/python/_sources/reference
    4.1M    3.5.1/api/python/_sources/getting_started
     13M    3.5.1/api/python/_sources
    ```
    
    NO
    
    build locally
    
    ```
    ls api/python
    _images         _static         getting_started migration_guide reference       searchindex.js
    _modules        development     index.html      objects.inv     search.html     user_guide
    ```
    
    NO
    
    Closes #47686 from yaooqinn/SPARK-49182.
    
    Authored-by: Kent Yao <ya...@apache.org>
    Signed-off-by: Kent Yao <ya...@apache.org>
    (cherry picked from commit eb859def440299f269f38f30d3e9e465bd5cec26)
    Signed-off-by: Kent Yao <ya...@apache.org>
---
 docs/_plugins/copy_api_dirs.rb | 1 +
 1 file changed, 1 insertion(+)

diff --git a/docs/_plugins/copy_api_dirs.rb b/docs/_plugins/copy_api_dirs.rb
index 28d5e0d82c93..bafc47997455 100644
--- a/docs/_plugins/copy_api_dirs.rb
+++ b/docs/_plugins/copy_api_dirs.rb
@@ -136,6 +136,7 @@ if not (ENV['SKIP_API'] == '1')
     mkdir_p "api/python"
 
     puts "cp -r ../python/docs/build/html/. api/python"
+    rm_r("../python/docs/build/html/_sources")
     cp_r("../python/docs/build/html/.", "api/python")
   end
 


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org