You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by do...@apache.org on 2021/07/16 05:20:22 UTC
[spark] branch branch-3.2 updated: [SPARK-36165][INFRA] Fix SQL doc
generation in GitHub Action
This is an automated email from the ASF dual-hosted git repository.
dongjoon pushed a commit to branch branch-3.2
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.2 by this push:
new b855d38 [SPARK-36165][INFRA] Fix SQL doc generation in GitHub Action
b855d38 is described below
commit b855d380de93adde7c84d1f77c6fc95d615a48f8
Author: Dongjoon Hyun <do...@apache.org>
AuthorDate: Thu Jul 15 11:41:48 2021 -0700
[SPARK-36165][INFRA] Fix SQL doc generation in GitHub Action
### What changes were proposed in this pull request?
This PR aims to fix SQL doc generation in GitHub Action by specifying the mkdocs-installed python version explicitly.
### Why are the changes needed?
Currently, the SQL doc generation is using `spark-submit` and picked up another `Python 3` binaries.
```
Generating SQL configuration table HTML file.
Traceback (most recent call last):
File "/__w/spark/spark/sql/gen-sql-config-docs.py", line 25, in <module>
from mkdocs.structure.pages import markdown
ModuleNotFoundError: No module named 'mkdocs'
```
### Does this PR introduce _any_ user-facing change?
No.
### How was this patch tested?
Pass the GitHub Action linter job.
Closes #33372 from dongjoon-hyun/fix_mkdocs.
Authored-by: Dongjoon Hyun <do...@apache.org>
Signed-off-by: Dongjoon Hyun <do...@apache.org>
(cherry picked from commit d69f9818692c09e39246b875c9cbb2fc8954cf24)
Signed-off-by: Dongjoon Hyun <do...@apache.org>
---
.github/workflows/build_and_test.yml | 1 +
1 file changed, 1 insertion(+)
diff --git a/.github/workflows/build_and_test.yml b/.github/workflows/build_and_test.yml
index 49e105d..62f37d3 100644
--- a/.github/workflows/build_and_test.yml
+++ b/.github/workflows/build_and_test.yml
@@ -312,6 +312,7 @@ jobs:
env:
LC_ALL: C.UTF-8
LANG: C.UTF-8
+ PYSPARK_DRIVER_PYTHON: python3.9
container:
image: dongjoon/apache-spark-github-action-image:20210602
steps:
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org