You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2024/08/28 03:33:00 UTC
(spark) tag v3.5.2 created (now 7ef1ead3b933)
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a change to tag v3.5.2
in repository https://gitbox.apache.org/repos/asf/spark.git
at 7ef1ead3b933 (commit)
This tag includes the following new commits:
new 7ef1ead3b933 [SPARK-49402][PYTHON][FOLLOW-UP] Manually load ~/.profile in Spark Connect notebook
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org
(spark) 01/01: [SPARK-49402][PYTHON][FOLLOW-UP] Manually load ~/.profile in Spark Connect notebook
Posted by gu...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to tag v3.5.2
in repository https://gitbox.apache.org/repos/asf/spark.git
commit 7ef1ead3b933942d82349e3bca01404a259af219
Author: Hyukjin Kwon <gu...@apache.org>
AuthorDate: Wed Aug 28 12:25:24 2024 +0900
[SPARK-49402][PYTHON][FOLLOW-UP] Manually load ~/.profile in Spark Connect notebook
This is a followup of https://github.com/apache/spark/pull/47883 that adds manual `source ~/.profile`.
Ever since we switched to `Dockerfile`, none of `./profile`, `/.bashrc`, `./bash_profile`, etc seems working. There are a couple of related issues in Jupyter but I cannot figure it out.
This is the only cell it needs the environment variable so decided to simply work around.
No.
Manually tested.
No.
Closes #47902 from HyukjinKwon/SPARK-49402-followup.
Authored-by: Hyukjin Kwon <gu...@apache.org>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit 1c9cde59ba65dc4444cbb85471965e21d1e1e253)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit df07aa717cfe9835ba668954ef12bdcc61c1559e)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit dcfefd07244068af2d24de02e5bde37047644d88)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit 841c7e5ccc55120aa71001d1af7378b0fb4d433d)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
python/docs/source/getting_started/quickstart_connect.ipynb | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/python/docs/source/getting_started/quickstart_connect.ipynb b/python/docs/source/getting_started/quickstart_connect.ipynb
index 15a2ab749d2a..0397a0ebf507 100644
--- a/python/docs/source/getting_started/quickstart_connect.ipynb
+++ b/python/docs/source/getting_started/quickstart_connect.ipynb
@@ -28,7 +28,9 @@
"metadata": {},
"outputs": [],
"source": [
- "!$HOME/sbin/start-connect-server.sh --packages org.apache.spark:spark-connect_2.12:$SPARK_VERSION"
+ "%%bash\n",
+ "source ~/.profile # Make sure environment variables are loaded.\n",
+ "$HOME/sbin/start-connect-server.sh --packages org.apache.spark:spark-connect_2.12:$SPARK_VERSION"
]
},
{
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org