You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@spark.apache.org by gu...@apache.org on 2022/05/12 00:08:05 UTC
[spark] branch branch-3.3 updated: [SPARK-34827][PYTHON][DOC] Remove outdated statements on distributed-sequence default index
This is an automated email from the ASF dual-hosted git repository.
gurwls223 pushed a commit to branch branch-3.3
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.3 by this push:
new f75c00da3cf [SPARK-34827][PYTHON][DOC] Remove outdated statements on distributed-sequence default index
f75c00da3cf is described below
commit f75c00da3cf01e63d93cedbe480198413af41455
Author: Xinrong Meng <xi...@databricks.com>
AuthorDate: Thu May 12 09:07:11 2022 +0900
[SPARK-34827][PYTHON][DOC] Remove outdated statements on distributed-sequence default index
Remove outdated statements on distributed-sequence default index.
Since distributed-sequence default index is updated to be enforced only while execution, there are stale statements in documents to be removed.
No. Doc change only.
Manual tests.
Closes #36513 from xinrong-databricks/defaultIndexDoc.
Authored-by: Xinrong Meng <xi...@databricks.com>
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
(cherry picked from commit cec1e7b4e68deac321f409d424a3acdcd4cb91be)
Signed-off-by: Hyukjin Kwon <gu...@apache.org>
---
python/docs/source/user_guide/pandas_on_spark/options.rst | 4 +---
1 file changed, 1 insertion(+), 3 deletions(-)
diff --git a/python/docs/source/user_guide/pandas_on_spark/options.rst b/python/docs/source/user_guide/pandas_on_spark/options.rst
index c0d9b18c085..67b8f6841f5 100644
--- a/python/docs/source/user_guide/pandas_on_spark/options.rst
+++ b/python/docs/source/user_guide/pandas_on_spark/options.rst
@@ -186,9 +186,7 @@ This is conceptually equivalent to the PySpark example as below:
**distributed-sequence** (default): It implements a sequence that increases one by one, by group-by and
group-map approach in a distributed manner. It still generates the sequential index globally.
If the default index must be the sequence in a large dataset, this
-index has to be used.
-Note that if more data are added to the data source after creating this index,
-then it does not guarantee the sequential index. See the example below:
+index has to be used. See the example below:
.. code-block:: python
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@spark.apache.org
For additional commands, e-mail: commits-help@spark.apache.org