You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2024/08/09 13:27:00 UTC
(datafusion-python) branch asf-staging updated (df7dce8 -> ebcec09)
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a change to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/datafusion-python.git
discard df7dce8 Publish built docs triggered by 2205e058f01f4f577846833465258bfab12b8d15
new ebcec09 Publish built docs triggered by b6f06f760f8f4048a91538cbde15a4ab813f62ca
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (df7dce8)
\
N -- N -- N refs/heads/asf-staging (ebcec09)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
_sources/autoapi/datafusion/index.rst.txt | 2 +-
_sources/autoapi/datafusion/udf/index.rst.txt | 2 +-
.../common-operations/udf-and-udfa.rst.txt | 5 ++-
autoapi/datafusion/index.html | 2 +-
autoapi/datafusion/udf/index.html | 2 +-
searchindex.js | 2 +-
user-guide/common-operations/aggregations.html | 18 ++++-----
user-guide/common-operations/basic-info.html | 46 +++++++++++-----------
user-guide/common-operations/functions.html | 22 +++++------
user-guide/common-operations/joins.html | 6 +--
.../common-operations/select-and-filter.html | 2 +-
user-guide/common-operations/udf-and-udfa.html | 5 ++-
user-guide/common-operations/windows.html | 30 +++++++-------
13 files changed, 73 insertions(+), 71 deletions(-)
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org
(datafusion-python) 01/01: Publish built docs triggered by b6f06f760f8f4048a91538cbde15a4ab813f62ca
Posted by gi...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/datafusion-python.git
commit ebcec092c3b3dcb8d5f48b72063d82eb681817ad
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Fri Aug 9 13:26:55 2024 +0000
Publish built docs triggered by b6f06f760f8f4048a91538cbde15a4ab813f62ca
---
.../autoapi/datafusion/functions/index.rst.txt | 2 +-
_sources/autoapi/datafusion/index.rst.txt | 2 +-
_sources/autoapi/datafusion/udf/index.rst.txt | 2 +-
.../common-operations/udf-and-udfa.rst.txt | 5 ++--
autoapi/datafusion/functions/index.html | 2 +-
autoapi/datafusion/index.html | 2 +-
autoapi/datafusion/udf/index.html | 2 +-
searchindex.js | 2 +-
user-guide/common-operations/aggregations.html | 34 +++++++++++-----------
user-guide/common-operations/basic-info.html | 34 +++++++++++-----------
user-guide/common-operations/functions.html | 22 +++++++-------
user-guide/common-operations/joins.html | 6 ++--
.../common-operations/select-and-filter.html | 2 +-
user-guide/common-operations/udf-and-udfa.html | 5 ++--
user-guide/common-operations/windows.html | 30 +++++++++----------
15 files changed, 77 insertions(+), 75 deletions(-)
diff --git a/_sources/autoapi/datafusion/functions/index.rst.txt b/_sources/autoapi/datafusion/functions/index.rst.txt
index bc1173f..c3ed58e 100644
--- a/_sources/autoapi/datafusion/functions/index.rst.txt
+++ b/_sources/autoapi/datafusion/functions/index.rst.txt
@@ -277,7 +277,7 @@ Module Contents
Returns the approximate median value.
-.. py:function:: approx_percentile_cont(expression: datafusion.expr.Expr, percentile: datafusion.expr.Expr, distinct: bool = False) -> datafusion.expr.Expr
+.. py:function:: approx_percentile_cont(expression: datafusion.expr.Expr, percentile: datafusion.expr.Expr, num_centroids: datafusion.expr.Expr | None = None, distinct: bool = False) -> datafusion.expr.Expr
Returns the value that is approximately at a given percentile of ``expr``.
diff --git a/_sources/autoapi/datafusion/index.rst.txt b/_sources/autoapi/datafusion/index.rst.txt
index 7e02ef7..a804238 100644
--- a/_sources/autoapi/datafusion/index.rst.txt
+++ b/_sources/autoapi/datafusion/index.rst.txt
@@ -93,7 +93,7 @@ Package Contents
- .. py:method:: merge(states: pyarrow.Array) -> None
+ .. py:method:: merge(states: List[pyarrow.Array]) -> None
:abstractmethod:
diff --git a/_sources/autoapi/datafusion/udf/index.rst.txt b/_sources/autoapi/datafusion/udf/index.rst.txt
index f9c493e..88ccc9c 100644
--- a/_sources/autoapi/datafusion/udf/index.rst.txt
+++ b/_sources/autoapi/datafusion/udf/index.rst.txt
@@ -45,7 +45,7 @@ Module Contents
- .. py:method:: merge(states: pyarrow.Array) -> None
+ .. py:method:: merge(states: List[pyarrow.Array]) -> None
:abstractmethod:
diff --git a/_sources/user-guide/common-operations/udf-and-udfa.rst.txt b/_sources/user-guide/common-operations/udf-and-udfa.rst.txt
index 54c6857..e9c142f 100644
--- a/_sources/user-guide/common-operations/udf-and-udfa.rst.txt
+++ b/_sources/user-guide/common-operations/udf-and-udfa.rst.txt
@@ -50,6 +50,7 @@ Additionally the :py:func:`~datafusion.udf.AggregateUDF.udaf` function allows yo
import pyarrow.compute
import datafusion
from datafusion import col, udaf, Accumulator
+ from typing import List
class MyAccumulator(Accumulator):
"""
@@ -62,9 +63,9 @@ Additionally the :py:func:`~datafusion.udf.AggregateUDF.udaf` function allows yo
# not nice since pyarrow scalars can't be summed yet. This breaks on `None`
self._sum = pyarrow.scalar(self._sum.as_py() + pyarrow.compute.sum(values).as_py())
- def merge(self, states: pyarrow.Array) -> None:
+ def merge(self, states: List[pyarrow.Array]) -> None:
# not nice since pyarrow scalars can't be summed yet. This breaks on `None`
- self._sum = pyarrow.scalar(self._sum.as_py() + pyarrow.compute.sum(states).as_py())
+ self._sum = pyarrow.scalar(self._sum.as_py() + pyarrow.compute.sum(states[0]).as_py())
def state(self) -> pyarrow.Array:
return pyarrow.array([self._sum.as_py()])
diff --git a/autoapi/datafusion/functions/index.html b/autoapi/datafusion/functions/index.html
index 1169dcb..03961f3 100644
--- a/autoapi/datafusion/functions/index.html
+++ b/autoapi/datafusion/functions/index.html
@@ -3053,7 +3053,7 @@
<dl class="py function">
<dt class="sig sig-object py" id="datafusion.functions.approx_percentile_cont">
-<span class="sig-prename descclassname"><span class="pre">datafusion.functions.</span></span><span class="sig-name descname"><span class="pre">approx_percentile_cont</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">expression</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><a class="reference internal" href="../expr/index.html#datafusion.expr.Expr" title="datafusion.expr.Expr"><span [...]
+<span class="sig-prename descclassname"><span class="pre">datafusion.functions.</span></span><span class="sig-name descname"><span class="pre">approx_percentile_cont</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">expression</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><a class="reference internal" href="../expr/index.html#datafusion.expr.Expr" title="datafusion.expr.Expr"><span [...]
<dd><p>Returns the value that is approximately at a given percentile of <code class="docutils literal notranslate"><span class="pre">expr</span></code>.</p>
</dd></dl>
diff --git a/autoapi/datafusion/index.html b/autoapi/datafusion/index.html
index 9af1600..4d56989 100644
--- a/autoapi/datafusion/index.html
+++ b/autoapi/datafusion/index.html
@@ -1563,7 +1563,7 @@ See <a class="reference external" href="https://datafusion.apache.org/python">ht
<dl class="py method">
<dt class="sig sig-object py" id="datafusion.Accumulator.merge">
-<em class="property"><span class="pre">abstract</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">merge</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">states</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">pyarrow.Array</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">! [...]
+<em class="property"><span class="pre">abstract</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">merge</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">states</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">List</span><span class="p"><span class="pre">[</span></span><span class="pre">pyarrow.Array</span><span class="p"><span class [...]
<dd><p>Merge a set of states.</p>
</dd></dl>
diff --git a/autoapi/datafusion/udf/index.html b/autoapi/datafusion/udf/index.html
index e1977e3..62ff2e9 100644
--- a/autoapi/datafusion/udf/index.html
+++ b/autoapi/datafusion/udf/index.html
@@ -614,7 +614,7 @@
<dl class="py method">
<dt class="sig sig-object py" id="datafusion.udf.Accumulator.merge">
-<em class="property"><span class="pre">abstract</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">merge</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">states</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">pyarrow.Array</span></span></em><span class="sig-paren">)</span> <span class="sig-return"><span class="sig-return-icon">! [...]
+<em class="property"><span class="pre">abstract</span><span class="w"> </span></em><span class="sig-name descname"><span class="pre">merge</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">states</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">List</span><span class="p"><span class="pre">[</span></span><span class="pre">pyarrow.Array</span><span class="p"><span class [...]
<dd><p>Merge a set of states.</p>
</dd></dl>
diff --git a/searchindex.js b/searchindex.js
index ca9ee28..1fce981 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"API Reference": [[13, null]], "Aggregation": [[17, null]], "Attributes": [[3, "attributes"], [5, "attributes"], [9, "attributes"], [12, "attributes"]], "Avro": [[28, null]], "Basic Operations": [[18, null]], "Boolean": [[19, "boolean"]], "CSV": [[29, null]], "Classes": [[0, "classes"], [1, "classes"], [2, "classes"], [3, "classes"], [5, "classes"], [6, "classes"], [8, "classes"], [10, "classes"], [11, "classes"], [12, "classes"]], "Column": [[19, "column"] [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"API Reference": [[13, null]], "Aggregation": [[17, null]], "Attributes": [[3, "attributes"], [5, "attributes"], [9, "attributes"], [12, "attributes"]], "Avro": [[28, null]], "Basic Operations": [[18, null]], "Boolean": [[19, "boolean"]], "CSV": [[29, null]], "Classes": [[0, "classes"], [1, "classes"], [2, "classes"], [3, "classes"], [5, "classes"], [6, "classes"], [8, "classes"], [10, "classes"], [11, "classes"], [12, "classes"]], "Column": [[19, "column"] [...]
\ No newline at end of file
diff --git a/user-guide/common-operations/aggregations.html b/user-guide/common-operations/aggregations.html
index 859bb27..9a5846b 100644
--- a/user-guide/common-operations/aggregations.html
+++ b/user-guide/common-operations/aggregations.html
@@ -395,7 +395,7 @@ For performing an aggregation, DataFusion provides the <a class="reference inter
<span class="o">+----------------------------+--------------------------+------------------------------------------------+</span>
<span class="o">|</span> <span class="n">approx_distinct</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">c</span><span class="p">)</span> <span class="o">|</span> <span class="n">approx_median</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">d</span><span class="p">)</span> <span class="o">|</span> <span class="n">approx_percentile_cont</span><span class="p">(</span><span class="n">foo_ [...]
<span class="o">+----------------------------+--------------------------+------------------------------------------------+</span>
-<span class="o">|</span> <span class="mi">8</span> <span class="o">|</span> <span class="mf">0.6805277738625248</span> <span class="o">|</span> <span class="mf">0.6805277738625248</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">8</span> <span class="o">|</span> <span class="mf">0.3536379725006692</span> <span class="o">|</span> <span class="mf">0.3536379725006692</span> <span class="o">|</span>
<span class="o">+----------------------------+--------------------------+------------------------------------------------+</span>
</pre></div>
</div>
@@ -404,28 +404,28 @@ the <code class="code docutils literal notranslate"><span class="pre">group_by</
<div class="highlight-ipython notranslate"><div class="highlight"><pre><span></span><span class="n">In</span> <span class="p">[</span><span class="mi">12</span><span class="p">]:</span> <span class="n">df</span><span class="o">.</span><span class="n">aggregate</span><span class="p">([</span><span class="n">col_a</span><span class="p">],</span> <span class="p">[</span><span class="n">f</span><span class="o">.</span><span class="n">sum</span><span class="p">(</span><span class="n">col_c</s [...]
<span class="n">Out</span><span class="p">[</span><span class="mi">12</span><span class="p">]:</span>
<span class="n">DataFrame</span><span class="p">()</span>
-<span class="o">+-----+----------------+--------------------+----------------------+</span>
-<span class="o">|</span> <span class="n">a</span> <span class="o">|</span> <span class="nb">sum</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">c</span><span class="p">)</span> <span class="o">|</span> <span class="n">MAX</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">d</span><span class="p">)</span> <span class="o">|</span> <span class="n">MIN</span><span class="p">(</span><spa [...]
-<span class="o">+-----+----------------+--------------------+----------------------+</span>
-<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span> <span class="mi">253</span> <span class="o">|</span> <span class="mf">0.8227362212084992</span> <span class="o">|</span> <span class="mf">0.025561060814338177</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span> <span class="mi">150</span> <span class="o">|</span> <span class="mf">0.8310863643634276</span> <span class="o">|</span> <span class="mf">0.5186658360108796</span> <span class="o">|</span>
-<span class="o">+-----+----------------+--------------------+----------------------+</span>
+<span class="o">+-----+----------------+--------------------+---------------------+</span>
+<span class="o">|</span> <span class="n">a</span> <span class="o">|</span> <span class="nb">sum</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">c</span><span class="p">)</span> <span class="o">|</span> <span class="n">MAX</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">d</span><span class="p">)</span> <span class="o">|</span> <span class="n">MIN</span><span class="p">(</span><spa [...]
+<span class="o">+-----+----------------+--------------------+---------------------+</span>
+<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span> <span class="mi">278</span> <span class="o">|</span> <span class="mf">0.6164159413557458</span> <span class="o">|</span> <span class="mf">0.3425389197765689</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span> <span class="mi">87</span> <span class="o">|</span> <span class="mf">0.3300418727058926</span> <span class="o">|</span> <span class="mf">0.18174585750269157</span> <span class="o">|</span>
+<span class="o">+-----+----------------+--------------------+---------------------+</span>
</pre></div>
</div>
<p>More than one column can be used for grouping</p>
<div class="highlight-ipython notranslate"><div class="highlight"><pre><span></span><span class="n">In</span> <span class="p">[</span><span class="mi">13</span><span class="p">]:</span> <span class="n">df</span><span class="o">.</span><span class="n">aggregate</span><span class="p">([</span><span class="n">col_a</span><span class="p">,</span> <span class="n">col_b</span><span class="p">],</span> <span class="p">[</span><span class="n">f</span><span class="o">.</span><span class="n">sum</ [...]
<span class="n">Out</span><span class="p">[</span><span class="mi">13</span><span class="p">]:</span>
<span class="n">DataFrame</span><span class="p">()</span>
-<span class="o">+-----+-------+----------------+---------------------+----------------------+</span>
-<span class="o">|</span> <span class="n">a</span> <span class="o">|</span> <span class="n">b</span> <span class="o">|</span> <span class="nb">sum</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">c</span><span class="p">)</span> <span class="o">|</span> <span class="n">MAX</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">d</span><span class="p">)</span> <span class="o">|</span> [...]
-<span class="o">+-----+-------+----------------+---------------------+----------------------+</span>
-<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span> <span class="n">one</span> <span class="o">|</span> <span class="mi">25</span> <span class="o">|</span> <span class="mf">0.8227362212084992</span> <span class="o">|</span> <span class="mf">0.7636848745429012</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span> <span class="n">one</span> <span class="o">|</span> <span class="mi">86</span> <span class="o">|</span> <span class="mf">0.8310863643634276</span> <span class="o">|</span> <span class="mf">0.8310863643634276</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span> <span class="n">two</span> <span class="o">|</span> <span class="mi">139</span> <span class="o">|</span> <span class="mf">0.6612533874159027</span> <span class="o">|</span> <span class="mf">0.025561060814338177</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span> <span class="n">two</span> <span class="o">|</span> <span class="mi">27</span> <span class="o">|</span> <span class="mf">0.7061356456442744</span> <span class="o">|</span> <span class="mf">0.7061356456442744</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span> <span class="n">three</span> <span class="o">|</span> <span class="mi">37</span> <span class="o">|</span> <span class="mf">0.5186658360108796</span> <span class="o">|</span> <span class="mf">0.5186658360108796</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span> <span class="n">three</span> <span class="o">|</span> <span class="mi">89</span> <span class="o">|</span> <span class="mf">0.07239486454812849</span> <span class="o">|</span> <span class="mf">0.07239486454812849</span> <span class="o">|</span>
-<span class="o">+-----+-------+----------------+---------------------+----------------------+</span>
+<span class="o">+-----+-------+----------------+---------------------+---------------------+</span>
+<span class="o">|</span> <span class="n">a</span> <span class="o">|</span> <span class="n">b</span> <span class="o">|</span> <span class="nb">sum</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">c</span><span class="p">)</span> <span class="o">|</span> <span class="n">MAX</span><span class="p">(</span><span class="n">foo_bar</span><span class="o">.</span><span class="n">d</span><span class="p">)</span> <span class="o">|</span> [...]
+<span class="o">+-----+-------+----------------+---------------------+---------------------+</span>
+<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span> <span class="n">one</span> <span class="o">|</span> <span class="mi">167</span> <span class="o">|</span> <span class="mf">0.5584709860138927</span> <span class="o">|</span> <span class="mf">0.380612635241215</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span> <span class="n">one</span> <span class="o">|</span> <span class="mi">50</span> <span class="o">|</span> <span class="mf">0.23064609462748464</span> <span class="o">|</span> <span class="mf">0.23064609462748464</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span> <span class="n">two</span> <span class="o">|</span> <span class="mi">62</span> <span class="o">|</span> <span class="mf">0.6164159413557458</span> <span class="o">|</span> <span class="mf">0.3425389197765689</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span> <span class="n">two</span> <span class="o">|</span> <span class="mi">12</span> <span class="o">|</span> <span class="mf">0.3300418727058926</span> <span class="o">|</span> <span class="mf">0.3300418727058926</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">bar</span> <span class="o">|</span> <span class="n">three</span> <span class="o">|</span> <span class="mi">25</span> <span class="o">|</span> <span class="mf">0.18174585750269157</span> <span class="o">|</span> <span class="mf">0.18174585750269157</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">foo</span> <span class="o">|</span> <span class="n">three</span> <span class="o">|</span> <span class="mi">49</span> <span class="o">|</span> <span class="mf">0.45043757073875235</span> <span class="o">|</span> <span class="mf">0.45043757073875235</span> <span class="o">|</span>
+<span class="o">+-----+-------+----------------+---------------------+---------------------+</span>
</pre></div>
</div>
</section>
diff --git a/user-guide/common-operations/basic-info.html b/user-guide/common-operations/basic-info.html
index 1f09f8c..1571024 100644
--- a/user-guide/common-operations/basic-info.html
+++ b/user-guide/common-operations/basic-info.html
@@ -379,11 +379,11 @@
<span class="o">+-----+---------+--------+--------+</span>
<span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span> <span class="n">names</span> <span class="o">|</span> <span class="n">random</span> <span class="o">|</span> <span class="n">groups</span> <span class="o">|</span>
<span class="o">+-----+---------+--------+--------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">python</span> <span class="o">|</span> <span class="mi">568</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mi">472</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span> <span class="n">java</span> <span class="o">|</span> <span class="mi">946</span> <span class="o">|</span> <span class="n">B</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">4</span> <span class="o">|</span> <span class="n">haskell</span> <span class="o">|</span> <span class="mi">42</span> <span class="o">|</span> <span class="n">C</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span class="mi">909</span> <span class="o">|</span> <span class="n">B</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">python</span> <span class="o">|</span> <span class="mi">172</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mi">857</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span> <span class="n">java</span> <span class="o">|</span> <span class="mi">377</span> <span class="o">|</span> <span class="n">B</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">4</span> <span class="o">|</span> <span class="n">haskell</span> <span class="o">|</span> <span class="mi">36</span> <span class="o">|</span> <span class="n">C</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span class="mi">924</span> <span class="o">|</span> <span class="n">B</span> <span class="o">|</span>
<span class="o">+-----+---------+--------+--------+</span>
</pre></div>
</div>
@@ -394,8 +394,8 @@
<span class="o">+-----+--------+--------+--------+</span>
<span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span> <span class="n">names</span> <span class="o">|</span> <span class="n">random</span> <span class="o">|</span> <span class="n">groups</span> <span class="o">|</span>
<span class="o">+-----+--------+--------+--------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">python</span> <span class="o">|</span> <span class="mi">568</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mi">472</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">python</span> <span class="o">|</span> <span class="mi">172</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mi">857</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
<span class="o">+-----+--------+--------+--------+</span>
</pre></div>
</div>
@@ -413,11 +413,11 @@ passing them to an Arrow table, and then converting them to a pandas DataFrame.<
<div class="highlight-ipython notranslate"><div class="highlight"><pre><span></span><span class="n">In</span> <span class="p">[</span><span class="mi">8</span><span class="p">]:</span> <span class="n">df</span><span class="o">.</span><span class="n">to_pandas</span><span class="p">()</span>
<span class="n">Out</span><span class="p">[</span><span class="mi">8</span><span class="p">]:</span>
<span class="n">nrs</span> <span class="n">names</span> <span class="n">random</span> <span class="n">groups</span>
-<span class="mi">0</span> <span class="mi">1</span> <span class="n">python</span> <span class="mi">568</span> <span class="n">A</span>
-<span class="mi">1</span> <span class="mi">2</span> <span class="n">ruby</span> <span class="mi">472</span> <span class="n">A</span>
-<span class="mi">2</span> <span class="mi">3</span> <span class="n">java</span> <span class="mi">946</span> <span class="n">B</span>
-<span class="mi">3</span> <span class="mi">4</span> <span class="n">haskell</span> <span class="mi">42</span> <span class="n">C</span>
-<span class="mi">4</span> <span class="mi">5</span> <span class="n">go</span> <span class="mi">909</span> <span class="n">B</span>
+<span class="mi">0</span> <span class="mi">1</span> <span class="n">python</span> <span class="mi">172</span> <span class="n">A</span>
+<span class="mi">1</span> <span class="mi">2</span> <span class="n">ruby</span> <span class="mi">857</span> <span class="n">A</span>
+<span class="mi">2</span> <span class="mi">3</span> <span class="n">java</span> <span class="mi">377</span> <span class="n">B</span>
+<span class="mi">3</span> <span class="mi">4</span> <span class="n">haskell</span> <span class="mi">36</span> <span class="n">C</span>
+<span class="mi">4</span> <span class="mi">5</span> <span class="n">go</span> <span class="mi">924</span> <span class="n">B</span>
</pre></div>
</div>
<p><a class="reference internal" href="../../autoapi/datafusion/dataframe/index.html#datafusion.dataframe.DataFrame.describe" title="datafusion.dataframe.DataFrame.describe"><code class="xref py py-func docutils literal notranslate"><span class="pre">describe()</span></code></a> shows a quick statistic summary of your data:</p>
@@ -429,11 +429,11 @@ passing them to an Arrow table, and then converting them to a pandas DataFrame.<
<span class="o">+------------+--------------------+-------+-------------------+--------+</span>
<span class="o">|</span> <span class="n">count</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="mi">5</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">null_count</span> <span class="o">|</span> <span class="mf">0.0</span> <span class="o">|</span> <span class="mi">0</span> <span class="o">|</span> <span class="mf">0.0</span> <span class="o">|</span> <span class="mi">0</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">mean</span> <span class="o">|</span> <span class="mf">3.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">587.4</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">std</span> <span class="o">|</span> <span class="mf">1.5811388300841898</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">368.5021031147583</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
-<span class="o">|</span> <span class="nb">min</span> <span class="o">|</span> <span class="mf">1.0</span> <span class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span class="mf">42.0</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="nb">max</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mf">946.0</span> <span class="o">|</span> <span class="n">C</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">median</span> <span class="o">|</span> <span class="mf">3.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">568.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">mean</span> <span class="o">|</span> <span class="mf">3.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">473.2</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">std</span> <span class="o">|</span> <span class="mf">1.5811388300841898</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">400.5130459797783</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="nb">min</span> <span class="o">|</span> <span class="mf">1.0</span> <span class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span class="mf">36.0</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="nb">max</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mf">924.0</span> <span class="o">|</span> <span class="n">C</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">median</span> <span class="o">|</span> <span class="mf">3.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">377.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
<span class="o">+------------+--------------------+-------+-------------------+--------+</span>
</pre></div>
</div>
diff --git a/user-guide/common-operations/functions.html b/user-guide/common-operations/functions.html
index dc9f538..4020d9c 100644
--- a/user-guide/common-operations/functions.html
+++ b/user-guide/common-operations/functions.html
@@ -400,7 +400,7 @@ In here we will cover some of the more popular use cases. If you want to view al
<span class="o">...</span><span class="p">:</span> <span class="s2">"pokemon.csv"</span><span class="p">,</span>
<span class="o">...</span><span class="p">:</span> <span class="p">)</span>
<span class="o">...</span><span class="p">:</span>
-<span class="n">Out</span><span class="p">[</span><span class="mi">3</span><span class="p">]:</span> <span class="p">(</span><span class="s1">'pokemon.csv'</span><span class="p">,</span> <span class="o"><</span><span class="n">http</span><span class="o">.</span><span class="n">client</span><span class="o">.</span><span class="n">HTTPMessage</span> <span class="n">at</span> <span class="mh">0x7fe897a56750</span><span class="o">></span><span class="p">)</span>
+<span class="n">Out</span><span class="p">[</span><span class="mi">3</span><span class="p">]:</span> <span class="p">(</span><span class="s1">'pokemon.csv'</span><span class="p">,</span> <span class="o"><</span><span class="n">http</span><span class="o">.</span><span class="n">client</span><span class="o">.</span><span class="n">HTTPMessage</span> <span class="n">at</span> <span class="mh">0x7f5c2904ac90</span><span class="o">></span><span class="p">)</span>
<span class="n">In</span> <span class="p">[</span><span class="mi">4</span><span class="p">]:</span> <span class="n">ctx</span> <span class="o">=</span> <span class="n">SessionContext</span><span class="p">()</span>
@@ -474,16 +474,16 @@ In here we will cover some of the more popular use cases. If you want to view al
<span class="o">+--------------------------------+</span>
<span class="o">|</span> <span class="n">now</span><span class="p">()</span> <span class="o">|</span>
<span class="o">+--------------------------------+</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">06</span><span class="n">T14</span><span class="p">:</span><span class="mi">34</span><span class="p">:</span><span class="mf">13.206559161</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2024</span><span class="o">-</span><span class="mi">08</span><span class="o">-</span><span class="mi">09</span><span class="n">T13</span><span class="p">:</span><span class="mi">26</span><span class="p">:</span><span class="mf">50.783602444</span><span class="n">Z</span> <span class="o">|</span>
<span class="o">+--------------------------------+</span>
</pre></div>
</div>
diff --git a/user-guide/common-operations/joins.html b/user-guide/common-operations/joins.html
index 592a42d..d01c31b 100644
--- a/user-guide/common-operations/joins.html
+++ b/user-guide/common-operations/joins.html
@@ -428,8 +428,8 @@ will be included in the resulting DataFrame.</p>
<span class="o">+-------------+----------+----+-----------+</span>
<span class="o">|</span> <span class="n">customer_id</span> <span class="o">|</span> <span class="n">customer</span> <span class="o">|</span> <span class="nb">id</span> <span class="o">|</span> <span class="n">name</span> <span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Alice</span> <span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">CityCabs</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">Bob</span> <span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">MetroRide</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Alice</span> <span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">CityCabs</span> <span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
</pre></div>
</div>
@@ -447,9 +447,9 @@ values for the corresponding columns.</p>
<span class="o">+-------------+----------+----+-----------+</span>
<span class="o">|</span> <span class="n">customer_id</span> <span class="o">|</span> <span class="n">customer</span> <span class="o">|</span> <span class="nb">id</span> <span class="o">|</span> <span class="n">name</span> <span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Alice</span> <span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">CityCabs</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">Bob</span> <span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">MetroRide</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span> <span class="n">Charlie</span> <span class="o">|</span> <span class="o">|</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Alice</span> <span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">CityCabs</span> <span class="o">|</span>
<span class="o">+-------------+----------+----+-----------+</span>
</pre></div>
</div>
@@ -482,8 +482,8 @@ omitting duplicates with multiple matches in the right table.</p>
<span class="o">+-------------+----------+</span>
<span class="o">|</span> <span class="n">customer_id</span> <span class="o">|</span> <span class="n">customer</span> <span class="o">|</span>
<span class="o">+-------------+----------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Alice</span> <span class="o">|</span>
<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">Bob</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Alice</span> <span class="o">|</span>
<span class="o">+-------------+----------+</span>
</pre></div>
</div>
diff --git a/user-guide/common-operations/select-and-filter.html b/user-guide/common-operations/select-and-filter.html
index e0a8cbc..9d02b06 100644
--- a/user-guide/common-operations/select-and-filter.html
+++ b/user-guide/common-operations/select-and-filter.html
@@ -368,7 +368,7 @@
<span class="n">In</span> <span class="p">[</span><span class="mi">3</span><span class="p">]:</span> <span class="n">urllib</span><span class="o">.</span><span class="n">request</span><span class="o">.</span><span class="n">urlretrieve</span><span class="p">(</span><span class="s2">"https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2021-01.parquet"</span><span class="p">,</span>
<span class="o">...</span><span class="p">:</span> <span class="s2">"yellow_trip_data.parquet"</span><span class="p">)</span>
<span class="o">...</span><span class="p">:</span>
-<span class="n">Out</span><span class="p">[</span><span class="mi">3</span><span class="p">]:</span> <span class="p">(</span><span class="s1">'yellow_trip_data.parquet'</span><span class="p">,</span> <span class="o"><</span><span class="n">http</span><span class="o">.</span><span class="n">client</span><span class="o">.</span><span class="n">HTTPMessage</span> <span class="n">at</span> <span class="mh">0x7fe897126390</span><span class="o">></span><span class="p">)</span>
+<span class="n">Out</span><span class="p">[</span><span class="mi">3</span><span class="p">]:</span> <span class="p">(</span><span class="s1">'yellow_trip_data.parquet'</span><span class="p">,</span> <span class="o"><</span><span class="n">http</span><span class="o">.</span><span class="n">client</span><span class="o">.</span><span class="n">HTTPMessage</span> <span class="n">at</span> <span class="mh">0x7f5c28e85e10</span><span class="o">></span><span class="p">)</span>
<span class="n">In</span> <span class="p">[</span><span class="mi">4</span><span class="p">]:</span> <span class="n">ctx</span> <span class="o">=</span> <span class="n">SessionContext</span><span class="p">()</span>
diff --git a/user-guide/common-operations/udf-and-udfa.html b/user-guide/common-operations/udf-and-udfa.html
index b4150f8..7c13967 100644
--- a/user-guide/common-operations/udf-and-udfa.html
+++ b/user-guide/common-operations/udf-and-udfa.html
@@ -395,6 +395,7 @@ However you can still incorporate your own functions, i.e. User-Defined Function
<span class="kn">import</span> <span class="nn">pyarrow.compute</span>
<span class="kn">import</span> <span class="nn">datafusion</span>
<span class="kn">from</span> <span class="nn">datafusion</span> <span class="kn">import</span> <span class="n">col</span><span class="p">,</span> <span class="n">udaf</span><span class="p">,</span> <span class="n">Accumulator</span>
+<span class="kn">from</span> <span class="nn">typing</span> <span class="kn">import</span> <span class="n">List</span>
<span class="k">class</span> <span class="nc">MyAccumulator</span><span class="p">(</span><span class="n">Accumulator</span><span class="p">):</span>
<span class="w"> </span><span class="sd">"""</span>
@@ -407,9 +408,9 @@ However you can still incorporate your own functions, i.e. User-Defined Function
<span class="c1"># not nice since pyarrow scalars can't be summed yet. This breaks on `None`</span>
<span class="bp">self</span><span class="o">.</span><span class="n">_sum</span> <span class="o">=</span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">scalar</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">_sum</span><span class="o">.</span><span class="n">as_py</span><span class="p">()</span> <span class="o">+</span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">compute</span><span [...]
- <span class="k">def</span> <span class="nf">merge</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">states</span><span class="p">:</span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">Array</span><span class="p">)</span> <span class="o">-></span> <span class="kc">None</span><span class="p">:</span>
+ <span class="k">def</span> <span class="nf">merge</span><span class="p">(</span><span class="bp">self</span><span class="p">,</span> <span class="n">states</span><span class="p">:</span> <span class="n">List</span><span class="p">[</span><span class="n">pyarrow</span><span class="o">.</span><span class="n">Array</span><span class="p">])</span> <span class="o">-></span> <span class="kc">None</span><span class="p">:</span>
<span class="c1"># not nice since pyarrow scalars can't be summed yet. This breaks on `None`</span>
- <span class="bp">self</span><span class="o">.</span><span class="n">_sum</span> <span class="o">=</span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">scalar</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">_sum</span><span class="o">.</span><span class="n">as_py</span><span class="p">()</span> <span class="o">+</span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">compute</span><span [...]
+ <span class="bp">self</span><span class="o">.</span><span class="n">_sum</span> <span class="o">=</span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">scalar</span><span class="p">(</span><span class="bp">self</span><span class="o">.</span><span class="n">_sum</span><span class="o">.</span><span class="n">as_py</span><span class="p">()</span> <span class="o">+</span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">compute</span><span [...]
<span class="k">def</span> <span class="nf">state</span><span class="p">(</span><span class="bp">self</span><span class="p">)</span> <span class="o">-></span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">Array</span><span class="p">:</span>
<span class="k">return</span> <span class="n">pyarrow</span><span class="o">.</span><span class="n">array</span><span class="p">([</span><span class="bp">self</span><span class="o">.</span><span class="n">_sum</span><span class="o">.</span><span class="n">as_py</span><span class="p">()])</span>
diff --git a/user-guide/common-operations/windows.html b/user-guide/common-operations/windows.html
index 8cb9461..8eb9ed5 100644
--- a/user-guide/common-operations/windows.html
+++ b/user-guide/common-operations/windows.html
@@ -375,7 +375,7 @@ produce a result for each individual row, unlike an aggregate function that prov
<span class="o">...</span><span class="p">:</span> <span class="s2">"pokemon.csv"</span><span class="p">,</span>
<span class="o">...</span><span class="p">:</span> <span class="p">)</span>
<span class="o">...</span><span class="p">:</span>
-<span class="n">Out</span><span class="p">[</span><span class="mi">5</span><span class="p">]:</span> <span class="p">(</span><span class="s1">'pokemon.csv'</span><span class="p">,</span> <span class="o"><</span><span class="n">http</span><span class="o">.</span><span class="n">client</span><span class="o">.</span><span class="n">HTTPMessage</span> <span class="n">at</span> <span class="mh">0x7fe889bb6710</span><span class="o">></span><span class="p">)</span>
+<span class="n">Out</span><span class="p">[</span><span class="mi">5</span><span class="p">]:</span> <span class="p">(</span><span class="s1">'pokemon.csv'</span><span class="p">,</span> <span class="o"><</span><span class="n">http</span><span class="o">.</span><span class="n">client</span><span class="o">.</span><span class="n">HTTPMessage</span> <span class="n">at</span> <span class="mh">0x7f5c28ee5250</span><span class="o">></span><span class="p">)</span>
<span class="n">In</span> <span class="p">[</span><span class="mi">6</span><span class="p">]:</span> <span class="n">ctx</span> <span class="o">=</span> <span class="n">SessionContext</span><span class="p">()</span>
@@ -394,20 +394,20 @@ produce a result for each individual row, unlike an aggregate function that prov
<span class="o">...</span><span class="p">:</span>
<span class="n">Out</span><span class="p">[</span><span class="mi">8</span><span class="p">]:</span>
<span class="n">DataFrame</span><span class="p">()</span>
-<span class="o">+------------+--------+--------------------+</span>
-<span class="o">|</span> <span class="n">Name</span> <span class="o">|</span> <span class="n">Attack</span> <span class="o">|</span> <span class="n">Average</span> <span class="n">Attack</span> <span class="o">|</span>
-<span class="o">+------------+--------+--------------------+</span>
-<span class="o">|</span> <span class="n">Jynx</span> <span class="o">|</span> <span class="mi">50</span> <span class="o">|</span> <span class="mf">50.0</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Articuno</span> <span class="o">|</span> <span class="mi">85</span> <span class="o">|</span> <span class="mf">67.5</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Farfetch</span><span class="s1">'d | 65 | 65.0 |</span>
-<span class="o">|</span> <span class="n">Jigglypuff</span> <span class="o">|</span> <span class="mi">45</span> <span class="o">|</span> <span class="mf">55.0</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Rattata</span> <span class="o">|</span> <span class="mi">56</span> <span class="o">|</span> <span class="mf">55.333333333333336</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Raticate</span> <span class="o">|</span> <span class="mi">81</span> <span class="o">|</span> <span class="mf">61.75</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Spearow</span> <span class="o">|</span> <span class="mi">60</span> <span class="o">|</span> <span class="mf">61.4</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Fearow</span> <span class="o">|</span> <span class="mi">90</span> <span class="o">|</span> <span class="mf">66.16666666666667</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Doduo</span> <span class="o">|</span> <span class="mi">85</span> <span class="o">|</span> <span class="mf">68.85714285714286</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Wigglytuff</span> <span class="o">|</span> <span class="mi">70</span> <span class="o">|</span> <span class="mf">69.0</span> <span class="o">|</span>
-<span class="o">+------------+--------+--------------------+</span>
+<span class="o">+-----------------------+--------+--------------------+</span>
+<span class="o">|</span> <span class="n">Name</span> <span class="o">|</span> <span class="n">Attack</span> <span class="o">|</span> <span class="n">Average</span> <span class="n">Attack</span> <span class="o">|</span>
+<span class="o">+-----------------------+--------+--------------------+</span>
+<span class="o">|</span> <span class="n">Scyther</span> <span class="o">|</span> <span class="mi">110</span> <span class="o">|</span> <span class="mf">110.0</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Metapod</span> <span class="o">|</span> <span class="mi">20</span> <span class="o">|</span> <span class="mf">65.0</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Butterfree</span> <span class="o">|</span> <span class="mi">45</span> <span class="o">|</span> <span class="mf">58.333333333333336</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Weedle</span> <span class="o">|</span> <span class="mi">35</span> <span class="o">|</span> <span class="mf">52.5</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Kakuna</span> <span class="o">|</span> <span class="mi">25</span> <span class="o">|</span> <span class="mf">47.0</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Beedrill</span> <span class="o">|</span> <span class="mi">90</span> <span class="o">|</span> <span class="mf">54.166666666666664</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">BeedrillMega</span> <span class="n">Beedrill</span> <span class="o">|</span> <span class="mi">150</span> <span class="o">|</span> <span class="mf">67.85714285714286</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Parasect</span> <span class="o">|</span> <span class="mi">95</span> <span class="o">|</span> <span class="mf">71.25</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Paras</span> <span class="o">|</span> <span class="mi">70</span> <span class="o">|</span> <span class="mf">71.11111111111111</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Venomoth</span> <span class="o">|</span> <span class="mi">65</span> <span class="o">|</span> <span class="mf">70.5</span> <span class="o">|</span>
+<span class="o">+-----------------------+--------+--------------------+</span>
</pre></div>
</div>
<p>You can also control the order in which rows are processed by window functions by providing
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org