You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2025/05/05 13:55:54 UTC
(datafusion-python) branch asf-staging updated: Publish built docs triggered by 7d8bcd8d20623beb76a397eb4fddfb18781589eb
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-staging
in repository https://gitbox.apache.org/repos/asf/datafusion-python.git
The following commit(s) were added to refs/heads/asf-staging by this push:
new 9b9ac0df Publish built docs triggered by 7d8bcd8d20623beb76a397eb4fddfb18781589eb
9b9ac0df is described below
commit 9b9ac0dfa9a47151085efdf6adf0694fd19ac8bb
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Mon May 5 13:55:50 2025 +0000
Publish built docs triggered by 7d8bcd8d20623beb76a397eb4fddfb18781589eb
---
.../datafusion/html_formatter/index.rst.txt | 53 +++++++++-
_sources/autoapi/datafusion/index.rst.txt | 2 +
_sources/user-guide/dataframe.rst.txt | 52 ++++++++--
autoapi/datafusion/html_formatter/index.html | 114 ++++++++++++++++++++-
autoapi/datafusion/index.html | 3 +
genindex.html | 18 +++-
objects.inv | Bin 7627 -> 7682 bytes
searchindex.js | 2 +-
user-guide/common-operations/aggregations.html | 36 +++----
user-guide/common-operations/basic-info.html | 46 ++++-----
user-guide/common-operations/functions.html | 20 ++--
user-guide/dataframe.html | 54 ++++++++--
12 files changed, 326 insertions(+), 74 deletions(-)
diff --git a/_sources/autoapi/datafusion/html_formatter/index.rst.txt b/_sources/autoapi/datafusion/html_formatter/index.rst.txt
index 1766f59a..b00cced1 100644
--- a/_sources/autoapi/datafusion/html_formatter/index.rst.txt
+++ b/_sources/autoapi/datafusion/html_formatter/index.rst.txt
@@ -27,6 +27,8 @@ Functions
.. autoapisummary::
datafusion.html_formatter._refresh_formatter_reference
+ datafusion.html_formatter._validate_bool
+ datafusion.html_formatter._validate_positive_int
datafusion.html_formatter.configure_formatter
datafusion.html_formatter.get_formatter
datafusion.html_formatter.reset_formatter
@@ -51,7 +53,7 @@ Module Contents
-.. py:class:: DataFrameHtmlFormatter(max_cell_length: int = 25, max_width: int = 1000, max_height: int = 300, enable_cell_expansion: bool = True, custom_css: Optional[str] = None, show_truncation_message: bool = True, style_provider: Optional[StyleProvider] = None, use_shared_styles: bool = True)
+.. py:class:: DataFrameHtmlFormatter(max_cell_length: int = 25, max_width: int = 1000, max_height: int = 300, max_memory_bytes: int = 2 * 1024 * 1024, min_rows_display: int = 20, repr_rows: int = 10, enable_cell_expansion: bool = True, custom_css: Optional[str] = None, show_truncation_message: bool = True, style_provider: Optional[StyleProvider] = None, use_shared_styles: bool = True)
Configurable HTML formatter for DataFusion DataFrames.
@@ -66,6 +68,9 @@ Module Contents
:param max_cell_length: Maximum characters to display in a cell before truncation
:param max_width: Maximum width of the HTML table in pixels
:param max_height: Maximum height of the HTML table in pixels
+ :param max_memory_bytes: Maximum memory in bytes for rendered data (default: 2MB)
+ :param min_rows_display: Minimum number of rows to display
+ :param repr_rows: Default number of rows to display in repr output
:param enable_cell_expansion: Whether to add expand/collapse buttons for long cell
values
:param custom_css: Additional CSS to include in the HTML output
@@ -82,6 +87,12 @@ Module Contents
:type max_width: int, default 1000
:param max_height: Maximum height of the displayed table in pixels.
:type max_height: int, default 300
+ :param max_memory_bytes: Maximum memory in bytes for rendered data.
+ :type max_memory_bytes: int, default 2097152 (2MB)
+ :param min_rows_display: Minimum number of rows to display.
+ :type min_rows_display: int, default 20
+ :param repr_rows: Default number of rows to display in repr output.
+ :type repr_rows: int, default 10
:param enable_cell_expansion: Whether to allow cells to expand when clicked.
:type enable_cell_expansion: bool, default True
:param custom_css: Custom CSS to apply to the HTML table.
@@ -95,7 +106,8 @@ Module Contents
:type use_shared_styles: bool, default True
:param Raises:
:param ------:
- :param ValueError: If max_cell_length, max_width, or max_height is not a positive integer.
+ :param ValueError: If max_cell_length, max_width, max_height, max_memory_bytes,
+ min_rows_display, or repr_rows is not a positive integer.
:param TypeError: If enable_cell_expansion, show_truncation_message, or use_shared_styles is
not a boolean,
or if custom_css is provided but is not a string,
@@ -284,11 +296,26 @@ Module Contents
+ .. py:attribute:: max_memory_bytes
+ :value: 2097152
+
+
+
.. py:attribute:: max_width
:value: 1000
+ .. py:attribute:: min_rows_display
+ :value: 20
+
+
+
+ .. py:attribute:: repr_rows
+ :value: 10
+
+
+
.. py:attribute:: show_truncation_message
:value: True
@@ -380,6 +407,26 @@ Module Contents
DataFrames that might be caching the formatter reference.
+.. py:function:: _validate_bool(value: Any, param_name: str) -> None
+
+ Validate that a parameter is a boolean.
+
+ :param value: The value to validate
+ :param param_name: Name of the parameter (used in error message)
+
+ :raises TypeError: If the value is not a boolean
+
+
+.. py:function:: _validate_positive_int(value: Any, param_name: str) -> None
+
+ Validate that a parameter is a positive integer.
+
+ :param value: The value to validate
+ :param param_name: Name of the parameter (used in error message)
+
+ :raises ValueError: If the value is not a positive integer
+
+
.. py:function:: configure_formatter(**kwargs: Any) -> None
Configure the global DataFrame HTML formatter.
@@ -390,6 +437,8 @@ Module Contents
:param \*\*kwargs: Formatter configuration parameters like max_cell_length,
max_width, max_height, enable_cell_expansion, etc.
+ :raises ValueError: If any invalid parameters are provided
+
.. rubric:: Example
>>> from datafusion.html_formatter import configure_formatter
diff --git a/_sources/autoapi/datafusion/index.rst.txt b/_sources/autoapi/datafusion/index.rst.txt
index df815111..6e2d556c 100644
--- a/_sources/autoapi/datafusion/index.rst.txt
+++ b/_sources/autoapi/datafusion/index.rst.txt
@@ -1887,6 +1887,8 @@ Package Contents
:param \*\*kwargs: Formatter configuration parameters like max_cell_length,
max_width, max_height, enable_cell_expansion, etc.
+ :raises ValueError: If any invalid parameters are provided
+
.. rubric:: Example
>>> from datafusion.html_formatter import configure_formatter
diff --git a/_sources/user-guide/dataframe.rst.txt b/_sources/user-guide/dataframe.rst.txt
index a78fd807..11e3d7e7 100644
--- a/_sources/user-guide/dataframe.rst.txt
+++ b/_sources/user-guide/dataframe.rst.txt
@@ -75,13 +75,17 @@ You can customize how DataFrames are rendered in HTML by configuring the formatt
# Change the default styling
configure_formatter(
- max_rows=50, # Maximum number of rows to display
- max_width=None, # Maximum width in pixels (None for auto)
- theme="light", # Theme: "light" or "dark"
- precision=2, # Floating point precision
- thousands_separator=",", # Separator for thousands
- date_format="%Y-%m-%d", # Date format
- truncate_width=20 # Max width for string columns before truncating
+ max_cell_length=25, # Maximum characters in a cell before truncation
+ max_width=1000, # Maximum width in pixels
+ max_height=300, # Maximum height in pixels
+ max_memory_bytes=2097152, # Maximum memory for rendering (2MB)
+ min_rows_display=20, # Minimum number of rows to display
+ repr_rows=10, # Number of rows to display in __repr__
+ enable_cell_expansion=True,# Allow expanding truncated cells
+ custom_css=None, # Additional custom CSS
+ show_truncation_message=True, # Show message when data is truncated
+ style_provider=None, # Custom styling provider
+ use_shared_styles=True # Share styles across tables
)
The formatter settings affect all DataFrames displayed after configuration.
@@ -113,6 +117,25 @@ For advanced styling needs, you can create a custom style provider:
# Apply the custom style provider
configure_formatter(style_provider=MyStyleProvider())
+Performance Optimization with Shared Styles
+-------------------------------------------
+The ``use_shared_styles`` parameter (enabled by default) optimizes performance when displaying
+multiple DataFrames in notebook environments:
+
+ .. code-block:: python
+ from datafusion.html_formatter import StyleProvider, configure_formatter
+ # Default: Use shared styles (recommended for notebooks)
+ configure_formatter(use_shared_styles=True)
+
+ # Disable shared styles (each DataFrame includes its own styles)
+ configure_formatter(use_shared_styles=False)
+
+When ``use_shared_styles=True``:
+- CSS styles and JavaScript are included only once per notebook session
+- This reduces HTML output size and prevents style duplication
+- Improves rendering performance with many DataFrames
+- Applies consistent styling across all DataFrames
+
Creating a Custom Formatter
---------------------------
@@ -177,3 +200,18 @@ You can also use a context manager to temporarily change formatting settings:
# Back to default formatting
df.show()
+
+Memory and Display Controls
+---------------------------
+
+You can control how much data is displayed and how much memory is used for rendering:
+
+ .. code-block:: python
+
+ configure_formatter(
+ max_memory_bytes=4 * 1024 * 1024, # 4MB maximum memory for display
+ min_rows_display=50, # Always show at least 50 rows
+ repr_rows=20 # Show 20 rows in __repr__ output
+ )
+
+These parameters help balance comprehensive data display against performance considerations.
\ No newline at end of file
diff --git a/autoapi/datafusion/html_formatter/index.html b/autoapi/datafusion/html_formatter/index.html
index 5e308885..7d6bbb4c 100644
--- a/autoapi/datafusion/html_formatter/index.html
+++ b/autoapi/datafusion/html_formatter/index.html
@@ -655,6 +655,15 @@
</code>
</a>
</li>
+ <li class="toc-h4 nav-item toc-entry">
+ <a class="reference internal nav-link" href="#datafusion.html_formatter.DataFrameHtmlFormatter.max_memory_bytes">
+ <code class="docutils literal notranslate">
+ <span class="pre">
+ DataFrameHtmlFormatter.max_memory_bytes
+ </span>
+ </code>
+ </a>
+ </li>
<li class="toc-h4 nav-item toc-entry">
<a class="reference internal nav-link" href="#datafusion.html_formatter.DataFrameHtmlFormatter.max_width">
<code class="docutils literal notranslate">
@@ -664,6 +673,24 @@
</code>
</a>
</li>
+ <li class="toc-h4 nav-item toc-entry">
+ <a class="reference internal nav-link" href="#datafusion.html_formatter.DataFrameHtmlFormatter.min_rows_display">
+ <code class="docutils literal notranslate">
+ <span class="pre">
+ DataFrameHtmlFormatter.min_rows_display
+ </span>
+ </code>
+ </a>
+ </li>
+ <li class="toc-h4 nav-item toc-entry">
+ <a class="reference internal nav-link" href="#datafusion.html_formatter.DataFrameHtmlFormatter.repr_rows">
+ <code class="docutils literal notranslate">
+ <span class="pre">
+ DataFrameHtmlFormatter.repr_rows
+ </span>
+ </code>
+ </a>
+ </li>
<li class="toc-h4 nav-item toc-entry">
<a class="reference internal nav-link" href="#datafusion.html_formatter.DataFrameHtmlFormatter.show_truncation_message">
<code class="docutils literal notranslate">
@@ -798,6 +825,24 @@
</code>
</a>
</li>
+ <li class="toc-h3 nav-item toc-entry">
+ <a class="reference internal nav-link" href="#datafusion.html_formatter._validate_bool">
+ <code class="docutils literal notranslate">
+ <span class="pre">
+ _validate_bool()
+ </span>
+ </code>
+ </a>
+ </li>
+ <li class="toc-h3 nav-item toc-entry">
+ <a class="reference internal nav-link" href="#datafusion.html_formatter._validate_positive_int">
+ <code class="docutils literal notranslate">
+ <span class="pre">
+ _validate_positive_int()
+ </span>
+ </code>
+ </a>
+ </li>
<li class="toc-h3 nav-item toc-entry">
<a class="reference internal nav-link" href="#datafusion.html_formatter.configure_formatter">
<code class="docutils literal notranslate">
@@ -898,6 +943,12 @@
<tr class="row-odd"><td><p><a class="reference internal" href="#datafusion.html_formatter._refresh_formatter_reference" title="datafusion.html_formatter._refresh_formatter_reference"><code class="xref py py-obj docutils literal notranslate"><span class="pre">_refresh_formatter_reference</span></code></a>(→ None)</p></td>
<td><p>Refresh formatter reference in any modules using it.</p></td>
</tr>
+<tr class="row-even"><td><p><a class="reference internal" href="#datafusion.html_formatter._validate_bool" title="datafusion.html_formatter._validate_bool"><code class="xref py py-obj docutils literal notranslate"><span class="pre">_validate_bool</span></code></a>(→ None)</p></td>
+<td><p>Validate that a parameter is a boolean.</p></td>
+</tr>
+<tr class="row-odd"><td><p><a class="reference internal" href="#datafusion.html_formatter._validate_positive_int" title="datafusion.html_formatter._validate_positive_int"><code class="xref py py-obj docutils literal notranslate"><span class="pre">_validate_positive_int</span></code></a>(→ None)</p></td>
+<td><p>Validate that a parameter is a positive integer.</p></td>
+</tr>
<tr class="row-even"><td><p><a class="reference internal" href="#datafusion.html_formatter.configure_formatter" title="datafusion.html_formatter.configure_formatter"><code class="xref py py-obj docutils literal notranslate"><span class="pre">configure_formatter</span></code></a>(→ None)</p></td>
<td><p>Configure the global DataFrame HTML formatter.</p></td>
</tr>
@@ -933,7 +984,7 @@
<dl class="py class">
<dt class="sig sig-object py" id="datafusion.html_formatter.DataFrameHtmlFormatter">
-<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">datafusion.html_formatter.</span></span><span class="sig-name descname"><span class="pre">DataFrameHtmlFormatter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">max_cell_length</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">int< [...]
+<em class="property"><span class="pre">class</span><span class="w"> </span></em><span class="sig-prename descclassname"><span class="pre">datafusion.html_formatter.</span></span><span class="sig-name descname"><span class="pre">DataFrameHtmlFormatter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">max_cell_length</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">int< [...]
<dd><p>Configurable HTML formatter for DataFusion DataFrames.</p>
<p>This class handles the HTML rendering of DataFrames for display in
Jupyter notebooks and other rich display contexts.</p>
@@ -947,6 +998,9 @@ Jupyter notebooks and other rich display contexts.</p>
<li><p><strong>max_cell_length</strong> – Maximum characters to display in a cell before truncation</p></li>
<li><p><strong>max_width</strong> – Maximum width of the HTML table in pixels</p></li>
<li><p><strong>max_height</strong> – Maximum height of the HTML table in pixels</p></li>
+<li><p><strong>max_memory_bytes</strong> – Maximum memory in bytes for rendered data (default: 2MB)</p></li>
+<li><p><strong>min_rows_display</strong> – Minimum number of rows to display</p></li>
+<li><p><strong>repr_rows</strong> – Default number of rows to display in repr output</p></li>
<li><p><strong>enable_cell_expansion</strong> – Whether to add expand/collapse buttons for long cell
values</p></li>
<li><p><strong>custom_css</strong> – Additional CSS to include in the HTML output</p></li>
@@ -964,6 +1018,9 @@ session</p></li>
<li><p><strong>max_cell_length</strong> (<em>int</em><em>, </em><em>default 25</em>) – Maximum length of cell content before truncation.</p></li>
<li><p><strong>max_width</strong> (<em>int</em><em>, </em><em>default 1000</em>) – Maximum width of the displayed table in pixels.</p></li>
<li><p><strong>max_height</strong> (<em>int</em><em>, </em><em>default 300</em>) – Maximum height of the displayed table in pixels.</p></li>
+<li><p><strong>max_memory_bytes</strong> (<em>int</em><em>, </em><em>default 2097152</em><em> (</em><em>2MB</em><em>)</em>) – Maximum memory in bytes for rendered data.</p></li>
+<li><p><strong>min_rows_display</strong> (<em>int</em><em>, </em><em>default 20</em>) – Minimum number of rows to display.</p></li>
+<li><p><strong>repr_rows</strong> (<em>int</em><em>, </em><em>default 10</em>) – Default number of rows to display in repr output.</p></li>
<li><p><strong>enable_cell_expansion</strong> (<em>bool</em><em>, </em><em>default True</em>) – Whether to allow cells to expand when clicked.</p></li>
<li><p><strong>custom_css</strong> (<em>str</em><em>, </em><em>optional</em>) – Custom CSS to apply to the HTML table.</p></li>
<li><p><strong>show_truncation_message</strong> (<em>bool</em><em>, </em><em>default True</em>) – Whether to show a message indicating that content has been truncated.</p></li>
@@ -972,7 +1029,8 @@ is used.</p></li>
<li><p><strong>use_shared_styles</strong> (<em>bool</em><em>, </em><em>default True</em>) – Whether to use shared styles across multiple tables.</p></li>
<li><p><strong>Raises</strong></p></li>
<li><p><strong>------</strong></p></li>
-<li><p><strong>ValueError</strong> – If max_cell_length, max_width, or max_height is not a positive integer.</p></li>
+<li><p><strong>ValueError</strong> – If max_cell_length, max_width, max_height, max_memory_bytes,
+min_rows_display, or repr_rows is not a positive integer.</p></li>
<li><p><strong>TypeError</strong> – If enable_cell_expansion, show_truncation_message, or use_shared_styles is
not a boolean,
or if custom_css is provided but is not a string,
@@ -1187,11 +1245,26 @@ a formatted string</p></li>
<span class="sig-name descname"><span class="pre">max_height</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">300</span></em><a class="headerlink" href="#datafusion.html_formatter.DataFrameHtmlFormatter.max_height" title="Link to this definition">¶</a></dt>
<dd></dd></dl>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="datafusion.html_formatter.DataFrameHtmlFormatter.max_memory_bytes">
+<span class="sig-name descname"><span class="pre">max_memory_bytes</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">2097152</span></em><a class="headerlink" href="#datafusion.html_formatter.DataFrameHtmlFormatter.max_memory_bytes" title="Link to this definition">¶</a></dt>
+<dd></dd></dl>
+
<dl class="py attribute">
<dt class="sig sig-object py" id="datafusion.html_formatter.DataFrameHtmlFormatter.max_width">
<span class="sig-name descname"><span class="pre">max_width</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">1000</span></em><a class="headerlink" href="#datafusion.html_formatter.DataFrameHtmlFormatter.max_width" title="Link to this definition">¶</a></dt>
<dd></dd></dl>
+<dl class="py attribute">
+<dt class="sig sig-object py" id="datafusion.html_formatter.DataFrameHtmlFormatter.min_rows_display">
+<span class="sig-name descname"><span class="pre">min_rows_display</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">20</span></em><a class="headerlink" href="#datafusion.html_formatter.DataFrameHtmlFormatter.min_rows_display" title="Link to this definition">¶</a></dt>
+<dd></dd></dl>
+
+<dl class="py attribute">
+<dt class="sig sig-object py" id="datafusion.html_formatter.DataFrameHtmlFormatter.repr_rows">
+<span class="sig-name descname"><span class="pre">repr_rows</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">10</span></em><a class="headerlink" href="#datafusion.html_formatter.DataFrameHtmlFormatter.repr_rows" title="Link to this definition">¶</a></dt>
+<dd></dd></dl>
+
<dl class="py attribute">
<dt class="sig sig-object py" id="datafusion.html_formatter.DataFrameHtmlFormatter.show_truncation_message">
<span class="sig-name descname"><span class="pre">show_truncation_message</span></span><em class="property"><span class="w"> </span><span class="p"><span class="pre">=</span></span><span class="w"> </span><span class="pre">True</span></em><a class="headerlink" href="#datafusion.html_formatter.DataFrameHtmlFormatter.show_truncation_message" title="Link to this definition">¶</a></dt>
@@ -1297,6 +1370,40 @@ a formatted string</p></li>
DataFrames that might be caching the formatter reference.</p>
</dd></dl>
+<dl class="py function">
+<dt class="sig sig-object py" id="datafusion.html_formatter._validate_bool">
+<span class="sig-prename descclassname"><span class="pre">datafusion.html_formatter.</span></span><span class="sig-name descname"><span class="pre">_validate_bool</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">value</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">param_name</span></spa [...]
+<dd><p>Validate that a parameter is a boolean.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters<span class="colon">:</span></dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>value</strong> – The value to validate</p></li>
+<li><p><strong>param_name</strong> – Name of the parameter (used in error message)</p></li>
+</ul>
+</dd>
+<dt class="field-even">Raises<span class="colon">:</span></dt>
+<dd class="field-even"><p><strong>TypeError</strong> – If the value is not a boolean</p>
+</dd>
+</dl>
+</dd></dl>
+
+<dl class="py function">
+<dt class="sig sig-object py" id="datafusion.html_formatter._validate_positive_int">
+<span class="sig-prename descclassname"><span class="pre">datafusion.html_formatter.</span></span><span class="sig-name descname"><span class="pre">_validate_positive_int</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="n"><span class="pre">value</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span></em>, <em class="sig-param"><span class="n"><span class="pre">param_name</sp [...]
+<dd><p>Validate that a parameter is a positive integer.</p>
+<dl class="field-list simple">
+<dt class="field-odd">Parameters<span class="colon">:</span></dt>
+<dd class="field-odd"><ul class="simple">
+<li><p><strong>value</strong> – The value to validate</p></li>
+<li><p><strong>param_name</strong> – Name of the parameter (used in error message)</p></li>
+</ul>
+</dd>
+<dt class="field-even">Raises<span class="colon">:</span></dt>
+<dd class="field-even"><p><strong>ValueError</strong> – If the value is not a positive integer</p>
+</dd>
+</dl>
+</dd></dl>
+
<dl class="py function">
<dt class="sig sig-object py" id="datafusion.html_formatter.configure_formatter">
<span class="sig-prename descclassname"><span class="pre">datafusion.html_formatter.</span></span><span class="sig-name descname"><span class="pre">configure_formatter</span></span><span class="sig-paren">(</span><em class="sig-param"><span class="o"><span class="pre">**</span></span><span class="n"><span class="pre">kwargs</span></span><span class="p"><span class="pre">:</span></span><span class="w"> </span><span class="n"><span class="pre">Any</span></span></em><span class="sig-paren"> [...]
@@ -1308,6 +1415,9 @@ and sets it as the global formatter for all DataFrames.</p>
<dd class="field-odd"><p><strong>**kwargs</strong> – Formatter configuration parameters like max_cell_length,
max_width, max_height, enable_cell_expansion, etc.</p>
</dd>
+<dt class="field-even">Raises<span class="colon">:</span></dt>
+<dd class="field-even"><p><strong>ValueError</strong> – If any invalid parameters are provided</p>
+</dd>
</dl>
<p class="rubric">Example</p>
<div class="doctest highlight-default notranslate"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span><span class="w"> </span><span class="nn">datafusion.html_formatter</span><span class="w"> </span><span class="kn">import</span> <span class="n">configure_formatter</span>
diff --git a/autoapi/datafusion/index.html b/autoapi/datafusion/index.html
index 7523e6ac..02be521a 100644
--- a/autoapi/datafusion/index.html
+++ b/autoapi/datafusion/index.html
@@ -4593,6 +4593,9 @@ and sets it as the global formatter for all DataFrames.</p>
<dd class="field-odd"><p><strong>**kwargs</strong> – Formatter configuration parameters like max_cell_length,
max_width, max_height, enable_cell_expansion, etc.</p>
</dd>
+<dt class="field-even">Raises<span class="colon">:</span></dt>
+<dd class="field-even"><p><strong>ValueError</strong> – If any invalid parameters are provided</p>
+</dd>
</dl>
<p class="rubric">Example</p>
<div class="doctest highlight-default notranslate"><div class="highlight"><pre><span></span><span class="gp">>>> </span><span class="kn">from</span><span class="w"> </span><span class="nn">datafusion.html_formatter</span><span class="w"> </span><span class="kn">import</span> <span class="n">configure_formatter</span>
diff --git a/genindex.html b/genindex.html
index 0b3d2b78..dd680f9e 100644
--- a/genindex.html
+++ b/genindex.html
@@ -741,6 +741,10 @@
<li><a href="autoapi/datafusion/index.html#datafusion.WindowUDF._udwf">(datafusion.WindowUDF attribute)</a>
</li>
</ul></li>
+ <li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter._validate_bool">_validate_bool() (in module datafusion.html_formatter)</a>
+</li>
+ <li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter._validate_positive_int">_validate_positive_int() (in module datafusion.html_formatter)</a>
+</li>
<li><a href="autoapi/datafusion/expr/index.html#datafusion.expr.Window._window_frame">_window_frame (datafusion.expr.Window attribute)</a>
</li>
</ul></td>
@@ -2160,6 +2164,8 @@
<li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter.DataFrameHtmlFormatter.max_cell_length">max_cell_length (datafusion.html_formatter.DataFrameHtmlFormatter attribute)</a>
</li>
<li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter.DataFrameHtmlFormatter.max_height">max_height (datafusion.html_formatter.DataFrameHtmlFormatter attribute)</a>
+</li>
+ <li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter.DataFrameHtmlFormatter.max_memory_bytes">max_memory_bytes (datafusion.html_formatter.DataFrameHtmlFormatter attribute)</a>
</li>
<li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter.DataFrameHtmlFormatter.max_width">max_width (datafusion.html_formatter.DataFrameHtmlFormatter attribute)</a>
</li>
@@ -2187,6 +2193,10 @@
</li>
<li><a href="autoapi/datafusion/functions/index.html#datafusion.functions.min">min() (in module datafusion.functions)</a>
</li>
+ <li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter.DataFrameHtmlFormatter.min_rows_display">min_rows_display (datafusion.html_formatter.DataFrameHtmlFormatter attribute)</a>
+</li>
+ </ul></td>
+ <td style="width: 33%; vertical-align: top;"><ul>
<li>
module
@@ -2228,8 +2238,6 @@
<li><a href="autoapi/datafusion/unparser/index.html#module-datafusion.unparser">datafusion.unparser</a>
</li>
</ul></li>
- </ul></td>
- <td style="width: 33%; vertical-align: top;"><ul>
<li><a href="autoapi/datafusion/unparser/index.html#datafusion.unparser.Dialect.mysql">mysql() (datafusion.unparser.Dialect static method)</a>
</li>
</ul></td>
@@ -2484,10 +2492,10 @@
</li>
<li><a href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.register_parquet">register_parquet() (datafusion.context.SessionContext method)</a>
</li>
- </ul></td>
- <td style="width: 33%; vertical-align: top;"><ul>
<li><a href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.register_record_batches">register_record_batches() (datafusion.context.SessionContext method)</a>
</li>
+ </ul></td>
+ <td style="width: 33%; vertical-align: top;"><ul>
<li><a href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.register_table">register_table() (datafusion.context.SessionContext method)</a>
</li>
<li><a href="autoapi/datafusion/context/index.html#datafusion.context.SessionContext.register_table_provider">register_table_provider() (datafusion.context.SessionContext method)</a>
@@ -2527,6 +2535,8 @@
<li><a href="autoapi/datafusion/functions/index.html#datafusion.functions.repeat">repeat() (in module datafusion.functions)</a>
</li>
<li><a href="autoapi/datafusion/functions/index.html#datafusion.functions.replace">replace() (in module datafusion.functions)</a>
+</li>
+ <li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter.DataFrameHtmlFormatter.repr_rows">repr_rows (datafusion.html_formatter.DataFrameHtmlFormatter attribute)</a>
</li>
<li><a href="autoapi/datafusion/html_formatter/index.html#datafusion.html_formatter.reset_formatter">reset_formatter() (in module datafusion.html_formatter)</a>
</li>
diff --git a/objects.inv b/objects.inv
index 96de4467..321bf19f 100644
Binary files a/objects.inv and b/objects.inv differ
diff --git a/searchindex.js b/searchindex.js
index 0e6b1592..6fee4bd6 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"alltitles": {"API Reference": [[18, null]], "Aggregate Functions": [[23, "aggregate-functions"], [30, "aggregate-functions"], [32, "aggregate-functions"]], "Aggregation": [[23, null]], "Alternative Approach": [[19, "alternative-approach"]], "Arrays": [[25, "arrays"]], "Arrow": [[37, null]], "Attributes": [[1, "attributes"], [4, "attributes"], [7, "attributes"], [12, "attributes"], [16, "attributes"]], "Available Functions": [[32, "available-functions"]], "Avro": [[38, n [...]
\ No newline at end of file
+Search.setIndex({"alltitles": {"API Reference": [[18, null]], "Aggregate Functions": [[23, "aggregate-functions"], [30, "aggregate-functions"], [32, "aggregate-functions"]], "Aggregation": [[23, null]], "Alternative Approach": [[19, "alternative-approach"]], "Arrays": [[25, "arrays"]], "Arrow": [[37, null]], "Attributes": [[1, "attributes"], [4, "attributes"], [7, "attributes"], [12, "attributes"], [16, "attributes"]], "Available Functions": [[32, "available-functions"]], "Avro": [[38, n [...]
\ No newline at end of file
diff --git a/user-guide/common-operations/aggregations.html b/user-guide/common-operations/aggregations.html
index 35ffae4f..ec4bb57e 100644
--- a/user-guide/common-operations/aggregations.html
+++ b/user-guide/common-operations/aggregations.html
@@ -598,16 +598,16 @@ Pokemon set. Since there will be many entries of <code class="docutils literal n
<span class="o">+----------+--------------------------------------------------+</span>
<span class="o">|</span> <span class="n">Type</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Type</span> <span class="mi">2</span> <span class="n">List</span> <span class="o">|</span>
<span class="o">+----------+--------------------------------------------------+</span>
-<span class="o">|</span> <span class="n">Bug</span> <span class="o">|</span> <span class="p">[,</span> <span class="n">Poison</span><span class="p">,</span> <span class="n">Grass</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Poison</span> <span class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span class="p">,</span> <span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Bug</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span class="p">,</span> <span class="n">Grass</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Poison</span> <span class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Electric</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="p">,</span> <span class="n">Steel</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Fairy</span> <span class="o">|</span> <span class="p">[]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Normal</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="p">,</span> <span class="n">Fairy</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Ice</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Grass</span> <span class="o">|</span> <span class="p">[,</span> <span class="n">Poison</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Fire</span> <span class="o">|</span> <span class="p">[,</span> <span class="n">Flying</span><span class="p">,</span> <span class="n">Dragon</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Water</span> <span class="o">|</span> <span class="p">[</span><span class="n">Ice</span><span class="p">,</span> <span class="n">Dark</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span class="n">Fighting</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Ground</span> <span class="o">|</span> <span class="p">[</span><span class="n">Rock</span><span class="p">,</span> <span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Normal</span> <span class="o">|</span> <span class="p">[,</span> <span class="n">Flying</span><span class="p">,</span> <span class="n">Fairy</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Ice</span> <span class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Grass</span> <span class="o">|</span> <span class="p">[</span><span class="n">Psychic</span><span class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Fire</span> <span class="o">|</span> <span class="p">[</span><span class="n">Dragon</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Water</span> <span class="o">|</span> <span class="p">[</span><span class="n">Fighting</span><span class="p">,</span> <span class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="n">Dark</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">,</span> <span class="n">Ice</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Ground</span> <span class="o">|</span> <span class="p">[,</span> <span class="n">Rock</span><span class="p">]</span> <span class="o">|</span>
<span class="o">+----------+--------------------------------------------------+</span>
<span class="n">Data</span> <span class="n">truncated</span><span class="o">.</span>
</pre></div>
@@ -622,15 +622,15 @@ entries entirely removed. The second is we can use the <code class="docutils lit
<span class="o">+----------+------------------------------------------------+</span>
<span class="o">|</span> <span class="n">Type</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Type</span> <span class="mi">2</span> <span class="n">List</span> <span class="o">|</span>
<span class="o">+----------+------------------------------------------------+</span>
-<span class="o">|</span> <span class="n">Bug</span> <span class="o">|</span> <span class="p">[</span><span class="n">Grass</span><span class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Bug</span> <span class="o">|</span> <span class="p">[</span><span class="n">Grass</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="n">Poison</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Poison</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Ground</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Electric</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Steel</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Normal</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Fairy</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Electric</span> <span class="o">|</span> <span class="p">[</span><span class="n">Steel</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Normal</span> <span class="o">|</span> <span class="p">[</span><span class="n">Fairy</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Ice</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Grass</span> <span class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Fire</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Dragon</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Water</span> <span class="o">|</span> <span class="p">[</span><span class="n">Ice</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="n">Dark</span><span class="p">,</span> <span class="n">Fighting</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Rock</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Ground</span><span class="p">,</span> <span class="n">Water</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Water</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">,</span> <span class="n">Fighting</span><span class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span class="n">Ice</span><span class="p">,</span> <span class="n">Dark</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Rock</span> <span class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span class="p">,</span> <span class="n">Water</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Ghost</span> <span class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span class="p">]</span> <span class="o">|</span>
<span class="o">+----------+------------------------------------------------+</span>
<span class="n">Data</span> <span class="n">truncated</span><span class="o">.</span>
@@ -641,15 +641,15 @@ entries entirely removed. The second is we can use the <code class="docutils lit
<span class="o">+----------+------------------------------------------------+</span>
<span class="o">|</span> <span class="n">Type</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">Type</span> <span class="mi">2</span> <span class="n">List</span> <span class="o">|</span>
<span class="o">+----------+------------------------------------------------+</span>
-<span class="o">|</span> <span class="n">Bug</span> <span class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span class="p">,</span> <span class="n">Grass</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Poison</span> <span class="o">|</span> <span class="p">[</span><span class="n">Ground</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Electric</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Steel</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Bug</span> <span class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="n">Grass</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Poison</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Ground</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Electric</span> <span class="o">|</span> <span class="p">[</span><span class="n">Steel</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Fairy</span> <span class="o">|</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Normal</span> <span class="o">|</span> <span class="p">[</span><span class="n">Fairy</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Normal</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Fairy</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Ice</span> <span class="o">|</span> <span class="p">[</span><span class="n">Flying</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Grass</span> <span class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Fire</span> <span class="o">|</span> <span class="p">[</span><span class="n">Dragon</span><span class="p">,</span> <span class="n">Flying</span><span class="p">]</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">Water</span> <span class="o">|</span> <span class="p">[</span><span class="n">Ice</span><span class="p">,</span> <span class="n">Fighting</span><span class="p">,</span> <span class="n">Poison</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="n">Dark</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">]</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">Water</span> <span class="o">|</span> <span class="p">[</span><span class="n">Poison</span><span class="p">,</span> <span class="n">Psychic</span><span class="p">,</span> <span class="n">Flying</span><span class="p">,</span> <span class="n">Ice</span><span class="p">,</span> <span class="n">Dark</span><span class="p">,</span> <span class="n">Fighting</span><span class="p">]</span> <span class="o">|</span>
<span class="o">|</span> <span class="n">Ground</span> <span class="o">|</span> <span class="p">[</span><span class="n">Rock</span><span class="p">]</span> <span class="o">|</span>
<span class="o">+----------+------------------------------------------------+</span>
<span class="n">Data</span> <span class="n">truncated</span><span class="o">.</span>
diff --git a/user-guide/common-operations/basic-info.html b/user-guide/common-operations/basic-info.html
index 198df0cf..5a6031e6 100644
--- a/user-guide/common-operations/basic-info.html
+++ b/user-guide/common-operations/basic-info.html
@@ -434,11 +434,11 @@
<span class="o">+-----+---------+--------+--------+</span>
<span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span> <span class="n">names</span> <span class="o">|</span> <span class="n">random</span> <span class="o">|</span> <span class="n">groups</span> <span class="o">|</span>
<span class="o">+-----+---------+--------+--------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">python</span> <span class="o">|</span> <span class="mi">296</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mi">659</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span> <span class="n">java</span> <span class="o">|</span> <span class="mi">17</span> <span class="o">|</span> <span class="n">B</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">4</span> <span class="o">|</span> <span class="n">haskell</span> <span class="o">|</span> <span class="mi">552</span> <span class="o">|</span> <span class="n">C</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span class="mi">960</span> <span class="o">|</span> <span class="n">B</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">python</span> <span class="o">|</span> <span class="mi">965</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mi">634</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">3</span> <span class="o">|</span> <span class="n">java</span> <span class="o">|</span> <span class="mi">87</span> <span class="o">|</span> <span class="n">B</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">4</span> <span class="o">|</span> <span class="n">haskell</span> <span class="o">|</span> <span class="mi">514</span> <span class="o">|</span> <span class="n">C</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span class="mi">695</span> <span class="o">|</span> <span class="n">B</span> <span class="o">|</span>
<span class="o">+-----+---------+--------+--------+</span>
</pre></div>
</div>
@@ -449,8 +449,8 @@
<span class="o">+-----+--------+--------+--------+</span>
<span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span> <span class="n">names</span> <span class="o">|</span> <span class="n">random</span> <span class="o">|</span> <span class="n">groups</span> <span class="o">|</span>
<span class="o">+-----+--------+--------+--------+</span>
-<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">python</span> <span class="o">|</span> <span class="mi">296</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mi">659</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">1</span> <span class="o">|</span> <span class="n">python</span> <span class="o">|</span> <span class="mi">965</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mi">634</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
<span class="o">+-----+--------+--------+--------+</span>
</pre></div>
</div>
@@ -468,28 +468,28 @@ passing them to an Arrow table, and then converting them to a pandas DataFrame.<
<div class="highlight-ipython notranslate"><div class="highlight"><pre><span></span><span class="n">In</span> <span class="p">[</span><span class="mi">8</span><span class="p">]:</span> <span class="n">df</span><span class="o">.</span><span class="n">to_pandas</span><span class="p">()</span>
<span class="n">Out</span><span class="p">[</span><span class="mi">8</span><span class="p">]:</span>
<span class="n">nrs</span> <span class="n">names</span> <span class="n">random</span> <span class="n">groups</span>
-<span class="mi">0</span> <span class="mi">1</span> <span class="n">python</span> <span class="mi">296</span> <span class="n">A</span>
-<span class="mi">1</span> <span class="mi">2</span> <span class="n">ruby</span> <span class="mi">659</span> <span class="n">A</span>
-<span class="mi">2</span> <span class="mi">3</span> <span class="n">java</span> <span class="mi">17</span> <span class="n">B</span>
-<span class="mi">3</span> <span class="mi">4</span> <span class="n">haskell</span> <span class="mi">552</span> <span class="n">C</span>
-<span class="mi">4</span> <span class="mi">5</span> <span class="n">go</span> <span class="mi">960</span> <span class="n">B</span>
+<span class="mi">0</span> <span class="mi">1</span> <span class="n">python</span> <span class="mi">965</span> <span class="n">A</span>
+<span class="mi">1</span> <span class="mi">2</span> <span class="n">ruby</span> <span class="mi">634</span> <span class="n">A</span>
+<span class="mi">2</span> <span class="mi">3</span> <span class="n">java</span> <span class="mi">87</span> <span class="n">B</span>
+<span class="mi">3</span> <span class="mi">4</span> <span class="n">haskell</span> <span class="mi">514</span> <span class="n">C</span>
+<span class="mi">4</span> <span class="mi">5</span> <span class="n">go</span> <span class="mi">695</span> <span class="n">B</span>
</pre></div>
</div>
<p><a class="reference internal" href="../../autoapi/datafusion/dataframe/index.html#datafusion.dataframe.DataFrame.describe" title="datafusion.dataframe.DataFrame.describe"><code class="xref py py-func docutils literal notranslate"><span class="pre">describe()</span></code></a> shows a quick statistic summary of your data:</p>
<div class="highlight-ipython notranslate"><div class="highlight"><pre><span></span><span class="n">In</span> <span class="p">[</span><span class="mi">9</span><span class="p">]:</span> <span class="n">df</span><span class="o">.</span><span class="n">describe</span><span class="p">()</span>
<span class="n">Out</span><span class="p">[</span><span class="mi">9</span><span class="p">]:</span>
<span class="n">DataFrame</span><span class="p">()</span>
-<span class="o">+------------+--------------------+-------+--------------------+--------+</span>
-<span class="o">|</span> <span class="n">describe</span> <span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span> <span class="n">names</span> <span class="o">|</span> <span class="n">random</span> <span class="o">|</span> <span class="n">groups</span> <span class="o">|</span>
-<span class="o">+------------+--------------------+-------+--------------------+--------+</span>
-<span class="o">|</span> <span class="n">count</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="mi">5</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">null_count</span> <span class="o">|</span> <span class="mf">0.0</span> <span class="o">|</span> <span class="mi">0</span> <span class="o">|</span> <span class="mf">0.0</span> <span class="o">|</span> <span class="mi">0</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">mean</span> <span class="o">|</span> <span class="mf">3.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">496.8</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">std</span> <span class="o">|</span> <span class="mf">1.5811388300841898</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">358.62194578692475</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
-<span class="o">|</span> <span class="nb">min</span> <span class="o">|</span> <span class="mf">1.0</span> <span class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span class="mf">17.0</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
-<span class="o">|</span> <span class="nb">max</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mf">960.0</span> <span class="o">|</span> <span class="n">C</span> <span class="o">|</span>
-<span class="o">|</span> <span class="n">median</span> <span class="o">|</span> <span class="mf">3.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">552.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
-<span class="o">+------------+--------------------+-------+--------------------+--------+</span>
+<span class="o">+------------+--------------------+-------+-------------------+--------+</span>
+<span class="o">|</span> <span class="n">describe</span> <span class="o">|</span> <span class="n">nrs</span> <span class="o">|</span> <span class="n">names</span> <span class="o">|</span> <span class="n">random</span> <span class="o">|</span> <span class="n">groups</span> <span class="o">|</span>
+<span class="o">+------------+--------------------+-------+-------------------+--------+</span>
+<span class="o">|</span> <span class="n">count</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="mi">5</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="mi">5</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">null_count</span> <span class="o">|</span> <span class="mf">0.0</span> <span class="o">|</span> <span class="mi">0</span> <span class="o">|</span> <span class="mf">0.0</span> <span class="o">|</span> <span class="mi">0</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">mean</span> <span class="o">|</span> <span class="mf">3.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">579.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">std</span> <span class="o">|</span> <span class="mf">1.5811388300841898</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">320.8449781436512</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
+<span class="o">|</span> <span class="nb">min</span> <span class="o">|</span> <span class="mf">1.0</span> <span class="o">|</span> <span class="n">go</span> <span class="o">|</span> <span class="mf">87.0</span> <span class="o">|</span> <span class="n">A</span> <span class="o">|</span>
+<span class="o">|</span> <span class="nb">max</span> <span class="o">|</span> <span class="mf">5.0</span> <span class="o">|</span> <span class="n">ruby</span> <span class="o">|</span> <span class="mf">965.0</span> <span class="o">|</span> <span class="n">C</span> <span class="o">|</span>
+<span class="o">|</span> <span class="n">median</span> <span class="o">|</span> <span class="mf">3.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span> <span class="mf">634.0</span> <span class="o">|</span> <span class="n">null</span> <span class="o">|</span>
+<span class="o">+------------+--------------------+-------+-------------------+--------+</span>
</pre></div>
</div>
</section>
diff --git a/user-guide/common-operations/functions.html b/user-guide/common-operations/functions.html
index 015fdf74..271c596e 100644
--- a/user-guide/common-operations/functions.html
+++ b/user-guide/common-operations/functions.html
@@ -525,16 +525,16 @@ In here we will cover some of the more popular use cases. If you want to view al
<span class="o">+--------------------------------+</span>
<span class="o">|</span> <span class="n">now</span><span class="p">()</span> <span class="o">|</span>
<span class="o">+--------------------------------+</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
-<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">47</span><span class="p">:</span><span class="mf">59.484229397</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
+<span class="o">|</span> <span class="mi">2025</span><span class="o">-</span><span class="mi">05</span><span class="o">-</span><span class="mi">05</span><span class="n">T13</span><span class="p">:</span><span class="mi">55</span><span class="p">:</span><span class="mf">38.308428329</span><span class="n">Z</span> <span class="o">|</span>
<span class="o">+--------------------------------+</span>
<span class="n">Data</span> <span class="n">truncated</span><span class="o">.</span>
</pre></div>
diff --git a/user-guide/dataframe.html b/user-guide/dataframe.html
index d194723f..cf4fa046 100644
--- a/user-guide/dataframe.html
+++ b/user-guide/dataframe.html
@@ -420,6 +420,11 @@
Custom Style Providers
</a>
</li>
+ <li class="toc-h2 nav-item toc-entry">
+ <a class="reference internal nav-link" href="#performance-optimization-with-shared-styles">
+ Performance Optimization with Shared Styles
+ </a>
+ </li>
<li class="toc-h2 nav-item toc-entry">
<a class="reference internal nav-link" href="#creating-a-custom-formatter">
Creating a Custom Formatter
@@ -435,6 +440,11 @@
Contextual Formatting
</a>
</li>
+ <li class="toc-h2 nav-item toc-entry">
+ <a class="reference internal nav-link" href="#memory-and-display-controls">
+ Memory and Display Controls
+ </a>
+ </li>
</ul>
</nav>
@@ -506,13 +516,17 @@ plain text output.</p>
<span class="c1"># Change the default styling</span>
<span class="n">configure_formatter</span><span class="p">(</span>
- <span class="n">max_rows</span><span class="o">=</span><span class="mi">50</span><span class="p">,</span> <span class="c1"># Maximum number of rows to display</span>
- <span class="n">max_width</span><span class="o">=</span><span class="kc">None</span><span class="p">,</span> <span class="c1"># Maximum width in pixels (None for auto)</span>
- <span class="n">theme</span><span class="o">=</span><span class="s2">"light"</span><span class="p">,</span> <span class="c1"># Theme: "light" or "dark"</span>
- <span class="n">precision</span><span class="o">=</span><span class="mi">2</span><span class="p">,</span> <span class="c1"># Floating point precision</span>
- <span class="n">thousands_separator</span><span class="o">=</span><span class="s2">","</span><span class="p">,</span> <span class="c1"># Separator for thousands</span>
- <span class="n">date_format</span><span class="o">=</span><span class="s2">"%Y-%m-</span><span class="si">%d</span><span class="s2">"</span><span class="p">,</span> <span class="c1"># Date format</span>
- <span class="n">truncate_width</span><span class="o">=</span><span class="mi">20</span> <span class="c1"># Max width for string columns before truncating</span>
+ <span class="n">max_cell_length</span><span class="o">=</span><span class="mi">25</span><span class="p">,</span> <span class="c1"># Maximum characters in a cell before truncation</span>
+ <span class="n">max_width</span><span class="o">=</span><span class="mi">1000</span><span class="p">,</span> <span class="c1"># Maximum width in pixels</span>
+ <span class="n">max_height</span><span class="o">=</span><span class="mi">300</span><span class="p">,</span> <span class="c1"># Maximum height in pixels</span>
+ <span class="n">max_memory_bytes</span><span class="o">=</span><span class="mi">2097152</span><span class="p">,</span> <span class="c1"># Maximum memory for rendering (2MB)</span>
+ <span class="n">min_rows_display</span><span class="o">=</span><span class="mi">20</span><span class="p">,</span> <span class="c1"># Minimum number of rows to display</span>
+ <span class="n">repr_rows</span><span class="o">=</span><span class="mi">10</span><span class="p">,</span> <span class="c1"># Number of rows to display in __repr__</span>
+ <span class="n">enable_cell_expansion</span><span class="o">=</span><span class="kc">True</span><span class="p">,</span><span class="c1"># Allow expanding truncated cells</span>
+ <span class="n">custom_css</span><span class="o">=</span><span class="kc">None</span><span class="p">,</span> <span class="c1"># Additional custom CSS</span>
+ <span class="n">show_truncation_message</span><span class="o">=</span><span class="kc">True</span><span class="p">,</span> <span class="c1"># Show message when data is truncated</span>
+ <span class="n">style_provider</span><span class="o">=</span><span class="kc">None</span><span class="p">,</span> <span class="c1"># Custom styling provider</span>
+ <span class="n">use_shared_styles</span><span class="o">=</span><span class="kc">True</span> <span class="c1"># Share styles across tables</span>
<span class="p">)</span>
</pre></div>
</div>
@@ -543,6 +557,18 @@ plain text output.</p>
</pre></div>
</div>
</section>
+<section id="performance-optimization-with-shared-styles">
+<h2>Performance Optimization with Shared Styles<a class="headerlink" href="#performance-optimization-with-shared-styles" title="Link to this heading">¶</a></h2>
+<p>The <code class="docutils literal notranslate"><span class="pre">use_shared_styles</span></code> parameter (enabled by default) optimizes performance when displaying
+multiple DataFrames in notebook environments:</p>
+<blockquote>
+<div></div></blockquote>
+<p>When <code class="docutils literal notranslate"><span class="pre">use_shared_styles=True</span></code>:
+- CSS styles and JavaScript are included only once per notebook session
+- This reduces HTML output size and prevents style duplication
+- Improves rendering performance with many DataFrames
+- Applies consistent styling across all DataFrames</p>
+</section>
<section id="creating-a-custom-formatter">
<h2>Creating a Custom Formatter<a class="headerlink" href="#creating-a-custom-formatter" title="Link to this heading">¶</a></h2>
<p>For complete control over rendering, you can implement a custom formatter:</p>
@@ -600,6 +626,20 @@ plain text output.</p>
</pre></div>
</div>
</section>
+<section id="memory-and-display-controls">
+<h2>Memory and Display Controls<a class="headerlink" href="#memory-and-display-controls" title="Link to this heading">¶</a></h2>
+<p>You can control how much data is displayed and how much memory is used for rendering:</p>
+<blockquote>
+<div><div class="highlight-python notranslate"><div class="highlight"><pre><span></span><span class="n">configure_formatter</span><span class="p">(</span>
+ <span class="n">max_memory_bytes</span><span class="o">=</span><span class="mi">4</span> <span class="o">*</span> <span class="mi">1024</span> <span class="o">*</span> <span class="mi">1024</span><span class="p">,</span> <span class="c1"># 4MB maximum memory for display</span>
+ <span class="n">min_rows_display</span><span class="o">=</span><span class="mi">50</span><span class="p">,</span> <span class="c1"># Always show at least 50 rows</span>
+ <span class="n">repr_rows</span><span class="o">=</span><span class="mi">20</span> <span class="c1"># Show 20 rows in __repr__ output</span>
+<span class="p">)</span>
+</pre></div>
+</div>
+</div></blockquote>
+<p>These parameters help balance comprehensive data display against performance considerations.</p>
+</section>
</section>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org