You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@datafusion.apache.org by gi...@apache.org on 2025/05/03 09:59:13 UTC
(datafusion) branch asf-site updated: Publish built docs triggered by b4b77e949d9f1c11242a6f34d8eb27f18ad4d807
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/datafusion.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 1ab7e32697 Publish built docs triggered by b4b77e949d9f1c11242a6f34d8eb27f18ad4d807
1ab7e32697 is described below
commit 1ab7e326975e00d72432274eef76399840e52691
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Sat May 3 09:59:09 2025 +0000
Publish built docs triggered by b4b77e949d9f1c11242a6f34d8eb27f18ad4d807
---
_sources/user-guide/configs.md.txt | 2 +-
user-guide/configs.html | 38 +++++++++++++++++++-------------------
2 files changed, 20 insertions(+), 20 deletions(-)
diff --git a/_sources/user-guide/configs.md.txt b/_sources/user-guide/configs.md.txt
index ea174943c1..0e75903219 100644
--- a/_sources/user-guide/configs.md.txt
+++ b/_sources/user-guide/configs.md.txt
@@ -59,6 +59,7 @@ Environment variables are read during `SessionConfig` initialisation so they mus
| datafusion.execution.parquet.schema_force_view_types | true | (reading) If true, parquet reader will read columns of `Utf8/Utf8Large` with `Utf8View`, and `Binary/BinaryLarge` with `BinaryView`. [...]
| datafusion.execution.parquet.binary_as_string | false | (reading) If true, parquet reader will read columns of `Binary/LargeBinary` with `Utf8`, and `BinaryView` with `Utf8View`. Parquet files generated by some legacy writers do not correctly set the UTF8 flag for strings, causing string columns to be loaded as BLOB instead. [...]
| datafusion.execution.parquet.coerce_int96 | NULL | (reading) If true, parquet reader will read columns of physical type int96 as originating from a different resolution than nanosecond. This is useful for reading data from systems like Spark which stores microsecond resolution timestamps in an int96 allowing it to write values with a larger date range than 64-bit timestamps with nanosecond resolution. [...]
+| datafusion.execution.parquet.bloom_filter_on_read | true | (reading) Use any available bloom filters when reading parquet files [...]
| datafusion.execution.parquet.data_pagesize_limit | 1048576 | (writing) Sets best effort maximum size of data page in bytes [...]
| datafusion.execution.parquet.write_batch_size | 1024 | (writing) Sets write_batch_size in bytes [...]
| datafusion.execution.parquet.writer_version | 1.0 | (writing) Sets parquet writer version valid values are "1.0" and "2.0" [...]
@@ -74,7 +75,6 @@ Environment variables are read during `SessionConfig` initialisation so they mus
| datafusion.execution.parquet.statistics_truncate_length | NULL | (writing) Sets statictics truncate length. If NULL, uses default parquet writer setting [...]
| datafusion.execution.parquet.data_page_row_count_limit | 20000 | (writing) Sets best effort maximum number of rows in data page [...]
| datafusion.execution.parquet.encoding | NULL | (writing) Sets default encoding for any column. Valid values are: plain, plain_dictionary, rle, bit_packed, delta_binary_packed, delta_length_byte_array, delta_byte_array, rle_dictionary, and byte_stream_split. These values are not case sensitive. If NULL, uses default parquet writer setting [...]
-| datafusion.execution.parquet.bloom_filter_on_read | true | (writing) Use any available bloom filters when reading parquet files [...]
| datafusion.execution.parquet.bloom_filter_on_write | false | (writing) Write bloom filters for all columns when creating parquet files [...]
| datafusion.execution.parquet.bloom_filter_fpp | NULL | (writing) Sets bloom filter false positive probability. If NULL, uses default parquet writer setting [...]
| datafusion.execution.parquet.bloom_filter_ndv | NULL | (writing) Sets bloom filter number of distinct values. If NULL, uses default parquet writer setting [...]
diff --git a/user-guide/configs.html b/user-guide/configs.html
index c76bac2646..94726dc96e 100644
--- a/user-guide/configs.html
+++ b/user-guide/configs.html
@@ -679,70 +679,70 @@ Environment variables are read during <code class="docutils literal notranslate"
<td><p>NULL</p></td>
<td><p>(reading) If true, parquet reader will read columns of physical type int96 as originating from a different resolution than nanosecond. This is useful for reading data from systems like Spark which stores microsecond resolution timestamps in an int96 allowing it to write values with a larger date range than 64-bit timestamps with nanosecond resolution.</p></td>
</tr>
-<tr class="row-even"><td><p>datafusion.execution.parquet.data_pagesize_limit</p></td>
+<tr class="row-even"><td><p>datafusion.execution.parquet.bloom_filter_on_read</p></td>
+<td><p>true</p></td>
+<td><p>(reading) Use any available bloom filters when reading parquet files</p></td>
+</tr>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.data_pagesize_limit</p></td>
<td><p>1048576</p></td>
<td><p>(writing) Sets best effort maximum size of data page in bytes</p></td>
</tr>
-<tr class="row-odd"><td><p>datafusion.execution.parquet.write_batch_size</p></td>
+<tr class="row-even"><td><p>datafusion.execution.parquet.write_batch_size</p></td>
<td><p>1024</p></td>
<td><p>(writing) Sets write_batch_size in bytes</p></td>
</tr>
-<tr class="row-even"><td><p>datafusion.execution.parquet.writer_version</p></td>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.writer_version</p></td>
<td><p>1.0</p></td>
<td><p>(writing) Sets parquet writer version valid values are “1.0” and “2.0”</p></td>
</tr>
-<tr class="row-odd"><td><p>datafusion.execution.parquet.skip_arrow_metadata</p></td>
+<tr class="row-even"><td><p>datafusion.execution.parquet.skip_arrow_metadata</p></td>
<td><p>false</p></td>
<td><p>(writing) Skip encoding the embedded arrow metadata in the KV_meta This is analogous to the <code class="docutils literal notranslate"><span class="pre">ArrowWriterOptions::with_skip_arrow_metadata</span></code>. Refer to <a class="reference external" href="https://docs.rs/parquet/53.3.0/parquet/arrow/arrow_writer/struct.ArrowWriterOptions.html#method.with_skip_arrow_metadata">https://docs.rs/parquet/53.3.0/parquet/arrow/arrow_writer/struct.ArrowWriterOptions.html#method.with_skip [...]
</tr>
-<tr class="row-even"><td><p>datafusion.execution.parquet.compression</p></td>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.compression</p></td>
<td><p>zstd(3)</p></td>
<td><p>(writing) Sets default parquet compression codec. Valid values are: uncompressed, snappy, gzip(level), lzo, brotli(level), lz4, zstd(level), and lz4_raw. These values are not case sensitive. If NULL, uses default parquet writer setting Note that this default setting is not the same as the default parquet writer setting.</p></td>
</tr>
-<tr class="row-odd"><td><p>datafusion.execution.parquet.dictionary_enabled</p></td>
+<tr class="row-even"><td><p>datafusion.execution.parquet.dictionary_enabled</p></td>
<td><p>true</p></td>
<td><p>(writing) Sets if dictionary encoding is enabled. If NULL, uses default parquet writer setting</p></td>
</tr>
-<tr class="row-even"><td><p>datafusion.execution.parquet.dictionary_page_size_limit</p></td>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.dictionary_page_size_limit</p></td>
<td><p>1048576</p></td>
<td><p>(writing) Sets best effort maximum dictionary page size, in bytes</p></td>
</tr>
-<tr class="row-odd"><td><p>datafusion.execution.parquet.statistics_enabled</p></td>
+<tr class="row-even"><td><p>datafusion.execution.parquet.statistics_enabled</p></td>
<td><p>page</p></td>
<td><p>(writing) Sets if statistics are enabled for any column Valid values are: “none”, “chunk”, and “page” These values are not case sensitive. If NULL, uses default parquet writer setting</p></td>
</tr>
-<tr class="row-even"><td><p>datafusion.execution.parquet.max_statistics_size</p></td>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.max_statistics_size</p></td>
<td><p>4096</p></td>
<td><p>(writing) Sets max statistics size for any column. If NULL, uses default parquet writer setting max_statistics_size is deprecated, currently it is not being used</p></td>
</tr>
-<tr class="row-odd"><td><p>datafusion.execution.parquet.max_row_group_size</p></td>
+<tr class="row-even"><td><p>datafusion.execution.parquet.max_row_group_size</p></td>
<td><p>1048576</p></td>
<td><p>(writing) Target maximum number of rows in each row group (defaults to 1M rows). Writing larger row groups requires more memory to write, but can get better compression and be faster to read.</p></td>
</tr>
-<tr class="row-even"><td><p>datafusion.execution.parquet.created_by</p></td>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.created_by</p></td>
<td><p>datafusion version 47.0.0</p></td>
<td><p>(writing) Sets “created by” property</p></td>
</tr>
-<tr class="row-odd"><td><p>datafusion.execution.parquet.column_index_truncate_length</p></td>
+<tr class="row-even"><td><p>datafusion.execution.parquet.column_index_truncate_length</p></td>
<td><p>64</p></td>
<td><p>(writing) Sets column index truncate length</p></td>
</tr>
-<tr class="row-even"><td><p>datafusion.execution.parquet.statistics_truncate_length</p></td>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.statistics_truncate_length</p></td>
<td><p>NULL</p></td>
<td><p>(writing) Sets statictics truncate length. If NULL, uses default parquet writer setting</p></td>
</tr>
-<tr class="row-odd"><td><p>datafusion.execution.parquet.data_page_row_count_limit</p></td>
+<tr class="row-even"><td><p>datafusion.execution.parquet.data_page_row_count_limit</p></td>
<td><p>20000</p></td>
<td><p>(writing) Sets best effort maximum number of rows in data page</p></td>
</tr>
-<tr class="row-even"><td><p>datafusion.execution.parquet.encoding</p></td>
+<tr class="row-odd"><td><p>datafusion.execution.parquet.encoding</p></td>
<td><p>NULL</p></td>
<td><p>(writing) Sets default encoding for any column. Valid values are: plain, plain_dictionary, rle, bit_packed, delta_binary_packed, delta_length_byte_array, delta_byte_array, rle_dictionary, and byte_stream_split. These values are not case sensitive. If NULL, uses default parquet writer setting</p></td>
</tr>
-<tr class="row-odd"><td><p>datafusion.execution.parquet.bloom_filter_on_read</p></td>
-<td><p>true</p></td>
-<td><p>(writing) Use any available bloom filters when reading parquet files</p></td>
-</tr>
<tr class="row-even"><td><p>datafusion.execution.parquet.bloom_filter_on_write</p></td>
<td><p>false</p></td>
<td><p>(writing) Write bloom filters for all columns when creating parquet files</p></td>
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datafusion.apache.org
For additional commands, e-mail: commits-help@datafusion.apache.org