You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@arrow.apache.org by gi...@apache.org on 2023/08/17 12:32:01 UTC
[arrow-datafusion] branch asf-site updated: Publish built docs triggered by 354d4ff521bf711cbaced480a17626c6f1fac4ba
This is an automated email from the ASF dual-hosted git repository.
github-bot pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 84c83b6b04 Publish built docs triggered by 354d4ff521bf711cbaced480a17626c6f1fac4ba
84c83b6b04 is described below
commit 84c83b6b04dae5cf9ea3c581728d446e78dcac0e
Author: github-actions[bot] <gi...@users.noreply.github.com>
AuthorDate: Thu Aug 17 12:31:55 2023 +0000
Publish built docs triggered by 354d4ff521bf711cbaced480a17626c6f1fac4ba
---
_sources/user-guide/configs.md.txt | 14 +++++++-------
searchindex.js | 2 +-
user-guide/configs.html | 28 ++++++++++++++--------------
3 files changed, 22 insertions(+), 22 deletions(-)
diff --git a/_sources/user-guide/configs.md.txt b/_sources/user-guide/configs.md.txt
index acb0893a70..a81bece2b5 100644
--- a/_sources/user-guide/configs.md.txt
+++ b/_sources/user-guide/configs.md.txt
@@ -58,19 +58,19 @@ Environment variables are read during `SessionConfig` initialisation so they mus
| datafusion.execution.parquet.data_pagesize_limit | 1048576 | Sets best effort maximum size of data page in bytes [...]
| datafusion.execution.parquet.write_batch_size | 1024 | Sets write_batch_size in bytes [...]
| datafusion.execution.parquet.writer_version | 1.0 | Sets parquet writer version valid values are "1.0" and "2.0" [...]
-| datafusion.execution.parquet.compression | snappy | Sets default parquet compression codec Valid values are: uncompressed, snappy, gzip(level), lzo, brotli(level), lz4, zstd(level), and lz4_raw. These values are not case sensitive. [...]
-| datafusion.execution.parquet.dictionary_enabled | true | Sets if dictionary encoding is enabled [...]
+| datafusion.execution.parquet.compression | NULL | Sets default parquet compression codec Valid values are: uncompressed, snappy, gzip(level), lzo, brotli(level), lz4, zstd(level), and lz4_raw. These values are not case sensitive. If NULL, uses default parquet writer setting [...]
+| datafusion.execution.parquet.dictionary_enabled | NULL | Sets if dictionary encoding is enabled. If NULL, uses default parquet writer setting [...]
| datafusion.execution.parquet.dictionary_page_size_limit | 1048576 | Sets best effort maximum dictionary page size, in bytes [...]
-| datafusion.execution.parquet.statistics_enabled | page | Sets if statistics are enabled for any column Valid values are: "none", "chunk", and "page" These values are not case sensitive. [...]
-| datafusion.execution.parquet.max_statistics_size | 4096 | Sets max statistics size for any column [...]
+| datafusion.execution.parquet.statistics_enabled | NULL | Sets if statistics are enabled for any column Valid values are: "none", "chunk", and "page" These values are not case sensitive. If NULL, uses default parquet writer setting [...]
+| datafusion.execution.parquet.max_statistics_size | NULL | Sets max statistics size for any column. If NULL, uses default parquet writer setting [...]
| datafusion.execution.parquet.max_row_group_size | 1048576 | Sets maximum number of rows in a row group [...]
| datafusion.execution.parquet.created_by | datafusion version 29.0.0 | Sets "created by" property [...]
| datafusion.execution.parquet.column_index_truncate_length | NULL | Sets column index trucate length [...]
| datafusion.execution.parquet.data_page_row_count_limit | 18446744073709551615 | Sets best effort maximum number of rows in data page [...]
-| datafusion.execution.parquet.encoding | plain | Sets default encoding for any column Valid values are: plain, plain_dictionary, rle, bit_packed, delta_binary_packed, delta_length_byte_array, delta_byte_array, rle_dictionary, and byte_stream_split. These values are not case sensitive. [...]
+| datafusion.execution.parquet.encoding | NULL | Sets default encoding for any column Valid values are: plain, plain_dictionary, rle, bit_packed, delta_binary_packed, delta_length_byte_array, delta_byte_array, rle_dictionary, and byte_stream_split. These values are not case sensitive. If NULL, uses default parquet writer setting [...]
| datafusion.execution.parquet.bloom_filter_enabled | false | Sets if bloom filter is enabled for any column [...]
-| datafusion.execution.parquet.bloom_filter_fpp | 0.05 | Sets bloom filter false positive probability [...]
-| datafusion.execution.parquet.bloom_filter_ndv | 1000000 | Sets bloom filter number of distinct values [...]
+| datafusion.execution.parquet.bloom_filter_fpp | NULL | Sets bloom filter false positive probability. If NULL, uses default parquet writer setting [...]
+| datafusion.execution.parquet.bloom_filter_ndv | NULL | Sets bloom filter number of distinct values. If NULL, uses default parquet writer setting [...]
| datafusion.execution.aggregate.scalar_update_factor | 10 | Specifies the threshold for using `ScalarValue`s to update accumulators during high-cardinality aggregations for each input batch. The aggregation is considered high-cardinality if the number of affected groups is greater than or equal to `batch_size / scalar_update_factor`. In such cases, `ScalarValue`s are utilized for updating accumulators, rather than the default batch-slice approach. This can [...]
| datafusion.execution.planning_concurrency | 0 | Fan-out during initial physical planning. This is mostly use to plan `UNION` children in parallel. Defaults to the number of CPU cores on the system [...]
| datafusion.execution.sort_spill_reservation_bytes | 10485760 | Specifies the reserved memory for each spillable sort operation to facilitate an in-memory merge. When a sort operation spills to disk, the in-memory data must be sorted and merged before being written to a file. This setting reserves a specific amount of memory for that in-memory sort/merge process. Note: This setting is irrelevant if the sort operation cannot spill (i.e., if there's no `DiskManag [...]
diff --git a/searchindex.js b/searchindex.js
index 1e2dd25b83..f5d784ba9b 100644
--- a/searchindex.js
+++ b/searchindex.js
@@ -1 +1 @@
-Search.setIndex({"docnames": ["contributor-guide/architecture", "contributor-guide/communication", "contributor-guide/index", "contributor-guide/quarterly_roadmap", "contributor-guide/roadmap", "contributor-guide/specification/index", "contributor-guide/specification/invariants", "contributor-guide/specification/output-field-name-semantic", "index", "library-user-guide/adding-udfs", "library-user-guide/building-logical-plans", "library-user-guide/catalogs", "library-user-guide/custom-tab [...]
\ No newline at end of file
+Search.setIndex({"docnames": ["contributor-guide/architecture", "contributor-guide/communication", "contributor-guide/index", "contributor-guide/quarterly_roadmap", "contributor-guide/roadmap", "contributor-guide/specification/index", "contributor-guide/specification/invariants", "contributor-guide/specification/output-field-name-semantic", "index", "library-user-guide/adding-udfs", "library-user-guide/building-logical-plans", "library-user-guide/catalogs", "library-user-guide/custom-tab [...]
\ No newline at end of file
diff --git a/user-guide/configs.html b/user-guide/configs.html
index ea6ada8cbf..ac355fdc48 100644
--- a/user-guide/configs.html
+++ b/user-guide/configs.html
@@ -484,24 +484,24 @@ Environment variables are read during <code class="docutils literal notranslate"
<td><p>Sets parquet writer version valid values are “1.0” and “2.0”</p></td>
</tr>
<tr class="row-odd"><td><p>datafusion.execution.parquet.compression</p></td>
-<td><p>snappy</p></td>
-<td><p>Sets default parquet compression codec Valid values are: uncompressed, snappy, gzip(level), lzo, brotli(level), lz4, zstd(level), and lz4_raw. These values are not case sensitive.</p></td>
+<td><p>NULL</p></td>
+<td><p>Sets default parquet compression codec Valid values are: uncompressed, snappy, gzip(level), lzo, brotli(level), lz4, zstd(level), and lz4_raw. These values are not case sensitive. If NULL, uses default parquet writer setting</p></td>
</tr>
<tr class="row-even"><td><p>datafusion.execution.parquet.dictionary_enabled</p></td>
-<td><p>true</p></td>
-<td><p>Sets if dictionary encoding is enabled</p></td>
+<td><p>NULL</p></td>
+<td><p>Sets if dictionary encoding is enabled. If NULL, uses default parquet writer setting</p></td>
</tr>
<tr class="row-odd"><td><p>datafusion.execution.parquet.dictionary_page_size_limit</p></td>
<td><p>1048576</p></td>
<td><p>Sets best effort maximum dictionary page size, in bytes</p></td>
</tr>
<tr class="row-even"><td><p>datafusion.execution.parquet.statistics_enabled</p></td>
-<td><p>page</p></td>
-<td><p>Sets if statistics are enabled for any column Valid values are: “none”, “chunk”, and “page” These values are not case sensitive.</p></td>
+<td><p>NULL</p></td>
+<td><p>Sets if statistics are enabled for any column Valid values are: “none”, “chunk”, and “page” These values are not case sensitive. If NULL, uses default parquet writer setting</p></td>
</tr>
<tr class="row-odd"><td><p>datafusion.execution.parquet.max_statistics_size</p></td>
-<td><p>4096</p></td>
-<td><p>Sets max statistics size for any column</p></td>
+<td><p>NULL</p></td>
+<td><p>Sets max statistics size for any column. If NULL, uses default parquet writer setting</p></td>
</tr>
<tr class="row-even"><td><p>datafusion.execution.parquet.max_row_group_size</p></td>
<td><p>1048576</p></td>
@@ -520,20 +520,20 @@ Environment variables are read during <code class="docutils literal notranslate"
<td><p>Sets best effort maximum number of rows in data page</p></td>
</tr>
<tr class="row-even"><td><p>datafusion.execution.parquet.encoding</p></td>
-<td><p>plain</p></td>
-<td><p>Sets default encoding for any column Valid values are: plain, plain_dictionary, rle, bit_packed, delta_binary_packed, delta_length_byte_array, delta_byte_array, rle_dictionary, and byte_stream_split. These values are not case sensitive.</p></td>
+<td><p>NULL</p></td>
+<td><p>Sets default encoding for any column Valid values are: plain, plain_dictionary, rle, bit_packed, delta_binary_packed, delta_length_byte_array, delta_byte_array, rle_dictionary, and byte_stream_split. These values are not case sensitive. If NULL, uses default parquet writer setting</p></td>
</tr>
<tr class="row-odd"><td><p>datafusion.execution.parquet.bloom_filter_enabled</p></td>
<td><p>false</p></td>
<td><p>Sets if bloom filter is enabled for any column</p></td>
</tr>
<tr class="row-even"><td><p>datafusion.execution.parquet.bloom_filter_fpp</p></td>
-<td><p>0.05</p></td>
-<td><p>Sets bloom filter false positive probability</p></td>
+<td><p>NULL</p></td>
+<td><p>Sets bloom filter false positive probability. If NULL, uses default parquet writer setting</p></td>
</tr>
<tr class="row-odd"><td><p>datafusion.execution.parquet.bloom_filter_ndv</p></td>
-<td><p>1000000</p></td>
-<td><p>Sets bloom filter number of distinct values</p></td>
+<td><p>NULL</p></td>
+<td><p>Sets bloom filter number of distinct values. If NULL, uses default parquet writer setting</p></td>
</tr>
<tr class="row-even"><td><p>datafusion.execution.aggregate.scalar_update_factor</p></td>
<td><p>10</p></td>