You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by dz...@apache.org on 2022/10/20 14:06:57 UTC

[drill-site] branch master updated: Document drill.exec.recursive_file_listing_max_size.

This is an automated email from the ASF dual-hosted git repository.

dzamo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/drill-site.git


The following commit(s) were added to refs/heads/master by this push:
     new 882596054 Document drill.exec.recursive_file_listing_max_size.
882596054 is described below

commit 8825960542c1de1ae89660d583a1132d2a2ad8f8
Author: James Turton <ja...@somecomputer.xyz>
AuthorDate: Thu Oct 20 16:06:32 2022 +0200

    Document drill.exec.recursive_file_listing_max_size.
---
 .../plugins/040-file-system-storage-plugin.md              | 14 ++++++++++++++
 .../sql-reference/sql-functions/040-string-manipulation.md |  2 +-
 2 files changed, 15 insertions(+), 1 deletion(-)

diff --git a/_docs/en/connect-a-data-source/plugins/040-file-system-storage-plugin.md b/_docs/en/connect-a-data-source/plugins/040-file-system-storage-plugin.md
index b8a5ae2b9..0eea05ce0 100644
--- a/_docs/en/connect-a-data-source/plugins/040-file-system-storage-plugin.md
+++ b/_docs/en/connect-a-data-source/plugins/040-file-system-storage-plugin.md
@@ -42,6 +42,8 @@ To change the `dfs` storage plugin configuration to point to a different local o
   }
   ```
 
+Note that a local file system configuration can be based on the mount point of a network file system that has been mounted at the same location in the local file systems of each Drillbit.
+
 * Distributed file system example:
 
   ```
@@ -98,3 +100,15 @@ If the `json_files` workspace did not exist, the query would have to include the
 full file path name to the `donuts.json` file:
 
     SELECT * FROM dfs.`/users/max/drill/json/donuts.json` WHERE type='frosted';
+
+## Configuration options in core-site.xml
+
+### drill.exec.recursive_file_listing_max_size
+
+Use this property to set a limit on the numer of files that Drill
+will list by recursing into a DFS directory tree. When the limit is
+encountered the initiating operation will fail with an error. The
+intended application of this limit is to allow admins to protect their
+Drillbits from an errant or malicious SELECT * FROM dfs.huge_workspace
+LIMIT 10 query, which will cause an OOM given a big enough workspace of
+files. Defaults to 0 which means no limit.
diff --git a/_docs/en/sql-reference/sql-functions/040-string-manipulation.md b/_docs/en/sql-reference/sql-functions/040-string-manipulation.md
index 7a6356b2c..0b4aa6b3e 100644
--- a/_docs/en/sql-reference/sql-functions/040-string-manipulation.md
+++ b/_docs/en/sql-reference/sql-functions/040-string-manipulation.md
@@ -122,7 +122,7 @@ true in the case of a match.
 
 ### ILIKE Syntax
 
-Note that it necessary quote ILIKE function calls using backticks because ILIKE
+Note that it is necessary to quote ILIKE function calls using backticks because ILIKE
 is also a SQL keyword.
 
 ```