You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by dz...@apache.org on 2022/10/20 14:06:57 UTC
[drill-site] branch master updated: Document drill.exec.recursive_file_listing_max_size.
This is an automated email from the ASF dual-hosted git repository.
dzamo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/drill-site.git
The following commit(s) were added to refs/heads/master by this push:
new 882596054 Document drill.exec.recursive_file_listing_max_size.
882596054 is described below
commit 8825960542c1de1ae89660d583a1132d2a2ad8f8
Author: James Turton <ja...@somecomputer.xyz>
AuthorDate: Thu Oct 20 16:06:32 2022 +0200
Document drill.exec.recursive_file_listing_max_size.
---
.../plugins/040-file-system-storage-plugin.md | 14 ++++++++++++++
.../sql-reference/sql-functions/040-string-manipulation.md | 2 +-
2 files changed, 15 insertions(+), 1 deletion(-)
diff --git a/_docs/en/connect-a-data-source/plugins/040-file-system-storage-plugin.md b/_docs/en/connect-a-data-source/plugins/040-file-system-storage-plugin.md
index b8a5ae2b9..0eea05ce0 100644
--- a/_docs/en/connect-a-data-source/plugins/040-file-system-storage-plugin.md
+++ b/_docs/en/connect-a-data-source/plugins/040-file-system-storage-plugin.md
@@ -42,6 +42,8 @@ To change the `dfs` storage plugin configuration to point to a different local o
}
```
+Note that a local file system configuration can be based on the mount point of a network file system that has been mounted at the same location in the local file systems of each Drillbit.
+
* Distributed file system example:
```
@@ -98,3 +100,15 @@ If the `json_files` workspace did not exist, the query would have to include the
full file path name to the `donuts.json` file:
SELECT * FROM dfs.`/users/max/drill/json/donuts.json` WHERE type='frosted';
+
+## Configuration options in core-site.xml
+
+### drill.exec.recursive_file_listing_max_size
+
+Use this property to set a limit on the numer of files that Drill
+will list by recursing into a DFS directory tree. When the limit is
+encountered the initiating operation will fail with an error. The
+intended application of this limit is to allow admins to protect their
+Drillbits from an errant or malicious SELECT * FROM dfs.huge_workspace
+LIMIT 10 query, which will cause an OOM given a big enough workspace of
+files. Defaults to 0 which means no limit.
diff --git a/_docs/en/sql-reference/sql-functions/040-string-manipulation.md b/_docs/en/sql-reference/sql-functions/040-string-manipulation.md
index 7a6356b2c..0b4aa6b3e 100644
--- a/_docs/en/sql-reference/sql-functions/040-string-manipulation.md
+++ b/_docs/en/sql-reference/sql-functions/040-string-manipulation.md
@@ -122,7 +122,7 @@ true in the case of a match.
### ILIKE Syntax
-Note that it necessary quote ILIKE function calls using backticks because ILIKE
+Note that it is necessary to quote ILIKE function calls using backticks because ILIKE
is also a SQL keyword.
```