You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by dz...@apache.org on 2021/10/30 09:52:01 UTC
[drill-site] branch master updated (d112814 -> c3cad90)
This is an automated email from the ASF dual-hosted git repository.
dzamo pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/drill-site.git.
from d112814 Updated docs.json files adding Dropbox page.
new 0b26ee8 Update sourceParameters example for pg to encourage minimumIdle = 0.
new cca4a08 Fix Docker run command syntax.
new c3cad90 Update link to progers' wiki to new Drill dev wiki.
The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../plugins/080-rdbms-storage-plugin.md | 18 +++----
.../011-running-drill-on-docker.md | 63 ++++++++++++----------
community-resources.md | 2 +-
3 files changed, 46 insertions(+), 37 deletions(-)
[drill-site] 01/03: Update sourceParameters example for pg to
encourage minimumIdle = 0.
Posted by dz...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
dzamo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/drill-site.git
commit 0b26ee8be6b965011f312a41349efe861db95da4
Author: James Turton <ja...@somecomputer.xyz>
AuthorDate: Fri Oct 22 11:14:32 2021 +0200
Update sourceParameters example for pg to encourage minimumIdle = 0.
---
.../plugins/080-rdbms-storage-plugin.md | 18 +++++++++---------
1 file changed, 9 insertions(+), 9 deletions(-)
diff --git a/_docs/en/connect-a-data-source/plugins/080-rdbms-storage-plugin.md b/_docs/en/connect-a-data-source/plugins/080-rdbms-storage-plugin.md
index 8832579..05c0f3e 100644
--- a/_docs/en/connect-a-data-source/plugins/080-rdbms-storage-plugin.md
+++ b/_docs/en/connect-a-data-source/plugins/080-rdbms-storage-plugin.md
@@ -10,18 +10,18 @@ As with any source, Drill supports joins within and between all systems. Drill a
## Using the RDBMS Storage Plugin
Drill is designed to work with any relational datastore that provides a JDBC driver. Drill is actively tested with
- Postgres, MySQL, Oracle, MSSQL, Apache Derby and H2. For each system, you will follow three basic steps for setup:
+ PostgreSQL, MySQL, Oracle, MSSQL, Apache Derby and H2. For each system, you will follow three basic steps for setup:
1. [Install Drill]({{ site.baseurl }}/docs/installing-drill-in-embedded-mode), if you do not already have it installed.
2. Copy your database's JDBC driver into the `jars/3rdparty` directory. (You'll need to do this on every node.)
3. Restart Drill. See [Starting Drill in Distributed Mode]({{site.baseurl}}/docs/starting-drill-in-distributed-mode/).
- 4. Add a new storage configuration to Drill through the Web UI. Example configurations for [Oracle](#example-oracle-configuration), [SQL Server](#example-sql-server-configuration), [MySQL](#example-mysql-configuration) and [Postgres](#example-postgres-configuration) are provided below.
+ 4. Add a new storage configuration to Drill through the Web UI. Example configurations for [Oracle](#example-oracle-configuration), [SQL Server](#example-sql-server-configuration), [MySQL](#example-mysql-configuration) and [PostgreSQL](#example-postgres-configuration) are provided below.
## Setting data source parameters in the storage plugin configuration
**Introduced in release:** 1.18
-A JDBC storage plugin configuration property `sourceParameters` was introduced to allow setting data source parameters described in [HikariCP](https://github.com/brettwooldridge/HikariCP#configuration-knobs-baby). Parameters names with incorrect naming and parameter values which are of incorrect data type or illegal will cause the storage plugin to fail to start. See the [Example of Postgres Configuration with `sourceParameters` configuration property](#example-of-postgres-configuratio [...]
+A JDBC storage plugin configuration property `sourceParameters` was introduced to allow setting data source parameters described in [HikariCP](https://github.com/brettwooldridge/HikariCP#configuration-knobs-baby). Parameters names with incorrect naming and parameter values which are of incorrect data type or illegal will cause the storage plugin to fail to start. See the [Example of PostgreSQL Configuration with `sourceParameters` configuration property](#example-of-postgres-configurat [...]
### Example: Working with MySQL
@@ -111,12 +111,12 @@ For MySQL, Drill has been tested with MySQL's [mysql-connector-java-5.1.37-bin.j
}
```
-### Example Postgres Configuration
+### Example PostgreSQL Configuration
-Drill is tested with the Postgres driver version [42.2.11](https://mvnrepository.com/artifact/org.postgresql/postgresql) (any recent driver should work).
+Drill is tested with the PostgreSQL driver version [42.2.11](https://mvnrepository.com/artifact/org.postgresql/postgresql) (any recent driver should work).
Download and copy this driver jar to the `jars/3rdparty` folder on all nodes.
-{% include startnote.html %}You'll need to provide a database name as part of your JDBC connection string for Drill to correctly expose Postgres tables.{% include endnote.html %}
+{% include startnote.html %}You'll need to provide a database name as part of your JDBC connection string for Drill to correctly expose PostgreSQL tables.{% include endnote.html %}
```json
{
@@ -155,7 +155,7 @@ You may need to qualify a table name with a schema name for Drill to return data
| 2 | 1.2.3.5 |
|------|---------|
-### Example of Postgres Configuration with `sourceParameters` configuration property
+### Example of PostgreSQL Configuration with `sourceParameters` configuration property
```json
{
"type": "jdbc",
@@ -165,8 +165,8 @@ You may need to qualify a table name with a schema name for Drill to return data
"username": "user",
"password": "password",
"sourceParameters": {
- "minimumIdle": 5,
- "autoCommit": false,
+ "minimumIdle": 0,
+ "autoCommit": true,
"connectionTestQuery": "select version() as postgresql_version",
"dataSource.cachePrepStmts": true,
"dataSource.prepStmtCacheSize": 250
[drill-site] 02/03: Fix Docker run command syntax.
Posted by dz...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
dzamo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/drill-site.git
commit cca4a080a092361e2410b3fa15adf55ce443851b
Author: James Turton <ja...@somecomputer.xyz>
AuthorDate: Mon Oct 25 11:03:37 2021 +0200
Fix Docker run command syntax.
---
.../011-running-drill-on-docker.md | 63 ++++++++++++----------
1 file changed, 36 insertions(+), 27 deletions(-)
diff --git a/_docs/en/install/installing-drill-in-embedded-mode/011-running-drill-on-docker.md b/_docs/en/install/installing-drill-in-embedded-mode/011-running-drill-on-docker.md
index 757a6f0..da6c5c9 100644
--- a/_docs/en/install/installing-drill-in-embedded-mode/011-running-drill-on-docker.md
+++ b/_docs/en/install/installing-drill-in-embedded-mode/011-running-drill-on-docker.md
@@ -31,11 +31,11 @@ You must have Docker version 18 or later [installed on your machine](https://doc
## Running Drill in a Docker Container
-You can start and run a Docker container in detached mode or foreground mode. [Detached mode]({{site.baseurl}}/docs/running-drill-on-docker/#running-the-drill-docker-container-in-detached-mode) runs the container in the background. Foreground is the default mode. [Foreground mode]({{site.baseurl}}/docs/running-drill-on-docker/#running-the-drill-docker-container-in-foreground-mode) runs the Drill process in the container and attaches the console to Drill’s standard input, output, and stan [...]
+You can start and run a Docker container in detached mode or foreground mode. [Detached mode]({{site.baseurl}}/docs/running-drill-on-docker/#running-the-drill-docker-container-in-detached-mode) runs the container in the background. Foreground is the default mode. [Foreground mode]({{site.baseurl}}/docs/running-drill-on-docker/#running-the-drill-docker-container-in-foreground-mode) runs the Drill process in the container and attaches the console to Drill’s standard input, output, and stan [...]
+
+Whether you run the Docker container in detached or foreground mode, you start Drill in a container by issuing the docker `run` command with some options, as described in the following table:
-Whether you run the Docker container in detached or foreground mode, you start Drill in a container by issuing the docker `run` command with some options, as described in the following table:
-
|--------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Option | Description |
|--------------------------|-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
@@ -49,14 +49,17 @@ Whether you run the Docker container in detached or foreground mode, you start D
If you decide to work in the filesytem of the Docker image, for example to modify a Drill configuration file, then be aware that Drill has been installed to /opt/drill. When reading the Drill documentation in the context of the official Docker image, you should substitute the mentioned path for any mentions of the environment variable `$DRILL_HOME`.
-### Running the Drill Docker Container in Foreground Mode
+### Running the Drill Docker Container in Foreground Mode
-Open a terminal window (Command Prompt or PowerShell, but not PowerShell ISE) and then issue the following command and options to connect to SQLLine (the Drill shell):
+Open a terminal window (Command Prompt or PowerShell, but not PowerShell ISE) and then issue the following command and options to connect to SQLLine (the Drill shell):
```sh
-docker run -i --name drill-1.19.0 -p 8047:8047 -t apache/drill:1.19.0 /bin/bash
+docker run -it --name drill \
+ -p 8047:8047 \ # web and REST
+ -p 31010:31010 \ # JDBC
+ apache/drill
```
-When you issue the docker run command, the Drill process starts in a container. SQLLine prints a message, and the prompt appears:
+When you issue the docker run command, the Drill process starts in a container. SQLLine prints a message, and the prompt appears:
Apache Drill 1.19.0
"json ain't no thang"
@@ -64,7 +67,7 @@ When you issue the docker run command, the Drill process starts in a container.
At the prompt, you can enter the following simple query to verify that Drill is running:
```sql
-SELECT version FROM sys.version;
+SELECT version FROM sys.version;
```
### Running the Drill Docker Container in Detached Mode
@@ -73,13 +76,19 @@ Open a terminal window (Command Prompt or PowerShell, but not PowerShell ISE) an
**Note:** When you run the Drill Docker container in detached mode, you connect to SQLLine (the Drill shell) using drill-localhost.
```sh
-$ docker run -i --name drill-1.19.0 -p 8047:8047 --detach -t apache/drill:1.19.0 /bin/bash
+$ docker run --name drill \
+ -p 8047:8047 \ # web and REST
+ -p 31010:31010 \ # JDBC
+ --detach
+ apache/drill
+
<displays container ID>
-$ docker exec -it drill-1.19.0 bash
+$ docker exec -it drill /bin/bash
+
<connects to container>
-$ /opt/drill/bin/drill-localhost
+$ $DRILL_HOME/bin/drill-embedded
```
After you issue the commands, the Drill process starts in a container. SQLLine prints a message, and the prompt appears:
@@ -88,14 +97,14 @@ After you issue the commands, the Drill process starts in a container. SQLLine p
"json ain't no thang"
apache drill>
-At the prompt, you can enter the following simple query to verify that Drill is running:
+At the prompt, you can enter the following simple query to verify that Drill is running:
```sql
-SELECT version FROM sys.version;
+SELECT version FROM sys.version;
```
-## Querying Data
+## Querying Data
-By default, you can only query files that are accessible within the container. For example, you can query the sample data packaged with Drill, as shown:
+By default, you can only query files that are accessible within the container. For example, you can query the sample data packaged with Drill, as shown:
```sql
SELECT first_name, last_name FROM cp.`employee.json` LIMIT 1;
@@ -106,31 +115,31 @@ SELECT first_name, last_name FROM cp.`employee.json` LIMIT 1;
|------------|-----------|
| Sheri | Nowmer |
|------------|-----------|
-1 row selected (0.256 seconds)
+1 row selected (0.256 seconds)
```
To query files stored outside of the container, you can [bind mount a directory in from the host](https://docs.docker.com/storage/bind-mounts/)
```sh
-docker run -i --name drill-1.19.0 \
- -p 8047:8047 \
- -t apache/drill:1.19.0
- -v /mnt/big/data:/mnt
- /bin/bash
+docker run -it --name drill \
+ -p 8047:8047 \ # web and REST
+ -p 31010:31010 \ # JDBC
+ -v /mnt/big/data:/mnt \
+ apache/drill
```
or you can [create and mount a Docker volume](https://docs.docker.com/storage/volumes/).
```sh
docker volume create big-data-vol
-docker run -i --name drill-1.19.0 \
- -p 8047:8047 \
- -t apache/drill:1.19.0
+docker run -it --name drill \
+ -p 8047:8047 \ # web and REST
+ -p 31010:31010 \ # JDBC
-v big-data-vol:/mnt
- /bin/bash
+ apache/drill
```
See the linked Docker documentation for more details.
-## Drill Web UI
+## Drill Web UI
-You can access the Drill web UI at `http://localhost:8047` when the Drill Docker container is running. On Windows, you may need to specify the IP address of your system instead of using "localhost".
+You can access the Drill web UI at `http://localhost:8047` when the Drill Docker container is running. On Windows, you may need to specify the IP address of your system instead of using "localhost".
[drill-site] 03/03: Update link to progers' wiki to new Drill dev
wiki.
Posted by dz...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
dzamo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/drill-site.git
commit c3cad901522bd005b58dfb99f668b9999241d2f2
Author: James Turton <ja...@somecomputer.xyz>
AuthorDate: Sat Oct 30 11:50:59 2021 +0200
Update link to progers' wiki to new Drill dev wiki.
---
community-resources.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/community-resources.md b/community-resources.md
index f6c618d..677a5ca 100644
--- a/community-resources.md
+++ b/community-resources.md
@@ -22,7 +22,7 @@ permalink: /community-resources/
* [Contribute to Drill]({{ site.baseurl }}/docs/contribute-to-drill/)
* Hangout: A [bi-weekly Drill hangout](https://plus.google.com/hangouts/_/event/ci4rdiju8bv04a64efj5fedd0lc) occurs every other Tuesday at 10 am PDT. For more information and hangout notes, see [Apache Drill Hangout Notes](https://docs.google.com/document/d/1o2GvZUtJvKzN013JdM715ZBzhseT0VyZ9WgmLMeeUUk/edit?ts=5744c15c#heading=h.z8q6drmaybbj).
* Source code: [GitHub](https://github.com/apache/drill)
-* Paul Rogers' wiki: [An informal set of notes describing Drill internals](https://github.com/paul-rogers/drill/wiki)
+* [Drill developer wiki (formerly Paul Rogers' wiki)](https://github.com/apache/drill/wiki)
## Apache Software Foundation Resources