You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@drill.apache.org by dz...@apache.org on 2021/12/22 13:12:28 UTC

[drill-site] branch master updated: DRILL-8077: add troubleshooting information for IPv6 connections to HDFS Datanode in CLOSE_WAIT state

This is an automated email from the ASF dual-hosted git repository.

dzamo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/drill-site.git


The following commit(s) were added to refs/heads/master by this push:
     new 3539904  DRILL-8077: add troubleshooting information for IPv6 connections to HDFS Datanode in CLOSE_WAIT state
     new 6b139c3  Merge pull request #21 from Z0ltrix/DRILL-8077
3539904 is described below

commit 353990460c147d89d65880ae03a771cee015117a
Author: Christian Pfarr <z0...@pm.me>
AuthorDate: Tue Dec 21 20:59:06 2021 +0100

    DRILL-8077: add troubleshooting information for IPv6 connections to HDFS Datanode in CLOSE_WAIT state
---
 _docs/en/110-troubleshooting.md | 13 +++++++++++++
 1 file changed, 13 insertions(+)

diff --git a/_docs/en/110-troubleshooting.md b/_docs/en/110-troubleshooting.md
index 88816f0..99db2f7 100644
--- a/_docs/en/110-troubleshooting.md
+++ b/_docs/en/110-troubleshooting.md
@@ -53,6 +53,7 @@ If you have any of the following problems, try the suggested solution:
 * [Queries Running Out of Memory]({{site.baseurl}}/docs/troubleshooting/#queries-running-out-of-memory)
 * [Unclear Error Message]({{site.baseurl}}/docs/troubleshooting/#unclear-error-message)
 * [Error Starting Drill in Embedded Mode]({{site.baseurl}}/docs/troubleshooting/#error-starting-drill-in-embedded-mode)
+* [CLOSE_WAIT connections to HDFS Datanode]({{site.baseurl}}/docs/troubleshooting/#close_wait-connections-to-hdfs-datanode)
 
 ### Memory Issues
 Symptom: Memory problems occur when you run certain queries, such as those with sort operators.
@@ -276,3 +277,15 @@ Symptom:
 `java.net.BindException: Address already in use`  
 
 Solution:  You can only run one Drillbit per node in embedded or distributed mode using default settings. You need to either change ports used by Drillbit or stop one Drillbit before starting another.
+
+### CLOSE_WAIT connections to HDFS Datanode
+
+Currently Hadoop does not support IPv6 client connections (See [HADOOP-11890](https://issues.apache.org/jira/browse/HADOOP-11890)).
+
+If you run Drill within an IPv6 environment and see a lot of IPv6 connections from Drillbit to HDFS Datanode in `CLOSE_WAIT` state, you can fix this by preferring IPv4 over IPv6 via `drill-env.sh` 
+
+```
+export DRILLBIT_JAVA_OPTS="$DRILLBIT_JAVA_OPTS -Djava.net.preferIPv4Stack=true -Djava.net.preferIPv6Addresses=false"
+```
+
+This tells the Drillbit to use IPv4 connections to all Datasources, not only to HDFS.
\ No newline at end of file