You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Adriano (JIRA)" <ji...@apache.org> on 2019/08/12 16:20:00 UTC
[jira] [Comment Edited] (IMPALA-8852) ImpalaD fail to start on a
non-datanode with "Invalid short-circuit reads configuration"
[ https://issues.apache.org/jira/browse/IMPALA-8852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903830#comment-16903830 ]
Adriano edited comment on IMPALA-8852 at 8/12/19 4:19 PM:
----------------------------------------------------------
WORKAROUND -1-:
Create the dfs.domain.socket.path manually with the proper hdfs user permission on the local fs as:
{code:java}
# mkdir /var/run/hdfs-sockets/
# chown hdfs:hadoop /var/run/hdfs-sockets/
# chmod 755 /var/run/hdfs-sockets/
# mkdir /var/run/hdfs-sockets/dn
# chown hdfs:hdfs /var/run/hdfs-sockets/dn
# chmod 1666 /var/run/hdfs-sockets/dn
{code}
*Best Solution*:
1) On the Dedicated Coordinators, where the "-is_executor=false" add the following property into "Impala Daemon HDFS Advanced Configuration Snippet (Safety Valve)":
{code:java}
<property>
<name>dfs.client.read.shortcircuit</name>
<value>false</value>
<description>Disable shortcircuit on dedicated coordinator</description>
</property>
{code}
2) Save the changes and restart the Impala Daemon Coordinator instances.
was (Author: adrenas):
WORKAROUND -1-:
Create the dfs.domain.socket.path manually with the proper hdfs user permission on the local fs as:
{code:java}
# mkdir /var/run/hdfs-sockets/
# chown hdfs:hadoop /var/run/hdfs-sockets/
# chmod 755 /var/run/hdfs-sockets/
# mkdir /var/run/hdfs-sockets/dn
# chown hdfs:hdfs /var/run/hdfs-sockets/dn
# chmod 1666 /var/run/hdfs-sockets/dn
{code}
WORKAROUND -2-:
1) On the Dedicated Coordinators, where the "-is_executor=false" add the following property into "Impala Daemon HDFS Advanced Configuration Snippet (Safety Valve)":
{code:java}
<property>
<name>dfs.client.read.shortcircuit</name>
<value>false</value>
<description>Disable shortcircuit on dedicated coordinator</description>
</property>
{code}
2) Save the changes and restart the Impala Daemon Coordinator instances.
> ImpalaD fail to start on a non-datanode with "Invalid short-circuit reads configuration"
> ----------------------------------------------------------------------------------------
>
> Key: IMPALA-8852
> URL: https://issues.apache.org/jira/browse/IMPALA-8852
> Project: IMPALA
> Issue Type: Bug
> Components: Backend
> Affects Versions: Impala 3.2.0, Impala 3.3.0
> Reporter: Adriano
> Priority: Major
> Labels: ramp-up
>
> On coordinator only nodes ([typically the edge nodes|https://www.cloudera.com/documentation/enterprise/5-15-x/topics/impala_dedicated_coordinator.html#concept_omm_gf1_n2b]):
> {code:java}
> --is_coordinator=true
> --is_executor=false
> {code}
> the *dfs.domain.socket.path* (can be nonexistent on the local FS as the Datanode role eventually is not installed on the edge node).
> The non existing path prevent the ImpalaD to start with the message:
> {code:java}
> I0809 04:15:53.899714 25364 status.cc:124] Invalid short-circuit reads configuration:
> - Impala cannot read or execute the parent directory of dfs.domain.socket.path
> @ 0xb35f19
> @ 0x100e2fe
> @ 0x103f274
> @ 0x102836f
> @ 0xa9f573
> @ 0x7f97807e93d4
> @ 0xafb3b8
> E0809 04:15:53.899749 25364 impala-server.cc:278] Invalid short-circuit reads configuration:
> - Impala cannot read or execute the parent directory of dfs.domain.socket.path
> {code}
> despite a coordinator-only ImpalaD does not do short circuit reads.
--
This message was sent by Atlassian JIRA
(v7.6.14#76016)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org