[jira] [Created] (IMPALA-8582) HDFS Datanodes fail to start with USE_CDP_HIVE=true on Centos 6

["Joe McDonnell (JIRA)" <ji...@apache.org>]

Joe McDonnell created IMPALA-8582:
-------------------------------------

             Summary: HDFS Datanodes fail to start with USE_CDP_HIVE=true on Centos 6
                 Key: IMPALA-8582
                 URL: https://issues.apache.org/jira/browse/IMPALA-8582
             Project: IMPALA
          Issue Type: Bug
          Components: Infrastructure
    Affects Versions: Impala 3.3.0
            Reporter: Joe McDonnell


On Centos 6, the HDFS Datanode won't start up with this error:
{noformat}
2019-05-22 22:35:49,852 WARN org.apache.hadoop.util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
...
2019-05-22 22:35:52,497 ERROR org.apache.hadoop.hdfs.server.datanode.DataNode: Exception in secureMain
java.lang.RuntimeException: Cannot start datanode because the configured max locked memory size (dfs.datanode.max.locked.memory) is greater than zero and native code is not available.
at org.apache.hadoop.hdfs.server.datanode.DataNode.startDataNode(DataNode.java:1379)
at org.apache.hadoop.hdfs.server.datanode.DataNode.<init>(DataNode.java:500)
at org.apache.hadoop.hdfs.server.datanode.DataNode.makeInstance(DataNode.java:2782)
at org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:2690)
at org.apache.hadoop.hdfs.server.datanode.DataNode.createDataNode(DataNode.java:2732)
at org.apache.hadoop.hdfs.server.datanode.DataNode.secureMain(DataNode.java:2876)
at org.apache.hadoop.hdfs.server.datanode.DataNode.main(DataNode.java:2900)
2019-05-22 22:35:52,506 INFO org.apache.hadoop.util.ExitUtil: Exiting with status 1: java.lang.RuntimeException: Cannot start datanode because the configured max locked memory size (dfs.datanode.max.locked.memory) is greater than zero and native code is not available.{noformat}
There must be something about the CDP version of Hadoop binaries that impacts this. As far as I know, the CDP Hadoop binaries are built on Centos 7. This is likely to be fixed by getting appropriate binaries. Anecdotally, this seems fine on Ubuntu 16.04 and Centos 7. 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)