You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hbase.apache.org by Lian Jiang <ji...@gmail.com> on 2018/08/13 23:03:32 UTC

HDP3.0: failed to map segment from shared object: Operation not permitted

Hi,

I installed hadoop cluster using HDP3.0 but hbase does not work due to this
error:

Caused by: java.lang.UnsatisfiedLinkError: failed to load the required
native library

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.Epoll.ensureAvailability(Epoll.java:81)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.<clinit>(EpollEventLoop.java:55)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.newChild(EpollEventLoopGroup.java:134)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.newChild(EpollEventLoopGroup.java:35)

        at
org.apache.hbase.thirdparty.io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:84)

        at
org.apache.hbase.thirdparty.io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:58)

        at
org.apache.hbase.thirdparty.io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:47)

        at
org.apache.hbase.thirdparty.io.netty.channel.MultithreadEventLoopGroup.<init>(MultithreadEventLoopGroup.java:59)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:104)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:91)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:68)

        at
org.apache.hadoop.hbase.util.NettyEventLoopGroupConfig.<init>(NettyEventLoopGroupConfig.java:61)

        at
org.apache.hadoop.hbase.regionserver.HRegionServer.setupNetty(HRegionServer.java:673)

        at
org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:532)

        at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:472)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)

        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

        at
org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2923)

        ... 5 more

Caused by: java.lang.UnsatisfiedLinkError:
/tmp/liborg_apache_hbase_thirdparty_netty_transport_native_epoll_x86_644257058602762792223.so:
/tmp/liborg_apache_hbase_thirdparty_netty_transport_native_ep

oll_x86_644257058602762792223.so: failed to map segment from shared object:
Operation not permitted

        at java.lang.ClassLoader$NativeLibrary.load(Native Method)

        at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)

        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)

        at java.lang.Runtime.load0(Runtime.java:809)

        at java.lang.System.load(System.java:1086)

        at
org.apache.hbase.thirdparty.io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)

        at
org.apache.hbase.thirdparty.io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:243)

        at
org.apache.hbase.thirdparty.io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:187)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:207)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.<clinit>(Native.java:65)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.Epoll.<clinit>(Epoll.java:33)

        ... 24 more


Looks it is caused by nonexec permission of /tmp. To make hbase not use
/tmp, I added

{
      "hbase-site": {
        "properties": {
          "hbase.tmp.dir": "/u01/tmp"
        }
      }
    },

But this does not work and hbase still uses /tmp. Any idea? Appreciate any
help.

Re: HDP3.0: failed to map segment from shared object: Operation not permitted

Posted by Lian Jiang <ji...@gmail.com>.

Thanks. I just did what you advised.

On Mon, Aug 13, 2018 at 4:29 PM, Ted Yu <yu...@gmail.com> wrote:

> Since you are using a vendor's distro, can you post on their user group ?
> Cheers
> -------- Original message --------From: Lian Jiang <ji...@gmail.com>
> Date: 8/13/18  4:03 PM  (GMT-08:00) To: user@hbase.apache.org Subject:
> HDP3.0: failed to map segment from shared object: Operation not permitted
> Hi,
>
> I installed hadoop cluster using HDP3.0 but hbase does not work due to this
> error:
>
> Caused by: java.lang.UnsatisfiedLinkError: failed to load the required
> native library
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.Epoll.
> ensureAvailability(Epoll.java:81)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.
> EpollEventLoop.<clinit>(EpollEventLoop.java:55)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.
> EpollEventLoopGroup.newChild(EpollEventLoopGroup.java:134)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.
> EpollEventLoopGroup.newChild(EpollEventLoopGroup.java:35)
>
>         at
> org.apache.hbase.thirdparty.io.netty.util.concurrent.
> MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.
> java:84)
>
>         at
> org.apache.hbase.thirdparty.io.netty.util.concurrent.
> MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.
> java:58)
>
>         at
> org.apache.hbase.thirdparty.io.netty.util.concurrent.
> MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.
> java:47)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.MultithreadEventLoopGroup.<
> init>(MultithreadEventLoopGroup.java:59)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.
> EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:104)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.
> EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:91)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.
> EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:68)
>
>         at
> org.apache.hadoop.hbase.util.NettyEventLoopGroupConfig.<init>(
> NettyEventLoopGroupConfig.java:61)
>
>         at
> org.apache.hadoop.hbase.regionserver.HRegionServer.
> setupNetty(HRegionServer.java:673)
>
>         at
> org.apache.hadoop.hbase.regionserver.HRegionServer.<
> init>(HRegionServer.java:532)
>
>         at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:472)
>
>         at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)
>
>         at
> sun.reflect.NativeConstructorAccessorImpl.newInstance(
> NativeConstructorAccessorImpl.java:62)
>
>         at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(
> DelegatingConstructorAccessorImpl.java:45)
>
>         at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
>
>         at
> org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2923)
>
>         ... 5 more
>
> Caused by: java.lang.UnsatisfiedLinkError:
> /tmp/liborg_apache_hbase_thirdparty_netty_transport_native_epoll_x86_
> 644257058602762792223.so:
> /tmp/liborg_apache_hbase_thirdparty_netty_transport_native_ep
>
> oll_x86_644257058602762792223.so: failed to map segment from shared
> object:
> Operation not permitted
>
>         at java.lang.ClassLoader$NativeLibrary.load(Native Method)
>
>         at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)
>
>         at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)
>
>         at java.lang.Runtime.load0(Runtime.java:809)
>
>         at java.lang.System.load(System.java:1086)
>
>         at
> org.apache.hbase.thirdparty.io.netty.util.internal.
> NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)
>
>         at
> org.apache.hbase.thirdparty.io.netty.util.internal.NativeLibraryLoader.
> loadLibrary(NativeLibraryLoader.java:243)
>
>         at
> org.apache.hbase.thirdparty.io.netty.util.internal.
> NativeLibraryLoader.load(NativeLibraryLoader.java:187)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.
> loadNativeLibrary(Native.java:207)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.
> <clinit>(Native.java:65)
>
>         at
> org.apache.hbase.thirdparty.io.netty.channel.epoll.Epoll.<
> clinit>(Epoll.java:33)
>
>         ... 24 more
>
>
> Looks it is caused by nonexec permission of /tmp. To make hbase not use
> /tmp, I added
>
> {
>       "hbase-site": {
>         "properties": {
>           "hbase.tmp.dir": "/u01/tmp"
>         }
>       }
>     },
>
> But this does not work and hbase still uses /tmp. Any idea? Appreciate any
> help.
>

Re: HDP3.0: failed to map segment from shared object: Operation not permitted

Posted by Ted Yu <yu...@gmail.com>.

Since you are using a vendor's distro, can you post on their user group ?
Cheers
-------- Original message --------From: Lian Jiang <ji...@gmail.com> Date: 8/13/18  4:03 PM  (GMT-08:00) To: user@hbase.apache.org Subject: HDP3.0: failed to map segment from shared object: Operation not permitted 
Hi,

I installed hadoop cluster using HDP3.0 but hbase does not work due to this
error:

Caused by: java.lang.UnsatisfiedLinkError: failed to load the required
native library

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.Epoll.ensureAvailability(Epoll.java:81)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.<clinit>(EpollEventLoop.java:55)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.newChild(EpollEventLoopGroup.java:134)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.newChild(EpollEventLoopGroup.java:35)

        at
org.apache.hbase.thirdparty.io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:84)

        at
org.apache.hbase.thirdparty.io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:58)

        at
org.apache.hbase.thirdparty.io.netty.util.concurrent.MultithreadEventExecutorGroup.<init>(MultithreadEventExecutorGroup.java:47)

        at
org.apache.hbase.thirdparty.io.netty.channel.MultithreadEventLoopGroup.<init>(MultithreadEventLoopGroup.java:59)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:104)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:91)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoopGroup.<init>(EpollEventLoopGroup.java:68)

        at
org.apache.hadoop.hbase.util.NettyEventLoopGroupConfig.<init>(NettyEventLoopGroupConfig.java:61)

        at
org.apache.hadoop.hbase.regionserver.HRegionServer.setupNetty(HRegionServer.java:673)

        at
org.apache.hadoop.hbase.regionserver.HRegionServer.<init>(HRegionServer.java:532)

        at org.apache.hadoop.hbase.master.HMaster.<init>(HMaster.java:472)

        at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)

        at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)

        at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)

        at java.lang.reflect.Constructor.newInstance(Constructor.java:423)

        at
org.apache.hadoop.hbase.master.HMaster.constructMaster(HMaster.java:2923)

        ... 5 more

Caused by: java.lang.UnsatisfiedLinkError:
/tmp/liborg_apache_hbase_thirdparty_netty_transport_native_epoll_x86_644257058602762792223.so:
/tmp/liborg_apache_hbase_thirdparty_netty_transport_native_ep

oll_x86_644257058602762792223.so: failed to map segment from shared object:
Operation not permitted

        at java.lang.ClassLoader$NativeLibrary.load(Native Method)

        at java.lang.ClassLoader.loadLibrary0(ClassLoader.java:1941)

        at java.lang.ClassLoader.loadLibrary(ClassLoader.java:1824)

        at java.lang.Runtime.load0(Runtime.java:809)

        at java.lang.System.load(System.java:1086)

        at
org.apache.hbase.thirdparty.io.netty.util.internal.NativeLibraryUtil.loadLibrary(NativeLibraryUtil.java:36)

        at
org.apache.hbase.thirdparty.io.netty.util.internal.NativeLibraryLoader.loadLibrary(NativeLibraryLoader.java:243)

        at
org.apache.hbase.thirdparty.io.netty.util.internal.NativeLibraryLoader.load(NativeLibraryLoader.java:187)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.loadNativeLibrary(Native.java:207)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.<clinit>(Native.java:65)

        at
org.apache.hbase.thirdparty.io.netty.channel.epoll.Epoll.<clinit>(Epoll.java:33)

        ... 24 more


Looks it is caused by nonexec permission of /tmp. To make hbase not use
/tmp, I added

{
      "hbase-site": {
        "properties": {
          "hbase.tmp.dir": "/u01/tmp"
        }
      }
    },

But this does not work and hbase still uses /tmp. Any idea? Appreciate any
help.