You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Marc Villacorta (JIRA)" <ji...@apache.org> on 2016/10/26 15:30:59 UTC

[jira] [Created] (MESOS-6486) Mesos on Alpine Linux

Marc Villacorta created MESOS-6486:
--------------------------------------

             Summary: Mesos on Alpine Linux
                 Key: MESOS-6486
                 URL: https://issues.apache.org/jira/browse/MESOS-6486
             Project: Mesos
          Issue Type: Wish
    Affects Versions: 1.0.1
         Environment: *Docker*
{code:none}
➜  ~ docker version
Client:
 Version:      1.12.1
 API version:  1.24
 Go version:   go1.7.1
 Git commit:   6f9534c
 Built:        Thu Sep  8 10:31:18 2016
 OS/Arch:      darwin/amd64

Server:
 Version:      1.12.1
 API version:  1.24
 Go version:   go1.6.3
 Git commit:   23cf638
 Built:        Thu Aug 18 17:52:38 2016
 OS/Arch:      linux/amd64
{code}

*Alpine*
{code:none}
---------------  S Y S T E M  ---------------

OS:NAME="Alpine Linux"
ID=alpine
VERSION_ID=3.4.4
PRETTY_NAME="Alpine Linux v3.4"
HOME_URL="http://alpinelinux.org"
BUG_REPORT_URL="http://bugs.alpinelinux.org"

uname:Linux 4.4.20-moby #1 SMP Thu Sep 15 12:10:20 UTC 2016 x86_64
libc:glibc 2.9 NPTL
rlimit: STACK 8192k, CORE infinity, NPROC infinity, NOFILE 1048576, AS infinity
load average:0.01 0.39 0.89
{code}

*Java*
{code:none}
# JRE version: OpenJDK Runtime Environment (8.0_101-b13) (build 1.8.0_101-b13)
# Java VM: OpenJDK 64-Bit Server VM (25.101-b13 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea 3.1.0
# Distribution: Custom build (Tue Aug 30 20:38:19 GMT 2016)
{code}
            Reporter: Marc Villacorta
            Priority: Minor


I have compiled Mesos 1.0.1 inside a Docker container using Alpine Linux (Dockerfile below):

{code:none}
# Set the base image for subsequent instructions:

FROM alpine:3.4
MAINTAINER Marc Villacorta Morera <ma...@gmail.com>

# Environment variables:

ENV TAG="1.0.1" \
    PREFIX="/usr/local" \
    JAVA_HOME="/usr/lib/jvm/default-jvm" \
    JAVA_JVM_LIBRARY="/usr/lib/jvm/default-jvm/jre/lib/amd64/server/libjvm.so" \
    LD_LIBRARY_PATH="/usr/lib/jvm/default-jvm/jre/lib/amd64/server" \
    EDGE_REPO="http://nl.alpinelinux.org/alpine/edge"

# Install mesos:

RUN apk add -U --no-cache -t dev git autoconf automake libtool g++ \
    zlib-dev fts-dev apr-dev curl-dev file cyrus-sasl-dev cyrus-sasl-crammd5 \
    subversion-dev make patch linux-headers binutils && apk add -U --no-cache \
    -t dev openjdk8 maven --repository ${EDGE_REPO}/community && apk add -U \
    --no-cache libstdc++ libgcc subversion-libs libcurl fts zlib coreutils \
    && git clone https://git-wip-us.apache.org/repos/asf/mesos.git && cd mesos \
    && { [ "${TAG}" != "master" ] && git checkout tags/${TAG} -b ${TAG}; }; \
    ./bootstrap && mkdir build && cd build && ../configure --prefix=${PREFIX} \
    --disable-dependency-tracking --disable-maintainer-mode --disable-python \
    --enable-optimize --enable-silent-rules \
    && CORES=$(cat /proc/cpuinfo | grep processor | wc -l) \
    && make -j${CORES} && make install && cd && rm -rf /mesos ${PREFIX}/include \
    && find ${PREFIX} -type f -perm /u=x,g=x,o=x | xargs strip -s 2>/dev/null; \
    apk del --purge dev && rm -rf /var/cache/apk/*

# Command:

CMD ["/bin/sh"]
{code}

Some tests are failing and my biggest concern is with this one:
{code:none}
make check GTEST_FILTER="ExamplesTest.JavaFramework"
{code}

{code:none}
[==========] Running 1 test from 1 test case.
[----------] Global test environment set-up.
[----------] 1 test from ExamplesTest
[ RUN      ] ExamplesTest.JavaFramework
../../src/tests/script.cpp:80: Failure
Failed
java_framework_test.sh terminated with signal Segmentation fault
[  FAILED  ] ExamplesTest.JavaFramework (5655 ms)
[----------] 1 test from ExamplesTest (5656 ms total)

[----------] Global test environment tear-down
[==========] 1 test from 1 test case ran. (5689 ms total)
[  PASSED  ] 0 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] ExamplesTest.JavaFramework
{code}

An ugly SIGSEGV is dispatched by the kernel. It looks like _libjvm.so_ is the offending library but I am not sure at all:

{code:none}
I1026 15:19:54.843340  1706 replica.cpp:712] Persisted action at 7
I1026 15:19:54.843683  1706 replica.cpp:691] Replica received learned notice for position 7 from @0.0.0.0:0
I1026 15:19:54.864063  1706 leveldb.cpp:341] Persisting action (690 bytes) to leveldb took 20.333769ms
I1026 15:19:54.864123  1706 replica.cpp:712] Persisted action at 7
I1026 15:19:54.864131  1706 replica.cpp:697] Replica learned APPEND action at position 7
I1026 15:19:54.864936  1705 registrar.cpp:509] Successfully updated the 'registry' in 31.458048ms
I1026 15:19:54.864989  1700 log.cpp:596] Attempting to truncate the log to 7
I1026 15:19:54.865267  1706 coordinator.cpp:348] Coordinator attempting to write TRUNCATE action at position 8
I1026 15:19:54.866050  1706 slave.cpp:1095] Registered with master master@172.17.0.2:37015; given agent ID 7d8d36ff-5d82-4e91-aba8-46267acc8536-S2
I1026 15:19:54.866025  1700 master.cpp:4619] Registered agent 7d8d36ff-5d82-4e91-aba8-46267acc8536-S2 at slave(1)@172.17.0.2:37015 (2a2f454552b6) with cpus(*):2; mem(*):10240; disk(*):55318; ports(*):[31000-32000]
I1026 15:19:54.866127  1702 hierarchical.cpp:478] Added agent 7d8d36ff-5d82-4e91-aba8-46267acc8536-S2 (2a2f454552b6) with cpus(*):2; mem(*):10240; disk(*):55318; ports(*):[31000-32000] (allocated: )
I1026 15:19:54.866257  1700 status_update_manager.cpp:181] Resuming sending status updates
I1026 15:19:54.866878  1706 slave.cpp:1155] Forwarding total oversubscribed resources
I1026 15:19:54.866969  1706 master.cpp:5002] Received update of agent 7d8d36ff-5d82-4e91-aba8-46267acc8536-S2 at slave(1)@172.17.0.2:37015 (2a2f454552b6) with total oversubscribed resources
I1026 15:19:54.867280  1705 hierarchical.cpp:542] Agent 7d8d36ff-5d82-4e91-aba8-46267acc8536-S2 (2a2f454552b6) updated with oversubscribed resources  (total: cpus(*):2; mem(*):10240; disk(*):55318; ports(*):[31000-32000], allocated: )
I1026 15:19:54.867350  1706 replica.cpp:537] Replica received write request for position 8 from (67)@172.17.0.2:37015
I1026 15:19:54.876315  1706 leveldb.cpp:341] Persisting action (16 bytes) to leveldb took 8.874131ms
I1026 15:19:54.876348  1706 replica.cpp:712] Persisted action at 8
I1026 15:19:54.876600  1705 replica.cpp:691] Replica received learned notice for position 8 from @0.0.0.0:0
I1026 15:19:54.885751  1705 leveldb.cpp:341] Persisting action (18 bytes) to leveldb took 9.032464ms
I1026 15:19:54.885886  1705 leveldb.cpp:399] Deleting ~2 keys from leveldb took 39508ns
I1026 15:19:54.885917  1705 replica.cpp:712] Persisted action at 8
I1026 15:19:54.885938  1705 replica.cpp:697] Replica learned TRUNCATE action at position 8
I1026 15:19:55.790892  1705 master.cpp:2424] Received SUBSCRIBE call for framework 'Test Framework (Java)' at scheduler-b2956950-fa7e-49c3-88ed-efcef624b837@172.17.0.2:37015
I1026 15:19:55.791019  1705 master.cpp:2500] Subscribing framework Test Framework (Java) with checkpointing enabled and capabilities [  ]
I1026 15:19:55.791221  1705 hierarchical.cpp:271] Added framework 7d8d36ff-5d82-4e91-aba8-46267acc8536-0000
I1026 15:19:55.791256  1700 sched.cpp:743] Framework registered with 7d8d36ff-5d82-4e91-aba8-46267acc8536-0000
#
# A fatal error has been detected by the Java Runtime Environment:
#
#  SIGSEGV (0xb) at pc=0x00007fcc6d6dcc64, pid=1677, tid=0x00007fcc54193ab0
#
# JRE version: OpenJDK Runtime Environment (8.0_101-b13) (build 1.8.0_101-b13)
# Java VM: OpenJDK 64-Bit Server VM (25.101-b13 mixed mode linux-amd64 compressed oops)
# Derivative: IcedTea 3.1.0
# Distribution: Custom build (Tue Aug 30 20:38:19 GMT 2016)
# Problematic frame:
# C  [libjvm.so+0x300c64]
#
# Core dump written. Default location: /mesos/build/src/examples/java/core or core.1677
#
# An error report file with more information is saved as:
# /mesos/build/src/examples/java/hs_err_pid1677.log
I1026 15:19:55.792402  1705 master.cpp:5725] Sending 3 offers to framework 7d8d36ff-5d82-4e91-aba8-46267acc8536-0000 (Test Framework (Java)) at scheduler-b2956950-fa7e-49c3-88ed-efcef624b837@172.17.0.2:37015
#
# If you would like to submit a bug report, please include
# instructions on how to reproduce the bug and visit:
#   http://icedtea.classpath.org/bugzilla
#
Segmentation fault (core dumped)
{code}

Find attached the _/mesos/build/src/examples/java/hs_err_pid1677.log_ file.

Also here you have a GDB _bt_ (for those who understand it):

{code:none}
warning: Can't read pathname for load map: No error information.
Core was generated by `/usr/lib/jvm/default-jvm/bin/java -cp /mesos/build/src/java/target/protobuf-jav'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00007fcc6e31dd08 in abort () from /lib/ld-musl-x86_64.so.1
[Current thread is 1 (LWP 1700)]
(gdb) bt
#0  0x00007fcc6e31dd08 in abort () from /lib/ld-musl-x86_64.so.1
#1  0x00007fcc54192d28 in ?? ()
#2  0x00007fcc6d93ac91 in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#3  0x00007fcc6da0947c in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#4  0x00007fcc6d940a40 in JVM_handle_linux_signal () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#5  0x00007fcc6d939b21 in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#6  <signal handler called>
#7  0x00007fcc6d6dcc64 in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#8  0x00007fcc6d7f4a36 in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#9  0x00007fcc6d7f4c4c in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#10 0x00007fcc6d8218c4 in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#11 0x00007fcc5812057a in JNIScheduler::registered(mesos::SchedulerDriver*, mesos::FrameworkID const&, mesos::MasterInfo const&) ()
   from /mesos/build/src/.libs/libmesos-1.0.1.so
#12 0x00007fcc577e18df in mesos::internal::SchedulerProcess::registered(process::UPID const&, mesos::FrameworkID const&, mesos::MasterInfo const&) () from /mesos/build/src/.libs/libmesos-1.0.1.so
#13 0x00007fcc577f51e4 in void ProtobufProcess<mesos::internal::SchedulerProcess>::handler2<mesos::internal::FrameworkRegisteredMessage, mesos::FrameworkID const&, mesos::FrameworkID const&, mesos::MasterInfo const&, mesos::MasterInfo const&>(mesos::internal::SchedulerProcess*, void (mesos::internal::SchedulerProcess::*)(process::UPID const&, mesos::FrameworkID const&, mesos::MasterInfo const&), mesos::FrameworkID const& (mesos::internal::FrameworkRegisteredMessage::*)() const, mesos::MasterInfo const& (mesos::internal::FrameworkRegisteredMessage::*)() const, process::UPID const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&) () from /mesos/build/src/.libs/libmesos-1.0.1.so
#14 0x00007fcc577df4aa in std::_Function_handler<void (process::UPID const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&), std::_Bind<void (*(mesos::internal::SchedulerProcess*, void (mesos::internal::SchedulerProcess::*)(process::UPID const&, mesos::FrameworkID const&, mesos::MasterInfo const&), mesos::FrameworkID const& (mesos::internal::FrameworkRegisteredMessage::*)() const, mesos::MasterInfo const& (mesos::internal::FrameworkRegisteredMessage::*)() const, std::_Placeholder<1>, std::_Placeholder<2>))(mesos::internal::SchedulerProcess*, void (mesos::internal::SchedulerProcess::*)(process::UPID const&, mesos::FrameworkID const&, mesos::MasterInfo const&), mesos::FrameworkID const& (mesos::internal::FrameworkRegisteredMessage::*)() const, mesos::MasterInfo const& (mesos::internal::FrameworkRegisteredMessage::*)() const, process::UPID const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)> >::_M_invoke(std::_Any_data const&, process::UPID const&, std::__cxx11::basic_string<---Type ---Type <return> to continue, or q <return> to quit---
char, std::char_traits<char>, std::allocator<char> > const&) () from /mesos/build/src/.libs/libmesos-1.0.1.so
#15 0x00007fcc577e9d0a in ProtobufProcess<mesos::internal::SchedulerProcess>::visit(process::MessageEvent const&) () from /mesos/build/src/.libs/libmesos-1.0.1.so
#16 0x00007fcc580cef73 in process::ProcessManager::resume(process::ProcessBase*) () from /mesos/build/src/.libs/libmesos-1.0.1.so
#17 0x00007fcc580cf8d7 in std::thread::_Impl<std::_Bind_simple<process::ProcessManager::init_threads()::{unnamed type#1} ()> >::_M_run() () from /mesos/build/src/.libs/libmesos-1.0.1.so
#18 0x00007fcc6d147c8a in execute_native_thread_routine () from /usr/lib/libstdc++.so.6
#19 0x00007fcc6e35154d in ?? () from /lib/ld-musl-x86_64.so.1
#20 0x0000000000000000 in ?? ()
(gdb)
{code}

... and the same _bt_ after I installed the _musl-dbg_ package:

{code:none}
warning: Can't read pathname for load map: No error information.
Core was generated by `/usr/lib/jvm/default-jvm/bin/java -cp /mesos/build/src/java/target/protobuf-jav'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  a_crash () at ./arch/x86_64/atomic_arch.h:108
108	./arch/x86_64/atomic_arch.h: No such file or directory.
[Current thread is 1 (LWP 1700)]
(gdb) bt
#0  a_crash () at ./arch/x86_64/atomic_arch.h:108
#1  abort () at src/exit/abort.c:11
#2  0x00007fcc6d93ac91 in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#3  0x00007fcc6da0947c in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#4  0x00007fcc6d940a40 in JVM_handle_linux_signal () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#5  0x00007fcc6d939b21 in ?? () from /usr/lib/jvm/java-1.8-openjdk/jre/lib/amd64/server/libjvm.so
#6  0x00007fcc6e345d04 in sigwaitinfo (mask=<optimized out>, si=<optimized out>) at src/signal/sigwaitinfo.c:5
#7  0x0000000000000001 in ?? ()
#8  0x0000000000000000 in ?? ()
(gdb)
{code}

I have tested with _openjdk7_ and _openjdk8_ (3.4.4 and edge) with no luck.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)