You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "kasim (JIRA)" <ji...@apache.org> on 2016/09/26 09:15:20 UTC
[jira] [Comment Edited] (MESOS-6248) mesos-slave cannot start ,
Assertion `isError()' failed
[ https://issues.apache.org/jira/browse/MESOS-6248?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15522536#comment-15522536 ]
kasim edited comment on MESOS-6248 at 9/26/16 9:14 AM:
-------------------------------------------------------
Same error, I found
`service mesos-slave start` excute
`logged /usr/sbin/mesos-master "${args[@]:-}"` in `function slave` in `/usr/bin/mesos-init-wrapper`.
I copy the print args out and excute directly:
[root@zk2 mesos]# mesos-slave --master=zk://10.142.55.190:2181,10.142.55.196:2181,10.142.55.202:2181/mesos --log_dir=/var/log/mesos --containerizers=docker,mesos --executor_registration_timeout=10mins --hostname=10.142.55.196 --ip=10.142.55.196 --work_dir=/var/lib/mesos --no-systemd_enable_support
```
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0926 18:12:24.743870 3658 main.cpp:243] Build: 2016-08-26 23:06:27 by centos
I0926 18:12:24.744038 3658 main.cpp:244] Version: 1.0.1
I0926 18:12:24.744047 3658 main.cpp:247] Git tag: 1.0.1
I0926 18:12:24.744055 3658 main.cpp:251] Git SHA: 3611eb0b7eea8d144e9b2e840e0ba16f2f659ee3
I0926 18:12:24.745198 3658 logging.cpp:194] INFO level logging started!
mesos-slave: ../../3rdparty/stout/include/stout/result.hpp:134: const string& Result<T>::error() const [with T = std::basic_string<char>; std::string = std::basic_string<char>]: Assertion `isError()' failed.
*** Aborted at 1474884744 (unix time) try "date -d @1474884744" if you are using GNU date ***
PC: @ 0x7f4cc2fc25f7 __GI_raise
*** SIGABRT (@0xe4a) received by PID 3658 (TID 0x7f4cc5e5d8c0) from PID 3658; stack trace: ***
@ 0x7f4cc387c100 (unknown)
@ 0x7f4cc2fc25f7 __GI_raise
@ 0x7f4cc2fc3ce8 __GI_abort
@ 0x7f4cc2fbb566 __assert_fail_base
@ 0x7f4cc2fbb612 __GI___assert_fail
@ 0x7f4cc45dfe4a Result<>::error()
@ 0x7f4cc4cde9a3 _ZZN7systemd6existsEvENKUlvE_clEv.isra.297
@ 0x7f4cc4cdf0bd systemd::exists()
@ 0x41063c main
@ 0x7f4cc2faeb15 __libc_start_main
@ 0x412099 (unknown)
Aborted
```
was (Author: mithril):
Same error, I found
service mesos-slave start excute
`logged /usr/sbin/mesos-master "${args[@]:-}"` in function slave
in `/usr/bin/mesos-init-wrapper`.
I copy the print args out and excute directly:
[root@zk2 mesos]# mesos-slave --master=zk://10.142.55.190:2181,10.142.55.196:2181,10.142.55.202:2181/mesos --log_dir=/var/log/mesos --containerizers=docker,mesos --executor_registration_timeout=10mins --hostname=10.142.55.196 --ip=10.142.55.196 --work_dir=/var/lib/mesos --no-systemd_enable_support
```
WARNING: Logging before InitGoogleLogging() is written to STDERR
I0926 18:12:24.743870 3658 main.cpp:243] Build: 2016-08-26 23:06:27 by centos
I0926 18:12:24.744038 3658 main.cpp:244] Version: 1.0.1
I0926 18:12:24.744047 3658 main.cpp:247] Git tag: 1.0.1
I0926 18:12:24.744055 3658 main.cpp:251] Git SHA: 3611eb0b7eea8d144e9b2e840e0ba16f2f659ee3
I0926 18:12:24.745198 3658 logging.cpp:194] INFO level logging started!
mesos-slave: ../../3rdparty/stout/include/stout/result.hpp:134: const string& Result<T>::error() const [with T = std::basic_string<char>; std::string = std::basic_string<char>]: Assertion `isError()' failed.
*** Aborted at 1474884744 (unix time) try "date -d @1474884744" if you are using GNU date ***
PC: @ 0x7f4cc2fc25f7 __GI_raise
*** SIGABRT (@0xe4a) received by PID 3658 (TID 0x7f4cc5e5d8c0) from PID 3658; stack trace: ***
@ 0x7f4cc387c100 (unknown)
@ 0x7f4cc2fc25f7 __GI_raise
@ 0x7f4cc2fc3ce8 __GI_abort
@ 0x7f4cc2fbb566 __assert_fail_base
@ 0x7f4cc2fbb612 __GI___assert_fail
@ 0x7f4cc45dfe4a Result<>::error()
@ 0x7f4cc4cde9a3 _ZZN7systemd6existsEvENKUlvE_clEv.isra.297
@ 0x7f4cc4cdf0bd systemd::exists()
@ 0x41063c main
@ 0x7f4cc2faeb15 __libc_start_main
@ 0x412099 (unknown)
Aborted
```
> mesos-slave cannot start , Assertion `isError()' failed
> -------------------------------------------------------
>
> Key: MESOS-6248
> URL: https://issues.apache.org/jira/browse/MESOS-6248
> Project: Mesos
> Issue Type: Bug
> Environment: mesos 1.01 centos 7
> Reporter: kasim
>
> There is an error `mesos-slave: ../../3rdparty/stout/include/stout/result.hpp:134: const string& Result<T>::error() const [with T = std::basic_string<char>; std::string = std::basic_string<char>]: Assertion `isError()' failed.` when I start `mesos-slave`.
> What I do before this error happen:
> - service docker stop and add a `registry-mirror`
> - service docker start
> - service mesos-slave start
> Log as below:
> <code>
> Sep 26 15:29:56 zk2 mesos-slave[5050]: I0926 15:29:56.421854 5070 slave.cpp:4591] Current disk usage 24.36%. Max allowed age: 4.594670214119757days
> Sep 26 15:30:56 zk2 mesos-slave[5050]: I0926 15:30:56.422523 5070 slave.cpp:4591] Current disk usage 24.36%. Max allowed age: 4.594670214119757days
> Sep 26 15:31:56 zk2 mesos-slave[5050]: I0926 15:31:56.423301 5070 slave.cpp:4591] Current disk usage 24.36%. Max allowed age: 4.594654510807141days
> Sep 26 15:31:57 zk2 mesos-slave[5050]: W0926 15:31:57.067425 5070 slave.cpp:2376] Ignoring updating pid for framework ef169d8a-24fc-41d1-8b0d-c67718937a48-0000 because it does not exist
> Sep 26 15:32:56 zk2 mesos-slave[5050]: I0926 15:32:56.424700 5070 slave.cpp:4591] Current disk usage 24.36%. Max allowed age: 4.594667358972014days
> Sep 26 15:33:56 zk2 mesos-slave[5050]: I0926 15:33:56.425257 5070 slave.cpp:4591] Current disk usage 24.36%. Max allowed age: 4.594667358972014days
> Sep 26 15:34:56 zk2 mesos-slave[5050]: I0926 15:34:56.425698 5070 slave.cpp:4591] Current disk usage 24.36%. Max allowed age: 4.594667358972014days
> Sep 26 15:35:56 zk2 mesos-slave[5050]: I0926 15:35:56.426959 5070 slave.cpp:4591] Current disk usage 24.36%. Max allowed age: 4.594667358972014days
> Sep 26 15:36:56 zk2 mesos-slave[5050]: I0926 15:36:56.428061 5070 slave.cpp:4591] Current disk usage 24.36%. Max allowed age: 4.594667358972014days
> Sep 26 15:37:56 zk2 mesos-slave[5050]: I0926 15:37:56.429162 5070 slave.cpp:4591] Current disk usage 24.33%. Max allowed age: 4.597191309582847days
> Sep 26 15:38:56 zk2 mesos-slave[5050]: I0926 15:38:56.429811 5070 slave.cpp:4591] Current disk usage 24.33%. Max allowed age: 4.597191309582847days
> Sep 26 15:39:56 zk2 mesos-slave[5050]: I0926 15:39:56.430641 5070 slave.cpp:4591] Current disk usage 24.33%. Max allowed age: 4.597191309582847days
> Sep 26 15:40:56 zk2 mesos-slave[5050]: I0926 15:40:56.431457 5070 slave.cpp:4591] Current disk usage 24.33%. Max allowed age: 4.597191309582847days
> Sep 26 15:41:56 zk2 mesos-slave[5050]: I0926 15:41:56.432929 5070 slave.cpp:4591] Current disk usage 24.33%. Max allowed age: 4.597191309582847days
> Sep 26 15:42:56 zk2 mesos-slave[5050]: I0926 15:42:56.433922 5070 slave.cpp:4591] Current disk usage 24.33%. Max allowed age: 4.597191309582847days
> Sep 26 15:43:56 zk2 mesos-slave[5050]: I0926 15:43:56.434734 5070 slave.cpp:4591] Current disk usage 24.33%. Max allowed age: 4.597191309582847days
> Sep 26 15:44:56 zk2 mesos-slave[5050]: I0926 15:44:56.435595 5070 slave.cpp:4591] Current disk usage 24.33%. Max allowed age: 4.597189882008970days
> Sep 26 15:45:48 zk2 mesos-slave[5050]: W0926 15:44:56.435595 5050 logging.cpp:91] RAW: Received signal SIGTERM from process 1 of user 0; exiting
> Sep 26 15:51:42 zk2 mesos-slave[4475]: WARNING: Logging before InitGoogleLogging() is written to STDERR
> Sep 26 15:51:42 zk2 mesos-slave[4475]: I0926 15:51:42.072932 4475 main.cpp:243] Build: 2016-08-26 23:06:27 by centos
> Sep 26 15:51:42 zk2 mesos-slave[4475]: I0926 15:51:42.073128 4475 main.cpp:244] Version: 1.0.1
> Sep 26 15:51:42 zk2 mesos-slave[4475]: I0926 15:51:42.073138 4475 main.cpp:247] Git tag: 1.0.1
> Sep 26 15:51:42 zk2 mesos-slave[4475]: I0926 15:51:42.073144 4475 main.cpp:251] Git SHA: 3611eb0b7eea8d144e9b2e840e0ba16f2f659ee3
> Sep 26 15:51:42 zk2 mesos-slave[4475]: I0926 15:51:42.075127 4475 logging.cpp:194] INFO level logging started!
> Sep 26 15:51:42 zk2 mesos-slave[4475]: mesos-slave: ../../3rdparty/stout/include/stout/result.hpp:134: const string& Result<T>::error() const [with T = std::basic_string<char>; std::string = std::basic_string<char>]: Assertion `isError()' failed.
> Sep 26 15:51:42 zk2 mesos-slave[4475]: *** Aborted at 1474876302 (unix time) try "date -d @1474876302" if you are using GNU date ***
> Sep 26 15:51:42 zk2 mesos-slave[4475]: PC: @ 0x7f795491e5f7 __GI_raise
> Sep 26 15:51:42 zk2 mesos-slave[4475]: *** SIGABRT (@0x117b) received by PID 4475 (TID 0x7f79577b98c0) from PID 4475; stack trace: ***
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f79551d8100 (unknown)
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f795491e5f7 __GI_raise
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f795491fce8 __GI_abort
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f7954917566 __assert_fail_base
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f7954917612 __GI___assert_fail
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f7955f3be4a Result<>::error()
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f795663a9a3 _ZZN7systemd6existsEvENKUlvE_clEv.isra.297
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f795663b0bd systemd::exists()
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x41063c main
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x7f795490ab15 __libc_start_main
> Sep 26 15:51:42 zk2 mesos-slave[4475]: @ 0x412099 (unknown)
> Sep 26 15:52:02 zk2 mesos-slave[4506]: WARNING: Logging before InitGoogleLogging() is written to STDERR
> Sep 26 15:52:02 zk2 mesos-slave[4506]: I0926 15:52:02.413128 4506 main.cpp:243] Build: 2016-08-26 23:06:27 by centos
> Sep 26 15:52:02 zk2 mesos-slave[4506]: I0926 15:52:02.413291 4506 main.cpp:244] Version: 1.0.1
> Sep 26 15:52:02 zk2 mesos-slave[4506]: I0926 15:52:02.413301 4506 main.cpp:247] Git tag: 1.0.1
> Sep 26 15:52:02 zk2 mesos-slave[4506]: I0926 15:52:02.413307 4506 main.cpp:251] Git SHA: 3611eb0b7eea8d144e9b2e840e0ba16f2f659ee3
> Sep 26 15:52:02 zk2 mesos-slave[4506]: I0926 15:52:02.414762 4506 logging.cpp:194] INFO level logging started!
> Sep 26 15:52:02 zk2 mesos-slave[4506]: mesos-slave: ../../3rdparty/stout/include/stout/result.hpp:134: const string& Result<T>::error() const [with T = std::basic_string<char>; std::string = std::basic_string<char>]: Assertion `isError()' failed.
> Sep 26 15:52:02 zk2 mesos-slave[4506]: *** Aborted at 1474876322 (unix time) try "date -d @1474876322" if you are using GNU date ***
> Sep 26 15:52:02 zk2 mesos-slave[4506]: PC: @ 0x7fd70eb165f7 __GI_raise
> Sep 26 15:52:02 zk2 mesos-slave[4506]: *** SIGABRT (@0x119a) received by PID 4506 (TID 0x7fd7119b18c0) from PID 4506; stack trace: ***
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd70f3d0100 (unknown)
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd70eb165f7 __GI_raise
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd70eb17ce8 __GI_abort
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd70eb0f566 __assert_fail_base
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd70eb0f612 __GI___assert_fail
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd710133e4a Result<>::error()
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd7108329a3 _ZZN7systemd6existsEvENKUlvE_clEv.isra.297
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd7108330bd systemd::exists()
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x41063c main
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x7fd70eb02b15 __libc_start_main
> Sep 26 15:52:02 zk2 mesos-slave[4506]: @ 0x412099 (unknown)
> Sep 26 15:52:22 zk2 mesos-slave[4584]: WARNING: Logging before InitGoogleLogging() is written to STDERR
> Sep 26 15:52:22 zk2 mesos-slave[4584]: I0926 15:52:22.970069 4584 main.cpp:243] Build: 2016-08-26 23:06:27 by centos
> Sep 26 15:52:22 zk2 mesos-slave[4584]: I0926 15:52:22.970333 4584 main.cpp:244] Version: 1.0.1
> Sep 26 15:52:22 zk2 mesos-slave[4584]: I0926 15:52:22.970345 4584 main.cpp:247] Git tag: 1.0.1
> Sep 26 15:52:22 zk2 mesos-slave[4584]: I0926 15:52:22.970352 4584 main.cpp:251] Git SHA: 3611eb0b7eea8d144e9b2e840e0ba16f2f659ee3
> Sep 26 15:52:22 zk2 mesos-slave[4584]: I0926 15:52:22.973122 4584 logging.cpp:194] INFO level logging started!
> Sep 26 15:52:22 zk2 mesos-slave[4584]: mesos-slave: ../../3rdparty/stout/include/stout/result.hpp:134: const string& Result<T>::error() const [with T = std::basic_string<char>; std::string = std::basic_string<char>]: Assertion `isError()' failed.
> Sep 26 15:52:22 zk2 mesos-slave[4584]: *** Aborted at 1474876342 (unix time) try "date -d @1474876342" if you are using GNU date ***
> Sep 26 15:52:22 zk2 mesos-slave[4584]: PC: @ 0x7f5348b8b5f7 __GI_raise
> Sep 26 15:52:22 zk2 mesos-slave[4584]: *** SIGABRT (@0x11e8) received by PID 4584 (TID 0x7f534ba268c0) from PID 4584; stack trace: ***
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f5349445100 (unknown)
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f5348b8b5f7 __GI_raise
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f5348b8cce8 __GI_abort
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f5348b84566 __assert_fail_base
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f5348b84612 __GI___assert_fail
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f534a1a8e4a Result<>::error()
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f534a8a79a3 _ZZN7systemd6existsEvENKUlvE_clEv.isra.297
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f534a8a80bd systemd::exists()
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x41063c main
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x7f5348b77b15 __libc_start_main
> Sep 26 15:52:22 zk2 mesos-slave[4584]: @ 0x412099 (unknown)
> Sep 26 15:52:43 zk2 mesos-slave[4831]: WARNING: Logging before InitGoogleLogging() is written to STDERR
> Sep 26 15:52:43 zk2 mesos-slave[4831]: I0926 15:52:43.165402 4831 main.cpp:243] Build: 2016-08-26 23:06:27 by centos
> Sep 26 15:52:43 zk2 mesos-slave[4831]: I0926 15:52:43.165585 4831 main.cpp:244] Version: 1.0.1
> Sep 26 15:52:43 zk2 mesos-slave[4831]: I0926 15:52:43.165598 4831 main.cpp:247] Git tag: 1.0.1
> Sep 26 15:52:43 zk2 mesos-slave[4831]: I0926 15:52:43.165604 4831 main.cpp:251] Git SHA: 3611eb0b7eea8d144e9b2e840e0ba16f2f659ee3
> Sep 26 15:52:43 zk2 mesos-slave[4831]: I0926 15:52:43.167140 4831 logging.cpp:194] INFO level logging started!
> </code>
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)