You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Jojy Varghese (JIRA)" <ji...@apache.org> on 2015/12/18 08:03:46 UTC
[jira] [Updated] (MESOS-3588) Port mapping isolator check failed:
createQdisc.get()
[ https://issues.apache.org/jira/browse/MESOS-3588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jojy Varghese updated MESOS-3588:
---------------------------------
Assignee: (was: Jojy Varghese)
> Port mapping isolator check failed: createQdisc.get()
> -----------------------------------------------------
>
> Key: MESOS-3588
> URL: https://issues.apache.org/jira/browse/MESOS-3588
> Project: Mesos
> Issue Type: Bug
> Reporter: Paul Brett
>
> Container creation is failing occasionally due to the required name already existing, e.g:
> {code}
> F1005 13:25:04.331053 48582 port_mapping.cpp:2245] Check failed: createQdisc.get()
> *** Check failure stack trace: ***
> @ 0x7f3b5c3b668d google::LogMessage::Fail()
> @ 0x7f3b5c3b84d4 google::LogMessage::SendToLog()
> @ 0x7f3b5c3b627c google::LogMessage::Flush()
> @ 0x7f3b5c3b8dc9 google::LogMessageFatal::~LogMessageFatal()
> @ 0x7f3b5c0bdc8c mesos::internal::slave::PortMappingIsolatorProcess::isolate()
> @ 0x7f3b5bf28fd6 _ZNSt17_Function_handlerIFvPN7process11ProcessBaseEEZNS0_8dispatchI7NothingN5mesos8internal5slave20MesosIsolatorProcessERKNS6_11ContainerIDEiSA_iEENS0_6FutureIT_EERKNS0_3PIDIT0_EEMSH_FSF_T1_T2_ET3_T4_EUlS2_E_E9_M_invokeERKSt9_Any_dataS2_
> @ 0x7f3b5c3690b1 process::ProcessManager::resume()
> @ 0x7f3b5c3693af process::internal::schedule()
> @ 0x7f3b5c478cd0 execute_native_thread_routine
> @ 0x7f3b5b14283d start_thread
> @ 0x7f3b5abb7fdd clone
> /usr/local/bin/mesos-slave.sh: line 102: 48575 Aborted (core dumped) $debug /usr/local/sbin/mesos-slave "${MESOS_FLAGS[@]}"
> Slave Exit Status: 134
> {code}
> It appears the there are valid circumstances under which the kernel can reallocate the namespace PID before the containers external interface (mesos_nnnnn) has been destroyed.
> {code}
> 2236 // Prepare the ingress queueing disciplines on veth.
> 2237 Try<bool> createQdisc = ingress::create(veth(pid));
> 2238 if (createQdisc.isError()) {
> 2239 return Failure(
> 2240 "Failed to create the ingress qdisc on " + veth(pid) +
> 2241 ": " + createQdisc.error());
> 2242 }
> 2243
> 2244 // Veth device should exist since we just created it.
> 2245 CHECK(createQdisc.get());
> {code}
> We should check for test for link already exists errors in port mapping (e.g. link::create returns false) and fail the container creation rather than killing the slave.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)