You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Alexandr (JIRA)" <ji...@apache.org> on 2019/04/22 12:16:00 UTC
[jira] [Commented] (MESOS-9726) No running tasks in marathon after
restart non-leader mesos-master node
[ https://issues.apache.org/jira/browse/MESOS-9726?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16823060#comment-16823060 ]
Alexandr commented on MESOS-9726:
---------------------------------
Good day, [~abudnik] !
Can someone help me with this case?
> No running tasks in marathon after restart non-leader mesos-master node
> -----------------------------------------------------------------------
>
> Key: MESOS-9726
> URL: https://issues.apache.org/jira/browse/MESOS-9726
> Project: Mesos
> Issue Type: Bug
> Affects Versions: 1.4.1
> Reporter: Alexandr
> Priority: Minor
> Labels: beginner
>
> Good day!
> I have problem with my mesos-cluster:
> I have 3 mesos-master (Mesos version 1.4.1) nodes with Marathon cluster v 1.5.11 (lets call them - Mas1,Mas2,Mas3) and 3 mesos-slave nodes (lets call them - Slv1,Slv2,Slv3) with running apps on it. And I also have a Zookeeper cluster on nodes Mas1,Mas2,Mas3.
> So, Mesos leader - master-node "Mas1".
> After I restarted master-node "Mas3" - he got back to the Mesos cluster, everything is fine but after a moment I opened Marathon and all running tasks from my mesos-slave nodes became "unknown" and have no instances on it.
> So I checked:
> 1. My mesos agents - everything was ok, 3 agents running.
> 2. That all services are running and all clusters (Mesos\Marathon\Zookeeper) are fine
> 3. Decided to restart all mesos-slave services on slave nodes - on slave-node Slv3 1 of 3 instances launched for all applications, then restarted all marathon-services. After it all tasks switched to status "Waiting"\"Delayed".
> 4. Checked mesos-master and slave logs, no errors or information about any problems on cluster - only information about killing and launching new tasks on slave-node.
> 5. Decided to stop-start mesos-master service for re-election of a Mesos leader.
> After it leader became master-node "Mas2" and all tasks in marathon started to run instances like normal.
> Logs will be uploaded later. Wonder how it could happen
> {code:java}
> Apr 10 18:32:18 Mas1 docker[*****]: I0410 15:32:18.342406 12 http.cpp:**] HTTP GET for /master/state from ****:*** with User-Agent='Go-http-client/1.1' Apr 10 18:32:18 Mas1 docker[*****]: I0410 15:32:18.391480 9 http.cpp:1185] HTTP GET for /master/state from *****:40686 with User-Agent='Go-http-client/1.1' Apr 10 18:32:18 Mas1 docker[27956]: E0410 15:32:18.567880 14 process.cpp:2577] Failed to shutdown socket with fd 44, address ****:5050: Transport endpoint is not connected Apr 10 18:32:18 Mas1 docker[27956]: E0410 15:32:18.596901 14 process.cpp:2577] Failed to shutdown socket with fd 46, address ****:5050: Transport endpoint is not connected
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)