You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@mesos.apache.org by "Benjamin Mahler (JIRA)" <ji...@apache.org> on 2015/02/07 03:50:34 UTC
[jira] [Commented] (MESOS-2325) CPU busy loop in libprocess libev
clock
[ https://issues.apache.org/jira/browse/MESOS-2325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14310486#comment-14310486 ]
Benjamin Mahler commented on MESOS-2325:
----------------------------------------
A possible issue is the approach to setting up timers. In the new code, we can have a build-up of outstanding ev_timers:
{noformat}
ev_timer clock Timer
10 10
3,10 3,10 // Delay at 3
2,3,10 2,3,10 // Delay at 2
1,2,3,10 1,2,3,10 // Delay at 1
2,3,10,10 2,3,10 // 1 fires
10,10,10 3,10 // 2 fires
10,10,10,10 10 // 3 fires
^ 4 ev_timers for 1 Timer! ^
{noformat}
This occurs because:
* Clock::timer() calls EventLoop::delay if the timer is occurring sooner than the earliest existing timer.
* Clock::tick() calls EventLoop::delay if a Timer still exists, regardless of the existing ev_timers.
Now, as long as there is a Timer scheduled late in the future (which happens on the slave w/ GC), we'll never get below 4 timers. We can be prone to have the number of timers slowly creep up (for example, each 100ms reap timer will add a timer here). What do you guys think? Am I missing something?
Here's a snippet of a slave with GLOG_v=3 that might help shed some more light on this or any other issues:
{noformat}
I0206 23:43:25.180183 13411 main.cpp:154] Version: 0.22.0-tw1
I0206 23:43:25.280568 13419 clock.cpp:199] Created a timer for slave(1)@IP:5051 in 1mins in the future (2015-02-06 23:44:25.280548096+00:00)
I0206 23:43:25.321519 13426 clock.cpp:199] Created a timer for (5)@IP:5051 in 6.98697545998815days in the future (2015-02-13 23:24:40.001250048+00:00)
I0206 23:43:25.324693 13426 clock.cpp:199] Created a timer for (5)@IP:5051 in 6.95960274915556days in the future (2015-02-13 22:45:15.002209024+00:00)
I0206 23:43:25.327244 13426 clock.cpp:199] Created a timer for (5)@IP:5051 in 6.88654716389333days in the future (2015-02-13 21:00:03.002188544+00:00)
I0206 23:43:25.327715 13426 clock.cpp:199] Created a timer for (5)@IP:5051 in 6.88435966332148days in the future (2015-02-13 20:56:54.002617088+00:00)
I0206 23:43:25.331094 13426 clock.cpp:199] Created a timer for (5)@IP:5051 in 6.85533182368days in the future (2015-02-13 20:15:06.000651008+00:00)
I0206 23:43:25.332700 13426 clock.cpp:199] Created a timer for (5)@IP:5051 in 6.83015819298667days in the future (2015-02-13 19:38:51.000557056+00:00)
I0206 23:43:25.334684 13426 clock.cpp:199] Created a timer for (5)@IP:5051 in 6.82998455427259days in the future (2015-02-13 19:38:36.000164352+00:00)
I0206 23:43:25.437305 13424 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:25.537285888+00:00)
I0206 23:43:25.443500 13422 clock.cpp:199] Created a timer for slave(1)@IP:5051 in 2secs in the future (2015-02-06 23:43:27.443489024+00:00)
I0206 23:43:25.445533 13418 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:26.445518080+00:00)
I0206 23:43:25.449419 13412 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:26.449406976+00:00)
I0206 23:43:25.462172 13415 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:26.462161152+00:00)
I0206 23:43:25.537472 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:25.537446144+00:00
I0206 23:43:25.537986 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:25.537285888+00:00
I0206 23:43:25.539068 13420 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:25.639051008+00:00)
I0206 23:43:25.639894 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:25.639885056+00:00
I0206 23:43:25.640506 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:25.639051008+00:00
I0206 23:43:25.641795 13424 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:25.741776128+00:00)
I0206 23:43:25.742599 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:25.742589952+00:00
I0206 23:43:25.743175 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:25.741776128+00:00
I0206 23:43:25.744331 13419 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:25.844314880+00:00)
I0206 23:43:25.845268 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:25.845259008+00:00
I0206 23:43:25.845820 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:25.844314880+00:00
I0206 23:43:25.847043 13427 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:25.947028992+00:00)
I0206 23:43:25.947896 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:25.947886848+00:00
I0206 23:43:25.948477 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:25.947028992+00:00
I0206 23:43:25.949686 13423 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.049668864+00:00)
I0206 23:43:26.050537 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.050529024+00:00
I0206 23:43:26.051165 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.049668864+00:00
I0206 23:43:26.052178 13412 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.152166912+00:00)
I0206 23:43:26.152931 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.152921856+00:00
I0206 23:43:26.153455 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.152166912+00:00
I0206 23:43:26.154639 13425 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.254618112+00:00)
I0206 23:43:26.255545 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.255536128+00:00
I0206 23:43:26.256100 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.254618112+00:00
I0206 23:43:26.257208 13422 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.357188096+00:00)
I0206 23:43:26.357959 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.357950976+00:00
I0206 23:43:26.358482 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.357188096+00:00
I0206 23:43:26.359546 13421 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.459534080+00:00)
I0206 23:43:26.445286 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.445276928+00:00
I0206 23:43:26.445822 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.445817856+00:00
I0206 23:43:26.446379 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.445518080+00:00
I0206 23:43:26.447026 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.446978048+00:00
I0206 23:43:26.447643 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.447622144+00:00
I0206 23:43:26.448104 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.448088832+00:00
I0206 23:43:26.448659 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.448621056+00:00
I0206 23:43:26.449129 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.449112832+00:00
I0206 23:43:26.449614 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.449580032+00:00
I0206 23:43:26.450043 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.449406976+00:00
I0206 23:43:26.450466 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.450440960+00:00
I0206 23:43:26.451961 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.451951104+00:00
I0206 23:43:26.456575 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.456542976+00:00
I0206 23:43:26.457212 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.457180928+00:00
I0206 23:43:26.457574 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.457556992+00:00
I0206 23:43:26.457969 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.457954048+00:00
I0206 23:43:26.458421 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.458386944+00:00
I0206 23:43:26.458808 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.458790912+00:00
I0206 23:43:26.460244 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.460239872+00:00
I0206 23:43:26.461405 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.459534080+00:00
I0206 23:43:26.461798 13424 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:27.461783808+00:00)
I0206 23:43:26.461946 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.461894144+00:00
I0206 23:43:26.462683 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.462680064+00:00
I0206 23:43:26.462813 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.462161152+00:00
I0206 23:43:26.462990 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.462973952+00:00
I0206 23:43:26.463220 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.463217920+00:00
I0206 23:43:26.463524 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.463495936+00:00
I0206 23:43:26.463796 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.463792128+00:00
I0206 23:43:26.464180 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.464147968+00:00
I0206 23:43:26.464617 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.464585984+00:00
I0206 23:43:26.465100 13424 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:27.465081088+00:00)
I0206 23:43:26.465782 13420 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.565771008+00:00)
I0206 23:43:26.466099 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.466072064+00:00
I0206 23:43:26.467711 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.467691776+00:00
I0206 23:43:26.471709 13413 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:27.471697920+00:00)
I0206 23:43:26.566712 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.566699008+00:00
I0206 23:43:26.567292 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.565771008+00:00
I0206 23:43:26.568349 13415 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.668336896+00:00)
I0206 23:43:26.669206 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.669198080+00:00
I0206 23:43:26.669770 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.668336896+00:00
I0206 23:43:26.670991 13414 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.770970880+00:00)
I0206 23:43:26.771921 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.771902976+00:00
I0206 23:43:26.772454 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.770970880+00:00
I0206 23:43:26.773542 13418 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.873530112+00:00)
I0206 23:43:26.874392 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.874382080+00:00
I0206 23:43:26.874894 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.873530112+00:00
I0206 23:43:26.876015 13426 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:26.976004096+00:00)
I0206 23:43:26.976846 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:26.976838144+00:00
I0206 23:43:26.977412 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:26.976004096+00:00
I0206 23:43:26.978340 13423 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:27.078322944+00:00)
I0206 23:43:27.079165 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.079155968+00:00
I0206 23:43:27.079761 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.078322944+00:00
I0206 23:43:27.080970 13416 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:27.180950016+00:00)
I0206 23:43:27.181695 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.181684992+00:00
I0206 23:43:27.182258 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.180950016+00:00
I0206 23:43:27.183290 13419 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:27.283272960+00:00)
I0206 23:43:27.283881 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.283872000+00:00
I0206 23:43:27.284425 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.283272960+00:00
I0206 23:43:27.285636 13424 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:27.385614848+00:00)
I0206 23:43:27.386476 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.386467072+00:00
I0206 23:43:27.387018 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.385614848+00:00
I0206 23:43:27.388100 13412 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:27.488081920+00:00)
I0206 23:43:27.439746 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.439737088+00:00
I0206 23:43:27.440302 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.440300032+00:00
I0206 23:43:27.440850 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.440845056+00:00
I0206 23:43:27.442576 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.442567936+00:00
I0206 23:43:27.443145 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.443140096+00:00
I0206 23:43:27.443712 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.443706880+00:00
I0206 23:43:27.444304 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.443489024+00:00
I0206 23:43:27.444926 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.444860928+00:00
I0206 23:43:27.445350 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.445308928+00:00
I0206 23:43:27.445662 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.445606912+00:00
I0206 23:43:27.446099 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.446074880+00:00
I0206 23:43:27.446539 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.446508032+00:00
I0206 23:43:27.446987 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.446955008+00:00
I0206 23:43:27.447419 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.447388928+00:00
I0206 23:43:27.447862 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.447831040+00:00
I0206 23:43:27.448310 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.448275968+00:00
I0206 23:43:27.448740 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.448705792+00:00
I0206 23:43:27.449213 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.449181184+00:00
I0206 23:43:27.449683 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.449654016+00:00
I0206 23:43:27.450178 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.450148096+00:00
I0206 23:43:27.450631 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.450599936+00:00
I0206 23:43:27.452095 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.452088064+00:00
I0206 23:43:27.452606 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.452601856+00:00
I0206 23:43:27.453048 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.453042944+00:00
I0206 23:43:27.454359 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.454349056+00:00
I0206 23:43:27.455078 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.455073024+00:00
I0206 23:43:27.455433 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.455426816+00:00
I0206 23:43:27.456866 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.456860160+00:00
I0206 23:43:27.457315 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.457310976+00:00
I0206 23:43:27.457684 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.457680896+00:00
I0206 23:43:27.458044 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.458040064+00:00
I0206 23:43:27.458433 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.458429184+00:00
I0206 23:43:27.459897 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.459891968+00:00
I0206 23:43:27.460319 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.460314880+00:00
I0206 23:43:27.460727 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.460724224+00:00
I0206 23:43:27.461132 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.461127168+00:00
I0206 23:43:27.461551 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.461548032+00:00
I0206 23:43:27.461966 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.461961984+00:00
I0206 23:43:27.462388 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.461783808+00:00
I0206 23:43:27.462841 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.462812928+00:00
I0206 23:43:27.463251 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.463234816+00:00
I0206 23:43:27.464586 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.464577792+00:00
I0206 23:43:27.467097 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.467088896+00:00
I0206 23:43:27.467327 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.465081088+00:00
I0206 23:43:27.467667 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.467662080+00:00
I0206 23:43:27.468111 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.468107008+00:00
I0206 23:43:27.468264 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.468259072+00:00
I0206 23:43:27.468407 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.468403968+00:00
I0206 23:43:27.468514 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.468512000+00:00
I0206 23:43:27.468673 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.468668928+00:00
I0206 23:43:27.468858 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.468854784+00:00
I0206 23:43:27.469012 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.469007104+00:00
I0206 23:43:27.469169 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.469165056+00:00
I0206 23:43:27.469403 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.469398016+00:00
I0206 23:43:27.469614 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.469611776+00:00
I0206 23:43:27.469753 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.469750016+00:00
I0206 23:43:27.469893 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.469891072+00:00
I0206 23:43:27.470053 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.470051072+00:00
I0206 23:43:27.470221 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.470200064+00:00
I0206 23:43:27.470337 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.470333952+00:00
I0206 23:43:27.470863 13414 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:28.470851840+00:00)
I0206 23:43:27.471561 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.471549952+00:00
I0206 23:43:27.472220 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.472215040+00:00
I0206 23:43:27.472617 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.471697920+00:00
I0206 23:43:27.472879 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.472860928+00:00
I0206 23:43:27.473027 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.473024000+00:00
I0206 23:43:27.473155 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.473150976+00:00
I0206 23:43:27.473268 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.473264896+00:00
I0206 23:43:27.473383 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.473381120+00:00
I0206 23:43:27.473522 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.473520128+00:00
I0206 23:43:27.473650 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.473647104+00:00
I0206 23:43:27.473791 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.473787136+00:00
I0206 23:43:27.473912 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.473901056+00:00
I0206 23:43:27.474040 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.474036992+00:00
I0206 23:43:27.474261 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.474257920+00:00
I0206 23:43:27.474534 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.474519040+00:00
I0206 23:43:27.474809 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.474804992+00:00
I0206 23:43:27.475039 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.475034112+00:00
I0206 23:43:27.475183 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.475181056+00:00
I0206 23:43:27.475352 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.475348992+00:00
I0206 23:43:27.476645 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.476636928+00:00
I0206 23:43:27.479737 13420 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:28.479720192+00:00)
I0206 23:43:27.484259 13423 clock.cpp:199] Created a timer for monitor@IP:5051 in 1secs in the future (2015-02-06 23:43:28.484246016+00:00)
I0206 23:43:27.484693 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.484683008+00:00
I0206 23:43:27.484977 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.484971008+00:00
I0206 23:43:27.485378 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.485344768+00:00
I0206 23:43:27.485702 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.485670144+00:00
I0206 23:43:27.486976 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.486968064+00:00
I0206 23:43:27.487275 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.487271168+00:00
I0206 23:43:27.487709 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.487703040+00:00
I0206 23:43:27.487943 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.487938816+00:00
I0206 23:43:27.488301 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.488295168+00:00
I0206 23:43:27.488672 13428 clock.cpp:102] Have timeout(s) at 2015-02-06 23:43:27.488081920+00:00
I0206 23:43:27.489022 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.489017088+00:00
I0206 23:43:27.489420 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.489403136+00:00
I0206 23:43:27.489729 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.489696000+00:00
I0206 23:43:27.490038 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.490031872+00:00
I0206 23:43:27.491219 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.491184896+00:00
I0206 23:43:27.491508 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.491479040+00:00
I0206 23:43:27.491818 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.491782912+00:00
I0206 23:43:27.491989 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.491985920+00:00
I0206 23:43:27.492305 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.492270080+00:00
I0206 23:43:27.492595 13428 clock.cpp:95] Handling timers up to 2015-02-06 23:43:27.492564992+00:00
I0206 23:43:27.493217 13414 clock.cpp:199] Created a timer for reaper(1)@IP:5051 in 100ms in the future (2015-02-06 23:43:27.593204992+00:00)
{noformat}
> CPU busy loop in libprocess libev clock
> ---------------------------------------
>
> Key: MESOS-2325
> URL: https://issues.apache.org/jira/browse/MESOS-2325
> Project: Mesos
> Issue Type: Bug
> Components: libprocess
> Affects Versions: 0.22.0
> Reporter: Joris Van Remoortere
> Assignee: Joris Van Remoortere
> Priority: Blocker
> Fix For: 0.22.0
>
>
> Sample stack trace:
> Thread 4 (Thread 0x7ff0917c4940 (LWP 46495)):
> #0 0x00007ff09b7a9c6d in gettimeofday () from /lib64/libc.so.6
> #1 0x00007ff09f6f8e2e in ev_time () at ev.c:1572
> #2 0x00007ff09f65f223 in process::Clock::now (process=Unhandled dwarf expression opcode 0xf3
> ) at src/clock.cpp:173
> #3 0x00007ff09f65f54d in process::Clock::now () at src/clock.cpp:153
> #4 0x00007ff09f65f59a in process::clock::next (timers=Traceback (most recent call last):
> File "/usr/share/gdb/python/libstdcxx/v6/printers.py", line 288, in children
> nodetype = gdb.lookup_type('std::_Rb_tree_node< std::pair< %s, %s > >' % (keytype, valuetype))
> RuntimeError: No type named std::_Rb_tree_node< std::pair< const process::Time, std::list<process::Timer, std::allocator<process::Timer> > > >.
> std::map with 7 elements) at src/clock.cpp:70
> #5 0x00007ff09f660e20 in process::tick () at src/clock.cpp:123
> #6 0x00007ff09f6cf1cf in process::internal::handle_delay (loop=0x7ff0a06307c0, timer=0x13ba440, revents=Unhandled dwarf expression opcode 0xf3
> ) at src/libev.cpp:64
> #7 0x00007ff09f6f88c5 in ev_invoke_pending (loop=0x7ff0a06307c0) at ev.c:2994
> #8 0x00007ff09f6fb877 in ev_run (loop=0x7ff0a06307c0, flags=0) at ev.c:3394
> #9 0x00007ff09f6cf34e in ev_loop () at 3rdparty/libev-4.15/ev.h:826
> #10 process::EventLoop::run () at src/libev.cpp:114
> #11 0x00007ff09ca7683d in start_thread () from /lib64/libpthread.so.0
> #12 0x00007ff09b7f2fcd in clone () from /lib64/libc.so.6
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)