You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kudu.apache.org by "Mostafa Mokhtar (JIRA)" <ji...@apache.org> on 2018/03/16 18:26:00 UTC
[jira] [Updated] (KUDU-2355) Uneven assignment of work across
Maintenance Mgr threads
[ https://issues.apache.org/jira/browse/KUDU-2355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mostafa Mokhtar updated KUDU-2355:
----------------------------------
Summary: Uneven assignment of work across Maintenance Mgr threads (was: Uneven assignment of work across )
> Uneven assignment of work across Maintenance Mgr threads
> --------------------------------------------------------
>
> Key: KUDU-2355
> URL: https://issues.apache.org/jira/browse/KUDU-2355
> Project: Kudu
> Issue Type: Bug
> Affects Versions: 1.8.0
> Reporter: Mostafa Mokhtar
> Priority: Major
>
> While running inserts into a Kudu table I noticed that there is an uneven assignment of work across maintenance threads, this reduces scalability of the maintenance as more threads won't always mean better throughput.
> |Thread name|| Cumulative User CPU(s)|| Cumulative Kernel CPU(s) ||Cumulative IO-wait(s)|
> |MaintenanceMgr [worker]-59102| 3410.94| 352.07| 866.71|
> |MaintenanceMgr [worker]-59101| 3056.77| 319.32| 794.1|
> |MaintenanceMgr [worker]-59100| 2924.29| 300.35| 831.66|
> |MaintenanceMgr [worker]-59099| 3021.22| 307.3| 783.84|
> |MaintenanceMgr [worker]-59098| 2174.47| 216.55| 716|
> |MaintenanceMgr [worker]-59097| 3240.47| 335.55| 846.99|
> |MaintenanceMgr [worker]-59096| 2206.57| 218.63| 752.62|
> |MaintenanceMgr [worker]-59095| 2112.76| 210.93| 720.67|
> Snapshot from top
> {code}
> PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
> 59102 kudu 20 0 25.3g 15g 11m R 105.0 6.1 64:42.20 MaintenanceMgr
> 59097 kudu 20 0 25.3g 15g 11m R 101.7 6.1 61:15.90 MaintenanceMgr
> 59096 kudu 20 0 25.3g 15g 11m R 98.4 6.1 42:12.19 MaintenanceMgr
> 59098 kudu 20 0 25.3g 15g 11m R 98.4 6.1 41:53.22 MaintenanceMgr
> 59100 kudu 20 0 25.3g 15g 11m D 36.1 6.1 55:49.99 MaintenanceMgr
> 59095 kudu 20 0 25.3g 15g 11m D 29.5 6.1 40:34.79 MaintenanceMgr
> 59099 kudu 20 0 25.3g 15g 11m D 0.0 6.1 57:28.81 MaintenanceMgr
> 59101 kudu 20 0 25.3g 15g 11m D 0.0 6.1 58:03.63 MaintenanceMgr
> {code}
> This was found using
> kudu 1.8.0-SNAPSHOT (rev e70c5ee0d6d598ba53d002ebfc7f81bb2ceda404)
> server uuid bd4cc6fdd79d4ebc8a4def27004b011d
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)