You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@accumulo.apache.org by "Keith Turner (Created) (JIRA)" <ji...@apache.org> on 2012/02/13 19:12:59 UTC
[jira] [Created] (ACCUMULO-395) Map reduce reading from Accumulo is
not running mapper locally
Map reduce reading from Accumulo is not running mapper locally
---------------------------------------------------------------
Key: ACCUMULO-395
URL: https://issues.apache.org/jira/browse/ACCUMULO-395
Project: Accumulo
Issue Type: Bug
Reporter: Keith Turner
Noticed the continuous ingest verification map reduce job was running slow. Looking into I noticed that scans were not running locally. Not sure if this is map reduce issue or AccumuloInputFormat issue. Not only are the scans not local, sometimes a single tablet server will get a lot scans from many mappers overwhelming it.
{noformat}
$ accumulo shell -u root -p xxxx -e "listscans -np"
TABLET SERVER | CLIENT | AGE | LAST | STATE | TYPE | USER | TABLE | COLUMNS | TABLET | ITERATORS | ITERATOR OPTIONS
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.4:59715 | 2m42s | 8ms | IDLE |SINGLE | root | ci | [] |6;23a0cc;2380ca | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.12:49054 | 5m3s | 7ms | IDLE |SINGLE | root | ci | [] |6;1ea0a4c;1e80ac | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.9:57157 | 2m27s | 3ms |RUNNING |SINGLE | root | ci | [] |6;3a00b;39e0bb | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.10:47880 | 2m58s | 3ms |RUNNING |SINGLE | root | ci | [] |6;0aa0ab;0a80aa | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.9:57101 | 3m12s | 157ms |RUNNING |SINGLE | root | ci | [] |6;04a05f;04805a | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.13:34053 | 6m20s | 180ms | IDLE |SINGLE | root | ci | [] |6;34a0cd;3480bd | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.10:47862 | 3m18s | 48ms | IDLE |SINGLE | root | ci | [] |6;3ea08a;3e808f | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.7:42593 | 2m35s | 2ms |RUNNING |SINGLE | root | ci | [] |6;46a0c5;4680c5 | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.5:34764 | 2m11s | 177ms | IDLE |SINGLE | root | ci | [] |6;78007;77e07c | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43458 | 1m51s | 139ms | IDLE |SINGLE | root | ci | [] |6;3f803b;3f604e | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.4:40674 | 3m0s | 1ms |RUNNING |SINGLE | root | ci | [] |6;0ea08b;0e808f | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:49562 | 2m31s | 111ms |RUNNING |SINGLE | root | ci | [] |6;0ba086;0b8086 | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43274 | 2m38s | 35ms | IDLE |SINGLE | root | ci | [] |6;57a024;578025 | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.6:39526 | 5m11s | 133ms | IDLE |SINGLE | root | ci | [] |6;16a0c9;1680cc | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.9:40769 | 5m0s | 11ms | IDLE |SINGLE | root | ci | [] |6;3fa034;3f803b | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.6:60691 | 2m59s | 11ms | IDLE |SINGLE | root | ci | [] |6;1ba0dbe;1b80da | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.10:35987 | 5m4s | 31ms | IDLE |SINGLE | root | ci | [] |6;72a066;72806a | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.9:40839 | 3m18s | 8ms | IDLE |SINGLE | root | ci | [] |6;71a05e;71805b | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43189 | 4m36s | 135ms | IDLE |SINGLE | root | ci | [] |6;75a07d;758075 | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.12:45476 | 2m5s | 112ms | IDLE |SINGLE | root | ci | [] |6;48007;47e08 | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.7:33791 | 4s981ms | 85ms |RUNNING |SINGLE | root | ci | [] |6;5f8036;5f6044c | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.6:38304 | 2m38s | 18ms | IDLE |SINGLE | root | ci | [] |6;7ea059;7e8058 | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44152 | 2m3s | 7ms | IDLE |SINGLE | root | ci | [] |6;6e809f;6e60a8b | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44058 | 2m23s | 7ms | IDLE |SINGLE | root | ci | [] |6;7a00d;79e0d7f | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.13:52463 | 2m35s | 6ms | IDLE |SINGLE | root | ci | [] |6;77a089;778089 | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44086 | 2m19s | 1ms |RUNNING |SINGLE | root | ci | [] |6;4a00c;49e0c3 | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.13:43610 | 2m12s | 179ms | IDLE |SINGLE | root | ci | [] |6;3800b;37e0bf | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.13:55025 | 4m59s | 152ms | IDLE |SINGLE | root | ci | [] |6;2ba1568;2b815c | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.6:44613 | 1s520ms | 518ms |RUNNING |SINGLE | root | ci | [] |6;0f802f;0f6047 | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.9:33954 | 3m23s | 3ms |RUNNING |SINGLE | root | ci | [] |6;4da0b4;4d80b9 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:57942 | 2m18s | 224ms | IDLE |SINGLE | root | ci | [] |6;0a00a;09e0a2 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:58004 | 2m9s | 164ms | IDLE |SINGLE | root | ci | [] |6;68016;67e16c | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.10:57480 | 3m3s | 80ms |RUNNING |SINGLE | root | ci | [] |6;17a0bc;1780bf | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.12:59552 | 1m59s | 145ms | IDLE |SINGLE | root | ci | [] |6;1880d8;1860cc | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.5:47196 | 2m29s | 15ms | IDLE |SINGLE | root | ci | [] |6;1a00d;19e0dd | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:58101 | 1m39s | 43ms | IDLE |SINGLE | root | ci | [] |6;4f8035;4f6045 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.4:36684 | 3m3s | 97ms | IDLE |SINGLE | root | ci | [] |6;1ca0df;1c80dc | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.9:45627 | 3m15s | 4ms |RUNNING |SINGLE | root | ci | [] |6;07a022;078025 | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.6:37328 | 4m35s | 93ms | IDLE |SINGLE | root | ci | [] |6;2da0e5;2d80ed | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.4:46787 | 4m24s | 204ms | IDLE |SINGLE | root | ci | [] |6;39a0c7d;3980c8 | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.12:39133 | 9m18s | 451ms | IDLE |SINGLE | root | ci | [] |6;25a147;25813c | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.4:46827 | 3m21s | 3ms |RUNNING |SINGLE | root | ci | [] |6;52a069;528062 | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.8:49713 | 2m29s | 4ms | IDLE |SINGLE | root | ci | [] |6;2aa18b;2a818b | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:55427 | 2m39s | 1ms |RUNNING |SINGLE | root | ci | [] |6;45a0c6;4580c7 | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.9:40025 | 6m6s | 66ms | IDLE |SINGLE | root | ci | [] |6;44a0bf;4480b9 | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.7:46896 | 4m48s | 5ms | IDLE |SINGLE | root | ci | [] |6;6ea092;6e809f | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.5:59397 | 2m26s | 189ms | IDLE |SINGLE | root | ci | [] |6;5a004;59e048d | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.8:47096 | 4m33s | 5ms | IDLE |SINGLE | root | ci | [] |6;6ca11f;6c8117 | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.6:47355 | 3m23s | 8ms | IDLE |SINGLE | root | ci | [] |6;06a063;068068 | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.12:56529 | 2m11s | 4ms |RUNNING |SINGLE | root | ci | [] |6;1800a;17e0ad | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.12:56401 | 2m48s | 47ms | IDLE |SINGLE | root | ci | [] |6;15a0bf;1580bd | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.9:44547 | 3m21s | 6ms | IDLE |SINGLE | root | ci | [] |6;5ea049;5e8043 | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.8:58391 | 5m6s | 236ms | IDLE |SINGLE | root | ci | [] |6;28a19a;288196 | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.8:60543 | 2m41s | 43ms | IDLE |SINGLE | root | ci | [] |6;53a069;538068 | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.4:46148 | 3m6s | 235ms | IDLE |SINGLE | root | ci | [] |6;03a05c;03805e | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.12:52594 | 2m8s | 319ms | IDLE |SINGLE | root | ci | [] |6;28019;27e198 | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.7:51462 | 2m59s | 115ms | IDLE |SINGLE | root | ci | [] |6;19a0eb;1980ea | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.5:48253 | 2m5s | 195ms | IDLE |SINGLE | root | ci | [] |6;6f803a;6f60496 | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.10:43025 | 2m24s | 3ms | IDLE |SINGLE | root | ci | [] |6;2a018;29e188 | [] | {}
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (ACCUMULO-395) Map reduce reading from Accumulo is
not running mapper locally
Posted by "Keith Turner (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Keith Turner updated ACCUMULO-395:
----------------------------------
Priority: Critical (was: Major)
Affects Version/s: 1.3.5
Fix Version/s: 1.4.0
Assignee: Keith Turner
I think I found the issues. The AccumuloInputFormat passes ip address back for InputSplit locations. I looked at some other InputFormats and noticed they passed back host names. I made a quick change to pass back hostnames, and now scans are running locally and evenly.
{noformat}
$ accumulo shell -u root -p xxxx -e "listscans -np"
TABLET SERVER | CLIENT | AGE | LAST | STATE | TYPE | USER | TABLE | COLUMNS | TABLET | ITERATORS | ITERATOR OPTIONS
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:39186 | 2m4s | 3ms |RUNNING |SINGLE | root | ci | [] |6;2380ca;2360c5 | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:39138 | 2m14s | 1ms |RUNNING |SINGLE | root | ci | [] |6;4480b9;4460ba | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:39263 | 1m50s | 162ms | IDLE |SINGLE | root | ci | [] |6;2a818b;2a618f | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:39377 | 1m28s | 4ms |RUNNING |SINGLE | root | ci | [] |6;7980cf;7960cd | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:39265 | 1m50s | 225ms | IDLE |SINGLE | root | ci | [] |6;3480bd;3460bbe | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:39302 | 1m47s | 3ms |RUNNING |SINGLE | root | ci | [] |6;7c808d;7c608f | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:39102 | 2m17s | - |RUNNING |SINGLE | root | ci | [] |6;1b80da;1b60e7 | [] | {}
xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:39433 | 1m23s | 2ms |RUNNING |SINGLE | root | ci | [] |6;56802c;56602bc | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.8:41679 | 2m52s | 1ms |RUNNING |SINGLE | root | ci | [] |6;088038;086031 | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.8:41926 | 2m13s | 249ms | IDLE |SINGLE | root | ci | [] |6;04004;03e04d | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.8:41838 | 2m24s | 8ms | IDLE |SINGLE | root | ci | [] |6;32807c;32607ae | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.8:41626 | 2m56s | 2ms |RUNNING |SINGLE | root | ci | [] |6;3880c5;3860c9 | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.8:41548 | 2m59s | 1ms |RUNNING |SINGLE | root | ci | [] |6;61808a;616088 | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.8:42009 | 1m34s | 3ms |RUNNING |SINGLE | root | ci | [] |6;54006;53e06c | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.8:41533 | 3m2s | 3ms |RUNNING |SINGLE | root | ci | [] |6;25813c;256138 | [] | {}
xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.8:41775 | 2m29s | 5ms | IDLE |SINGLE | root | ci | [] |6;4980be;4960bb | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.10:57988 | 3m0s | 282ms | IDLE |SINGLE | root | ci | [] |6;29818f;296198 | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.10:58288 | 2m17s | 1ms |RUNNING |SINGLE | root | ci | [] |6;3e808f;3e609a | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.10:58157 | 2m39s | 12ms |RUNNING |SINGLE | root | ci | [] |6;068068;066072 | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.10:58126 | 2m41s | 67ms |RUNNING |SINGLE | root | ci | [] |6;1580bd;1560c3 | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.10:58074 | 2m48s | 3ms |RUNNING |SINGLE | root | ci | [] |6;6d80dd;6d60e8f | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.10:57951 | 3m3s | 2ms |RUNNING |SINGLE | root | ci | [] |6;6f803a;6f60496 | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.10:57880 | 3m10s | 1ms |RUNNING |SINGLE | root | ci | [] |6;1880d8;1860cc | [] | {}
xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.10:58389 | 1m53s | 3ms |RUNNING |SINGLE | root | ci | [] |6;078025;076034 | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.7:60817 | 2m22s | 1ms |RUNNING |SINGLE | root | ci | [] |6;60803b;60602d | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.7:60705 | 2m40s | 29ms |RUNNING |SINGLE | root | ci | [] |6;4d80b9;4d60c2 | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.7:60901 | 2m16s | 124ms |RUNNING |SINGLE | root | ci | [] |6;4580c7;4560ce | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.7:60862 | 2m18s | 3ms |RUNNING |SINGLE | root | ci | [] |6;1480aa;1460a4 | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.7:60461 | 3m29s | 29ms |RUNNING |SINGLE | root | ci | [] |6;3a80ae;3a60b6 | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.7:60641 | 2m46s | 82ms |RUNNING |SINGLE | root | ci | [] |6;4c80df;4c60e7 | [] | {}
xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.7:60621 | 2m48s | 1ms |RUNNING |SINGLE | root | ci | [] |6;1780bf;1760c4 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.6:45999 | 2m33s | 1ms |RUNNING |SINGLE | root | ci | [] |6;2480f7;2460ee | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.6:45903 | 2m53s | 133ms | IDLE |SINGLE | root | ci | [] |6;03805e;036069 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.6:37971 | 1m5s | 2ms |RUNNING |SINGLE | root | ci | [] |6;6380f7;6360f97 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.6:45815 | 3m3s | 4ms |RUNNING |SINGLE | root | ci | [] |6;48007;47e08 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.6:45866 | 2m56s | - |RUNNING |SINGLE | root | ci | [] |6;0f802f;0f6047 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.6:46210 | 1m56s | 294ms | IDLE |SINGLE | root | ci | [] |6;028066;026069 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.6:46049 | 2m27s | 2ms |RUNNING |SINGLE | root | ci | [] |6;528062;526058 | [] | {}
xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.6:46095 | 2m23s | - | QUEUED |SINGLE | root | ci | [] |6;5c8069;5c606f | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.5:47861 | 2m44s | 430ms | IDLE |SINGLE | root | ci | [] |6;748059;74605a | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.5:47802 | 2m53s | 190ms | IDLE |SINGLE | root | ci | [] |6;538068;53606a | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.5:47751 | 2m56s | 115ms |RUNNING |SINGLE | root | ci | [] |6;64812e;646129 | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.5:47913 | 2m35s | 5ms | IDLE |SINGLE | root | ci | [] |6;4780a5;4760ac | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.5:48009 | 2m22s | 4ms | IDLE |SINGLE | root | ci | [] |6;20802a;206025 | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.5:47614 | 3m15s | 2ms |RUNNING |SINGLE | root | ci | [] |6;518026;516032 | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.5:47658 | 3m9s | 3ms |RUNNING |SINGLE | root | ci | [] |6;0b8086;0b6092 | [] | {}
xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.5:47578 | 3m26s | 1ms |RUNNING |SINGLE | root | ci | [] |6;1800a;17e0ad | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:40908 | 1m27s | 3ms |RUNNING |SINGLE | root | ci | [] |6;5b8075;5b607d | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:47605 | 1m58s | 284ms | IDLE |SINGLE | root | ci | [] |6;7d8086;7d608b | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:40944 | 1m23s | 5ms |RUNNING |SINGLE | root | ci | [] |6;69815a;69615f | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:47540 | 2m12s | 1ms |RUNNING |SINGLE | root | ci | [] |6;058079;05607a | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:47412 | 2m29s | 5ms |RUNNING |SINGLE | root | ci | [] |6;2f8049;2f6057 | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:41040 | 27s98ms | 2ms |RUNNING |SINGLE | root | ci | [] |6;33808d;33608c | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:47505 | 2m15s | 148ms | IDLE |SINGLE | root | ci | [] |6;22809a;226098 | [] | {}
xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:47624 | 1m57s | 77ms |RUNNING |SINGLE | root | ci | [] |6;758075;75607a | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.4:54574 | 3m8s | 1ms |RUNNING |SINGLE | root | ci | [] |6;15a0bf;1580bd | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.4:54805 | 2m34s | 213ms | IDLE |SINGLE | root | ci | [] |6;548069;54606c | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.4:54688 | 2m52s | 4ms |RUNNING |SINGLE | root | ci | [] |6;6280be;6260c1 | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.4:54873 | 2m25s | 310ms | IDLE |SINGLE | root | ci | [] |6;288196;28619b | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.4:54987 | 2m12s | 267ms | IDLE |SINGLE | root | ci | [] |6;6c8117;6c611f | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.4:54751 | 2m43s | 5ms | IDLE |SINGLE | root | ci | [] |6;59804d;596049 | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.4:54549 | 3m11s | 3ms |RUNNING |SINGLE | root | ci | [] |6;1ba0dbe;1b80da | [] | {}
xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.4:55098 | 1m25s | 1ms | QUEUED |SINGLE | root | ci | [] |6;098088;096085 | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.9:35781 | 2m56s | 13ms | IDLE |SINGLE | root | ci | [] |6;778089;77608f | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.9:36092 | 2m6s | 2ms |RUNNING |SINGLE | root | ci | [] |6;2e80a4;2e60ad | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.9:35884 | 2m46s | 108ms |RUNNING |SINGLE | root | ci | [] |6;678174;67617b | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.9:35822 | 2m53s | 174ms | IDLE |SINGLE | root | ci | [] |6;7e8058;7e605d | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.9:35740 | 2m59s | 70ms |RUNNING |SINGLE | root | ci | [] |6;4e808d;4e6092 | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.9:35676 | 3m6s | 86ms |RUNNING |SINGLE | root | ci | [] |6;5f8036;5f6044c | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.9:35950 | 2m37s | 4ms | IDLE |SINGLE | root | ci | [] |6;4680c5;4660ca | [] | {}
xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.9:35638 | 3m9s | 120ms |RUNNING |SINGLE | root | ci | [] |6;78007;77e07c | [] | {}
{noformat}
> Map reduce reading from Accumulo is not running mapper locally
> ---------------------------------------------------------------
>
> Key: ACCUMULO-395
> URL: https://issues.apache.org/jira/browse/ACCUMULO-395
> Project: Accumulo
> Issue Type: Bug
> Affects Versions: 1.3.5
> Reporter: Keith Turner
> Assignee: Keith Turner
> Priority: Critical
> Labels: 14_qa_bug
> Fix For: 1.4.0
>
>
> Noticed the continuous ingest verification map reduce job was running slow. Looking into I noticed that scans were not running locally. Not sure if this is map reduce issue or AccumuloInputFormat issue. Not only are the scans not local, sometimes a single tablet server will get a lot scans from many mappers overwhelming it.
> {noformat}
> $ accumulo shell -u root -p xxxx -e "listscans -np"
> TABLET SERVER | CLIENT | AGE | LAST | STATE | TYPE | USER | TABLE | COLUMNS | TABLET | ITERATORS | ITERATOR OPTIONS
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.4:59715 | 2m42s | 8ms | IDLE |SINGLE | root | ci | [] |6;23a0cc;2380ca | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.12:49054 | 5m3s | 7ms | IDLE |SINGLE | root | ci | [] |6;1ea0a4c;1e80ac | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.9:57157 | 2m27s | 3ms |RUNNING |SINGLE | root | ci | [] |6;3a00b;39e0bb | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.10:47880 | 2m58s | 3ms |RUNNING |SINGLE | root | ci | [] |6;0aa0ab;0a80aa | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.9:57101 | 3m12s | 157ms |RUNNING |SINGLE | root | ci | [] |6;04a05f;04805a | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.13:34053 | 6m20s | 180ms | IDLE |SINGLE | root | ci | [] |6;34a0cd;3480bd | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.10:47862 | 3m18s | 48ms | IDLE |SINGLE | root | ci | [] |6;3ea08a;3e808f | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.7:42593 | 2m35s | 2ms |RUNNING |SINGLE | root | ci | [] |6;46a0c5;4680c5 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.5:34764 | 2m11s | 177ms | IDLE |SINGLE | root | ci | [] |6;78007;77e07c | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43458 | 1m51s | 139ms | IDLE |SINGLE | root | ci | [] |6;3f803b;3f604e | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.4:40674 | 3m0s | 1ms |RUNNING |SINGLE | root | ci | [] |6;0ea08b;0e808f | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:49562 | 2m31s | 111ms |RUNNING |SINGLE | root | ci | [] |6;0ba086;0b8086 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43274 | 2m38s | 35ms | IDLE |SINGLE | root | ci | [] |6;57a024;578025 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.6:39526 | 5m11s | 133ms | IDLE |SINGLE | root | ci | [] |6;16a0c9;1680cc | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.9:40769 | 5m0s | 11ms | IDLE |SINGLE | root | ci | [] |6;3fa034;3f803b | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.6:60691 | 2m59s | 11ms | IDLE |SINGLE | root | ci | [] |6;1ba0dbe;1b80da | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.10:35987 | 5m4s | 31ms | IDLE |SINGLE | root | ci | [] |6;72a066;72806a | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.9:40839 | 3m18s | 8ms | IDLE |SINGLE | root | ci | [] |6;71a05e;71805b | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43189 | 4m36s | 135ms | IDLE |SINGLE | root | ci | [] |6;75a07d;758075 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.12:45476 | 2m5s | 112ms | IDLE |SINGLE | root | ci | [] |6;48007;47e08 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.7:33791 | 4s981ms | 85ms |RUNNING |SINGLE | root | ci | [] |6;5f8036;5f6044c | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.6:38304 | 2m38s | 18ms | IDLE |SINGLE | root | ci | [] |6;7ea059;7e8058 | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44152 | 2m3s | 7ms | IDLE |SINGLE | root | ci | [] |6;6e809f;6e60a8b | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44058 | 2m23s | 7ms | IDLE |SINGLE | root | ci | [] |6;7a00d;79e0d7f | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.13:52463 | 2m35s | 6ms | IDLE |SINGLE | root | ci | [] |6;77a089;778089 | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44086 | 2m19s | 1ms |RUNNING |SINGLE | root | ci | [] |6;4a00c;49e0c3 | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.13:43610 | 2m12s | 179ms | IDLE |SINGLE | root | ci | [] |6;3800b;37e0bf | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.13:55025 | 4m59s | 152ms | IDLE |SINGLE | root | ci | [] |6;2ba1568;2b815c | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.6:44613 | 1s520ms | 518ms |RUNNING |SINGLE | root | ci | [] |6;0f802f;0f6047 | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.9:33954 | 3m23s | 3ms |RUNNING |SINGLE | root | ci | [] |6;4da0b4;4d80b9 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:57942 | 2m18s | 224ms | IDLE |SINGLE | root | ci | [] |6;0a00a;09e0a2 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:58004 | 2m9s | 164ms | IDLE |SINGLE | root | ci | [] |6;68016;67e16c | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.10:57480 | 3m3s | 80ms |RUNNING |SINGLE | root | ci | [] |6;17a0bc;1780bf | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.12:59552 | 1m59s | 145ms | IDLE |SINGLE | root | ci | [] |6;1880d8;1860cc | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.5:47196 | 2m29s | 15ms | IDLE |SINGLE | root | ci | [] |6;1a00d;19e0dd | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:58101 | 1m39s | 43ms | IDLE |SINGLE | root | ci | [] |6;4f8035;4f6045 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.4:36684 | 3m3s | 97ms | IDLE |SINGLE | root | ci | [] |6;1ca0df;1c80dc | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.9:45627 | 3m15s | 4ms |RUNNING |SINGLE | root | ci | [] |6;07a022;078025 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.6:37328 | 4m35s | 93ms | IDLE |SINGLE | root | ci | [] |6;2da0e5;2d80ed | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.4:46787 | 4m24s | 204ms | IDLE |SINGLE | root | ci | [] |6;39a0c7d;3980c8 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.12:39133 | 9m18s | 451ms | IDLE |SINGLE | root | ci | [] |6;25a147;25813c | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.4:46827 | 3m21s | 3ms |RUNNING |SINGLE | root | ci | [] |6;52a069;528062 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.8:49713 | 2m29s | 4ms | IDLE |SINGLE | root | ci | [] |6;2aa18b;2a818b | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:55427 | 2m39s | 1ms |RUNNING |SINGLE | root | ci | [] |6;45a0c6;4580c7 | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.9:40025 | 6m6s | 66ms | IDLE |SINGLE | root | ci | [] |6;44a0bf;4480b9 | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.7:46896 | 4m48s | 5ms | IDLE |SINGLE | root | ci | [] |6;6ea092;6e809f | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.5:59397 | 2m26s | 189ms | IDLE |SINGLE | root | ci | [] |6;5a004;59e048d | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.8:47096 | 4m33s | 5ms | IDLE |SINGLE | root | ci | [] |6;6ca11f;6c8117 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.6:47355 | 3m23s | 8ms | IDLE |SINGLE | root | ci | [] |6;06a063;068068 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.12:56529 | 2m11s | 4ms |RUNNING |SINGLE | root | ci | [] |6;1800a;17e0ad | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.12:56401 | 2m48s | 47ms | IDLE |SINGLE | root | ci | [] |6;15a0bf;1580bd | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.9:44547 | 3m21s | 6ms | IDLE |SINGLE | root | ci | [] |6;5ea049;5e8043 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.8:58391 | 5m6s | 236ms | IDLE |SINGLE | root | ci | [] |6;28a19a;288196 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.8:60543 | 2m41s | 43ms | IDLE |SINGLE | root | ci | [] |6;53a069;538068 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.4:46148 | 3m6s | 235ms | IDLE |SINGLE | root | ci | [] |6;03a05c;03805e | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.12:52594 | 2m8s | 319ms | IDLE |SINGLE | root | ci | [] |6;28019;27e198 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.7:51462 | 2m59s | 115ms | IDLE |SINGLE | root | ci | [] |6;19a0eb;1980ea | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.5:48253 | 2m5s | 195ms | IDLE |SINGLE | root | ci | [] |6;6f803a;6f60496 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.10:43025 | 2m24s | 3ms | IDLE |SINGLE | root | ci | [] |6;2a018;29e188 | [] | {}
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (ACCUMULO-395) Map reduce reading from Accumulo is
not running mapper locally
Posted by "Keith Turner (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Keith Turner updated ACCUMULO-395:
----------------------------------
Fix Version/s: 1.3.6
> Map reduce reading from Accumulo is not running mapper locally
> ---------------------------------------------------------------
>
> Key: ACCUMULO-395
> URL: https://issues.apache.org/jira/browse/ACCUMULO-395
> Project: Accumulo
> Issue Type: Bug
> Affects Versions: 1.3.5
> Reporter: Keith Turner
> Assignee: Keith Turner
> Priority: Critical
> Labels: 14_qa_bug
> Fix For: 1.4.0, 1.3.6
>
>
> Noticed the continuous ingest verification map reduce job was running slow. Looking into I noticed that scans were not running locally. Not sure if this is map reduce issue or AccumuloInputFormat issue. Not only are the scans not local, sometimes a single tablet server will get a lot scans from many mappers overwhelming it.
> {noformat}
> $ accumulo shell -u root -p xxxx -e "listscans -np"
> TABLET SERVER | CLIENT | AGE | LAST | STATE | TYPE | USER | TABLE | COLUMNS | TABLET | ITERATORS | ITERATOR OPTIONS
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.4:59715 | 2m42s | 8ms | IDLE |SINGLE | root | ci | [] |6;23a0cc;2380ca | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.12:49054 | 5m3s | 7ms | IDLE |SINGLE | root | ci | [] |6;1ea0a4c;1e80ac | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.9:57157 | 2m27s | 3ms |RUNNING |SINGLE | root | ci | [] |6;3a00b;39e0bb | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.10:47880 | 2m58s | 3ms |RUNNING |SINGLE | root | ci | [] |6;0aa0ab;0a80aa | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.9:57101 | 3m12s | 157ms |RUNNING |SINGLE | root | ci | [] |6;04a05f;04805a | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.13:34053 | 6m20s | 180ms | IDLE |SINGLE | root | ci | [] |6;34a0cd;3480bd | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.10:47862 | 3m18s | 48ms | IDLE |SINGLE | root | ci | [] |6;3ea08a;3e808f | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.7:42593 | 2m35s | 2ms |RUNNING |SINGLE | root | ci | [] |6;46a0c5;4680c5 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.5:34764 | 2m11s | 177ms | IDLE |SINGLE | root | ci | [] |6;78007;77e07c | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43458 | 1m51s | 139ms | IDLE |SINGLE | root | ci | [] |6;3f803b;3f604e | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.4:40674 | 3m0s | 1ms |RUNNING |SINGLE | root | ci | [] |6;0ea08b;0e808f | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:49562 | 2m31s | 111ms |RUNNING |SINGLE | root | ci | [] |6;0ba086;0b8086 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43274 | 2m38s | 35ms | IDLE |SINGLE | root | ci | [] |6;57a024;578025 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.6:39526 | 5m11s | 133ms | IDLE |SINGLE | root | ci | [] |6;16a0c9;1680cc | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.9:40769 | 5m0s | 11ms | IDLE |SINGLE | root | ci | [] |6;3fa034;3f803b | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.6:60691 | 2m59s | 11ms | IDLE |SINGLE | root | ci | [] |6;1ba0dbe;1b80da | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.10:35987 | 5m4s | 31ms | IDLE |SINGLE | root | ci | [] |6;72a066;72806a | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.9:40839 | 3m18s | 8ms | IDLE |SINGLE | root | ci | [] |6;71a05e;71805b | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43189 | 4m36s | 135ms | IDLE |SINGLE | root | ci | [] |6;75a07d;758075 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.12:45476 | 2m5s | 112ms | IDLE |SINGLE | root | ci | [] |6;48007;47e08 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.7:33791 | 4s981ms | 85ms |RUNNING |SINGLE | root | ci | [] |6;5f8036;5f6044c | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.6:38304 | 2m38s | 18ms | IDLE |SINGLE | root | ci | [] |6;7ea059;7e8058 | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44152 | 2m3s | 7ms | IDLE |SINGLE | root | ci | [] |6;6e809f;6e60a8b | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44058 | 2m23s | 7ms | IDLE |SINGLE | root | ci | [] |6;7a00d;79e0d7f | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.13:52463 | 2m35s | 6ms | IDLE |SINGLE | root | ci | [] |6;77a089;778089 | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44086 | 2m19s | 1ms |RUNNING |SINGLE | root | ci | [] |6;4a00c;49e0c3 | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.13:43610 | 2m12s | 179ms | IDLE |SINGLE | root | ci | [] |6;3800b;37e0bf | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.13:55025 | 4m59s | 152ms | IDLE |SINGLE | root | ci | [] |6;2ba1568;2b815c | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.6:44613 | 1s520ms | 518ms |RUNNING |SINGLE | root | ci | [] |6;0f802f;0f6047 | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.9:33954 | 3m23s | 3ms |RUNNING |SINGLE | root | ci | [] |6;4da0b4;4d80b9 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:57942 | 2m18s | 224ms | IDLE |SINGLE | root | ci | [] |6;0a00a;09e0a2 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:58004 | 2m9s | 164ms | IDLE |SINGLE | root | ci | [] |6;68016;67e16c | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.10:57480 | 3m3s | 80ms |RUNNING |SINGLE | root | ci | [] |6;17a0bc;1780bf | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.12:59552 | 1m59s | 145ms | IDLE |SINGLE | root | ci | [] |6;1880d8;1860cc | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.5:47196 | 2m29s | 15ms | IDLE |SINGLE | root | ci | [] |6;1a00d;19e0dd | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:58101 | 1m39s | 43ms | IDLE |SINGLE | root | ci | [] |6;4f8035;4f6045 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.4:36684 | 3m3s | 97ms | IDLE |SINGLE | root | ci | [] |6;1ca0df;1c80dc | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.9:45627 | 3m15s | 4ms |RUNNING |SINGLE | root | ci | [] |6;07a022;078025 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.6:37328 | 4m35s | 93ms | IDLE |SINGLE | root | ci | [] |6;2da0e5;2d80ed | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.4:46787 | 4m24s | 204ms | IDLE |SINGLE | root | ci | [] |6;39a0c7d;3980c8 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.12:39133 | 9m18s | 451ms | IDLE |SINGLE | root | ci | [] |6;25a147;25813c | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.4:46827 | 3m21s | 3ms |RUNNING |SINGLE | root | ci | [] |6;52a069;528062 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.8:49713 | 2m29s | 4ms | IDLE |SINGLE | root | ci | [] |6;2aa18b;2a818b | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:55427 | 2m39s | 1ms |RUNNING |SINGLE | root | ci | [] |6;45a0c6;4580c7 | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.9:40025 | 6m6s | 66ms | IDLE |SINGLE | root | ci | [] |6;44a0bf;4480b9 | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.7:46896 | 4m48s | 5ms | IDLE |SINGLE | root | ci | [] |6;6ea092;6e809f | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.5:59397 | 2m26s | 189ms | IDLE |SINGLE | root | ci | [] |6;5a004;59e048d | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.8:47096 | 4m33s | 5ms | IDLE |SINGLE | root | ci | [] |6;6ca11f;6c8117 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.6:47355 | 3m23s | 8ms | IDLE |SINGLE | root | ci | [] |6;06a063;068068 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.12:56529 | 2m11s | 4ms |RUNNING |SINGLE | root | ci | [] |6;1800a;17e0ad | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.12:56401 | 2m48s | 47ms | IDLE |SINGLE | root | ci | [] |6;15a0bf;1580bd | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.9:44547 | 3m21s | 6ms | IDLE |SINGLE | root | ci | [] |6;5ea049;5e8043 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.8:58391 | 5m6s | 236ms | IDLE |SINGLE | root | ci | [] |6;28a19a;288196 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.8:60543 | 2m41s | 43ms | IDLE |SINGLE | root | ci | [] |6;53a069;538068 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.4:46148 | 3m6s | 235ms | IDLE |SINGLE | root | ci | [] |6;03a05c;03805e | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.12:52594 | 2m8s | 319ms | IDLE |SINGLE | root | ci | [] |6;28019;27e198 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.7:51462 | 2m59s | 115ms | IDLE |SINGLE | root | ci | [] |6;19a0eb;1980ea | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.5:48253 | 2m5s | 195ms | IDLE |SINGLE | root | ci | [] |6;6f803a;6f60496 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.10:43025 | 2m24s | 3ms | IDLE |SINGLE | root | ci | [] |6;2a018;29e188 | [] | {}
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (ACCUMULO-395) Map reduce reading from Accumulo
is not running mapper locally
Posted by "Keith Turner (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/ACCUMULO-395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Keith Turner resolved ACCUMULO-395.
-----------------------------------
Resolution: Fixed
> Map reduce reading from Accumulo is not running mapper locally
> ---------------------------------------------------------------
>
> Key: ACCUMULO-395
> URL: https://issues.apache.org/jira/browse/ACCUMULO-395
> Project: Accumulo
> Issue Type: Bug
> Affects Versions: 1.3.5
> Reporter: Keith Turner
> Assignee: Keith Turner
> Priority: Critical
> Labels: 14_qa_bug
> Fix For: 1.4.0
>
>
> Noticed the continuous ingest verification map reduce job was running slow. Looking into I noticed that scans were not running locally. Not sure if this is map reduce issue or AccumuloInputFormat issue. Not only are the scans not local, sometimes a single tablet server will get a lot scans from many mappers overwhelming it.
> {noformat}
> $ accumulo shell -u root -p xxxx -e "listscans -np"
> TABLET SERVER | CLIENT | AGE | LAST | STATE | TYPE | USER | TABLE | COLUMNS | TABLET | ITERATORS | ITERATOR OPTIONS
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.4:59715 | 2m42s | 8ms | IDLE |SINGLE | root | ci | [] |6;23a0cc;2380ca | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.12:49054 | 5m3s | 7ms | IDLE |SINGLE | root | ci | [] |6;1ea0a4c;1e80ac | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.9:57157 | 2m27s | 3ms |RUNNING |SINGLE | root | ci | [] |6;3a00b;39e0bb | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.10:47880 | 2m58s | 3ms |RUNNING |SINGLE | root | ci | [] |6;0aa0ab;0a80aa | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.9:57101 | 3m12s | 157ms |RUNNING |SINGLE | root | ci | [] |6;04a05f;04805a | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.13:34053 | 6m20s | 180ms | IDLE |SINGLE | root | ci | [] |6;34a0cd;3480bd | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.10:47862 | 3m18s | 48ms | IDLE |SINGLE | root | ci | [] |6;3ea08a;3e808f | [] | {}
> xxx.xxx.xxx.8:9997 | xxx.xxx.xxx.7:42593 | 2m35s | 2ms |RUNNING |SINGLE | root | ci | [] |6;46a0c5;4680c5 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.5:34764 | 2m11s | 177ms | IDLE |SINGLE | root | ci | [] |6;78007;77e07c | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43458 | 1m51s | 139ms | IDLE |SINGLE | root | ci | [] |6;3f803b;3f604e | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.4:40674 | 3m0s | 1ms |RUNNING |SINGLE | root | ci | [] |6;0ea08b;0e808f | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.13:49562 | 2m31s | 111ms |RUNNING |SINGLE | root | ci | [] |6;0ba086;0b8086 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43274 | 2m38s | 35ms | IDLE |SINGLE | root | ci | [] |6;57a024;578025 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.6:39526 | 5m11s | 133ms | IDLE |SINGLE | root | ci | [] |6;16a0c9;1680cc | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.9:40769 | 5m0s | 11ms | IDLE |SINGLE | root | ci | [] |6;3fa034;3f803b | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.6:60691 | 2m59s | 11ms | IDLE |SINGLE | root | ci | [] |6;1ba0dbe;1b80da | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.10:35987 | 5m4s | 31ms | IDLE |SINGLE | root | ci | [] |6;72a066;72806a | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.9:40839 | 3m18s | 8ms | IDLE |SINGLE | root | ci | [] |6;71a05e;71805b | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.8:43189 | 4m36s | 135ms | IDLE |SINGLE | root | ci | [] |6;75a07d;758075 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.12:45476 | 2m5s | 112ms | IDLE |SINGLE | root | ci | [] |6;48007;47e08 | [] | {}
> xxx.xxx.xxx.13:9997 | xxx.xxx.xxx.7:33791 | 4s981ms | 85ms |RUNNING |SINGLE | root | ci | [] |6;5f8036;5f6044c | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.6:38304 | 2m38s | 18ms | IDLE |SINGLE | root | ci | [] |6;7ea059;7e8058 | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44152 | 2m3s | 7ms | IDLE |SINGLE | root | ci | [] |6;6e809f;6e60a8b | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44058 | 2m23s | 7ms | IDLE |SINGLE | root | ci | [] |6;7a00d;79e0d7f | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.13:52463 | 2m35s | 6ms | IDLE |SINGLE | root | ci | [] |6;77a089;778089 | [] | {}
> xxx.xxx.xxx.10:9997 | xxx.xxx.xxx.5:44086 | 2m19s | 1ms |RUNNING |SINGLE | root | ci | [] |6;4a00c;49e0c3 | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.13:43610 | 2m12s | 179ms | IDLE |SINGLE | root | ci | [] |6;3800b;37e0bf | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.13:55025 | 4m59s | 152ms | IDLE |SINGLE | root | ci | [] |6;2ba1568;2b815c | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.6:44613 | 1s520ms | 518ms |RUNNING |SINGLE | root | ci | [] |6;0f802f;0f6047 | [] | {}
> xxx.xxx.xxx.7:9997 | xxx.xxx.xxx.9:33954 | 3m23s | 3ms |RUNNING |SINGLE | root | ci | [] |6;4da0b4;4d80b9 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:57942 | 2m18s | 224ms | IDLE |SINGLE | root | ci | [] |6;0a00a;09e0a2 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:58004 | 2m9s | 164ms | IDLE |SINGLE | root | ci | [] |6;68016;67e16c | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.10:57480 | 3m3s | 80ms |RUNNING |SINGLE | root | ci | [] |6;17a0bc;1780bf | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.12:59552 | 1m59s | 145ms | IDLE |SINGLE | root | ci | [] |6;1880d8;1860cc | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.5:47196 | 2m29s | 15ms | IDLE |SINGLE | root | ci | [] |6;1a00d;19e0dd | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.13:58101 | 1m39s | 43ms | IDLE |SINGLE | root | ci | [] |6;4f8035;4f6045 | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.4:36684 | 3m3s | 97ms | IDLE |SINGLE | root | ci | [] |6;1ca0df;1c80dc | [] | {}
> xxx.xxx.xxx.6:9997 | xxx.xxx.xxx.9:45627 | 3m15s | 4ms |RUNNING |SINGLE | root | ci | [] |6;07a022;078025 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.6:37328 | 4m35s | 93ms | IDLE |SINGLE | root | ci | [] |6;2da0e5;2d80ed | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.4:46787 | 4m24s | 204ms | IDLE |SINGLE | root | ci | [] |6;39a0c7d;3980c8 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.12:39133 | 9m18s | 451ms | IDLE |SINGLE | root | ci | [] |6;25a147;25813c | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.4:46827 | 3m21s | 3ms |RUNNING |SINGLE | root | ci | [] |6;52a069;528062 | [] | {}
> xxx.xxx.xxx.5:9997 | xxx.xxx.xxx.8:49713 | 2m29s | 4ms | IDLE |SINGLE | root | ci | [] |6;2aa18b;2a818b | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.12:55427 | 2m39s | 1ms |RUNNING |SINGLE | root | ci | [] |6;45a0c6;4580c7 | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.9:40025 | 6m6s | 66ms | IDLE |SINGLE | root | ci | [] |6;44a0bf;4480b9 | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.7:46896 | 4m48s | 5ms | IDLE |SINGLE | root | ci | [] |6;6ea092;6e809f | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.5:59397 | 2m26s | 189ms | IDLE |SINGLE | root | ci | [] |6;5a004;59e048d | [] | {}
> xxx.xxx.xxx.12:9997 | xxx.xxx.xxx.8:47096 | 4m33s | 5ms | IDLE |SINGLE | root | ci | [] |6;6ca11f;6c8117 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.6:47355 | 3m23s | 8ms | IDLE |SINGLE | root | ci | [] |6;06a063;068068 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.12:56529 | 2m11s | 4ms |RUNNING |SINGLE | root | ci | [] |6;1800a;17e0ad | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.12:56401 | 2m48s | 47ms | IDLE |SINGLE | root | ci | [] |6;15a0bf;1580bd | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.9:44547 | 3m21s | 6ms | IDLE |SINGLE | root | ci | [] |6;5ea049;5e8043 | [] | {}
> xxx.xxx.xxx.4:9997 | xxx.xxx.xxx.8:58391 | 5m6s | 236ms | IDLE |SINGLE | root | ci | [] |6;28a19a;288196 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.8:60543 | 2m41s | 43ms | IDLE |SINGLE | root | ci | [] |6;53a069;538068 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.4:46148 | 3m6s | 235ms | IDLE |SINGLE | root | ci | [] |6;03a05c;03805e | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.12:52594 | 2m8s | 319ms | IDLE |SINGLE | root | ci | [] |6;28019;27e198 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.7:51462 | 2m59s | 115ms | IDLE |SINGLE | root | ci | [] |6;19a0eb;1980ea | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.5:48253 | 2m5s | 195ms | IDLE |SINGLE | root | ci | [] |6;6f803a;6f60496 | [] | {}
> xxx.xxx.xxx.9:9997 | xxx.xxx.xxx.10:43025 | 2m24s | 3ms | IDLE |SINGLE | root | ci | [] |6;2a018;29e188 | [] | {}
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira