You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Sameera Wijerathne (Jira)" <ji...@apache.org> on 2022/06/28 09:51:00 UTC
[jira] [Updated] (IMPALA-11400) Kudu scan bottleneck due to sharing a single Kudu client for multiple tablet scans
| ![](cid:jira-generated-image-avatar-70b1689c-9b3a-4b77-b85f-ac4e301e4382) |
[Sameera
Wijerathne](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=sameerawi)
**updated** an issue
---|---
|
---
| [IMPALA](https://issues.apache.org/jira/browse/IMPALA) / [![Bug](cid:jira-
generated-image-
avatar-9da37de0-55c8-44a1-a36a-6e7adfc6e732)](https://issues.apache.org/jira/browse/IMPALA-11400)
[IMPALA-11400](https://issues.apache.org/jira/browse/IMPALA-11400)
---
[Kudu scan bottleneck due to sharing a single Kudu client for multiple tablet
scans](https://issues.apache.org/jira/browse/IMPALA-11400)
| Change By: | [Sameera
Wijerathne](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=sameerawi)
---|---
Attachment: | 2-1.jpeg
| This issue was observed when impala queries large datasets resides in Kudu.
Even single ImpalaD is scanning multiple kudu tablets, it shows a slowness to
retrive data eventhough ImpalaD makes parrellel scans. Reason for this is
ImpalaD only uses a single Kudu client for multiple scans but
KuduScanner::NextBatch runs on a single thread. So it's rpc reactor thread
utilizes upto a single core and bottlenecks all parrelel scans.
This behaviour makes Impala clusters that scans kudu cannot be vertically
scales to the maximum performance/cores of a node.
Please refer the screenshots from Kudu slack channel for more information.
!2-1.jpeg!
---
| | [ ![Add Comment](cid:jira-generated-image-static-comment-
icon-286f0ba7-bdc8-4328-95c2-50dfe84aa8d3)
](https://issues.apache.org/jira/browse/IMPALA-11400#add-comment "Add
Comment") | [Add
Comment](https://issues.apache.org/jira/browse/IMPALA-11400#add-comment "Add
Comment")
---|---
| This message was sent by Atlassian Jira (v8.20.10#820010-sha1:ace47f9) | |
![Atlassian logo](https://issues.apache.org/jira/images/mail/atlassian-email-
logo.png)
---