You are viewing a plain text version of this content. The canonical link for it is here.

Posted to notifications@accumulo.apache.org by "Eric Newton (JIRA)" <ji...@apache.org> on 2014/03/26 16:05:15 UTC

[jira] [Created] (ACCUMULO-2556) use asynchronous calls to scale BatchReader client calls

Eric Newton created ACCUMULO-2556:
-------------------------------------

             Summary: use asynchronous calls to scale BatchReader client calls
                 Key: ACCUMULO-2556
                 URL: https://issues.apache.org/jira/browse/ACCUMULO-2556
             Project: Accumulo
          Issue Type: Bug
          Components: client
            Reporter: Eric Newton


Presently, the BatchReader uses a thread-pool to make synchronous calls to tablet servers to fetch data.  That limits the number of tablet servers that can be doing queries in parallel.  On very large clusters, clients may not initiate queries to all of the servers until some queries finish.  It is not practical to create thousands of threads just to initiate queries.

Alternatively, asynchronous calls can efficiently initiate queries an wait for responses, without using threads just to wait on responses.




--
This message was sent by Atlassian JIRA
(v6.2#6252)