You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by GitBox <gi...@apache.org> on 2020/07/14 17:46:55 UTC

[GitHub] [hbase] wchevreuil commented on pull request #2002: HBASE-24541 Add support to run LoadIncrementalHFiles in a distributed manner

wchevreuil commented on pull request #2002:
URL: https://github.com/apache/hbase/pull/2002#issuecomment-658319735


   > After inspecting thread dumps, I saw lots of time spent in re-creating HTTP connections. It seemed that the connections were not being re-used because the `HFile.Reader` was not reading all the bytes after seeking to read the trailer. In turn this causes the connection to get aborted and it can't be pooled.
   
   So the issue is bound to JVM instance, since the better performance with multiple tasks only, but not with multiple threads on same JVM instance?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org