You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by xicm000 <xi...@126.com> on 2021/08/16 08:42:22 UTC

get ASSIGN_SEQ_IDS from config when calling Bulkload in non-MR mode

Hi, 
When we use bulkload to load hfiles to hbase(not mapreduce), regionserver will call org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager.secureBulkLoadHFiles -> org.apache.hadoop.hbase.regionserver.bulkLoadHFiles, secureBulkLoadHFiles calls bulkLoadHFiles with 
```
return region.bulkLoadHFiles(familyPaths, true,
new SecureBulkLoadListener(fs, bulkToken, conf), request.getCopyFile(),
clusterIds, request.getReplicate());
```
secureBulkLoadHFiles passes true to assignSeqId:boolean in bulkLoadHFiles , this will cause a flush before bulkload. If we have many bulkload, it will generate many small hfiles. Can we get the assignSeqId from config?
| |
xicm000
|
|
xicm000@126.com
|
签名由网易邮箱大师定制