[jira] [Commented] (HBASE-12547) Adopt server side cleanup for bulk load staging directories

["Ted Yu (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-12547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15090351#comment-15090351 ] 

Ted Yu commented on HBASE-12547:
--------------------------------

We need some mechanism to track the expiration of leases.
Zookeeper is not favored as we're moving away from using zookeeper.

> Adopt server side cleanup for bulk load staging directories
> -----------------------------------------------------------
>
>                 Key: HBASE-12547
>                 URL: https://issues.apache.org/jira/browse/HBASE-12547
>             Project: HBase
>          Issue Type: Improvement
>            Reporter: Ted Yu
>              Labels: bulkloader
>
> Currently we rely on the client to send the clean up request for bulk load staging directories.
> In discussion of HBASE-12533, Enis and I raised similar comment about cleaning up bulk load staging directories from server side.
> We can keep lease on staging directory for bulk load operation. The default lease period should be long enough. After the lease expires, the underlying staging directory would be cleaned.
> This increases the robustness of bulk load process.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)