You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@crunch.apache.org by "Andrew Olson (JIRA)" <ji...@apache.org> on 2019/04/18 14:07:00 UTC

[jira] [Commented] (CRUNCH-681) HFileUtils. writeToHFilesForIncrementalLoad() should accept a FileSystem parameter

    [ https://issues.apache.org/jira/browse/CRUNCH-681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821144#comment-16821144 ] 

Andrew Olson commented on CRUNCH-681:
-------------------------------------

This change also needs to be made for writePutsToHFilesForIncrementalLoad which calls writeToHFilesForIncrementalLoad.

The scanHFiles methods should do similar for the HFileSource.

> HFileUtils. writeToHFilesForIncrementalLoad() should accept a FileSystem parameter
> ----------------------------------------------------------------------------------
>
>                 Key: CRUNCH-681
>                 URL: https://issues.apache.org/jira/browse/CRUNCH-681
>             Project: Crunch
>          Issue Type: Improvement
>    Affects Versions: 0.14.0
>            Reporter: Ben Roling
>            Priority: Major
>
> With CRUNCH-677 in, HFileUtils.writeToHFilesForIncrementalLoad() should have a form that accepts a FileSystem and propagates that FileSystem to the HFileTarget.  This enables writing HFiles to FileSystems not included in the Configuration of the Pipeline itself.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)