You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Matteo Bertozzi (JIRA)" <ji...@apache.org> on 2012/08/19 18:08:37 UTC
[jira] [Created] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Matteo Bertozzi created HBASE-6610:
--------------------------------------
Summary: HFileLink: Hardlink alternative for snapshot restore
Key: HBASE-6610
URL: https://issues.apache.org/jira/browse/HBASE-6610
Project: HBase
Issue Type: New Feature
Components: io
Affects Versions: 0.96.0
Reporter: Matteo Bertozzi
Assignee: Matteo Bertozzi
Fix For: 0.96.0
To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6610:
-------------------------
Status: Patch Available (was: Open)
Trying v8 against hadoopqa
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ted Yu updated HBASE-6610:
--------------------------
Attachment: HBASE-6610-v2.patch
Patch from Matteo.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Jesse Yates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461616#comment-13461616 ]
Jesse Yates commented on HBASE-6610:
------------------------------------
[~saint.ack@gmail.com] trunk is fine, I need to rebase snapshots soon anyways.
[~mbertozzi] another review is up. And don't sweat the test failure, this isn't related.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: (was: HBASE-6610-v1.patch)
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451482#comment-13451482 ]
stack commented on HBASE-6610:
------------------------------
@Ted When you say 'Patch from Matteo', what does that mean? He sent it to you to upload? Or you are doing something else? Is Matteo indisposed, unable to contribute his own patch to Apache for some reason? Just wondering.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13438948#comment-13438948 ]
Hadoop QA commented on HBASE-6610:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12541787/HBASE-6610-v1.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings).
-1 findbugs. The patch appears to introduce 7 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.regionserver.TestStore
org.apache.hadoop.hbase.TestMultiVersions
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2641//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2641//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2641//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2641//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2641//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2641//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2641//console
This message is automatically generated.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Zhihong Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439709#comment-13439709 ]
Zhihong Ted Yu commented on HBASE-6610:
---------------------------------------
TestStore#testDeleteExpiredStoreFiles failure seems to be related to the patch.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: HBASE-6610-v1.patch
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: HBASE-6610-v7.patch
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13439775#comment-13439775 ]
Matteo Bertozzi commented on HBASE-6610:
----------------------------------------
{quote}TestStore#testDeleteExpiredStoreFiles failure seems to be related to the patch.{quote}
Not sure if is related, since TestStore doesn't follow any code path for the FileLink. seems more a flaky test that uses sleep to verify the result...
but I'll take a deeper look at that.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465534#comment-13465534 ]
Hudson commented on HBASE-6610:
-------------------------------
Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #197 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/197/])
HBASE-6610 HFileLink: Hardlink alternative for snapshot restore (Revision 1391326)
Result = FAILURE
stack :
Files :
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/FileLink.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/HFileLink.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/HFileCleaner.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/HFileLinkCleaner.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/HFileArchiveUtil.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestFileLink.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestHFileLinkCleaner.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFile.java
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: 6610v9.patch, HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465420#comment-13465420 ]
Hadoop QA commented on HBASE-6610:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12546963/6610v9.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 11 new or modified tests.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2957//console
This message is automatically generated.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: 6610v9.patch, HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Jesse Yates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458443#comment-13458443 ]
Jesse Yates commented on HBASE-6610:
------------------------------------
[~saint.ack@gmail.com] commented on RB - almost there, mostly nits (and possibly some matter of the late hour of the review).
do we want to roll this into the 0.96 or the snapshots branch? Seems like its only being used in snapshots, but given the breadth of code it touches, I'd be ok with it going into trunk and then ported over to snapshots (or vice-versa, as long as it happens in a short period of time).
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458163#comment-13458163 ]
stack commented on HBASE-6610:
------------------------------
[~jesse_yates] Can you +1 Matteo's last patch up on RB if you are down w/ it? I'd like to commit.
[~mbertozzi] Is your most recent RB attached here Matteo? Would like to have hadoopqa run it. Thanks.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: HBASE-6610-v3.patch
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13458862#comment-13458862 ]
stack commented on HBASE-6610:
------------------------------
[~jesse_yates] Thanks. Good review. I'd say roll this into trunk. How do I get it into our snapshot branch. Can you do that?
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461252#comment-13461252 ]
stack commented on HBASE-6610:
------------------------------
[~jesse_yates] Whatever is easiest for you. I wouldn't mind rolling it into trunk because its been well-reviewed.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6610:
-------------------------
Resolution: Fixed
Release Note: Adds a 'HardLink', an hfile proxy that tolerates files being moved from original location out to archive; it will find and serve the data whichever location the file happens to be in.
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
Committed to trunk. Nice one Matteo. I made a pass at a release note. Feel free to improve. Nice reviewing Jesse (I think this one of the most reviewed patches in hbase history -- good going lads)
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: 6610v9.patch, HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6610:
-------------------------
Attachment: 6610v9.patch
What I applied... org.apache.hadoop.hbase.ResourceCheckerJUnitRule is not needed in tests anymore (and moved to hbase-common so wouldn't compile). Instead, nkeywal provided the same resource checking via a surefile 'Listener', a config added to the plugin in the pom.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: 6610v9.patch, HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: (was: HBASE-6610-v0.patch)
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451494#comment-13451494 ]
Ted Yu commented on HBASE-6610:
-------------------------------
Good suggestion.
Will do that next time.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: HBASE-6610-v1.patch
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: HBASE-6610-v8.patch
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451488#comment-13451488 ]
Ted Yu commented on HBASE-6610:
-------------------------------
Patch v5 was the latest version on review board.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
stack updated HBASE-6610:
-------------------------
Status: Open (was: Patch Available)
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "stack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451489#comment-13451489 ]
stack commented on HBASE-6610:
------------------------------
You should ask Matteo to copy it over. Its his patch. Only he can contrib it to Apache.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13465452#comment-13465452 ]
Hudson commented on HBASE-6610:
-------------------------------
Integrated in HBase-TRUNK #3388 (See [https://builds.apache.org/job/HBase-TRUNK/3388/])
HBASE-6610 HFileLink: Hardlink alternative for snapshot restore (Revision 1391326)
Result = SUCCESS
stack :
Files :
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/FileLink.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/HFileLink.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/HFile.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/HFileCleaner.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/HFileLinkCleaner.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/FSUtils.java
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/util/HFileArchiveUtil.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestFileLink.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestHFileLinkCleaner.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFile.java
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: 6610v9.patch, HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Status: Patch Available (was: Open)
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: New Feature
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v0.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Status: Patch Available (was: Open)
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Jesse Yates (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13459076#comment-13459076 ]
Jesse Yates commented on HBASE-6610:
------------------------------------
[~saint.ack@gmail.com] I can roll it into the snapshots branch (DM me if you want commit access to avoid bottle-necks).
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Status: Open (was: Patch Available)
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v0.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Jonathan Hsieh (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-6610:
----------------------------------
Parent Issue: HBASE-6055 (was: HBASE-6230)
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: 6610v9.patch, HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch, HBASE-6610-v8.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Issue Type: Sub-task (was: New Feature)
Parent: HBASE-6230
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v0.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451412#comment-13451412 ]
Hadoop QA commented on HBASE-6610:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12544364/HBASE-6610-v5.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 11 new or modified tests.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The patch appears to cause mvn compile goal to fail.
-1 findbugs. The patch appears to cause Findbugs (version 1.3.9) to fail.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.client.TestFromClientSide
org.apache.hadoop.hbase.client.TestFromClientSideWithCoprocessor
org.apache.hadoop.hbase.master.TestSplitLogManager
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2832//testReport/
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2832//console
This message is automatically generated.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: HBASE-6610-v0.patch
HFileLink draft available on review board https://reviews.apache.org/r/6694/
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: New Feature
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v0.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Ted Yu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ted Yu updated HBASE-6610:
--------------------------
Attachment: HBASE-6610-v5.patch
Patch from Matteo.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13437535#comment-13437535 ]
Hadoop QA commented on HBASE-6610:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12541526/HBASE-6610-v0.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The applied patch generated 5 javac compiler warnings (more than the trunk's current 4 warnings).
-1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.master.TestSplitLogManager
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2621//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2621//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2621//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2621//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2621//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2621//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2621//console
This message is automatically generated.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Matteo Bertozzi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matteo Bertozzi updated HBASE-6610:
-----------------------------------
Attachment: HBASE-6610-v6.patch
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6610) HFileLink: Hardlink alternative for
snapshot restore
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-6610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13461124#comment-13461124 ]
Hadoop QA commented on HBASE-6610:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12546159/HBASE-6610-v7.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 11 new or modified tests.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
-1 javadoc. The javadoc tool appears to have generated 149 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 8 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these unit tests:
org.apache.hadoop.hbase.backup.example.TestZooKeeperTableArchiveClient
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2923//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2923//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop2-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2923//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop1-compat.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2923//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2923//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2923//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-hadoop-compat.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2923//console
This message is automatically generated.
> HFileLink: Hardlink alternative for snapshot restore
> ----------------------------------------------------
>
> Key: HBASE-6610
> URL: https://issues.apache.org/jira/browse/HBASE-6610
> Project: HBase
> Issue Type: Sub-task
> Components: io
> Affects Versions: 0.96.0
> Reporter: Matteo Bertozzi
> Assignee: Matteo Bertozzi
> Labels: snapshot
> Fix For: 0.96.0
>
> Attachments: HBASE-6610-v1.patch, HBASE-6610-v2.patch, HBASE-6610-v3.patch, HBASE-6610-v5.patch, HBASE-6610-v6.patch, HBASE-6610-v7.patch
>
>
> To avoid copying data during restore snapshot we need to introduce an HFile Link that allows to reference a file that can be in the original path (/hbase/table/region/cf/hfile) or, if the file is archived, in the archive directory (/hbase/.archive/table/region/cf/hfile).
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira