You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Hudson (Jira)" <ji...@apache.org> on 2020/03/04 06:26:00 UTC

[jira] [Commented] (HBASE-23553) Snapshot referenced data files are deleted in some case

    [ https://issues.apache.org/jira/browse/HBASE-23553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17050934#comment-17050934 ] 

Hudson commented on HBASE-23553:
--------------------------------

Results for branch branch-2.1
	[build #1823 on builds.a.o|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/1823/]: (x) *{color:red}-1 overall{color}*
----
details (if available):

(/) {color:green}+1 general checks{color}
-- For more information [see general report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/1823//General_Nightly_Build_Report/]




(x) {color:red}-1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/1823//JDK8_Nightly_Build_Report_(Hadoop2)/]


(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3) report|https://builds.apache.org/job/HBase%20Nightly/job/branch-2.1/1823//JDK8_Nightly_Build_Report_(Hadoop3)/]


(/) {color:green}+1 source release artifact{color}
-- See build output for details.


(/) {color:green}+1 client integration test{color}


> Snapshot referenced data files are deleted in some case
> -------------------------------------------------------
>
>                 Key: HBASE-23553
>                 URL: https://issues.apache.org/jira/browse/HBASE-23553
>             Project: HBase
>          Issue Type: Bug
>          Components: snapshots
>            Reporter: Yi Mei
>            Assignee: Yi Mei
>            Priority: Major
>             Fix For: 3.0.0, 2.3.0, 2.2.3, 2.1.10
>
>
> We scan snapshot in our cluster and got following exception:
> {code:java}
> java.io.IOException: java.io.IOException: java.io.FileNotFoundException: Unable to open link: org.apache.hadoop.hbase.io.HFileLink locations=[hdfs://tjwqsrv-galaxy98/hbase/tjwqsrv-galaxy98/data/default/galaxy_online_fds_object_table/06dd90d8540b56343859b63a6134450c/A/4dddda6cf05f419a9f61059cb05a962f, hdfs://tjwqsrv-galaxy98/hbase/tjwqsrv-galaxy98/.tmp/data/default/galaxy_online_fds_object_table/06dd90d8540b56343859b63a6134450c/A/4dddda6cf05f419a9f61059cb05a962f, hdfs://tjwqsrv-galaxy98/hbase/tjwqsrv-galaxy98/archive/data/default/galaxy_online_fds_object_table/06dd90d8540b56343859b63a6134450c/A/4dddda6cf05f419a9f61059cb05a962f] 
> at org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionStores(HRegion.java:867) 
> at org.apache.hadoop.hbase.regionserver.HRegion.initializeRegionInternals(HRegion.java:778) at org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:749) 
> at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:5306) 
> at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:5271) 
> at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:5243) 
> at org.apache.hadoop.hbase.client.ClientSideRegionScanner.<init>(ClientSideRegionScanner.java:72) 
> at org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormatImpl$RecordReader.initialize(TableSnapshotInputFormatImpl.java:239) 
> at org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat$TableSnapshotRegionRecordReader.initialize(TableSnapshotInputFormat.java:150) 
> at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.initialize(MapTask.java:552) at {code}
> I checked to namenode logs and found that this file is deleted by hbase cleaner although a snapshot still referenced to this file.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)