[jira] [Commented] (HBASE-16265) BulkLoadSuite#Wide Row Bulk Load fails in master branch

["Jerry He (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-16265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15387014#comment-15387014 ] 

Jerry He commented on HBASE-16265:
----------------------------------

This may be related to the commit by HBASE-13701.
But the root cause is HBASE-15291.  See my comment on that JIRA.
The refactoring makes it happen more often in the tests since secure bulk load is the default now.
I think we need to revert HBASE-15291

See: 
https://builds.apache.org/job/PreCommit-HBASE-Build/2437/testReport/org.apache.hadoop.hbase.mapreduce/TestLoadIncrementalHFilesSplitRecovery/testSplitTmpFileCleanUp/
Towards the end of the output:
{noformat}
2016-06-30 07:48:23,454 ERROR [RpcServer.FifoWFPBQ.default.handler=3,queue=0,port=56734] regionserver.HRegion(5508): There was a partial failure due to IO when attempting to load family_0004 : hdfs://localhost:52668/user/jenkins/test-data/34d5b872-06e9-4844-a90b-4635a736994d/splitTmpFileCleanUp/splitTmpFileCleanUp2/family_0004/.tmp/2f32f7a8e89f4dbcbbe38b095e06352e.top
java.io.IOException: Filesystem closed
	at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:808)
	at org.apache.hadoop.hdfs.DFSClient.getFileInfo(DFSClient.java:2113)
	at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1305)
	at org.apache.hadoop.hdfs.DistributedFileSystem$22.doCall(DistributedFileSystem.java:1301)
	at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
	at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:1317)
	at org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager$SecureBulkLoadListener.isFile(SecureBulkLoadManager.java:410)
	at org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager$SecureBulkLoadListener.prepareBulkLoad(SecureBulkLoadManager.java:347)
	at org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:5479)
	at org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager$1.run(SecureBulkLoadManager.java:249)
	at org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager$1.run(SecureBulkLoadManager.java:234)
{noformat}

> BulkLoadSuite#Wide Row Bulk Load fails in master branch
> -------------------------------------------------------
>
>                 Key: HBASE-16265
>                 URL: https://issues.apache.org/jira/browse/HBASE-16265
>             Project: HBase
>          Issue Type: Bug
>            Reporter: Ted Yu
>
> See https://builds.apache.org/job/HBase-TRUNK_matrix/1265/jdk=latest1.8,label=yahoo-not-h2/testReport/org.apache.hadoop.hbase.spark/BulkLoadSuite/Wide_Row_Bulk_Load__Test_multi_family_and_multi_column_tests_with_one_column_family_with_custom_configs_plus_multi_region/ :
> {code}
> File does not exist: /tmp/junit811617169708528768/junit7419829633245108670/f1/b934f7ee0d414de5ab3457d057b9df64
 at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:71)
 at org.apache.hadoop.hdfs.server.namenode.INodeFile.valueOf(INodeFile.java:61)
 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocationsInt(FSNamesystem.java:1828)
 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1799)
 at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1712)
 at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:587)
 at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:365)
 at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java)
 at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
 at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
 at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
 at java.security.AccessController.doPrivileged(Native Method)
 at javax.security.auth.Subject.doAs(Subject.java:422)
 at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
 at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2045)

> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)