You are viewing a plain text version of this content. The canonical link for it is here.
Posted to builds@hbase.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/12/09 06:16:06 UTC

Build failed in Jenkins: HBase-1.2-IT » IntegrationTestAcidGuarantees,latest1.8,Hadoop #330

See <https://builds.apache.org/job/HBase-1.2-IT/it.test=IntegrationTestAcidGuarantees,jdk=latest1.8,label=Hadoop/330/changes>

Changes:

[antonov] HBASE-7171 Initial web UI for region/memstore/storefiles details

[larsh] HBASE-14869 Better request latency and size histograms. (Vikas

------------------------------------------
[...truncated 2402 lines...]
     intx VMThreadPriority                          = -1                                  {product}
     intx VMThreadStackSize                         = 1024                                {pd product}
     intx ValueMapInitialSize                       = 11                                  {C1 product}
     intx ValueMapMaxLoopSize                       = 8                                   {C1 product}
     intx ValueSearchLimit                          = 1000                                {C2 product}
     bool VerifyMergedCPBytecodes                   = true                                {product}
     bool VerifySharedSpaces                        = false                               {product}
     intx WorkAroundNPTLTimedWaitHang               = 1                                   {product}
    uintx YoungGenerationSizeIncrement              = 20                                  {product}
    uintx YoungGenerationSizeSupplement             = 80                                  {product}
    uintx YoungGenerationSizeSupplementDecay        = 8                                   {product}
    uintx YoungPLABSize                             = 4096                                {product}
     bool ZeroTLAB                                  = false                               {product}
     intx hashCode                                  = 5                                   {product}
Running org.apache.hadoop.hbase.IntegrationTestAcidGuarantees
SUREFIRE-859: [GC (Allocation Failure)  193536K->67470K(741888K), 0.3262930 secs]
SUREFIRE-859: [GC (Metadata GC Threshold)  105987K->43103K(935424K), 0.1442437 secs]
SUREFIRE-859: [Full GC (Metadata GC Threshold)  43103K->7957K(715776K), 0.2634292 secs]
SUREFIRE-859: [GC (Metadata GC Threshold)  294789K->88547K(715776K), 0.6676521 secs]
SUREFIRE-859: [Full GC (Metadata GC Threshold)  88547K->85330K(907776K), 0.5501458 secs]
SUREFIRE-859: [GC (Allocation Failure)  472402K->144686K(1128960K), 0.3115266 secs]
SUREFIRE-859: [GC (Metadata GC Threshold)  634488K->153293K(1197568K), 0.2252488 secs]
SUREFIRE-859: [Full GC (Metadata GC Threshold)  153293K->104102K(1301504K), 1.2380262 secs]
SUREFIRE-859: [GC (Allocation Failure)  780966K->202226K(1599488K), 0.4218283 secs]
SUREFIRE-859: [GC (Allocation Failure)  1111193K->224942K(1618432K), 0.5368467 secs]
SUREFIRE-859: [GC (Allocation Failure)  1135790K->243631K(1812480K), 0.9475295 secs]
Tests run: 3, Failures: 0, Errors: 1, Skipped: 0, Time elapsed: 1,143.552 sec <<< FAILURE! - in org.apache.hadoop.hbase.IntegrationTestAcidGuarantees
testScanAtomicity(org.apache.hadoop.hbase.IntegrationTestAcidGuarantees)  Time elapsed: 756.054 sec  <<< ERROR!
java.lang.RuntimeException: Deferred
	at org.apache.hadoop.hbase.MultithreadedTestUtil$TestContext.checkException(MultithreadedTestUtil.java:78)
	at org.apache.hadoop.hbase.MultithreadedTestUtil$TestContext.stop(MultithreadedTestUtil.java:105)
	at org.apache.hadoop.hbase.TestAcidGuarantees.runTestAtomicity(TestAcidGuarantees.java:316)
	at org.apache.hadoop.hbase.TestAcidGuarantees.runTestAtomicity(TestAcidGuarantees.java:254)
	at org.apache.hadoop.hbase.IntegrationTestAcidGuarantees.testScanAtomicity(IntegrationTestAcidGuarantees.java:101)
Caused by: java.lang.RuntimeException: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions:
Wed Dec 09 05:04:08 UTC 2015, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69241: row '' on table 'TestAcidGuarantees' at region=TestAcidGuarantees,,1449637392545.dc42e93978fea7982a8497ef2070c92f., hostname=asf907.gq1.ygridcore.net,55914,1449637388079, seqNum=2

	at org.apache.hadoop.hbase.client.AbstractClientScanner$1.hasNext(AbstractClientScanner.java:97)
	at org.apache.hadoop.hbase.TestAcidGuarantees$AtomicScanReader.doAnAction(TestAcidGuarantees.java:216)
	at org.apache.hadoop.hbase.MultithreadedTestUtil$RepeatingTestThread.doWork(MultithreadedTestUtil.java:147)
	at org.apache.hadoop.hbase.MultithreadedTestUtil$TestThread.run(MultithreadedTestUtil.java:123)
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after attempts=36, exceptions:
Wed Dec 09 05:04:08 UTC 2015, null, java.net.SocketTimeoutException: callTimeout=60000, callDuration=69241: row '' on table 'TestAcidGuarantees' at region=TestAcidGuarantees,,1449637392545.dc42e93978fea7982a8497ef2070c92f., hostname=asf907.gq1.ygridcore.net,55914,1449637388079, seqNum=2

	at org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:203)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
	at org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:320)
	at org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:295)
	at org.apache.hadoop.hbase.client.ClientScanner.possiblyNextScanner(ClientScanner.java:241)
	at org.apache.hadoop.hbase.client.ClientScanner.loadCache(ClientScanner.java:534)
	at org.apache.hadoop.hbase.client.ClientScanner.next(ClientScanner.java:364)
	at org.apache.hadoop.hbase.client.AbstractClientScanner$1.hasNext(AbstractClientScanner.java:94)
	at org.apache.hadoop.hbase.TestAcidGuarantees$AtomicScanReader.doAnAction(TestAcidGuarantees.java:216)
	at org.apache.hadoop.hbase.MultithreadedTestUtil$RepeatingTestThread.doWork(MultithreadedTestUtil.java:147)
	at org.apache.hadoop.hbase.MultithreadedTestUtil$TestThread.run(MultithreadedTestUtil.java:123)
Caused by: java.net.SocketTimeoutException: callTimeout=60000, callDuration=69241: row '' on table 'TestAcidGuarantees' at region=TestAcidGuarantees,,1449637392545.dc42e93978fea7982a8497ef2070c92f., hostname=asf907.gq1.ygridcore.net,55914,1449637388079, seqNum=2
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:159)
	at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.NotServingRegionException: org.apache.hadoop.hbase.NotServingRegionException: Region TestAcidGuarantees,,1449637392545.dc42e93978fea7982a8497ef2070c92f. is not online on asf907.gq1.ygridcore.net,55914,1449637388079
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2912)
	at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:976)
	at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2269)
	at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33558)
	at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2168)
	at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
	at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
	at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
	at java.lang.Thread.run(Thread.java:745)

	at sun.reflect.GeneratedConstructorAccessor39.newInstance(Unknown Source)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:422)
	at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:106)
	at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:95)
	at org.apache.hadoop.hbase.protobuf.ProtobufUtil.getRemoteException(ProtobufUtil.java:329)
	at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:401)
	at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:202)
	at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:64)
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:356)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:330)
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126)
	at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException: org.apache.hadoop.hbase.NotServingRegionException: Region TestAcidGuarantees,,1449637392545.dc42e93978fea7982a8497ef2070c92f. is not online on asf907.gq1.ygridcore.net,55914,1449637388079
	at org.apache.hadoop.hbase.regionserver.HRegionServer.getRegionByEncodedName(HRegionServer.java:2912)
	at org.apache.hadoop.hbase.regionserver.RSRpcServices.getRegion(RSRpcServices.java:976)
	at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:2269)
	at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:33558)
	at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2168)
	at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:109)
	at org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop(RpcExecutor.java:133)
	at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:108)
	at java.lang.Thread.run(Thread.java:745)

	at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1258)
	at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:217)
	at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:295)
	at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:34004)
	at org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:393)
	at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:202)
	at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:64)
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:356)
	at org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:330)
	at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126)
	at org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)


Results :

Tests in error: 
  IntegrationTestAcidGuarantees.testScanAtomicity:101 » Runtime Deferred

Tests run: 3, Failures: 0, Errors: 1, Skipped: 0

[WARNING] File encoding has not been set, using platform encoding ISO-8859-1, i.e. build is platform dependent! The file encoding for reports output files should be provided by the POM property ${project.reporting.outputEncoding}.
[INFO] 
[INFO] --- maven-failsafe-plugin:2.18.1:verify (verify) @ hbase-it ---
[INFO] Failsafe report directory: <https://builds.apache.org/job/HBase-1.2-IT/it.test=IntegrationTestAcidGuarantees,jdk=latest1.8,label=Hadoop/ws/hbase-it/target/failsafe-reports>
[WARNING] File encoding has not been set, using platform encoding ISO-8859-1, i.e. build is platform dependent! The file encoding for reports output files should be provided by the POM property ${project.reporting.outputEncoding}.
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache HBase ...................................... SUCCESS [13.912s]
[INFO] Apache HBase - Checkstyle ......................... SUCCESS [4.098s]
[INFO] Apache HBase - Resource Bundle .................... SUCCESS [1.248s]
[INFO] Apache HBase - Annotations ........................ SUCCESS [5.909s]
[INFO] Apache HBase - Protocol ........................... SUCCESS [1:02.246s]
[INFO] Apache HBase - Common ............................. SUCCESS [41.001s]
[INFO] Apache HBase - Procedure .......................... SUCCESS [8.020s]
[INFO] Apache HBase - Client ............................. SUCCESS [27.617s]
[INFO] Apache HBase - Hadoop Compatibility ............... SUCCESS [2.106s]
[INFO] Apache HBase - Hadoop Two Compatibility ........... SUCCESS [6.812s]
[INFO] Apache HBase - Prefix Tree ........................ SUCCESS [7.456s]
[INFO] Apache HBase - Server ............................. SUCCESS [2:01.128s]
[INFO] Apache HBase - Testing Util ....................... SUCCESS [5.430s]
[INFO] Apache HBase - Thrift ............................. SUCCESS [20.754s]
[INFO] Apache HBase - Rest ............................... SUCCESS [8.218s]
[INFO] Apache HBase - Shell .............................. SUCCESS [2.837s]
[INFO] Apache HBase - Integration Tests .................. FAILURE [19:28.149s]
[INFO] Apache HBase - Examples ........................... SKIPPED
[INFO] Apache HBase - External Block Cache ............... SKIPPED
[INFO] Apache HBase - Assembly ........................... SKIPPED
[INFO] Apache HBase - Shaded ............................. SKIPPED
[INFO] Apache HBase - Shaded - Client .................... SKIPPED
[INFO] Apache HBase - Shaded - Server .................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 25:14.188s
[INFO] Finished at: Wed Dec 09 05:15:55 UTC 2015
[INFO] Final Memory: 165M/2498M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal org.apache.maven.plugins:maven-failsafe-plugin:2.18.1:verify (verify) on project hbase-it: There are test failures.
[ERROR] 
[ERROR] Please refer to <https://builds.apache.org/job/HBase-1.2-IT/it.test=IntegrationTestAcidGuarantees,jdk=latest1.8,label=Hadoop/ws/hbase-it/target/failsafe-reports> for the individual test results.
[ERROR] -> [Help 1]
[ERROR] 
[ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR] 
[ERROR] For more information about the errors and possible solutions, please read the following articles:
[ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
[ERROR] 
[ERROR] After correcting the problems, you can resume the build with the command
[ERROR]   mvn <goals> -rf :hbase-it
Build step 'Invoke top-level Maven targets' marked build as failure
Performing Post build task...
Match found for :.* : True
Logical operation result is TRUE
Running script  : # Post-build task script. TODO: Check this in and have all builds reference check-in.
pwd && ls
# NOTE!!!! The below code has been copied and pasted from ./dev-tools/run-test.sh
# Do not change here without syncing there and vice-versa.
ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' | wc -l`
if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
 echo "Suspicious java process found - waiting 30s to see if there are just slow to stop"
 sleep 30
 ZOMBIE_TESTS_COUNT=`jps -v | grep surefirebooter | grep -e '-Dhbase.test' | wc -l`
 if [[ $ZOMBIE_TESTS_COUNT != 0 ]] ; then
   echo " {color:red}There appear to be $ZOMBIE_TESTS_COUNT zombie tests{color}, they should have been killed by surefire but survived"
   jps -v | grep surefirebooter | grep -e '-Dhbase.test'
   jps -v | grep surefirebooter | grep -e '-Dhbase.test' | cut -d ' ' -f 1 | xargs -n 1 jstack
   # Exit with error
   exit 1
 else
   echo "We're ok: there is no zombie test, but some tests took some time to stop"
 fi
else
  echo "We're ok: there is no zombie test"
fi
[Hadoop] $ /bin/bash -xe /tmp/hudson6306980877054995637.sh
+ pwd
<https://builds.apache.org/job/HBase-1.2-IT/it.test=IntegrationTestAcidGuarantees,jdk=latest1.8,label=Hadoop/ws/>
+ ls
bin
CHANGES.txt
conf
dev-support
hbase-annotations
hbase-assembly
hbase-checkstyle
hbase-client
hbase-common
hbase-examples
hbase-external-blockcache
hbase-hadoop2-compat
hbase-hadoop-compat
hbase-it
hbase-native-client
hbase-prefix-tree
hbase-procedure
hbase-protocol
hbase-resource-bundle
hbase-rest
hbase-server
hbase-shaded
hbase-shell
hbase-spark
hbase-testing-util
hbase-thrift
LICENSE.txt
NOTICE.txt
pom.xml
README.txt
src
target
++ wc -l
++ grep -e -Dhbase.test
++ grep surefirebooter
++ jps -v
+ ZOMBIE_TESTS_COUNT=0
+ [[ 0 != 0 ]]
+ echo 'We'\''re ok: there is no zombie test'
We're ok: there is no zombie test
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Archiving artifacts

Jenkins build is back to normal : HBase-1.2-IT » IntegrationTestAcidGuarantees,latest1.8,Hadoop #331

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/HBase-1.2-IT/it.test=IntegrationTestAcidGuarantees,jdk=latest1.8,label=Hadoop/331/changes>