You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@phoenix.apache.org by "Csaba Skrabak (JIRA)" <ji...@apache.org> on 2017/09/20 07:47:00 UTC

[jira] [Comment Edited] (PHOENIX-3708) Tests introduced in PHOENIX-3346 doesn't work well with failsafe plugin

    [ https://issues.apache.org/jira/browse/PHOENIX-3708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16172864#comment-16172864 ] 

Csaba Skrabak edited comment on PHOENIX-3708 at 9/20/17 7:46 AM:
-----------------------------------------------------------------

Hi [~sergey.soldatov], did the reenabled tests succeed eventually? They give me exceptions in local runs:
{noformat}
[2017-09-19 16:20:51,440 WARN  [main] org.apache.hadoop.util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-09-19 16:20:52,659 DEBUG [main] org.apache.commons.configuration.ConfigurationUtils(447): ConfigurationUtils.locate(): base is null, name is hadoop-metrics2-namenode.properties
2017-09-19 16:20:52,662 DEBUG [main] org.apache.commons.configuration.ConfigurationUtils(447): ConfigurationUtils.locate(): base is null, name is hadoop-metrics2.properties
2017-09-19 16:20:52,662 DEBUG [main] org.apache.commons.configuration.ConfigurationUtils(580): Loading configuration from the context classpath (hadoop-metrics2.properties)
2017-09-19 16:20:53,314 WARN  [main] org.apache.hadoop.hdfs.server.namenode.FSNamesystem(705): Encountered exception loading fsimage
java.io.FileNotFoundException: No valid image files found
	at org.apache.hadoop.hdfs.server.namenode.FSImageTransactionalStorageInspector.getLatestImages(FSImageTransactionalStorageInspector.java:165)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:618)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:289)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1045)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:703)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:688)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:752)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:992)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:976)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1701)
	at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1155)
	at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1030)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:823)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:754)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:624)
	at org.apache.hadoop.hive.shims.Hadoop23Shims.getMiniDfs(Hadoop23Shims.java:512)
	at org.apache.phoenix.hive.HiveTestUtil.<init>(HiveTestUtil.java:303)
	at org.apache.phoenix.hive.HiveTestUtil.<init>(HiveTestUtil.java:261)
	at org.apache.phoenix.hive.BaseHivePhoenixStoreIT.setup(BaseHivePhoenixStoreIT.java:82)
	at org.apache.phoenix.hive.HiveTezIT.setUpBeforeClass(HiveTezIT.java:31)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:367)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:274)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
2017-09-19 16:20:53,336 ERROR [main] org.apache.hadoop.hdfs.MiniDFSCluster(828): IOE creating namenodes. Permissions dump:
path 'build/test/data/dfs/data': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build/test/data/dfs/data
	permissions: drwx
path 'build/test/data/dfs': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build/test/data/dfs
	permissions: drwx
path 'build/test/data': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build/test/data
	permissions: drwx
path 'build/test': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build/test
	permissions: drwx
path 'build': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build
	permissions: drwx
...
2017-09-19 16:20:53,337 ERROR [main] org.apache.phoenix.hive.BaseHivePhoenixStoreIT(84): Unexpected exception in setup
{noformat}
And then it ends up in a NPE.


was (Author: cskrabak):
Hi [~sergey.soldatov], did the reenabled tests succeed eventually? They give me exceptions in local runs:
{noformat}
[2017-09-19 16:20:51,440 WARN  [main] org.apache.hadoop.util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2017-09-19 16:20:52,659 DEBUG [main] org.apache.commons.configuration.ConfigurationUtils(447): ConfigurationUtils.locate(): base is null, name is hadoop-metrics2-namenode.properties
2017-09-19 16:20:52,662 DEBUG [main] org.apache.commons.configuration.ConfigurationUtils(447): ConfigurationUtils.locate(): base is null, name is hadoop-metrics2.properties
2017-09-19 16:20:52,662 DEBUG [main] org.apache.commons.configuration.ConfigurationUtils(580): Loading configuration from the context classpath (hadoop-metrics2.properties)
2017-09-19 16:20:53,314 WARN  [main] org.apache.hadoop.hdfs.server.namenode.FSNamesystem(705): Encountered exception loading fsimage
java.io.FileNotFoundException: No valid image files found
	at org.apache.hadoop.hdfs.server.namenode.FSImageTransactionalStorageInspector.getLatestImages(FSImageTransactionalStorageInspector.java:165)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:618)
	at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:289)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:1045)
	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:703)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:688)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:752)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:992)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:976)
	at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1701)
	at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:1155)
	at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:1030)
	at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:823)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:754)
	at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:624)
	at org.apache.hadoop.hive.shims.Hadoop23Shims.getMiniDfs(Hadoop23Shims.java:512)
	at org.apache.phoenix.hive.HiveTestUtil.<init>(HiveTestUtil.java:303)
	at org.apache.phoenix.hive.HiveTestUtil.<init>(HiveTestUtil.java:261)
	at org.apache.phoenix.hive.BaseHivePhoenixStoreIT.setup(BaseHivePhoenixStoreIT.java:82)
	at org.apache.phoenix.hive.HiveTezIT.setUpBeforeClass(HiveTezIT.java:31)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:50)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47)
	at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
	at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:363)
	at org.apache.maven.surefire.junit4.JUnit4Provider.execute(JUnit4Provider.java:367)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeWithRerun(JUnit4Provider.java:274)
	at org.apache.maven.surefire.junit4.JUnit4Provider.executeTestSet(JUnit4Provider.java:238)
	at org.apache.maven.surefire.junit4.JUnit4Provider.invoke(JUnit4Provider.java:161)
	at org.apache.maven.surefire.booter.ForkedBooter.invokeProviderInSameClassLoader(ForkedBooter.java:290)
	at org.apache.maven.surefire.booter.ForkedBooter.runSuitesInProcess(ForkedBooter.java:242)
	at org.apache.maven.surefire.booter.ForkedBooter.main(ForkedBooter.java:121)
2017-09-19 16:20:53,336 ERROR [main] org.apache.hadoop.hdfs.MiniDFSCluster(828): IOE creating namenodes. Permissions dump:
path 'build/test/data/dfs/data': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build/test/data/dfs/data
	permissions: drwx
path 'build/test/data/dfs': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build/test/data/dfs
	permissions: drwx
path 'build/test/data': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build/test/data
	permissions: drwx
path 'build/test': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build/test
	permissions: drwx
path 'build': 
	absolute:/Users/cskrabak/git/phoenix/phoenix-hive/build
	permissions: drwx
...
2017-09-19 16:20:53,337 ERROR [main] org.apache.phoenix.hive.BaseHivePhoenixStoreIT(84): Unexpected exception in setup
{noformat}


> Tests introduced in PHOENIX-3346 doesn't work well with failsafe plugin
> -----------------------------------------------------------------------
>
>                 Key: PHOENIX-3708
>                 URL: https://issues.apache.org/jira/browse/PHOENIX-3708
>             Project: Phoenix
>          Issue Type: Bug
>    Affects Versions: 4.10.0
>            Reporter: Sergey Soldatov
>            Assignee: Sergey Soldatov
>             Fix For: 4.11.0
>
>         Attachments: PHOENIX-3708.patch
>
>
> There is a strange behavior for those test. They run fine with surefire plugin, but with failsafe they just interrupted during execution and fails. Need to figure out why that happen and fix it. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)