You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by Boski Shah <bo...@gmail.com> on 2012/08/20 23:49:15 UTC
Error while running the unit test
Hello,
I am a masters student and working on a PIG-2597 Move grunt from JAVACC to
ANTLR.
I am facing an issue while testing org.apache.pig.test.TestGrunt.java
I am trying to run TestGrunt.java individually using the following command
$ ant -Dtestcase=Testgrunt.java clean test
While running this unit test I am getting an error:
12/08/20 11:00:50 WARN util.MBeans:
Hadoop:service=DataNode,name=MetricsSystem,sub=Control
javax.management.InstanceAlreadyExistsException: MXBean already registered
with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
at
com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:120)
at
com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:143)
at
com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:183)
at
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:941)
at
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:917)
at
com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:312)
at
com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:482)
at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
at
org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
at
org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1491)
at
org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1467)
at
org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:417)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280)
at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
at
org.apache.pig.test.MiniCluster.setupMiniDfsAndMrClusters(MiniCluster.java:50)
at
org.apache.pig.test.MiniGenericCluster.<init>(MiniGenericCluster.java:49)
at org.apache.pig.test.MiniCluster.<init>(MiniCluster.java:31)
at
org.apache.pig.test.MiniGenericCluster.<clinit>(MiniGenericCluster.java:45)
at org.apache.pig.test.TestGrunt.<clinit>(TestGrunt.java:64)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:169)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:373)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
at
org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
12/08/20 11:00:50 WARN datanode.DataNode: Invalid directory in
dfs.data.dir: Incorrect permission for build/test/data/dfs/data/data1,
expected: rwxr-xr-x, while actual: rwxrwxr-x
12/08/20 11:00:50 WARN datanode.DataNode: Invalid directory in
dfs.data.dir: Incorrect permission for build/test/data/dfs/data/data2,
expected: rwxr-xr-x, while actual: rwxrwxr-x
12/08/20 11:00:50 ERROR datanode.DataNode: All directories in dfs.data.dir
are invalid.
------------- ---------------- ---------------
The umask is already set to 0022. I also tried to set permission to
rwxr-xr-x, but it is being reset to rwxrwxr-x every time I run the test.
Could you please suggest me what could be the solution here?
--
Thanks,
Boski Shah
Re: Error while running the unit test
Posted by Boski Shah <bo...@gmail.com>.
Thanks for your reply.
I set umask but I did not know that it was limited to that particular
terminal only. I was running test in another terminal so it was giving an
error.
Thanks,
Boski
On Mon, Aug 20, 2012 at 3:03 PM, Cheolsoo Park <ch...@cloudera.com>wrote:
> That's strange because "umask 0022" should take care of it. I don't see any
> other reason.
>
> On Mon, Aug 20, 2012 at 2:49 PM, Boski Shah <bo...@gmail.com>
> wrote:
>
> > Hello,
> >
> > I am a masters student and working on a PIG-2597 Move grunt from JAVACC
> to
> > ANTLR.
> > I am facing an issue while testing org.apache.pig.test.TestGrunt.java
> > I am trying to run TestGrunt.java individually using the following
> command
> > $ ant -Dtestcase=Testgrunt.java clean test
> >
> > While running this unit test I am getting an error:
> >
> > 12/08/20 11:00:50 WARN util.MBeans:
> > Hadoop:service=DataNode,name=MetricsSystem,sub=Control
> > javax.management.InstanceAlreadyExistsException: MXBean already
> registered
> > with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
> > at
> > com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:120)
> > at
> > com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:143)
> > at
> > com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:183)
> > at
> >
> >
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:941)
> > at
> >
> >
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:917)
> > at
> >
> >
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:312)
> > at
> >
> >
> com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:482)
> > at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
> > at
> >
> >
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
> > at
> >
> >
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
> > at
> >
> >
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
> > at
> >
> >
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
> > at
> >
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1491)
> > at
> >
> >
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1467)
> > at
> >
> >
> org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:417)
> > at
> > org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280)
> > at
> > org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
> > at
> >
> >
> org.apache.pig.test.MiniCluster.setupMiniDfsAndMrClusters(MiniCluster.java:50)
> > at
> > org.apache.pig.test.MiniGenericCluster.<init>(MiniGenericCluster.java:49)
> > at org.apache.pig.test.MiniCluster.<init>(MiniCluster.java:31)
> > at
> >
> org.apache.pig.test.MiniGenericCluster.<clinit>(MiniGenericCluster.java:45)
> > at org.apache.pig.test.TestGrunt.<clinit>(TestGrunt.java:64)
> > at java.lang.Class.forName0(Native Method)
> > at java.lang.Class.forName(Class.java:169)
> > at
> >
> >
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:373)
> > at
> >
> >
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> > at
> >
> >
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> > 12/08/20 11:00:50 WARN datanode.DataNode: Invalid directory in
> > dfs.data.dir: Incorrect permission for build/test/data/dfs/data/data1,
> > expected: rwxr-xr-x, while actual: rwxrwxr-x
> > 12/08/20 11:00:50 WARN datanode.DataNode: Invalid directory in
> > dfs.data.dir: Incorrect permission for build/test/data/dfs/data/data2,
> > expected: rwxr-xr-x, while actual: rwxrwxr-x
> > 12/08/20 11:00:50 ERROR datanode.DataNode: All directories in
> dfs.data.dir
> > are invalid.
> > ------------- ---------------- ---------------
> >
> > The umask is already set to 0022. I also tried to set permission to
> > rwxr-xr-x, but it is being reset to rwxrwxr-x every time I run the test.
> > Could you please suggest me what could be the solution here?
> >
> >
> > --
> > Thanks,
> > Boski Shah
> >
>
Re: Error while running the unit test
Posted by Cheolsoo Park <ch...@cloudera.com>.
That's strange because "umask 0022" should take care of it. I don't see any
other reason.
On Mon, Aug 20, 2012 at 2:49 PM, Boski Shah <bo...@gmail.com> wrote:
> Hello,
>
> I am a masters student and working on a PIG-2597 Move grunt from JAVACC to
> ANTLR.
> I am facing an issue while testing org.apache.pig.test.TestGrunt.java
> I am trying to run TestGrunt.java individually using the following command
> $ ant -Dtestcase=Testgrunt.java clean test
>
> While running this unit test I am getting an error:
>
> 12/08/20 11:00:50 WARN util.MBeans:
> Hadoop:service=DataNode,name=MetricsSystem,sub=Control
> javax.management.InstanceAlreadyExistsException: MXBean already registered
> with name Hadoop:service=NameNode,name=MetricsSystem,sub=Control
> at
> com.sun.jmx.mbeanserver.MXBeanLookup.addReference(MXBeanLookup.java:120)
> at
> com.sun.jmx.mbeanserver.MXBeanSupport.register(MXBeanSupport.java:143)
> at
> com.sun.jmx.mbeanserver.MBeanSupport.preRegister2(MBeanSupport.java:183)
> at
>
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerDynamicMBean(DefaultMBeanServerInterceptor.java:941)
> at
>
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerObject(DefaultMBeanServerInterceptor.java:917)
> at
>
> com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.registerMBean(DefaultMBeanServerInterceptor.java:312)
> at
>
> com.sun.jmx.mbeanserver.JmxMBeanServer.registerMBean(JmxMBeanServer.java:482)
> at org.apache.hadoop.metrics2.util.MBeans.register(MBeans.java:56)
> at
>
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl.initSystemMBean(MetricsSystemImpl.java:500)
> at
>
> org.apache.hadoop.metrics2.impl.MetricsSystemImpl.init(MetricsSystemImpl.java:140)
> at
>
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.init(DefaultMetricsSystem.java:40)
> at
>
> org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.initialize(DefaultMetricsSystem.java:50)
> at
>
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1491)
> at
>
> org.apache.hadoop.hdfs.server.datanode.DataNode.instantiateDataNode(DataNode.java:1467)
> at
>
> org.apache.hadoop.hdfs.MiniDFSCluster.startDataNodes(MiniDFSCluster.java:417)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:280)
> at
> org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:124)
> at
>
> org.apache.pig.test.MiniCluster.setupMiniDfsAndMrClusters(MiniCluster.java:50)
> at
> org.apache.pig.test.MiniGenericCluster.<init>(MiniGenericCluster.java:49)
> at org.apache.pig.test.MiniCluster.<init>(MiniCluster.java:31)
> at
> org.apache.pig.test.MiniGenericCluster.<clinit>(MiniGenericCluster.java:45)
> at org.apache.pig.test.TestGrunt.<clinit>(TestGrunt.java:64)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:169)
> at
>
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:373)
> at
>
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:1052)
> at
>
> org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:906)
> 12/08/20 11:00:50 WARN datanode.DataNode: Invalid directory in
> dfs.data.dir: Incorrect permission for build/test/data/dfs/data/data1,
> expected: rwxr-xr-x, while actual: rwxrwxr-x
> 12/08/20 11:00:50 WARN datanode.DataNode: Invalid directory in
> dfs.data.dir: Incorrect permission for build/test/data/dfs/data/data2,
> expected: rwxr-xr-x, while actual: rwxrwxr-x
> 12/08/20 11:00:50 ERROR datanode.DataNode: All directories in dfs.data.dir
> are invalid.
> ------------- ---------------- ---------------
>
> The umask is already set to 0022. I also tried to set permission to
> rwxr-xr-x, but it is being reset to rwxrwxr-x every time I run the test.
> Could you please suggest me what could be the solution here?
>
>
> --
> Thanks,
> Boski Shah
>