You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amar Kamat (Created) (JIRA)" <ji...@apache.org> on 2011/11/23 10:07:40 UTC
[jira] [Created] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Job submission failing in JUnit tests
-------------------------------------
Key: MAPREDUCE-3462
URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: test
Affects Versions: 0.24.0
Reporter: Amar Kamat
Fix For: 0.24.0
When I run JUnit tests (e.g. TestGridmixSubmission), I see job submission failing with the following error:
{noformat}
java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
{noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Ravi Gummadi (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-3462:
------------------------------------
Attachment: 3462.trunk.patch
Patch for trunk with all gridmix testcases updated with this config setting.
I guess it would be better to set it somewhere in tests-config.
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179305#comment-13179305 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Commit #322 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Commit/322/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227052
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3462:
------------------------------------
Status: Patch Available (was: Open)
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175259#comment-13175259 ]
Amar Kamat commented on MAPREDUCE-3462:
---------------------------------------
I think setting {{mapreduce.job.hdfs-servers}} to an empty string in {{src/java/mapred-default.xml}} should take care of the failures. Thoughts?
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179306#comment-13179306 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk-Commit #1560 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1560/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175250#comment-13175250 ]
Amar Kamat commented on MAPREDUCE-3462:
---------------------------------------
Tested the fix on {{TestCompressionEmulationUtils}} and the test passed. I was wondering if it makes sense to add this to mapred-site.xml either at the top level (i.e {{conf/mapred-site.xml}}) or just for tests (i.e {{src/test/mapred-site.xml}}). I tired setting this property in {{src/test/mapred-site.xml}} but the test still failed. Somehow, we should make sure that the contrib tests load the {{src/test/mapred-site.xml}}.
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179301#comment-13179301 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Common-0.23-Commit #333 (See [https://builds.apache.org/job/Hadoop-Common-0.23-Commit/333/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227052
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179310#comment-13179310 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #1509 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Commit/1509/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3462:
------------------------------------
Attachment: MAPREDUCE-3462.branch-0.23.patch
Inside of Configuration.getStrings(), getProps().getProperty("mapreduce.job.hdfs-servers") returns "$fs.default.name".
System.getProperty(fs.default.name) is returning the string "${fs.default.name}" which continually is tried to be expanded causing the maximum depth exception.
This patch simply sets mapreduce.job.hdfs-servers to an empty string so that it doesn't return $fs.default.name (as defined in yarn-default.xml)
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.24.0
>
> Attachments: MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestGridmixSubmission), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Amar Kamat (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated MAPREDUCE-3462:
----------------------------------
Priority: Blocker (was: Major)
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.24.0
>
>
> When I run JUnit tests (e.g. TestGridmixSubmission), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Eli Collins (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13194065#comment-13194065 ]
Eli Collins commented on MAPREDUCE-3462:
----------------------------------------
bq. Also, I'm still ignorant of the change which made the tests start to fail. I should probably understand better the reasons for that change before proposing a more generalized fix.
I filed MAPREDUCE-3736 for the general fix. Ravi, if you figured anything out please chime in there.
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3462:
------------------------------------
Component/s: mrv2
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Ravi Prakash (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175915#comment-13175915 ]
Ravi Prakash commented on MAPREDUCE-3462:
-----------------------------------------
I'd be wary of adding it in src/main/..mapred-default.xml . I'd think src/test/../mapred-test.xml is where it should be added if at all. If that doesn't work currently, we should make it work. Just out of curiosity, do you know of any other tests which are failing due to this exception?
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179445#comment-13179445 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Hdfs-trunk #915 (See [https://builds.apache.org/job/Hadoop-Hdfs-trunk/915/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179452#comment-13179452 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Hdfs-0.23-Build #128 (See [https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/128/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227052
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179257#comment-13179257 ]
Amar Kamat commented on MAPREDUCE-3462:
---------------------------------------
Fixing contrib tests to respect {{src/test/mapred-site.xml}} can be addressed later. I will commit this patch for now.
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179293#comment-13179293 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Common-trunk-Commit #1488 (See [https://builds.apache.org/job/Hadoop-Common-trunk-Commit/1488/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179317#comment-13179317 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Commit #344 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Commit/344/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227052
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175391#comment-13175391 ]
Hadoop QA commented on MAPREDUCE-3462:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508507/3462.trunk.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 12 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1503//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1503//console
This message is automatically generated.
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hadoop QA (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175056#comment-13175056 ]
Hadoop QA commented on MAPREDUCE-3462:
--------------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12508428/MAPREDUCE-3462.branch-0.23.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 9 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 eclipse:eclipse. The patch built with eclipse:eclipse.
+1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
+1 contrib tests. The patch passed contrib unit tests.
Test results: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1498//testReport/
Console output: https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/1498//console
This message is automatically generated.
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Ravi Prakash (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash updated MAPREDUCE-3462:
------------------------------------
Description:
When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
{noformat}
java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
{noformat}
was:
When I run JUnit tests (e.g. TestGridmixSubmission), I see job submission failing with the following error:
{noformat}
java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
{noformat}
Target Version/s: 0.23.1 (was: 0.24.0)
Affects Version/s: (was: 0.24.0)
0.23.0
Fix Version/s: (was: 0.24.0)
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179465#comment-13179465 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Mapreduce-0.23-Build #150 (See [https://builds.apache.org/job/Hadoop-Mapreduce-0.23-Build/150/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227052
Files :
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/branches/branch-0.23/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Ravi Prakash (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Prakash reassigned MAPREDUCE-3462:
---------------------------------------
Assignee: Ravi Prakash
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: test
> Affects Versions: 0.24.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.24.0
>
>
> When I run JUnit tests (e.g. TestGridmixSubmission), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Amar Kamat (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated MAPREDUCE-3462:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.24.0
0.23.1
Release Note: Fixed failing JUnit tests in Gridmix.
Hadoop Flags: Reviewed
Status: Resolved (was: Patch Available)
I just committed this to trunk and branch-0.23. Thanks Ravi Prakash and Ravi Gummadi!
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13179487#comment-13179487 ]
Hudson commented on MAPREDUCE-3462:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #948 (See [https://builds.apache.org/job/Hadoop-Mapreduce-trunk/948/])
MAPREDUCE-3462. Fix Gridmix JUnit testcase failures. (Ravi Prakash and Ravi Gummadi via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1227051
Files :
* /hadoop/common/trunk/hadoop-mapreduce-project/CHANGES.txt
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestCompressionEmulationUtils.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestDistCacheEmulation.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestGridmixSubmission.java
* /hadoop/common/trunk/hadoop-mapreduce-project/src/contrib/gridmix/src/test/org/apache/hadoop/mapred/gridmix/TestSleepJob.java
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Fix For: 0.23.1, 0.24.0
>
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-3462) Job submission failing in JUnit
tests
Posted by "Ravi Prakash (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-3462?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175916#comment-13175916 ]
Ravi Prakash commented on MAPREDUCE-3462:
-----------------------------------------
Also, I'm still ignorant of the change which made the tests start to fail. I should probably understand better the reasons for that change before proposing a more generalized fix. For now, couldn't these tests passing unblock you?
> Job submission failing in JUnit tests
> -------------------------------------
>
> Key: MAPREDUCE-3462
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-3462
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2, test
> Affects Versions: 0.23.0
> Reporter: Amar Kamat
> Assignee: Ravi Prakash
> Priority: Blocker
> Labels: junit, test
> Attachments: 3462.trunk.patch, MAPREDUCE-3462.branch-0.23.patch
>
>
> When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
> {noformat}
> java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
> at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
> at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
> at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
> at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
> at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
> at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
> at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
> at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
> at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
> at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
> at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira