You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@ambari.apache.org by Dmytro Sen <ds...@hortonworks.com> on 2015/04/23 15:26:38 UTC

Review Request 33481: Exception while initialization of collectors

-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33481/
-----------------------------------------------------------

Review request for Ambari, Myroslav Papirkovskyy and Srimanth Gunturi.


Bugs: AMBARI-10700
    https://issues.apache.org/jira/browse/AMBARI-10700


Repository: ambari


Description
-------

ST failing as Job fails due to the following reason
Error: java.io.IOException: Initialization of all the collectors failed. Error in last collector was :Invalid "mapreduce.task.io.sort.mb": 2150
2015-04-22 12:42:58,961|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:414)
2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81)
2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:698)
2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770)
2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at java.security.AccessController.doPrivileged(Native Method)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at javax.security.auth.Subject.doAs(Subject.java:422)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|Caused by: java.io.IOException: Invalid "mapreduce.task.io.sort.mb": 2150
2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:978)
2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:402)
2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|... 9 more
2015-04-22 12:42:58,965|beaver.machine|INFO|17003|140043958609664|MainThread|


Diffs
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 0b54b38 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py 1a8034d 
  ambari-server/src/main/resources/stacks/stack_advisor.py cfb2485 
  ambari-server/src/test/python/TestStackAdvisor.py ab0a191 
  ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 4c79512 

Diff: https://reviews.apache.org/r/33481/diff/


Testing
-------

----------------------------------------------------------------------
Ran 263 tests in 10.057s

OK
----------------------------------------------------------------------
Total run:706
Total errors:0
Total failures:0
OK


Thanks,

Dmytro Sen

Re: Review Request 33481: Exception while initialization of collectors

Posted by Srimanth Gunturi <sr...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33481/#review81353
-----------------------------------------------------------

Ship it!


Ship It!

- Srimanth Gunturi


On April 23, 2015, 6:10 p.m., Dmytro Sen wrote:
> 
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://reviews.apache.org/r/33481/
> -----------------------------------------------------------
> 
> (Updated April 23, 2015, 6:10 p.m.)
> 
> 
> Review request for Ambari, Myroslav Papirkovskyy and Srimanth Gunturi.
> 
> 
> Bugs: AMBARI-10700
>     https://issues.apache.org/jira/browse/AMBARI-10700
> 
> 
> Repository: ambari
> 
> 
> Description
> -------
> 
> ST failing as Job fails due to the following reason
> Error: java.io.IOException: Initialization of all the collectors failed. Error in last collector was :Invalid "mapreduce.task.io.sort.mb": 2150
> 2015-04-22 12:42:58,961|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:414)
> 2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81)
> 2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:698)
> 2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770)
> 2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> 2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
> 2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at java.security.AccessController.doPrivileged(Native Method)
> 2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at javax.security.auth.Subject.doAs(Subject.java:422)
> 2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> 2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> 2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|Caused by: java.io.IOException: Invalid "mapreduce.task.io.sort.mb": 2150
> 2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:978)
> 2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:402)
> 2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|... 9 more
> 2015-04-22 12:42:58,965|beaver.machine|INFO|17003|140043958609664|MainThread|
> 
> 
> Diffs
> -----
> 
>   ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 0b54b38 
>   ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py 1a8034d 
>   ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py ef6def1 
>   ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 4c79512 
> 
> Diff: https://reviews.apache.org/r/33481/diff/
> 
> 
> Testing
> -------
> 
> ----------------------------------------------------------------------
> Ran 263 tests in 10.057s
> 
> OK
> ----------------------------------------------------------------------
> Total run:706
> Total errors:0
> Total failures:0
> OK
> 
> 
> Thanks,
> 
> Dmytro Sen
> 
>

Re: Review Request 33481: Exception while initialization of collectors

Posted by Dmytro Sen <ds...@hortonworks.com>.
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/33481/
-----------------------------------------------------------

(Updated Апрель 23, 2015, 6:10 п.п.)


Review request for Ambari, Myroslav Papirkovskyy and Srimanth Gunturi.


Bugs: AMBARI-10700
    https://issues.apache.org/jira/browse/AMBARI-10700


Repository: ambari


Description
-------

ST failing as Job fails due to the following reason
Error: java.io.IOException: Initialization of all the collectors failed. Error in last collector was :Invalid "mapreduce.task.io.sort.mb": 2150
2015-04-22 12:42:58,961|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:414)
2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81)
2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:698)
2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:770)
2015-04-22 12:42:58,962|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at java.security.AccessController.doPrivileged(Native Method)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at javax.security.auth.Subject.doAs(Subject.java:422)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
2015-04-22 12:42:58,963|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|Caused by: java.io.IOException: Invalid "mapreduce.task.io.sort.mb": 2150
2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:978)
2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:402)
2015-04-22 12:42:58,964|beaver.machine|INFO|17003|140043958609664|MainThread|... 9 more
2015-04-22 12:42:58,965|beaver.machine|INFO|17003|140043958609664|MainThread|


Diffs (updated)
-----

  ambari-server/src/main/resources/stacks/HDP/2.0.6/services/stack_advisor.py 0b54b38 
  ambari-server/src/main/resources/stacks/HDP/2.2/services/stack_advisor.py 1a8034d 
  ambari-server/src/test/python/stacks/2.0.6/common/test_stack_advisor.py ef6def1 
  ambari-server/src/test/python/stacks/2.2/common/test_stack_advisor.py 4c79512 

Diff: https://reviews.apache.org/r/33481/diff/


Testing
-------

----------------------------------------------------------------------
Ran 263 tests in 10.057s

OK
----------------------------------------------------------------------
Total run:706
Total errors:0
Total failures:0
OK


Thanks,

Dmytro Sen