You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Radim Kolar <hs...@filez.com> on 2012/10/15 11:44:57 UTC
possible resource leak in capacity scheduler
i have simple 2 node cluster. one node with 2 GB and second with 1 GB RAM
on node with 1 GB is running application master - no memory left,
nothing runs on node with 2 GB RAM
current application do not runs, it has only AM started and no resources
for running mapper. If you take a look at screenshot from scheduler,
interesting is that memory total is cluster metrics is just 1 GB.
http://postimage.org/image/t3pqmz6af/
its leak in cluster accounting?
Re: possible resource leak in capacity scheduler
Posted by Radim Kolar <hs...@filez.com>.
Dne 16.10.2012 1:13, Vinod Kumar Vavilapalli napsal(a):
>
> Which version are you running?
it was branch-0.23 but after i updated to trunk or latest branch-0.23 it
seems to work fine now.
Re: possible resource leak in capacity scheduler
Posted by Radim Kolar <hs...@filez.com>.
Dne 16.10.2012 1:13, Vinod Kumar Vavilapalli napsal(a):
>
> Which version are you running?
it was branch-0.23 but after i updated to trunk or latest branch-0.23 it
seems to work fine now.
Re: possible resource leak in capacity scheduler
Posted by Radim Kolar <hs...@filez.com>.
Dne 16.10.2012 1:13, Vinod Kumar Vavilapalli napsal(a):
>
> Which version are you running?
it was branch-0.23 but after i updated to trunk or latest branch-0.23 it
seems to work fine now.
Re: possible resource leak in capacity scheduler
Posted by Radim Kolar <hs...@filez.com>.
Dne 16.10.2012 1:13, Vinod Kumar Vavilapalli napsal(a):
>
> Which version are you running?
it was branch-0.23 but after i updated to trunk or latest branch-0.23 it
seems to work fine now.
Re: possible resource leak in capacity scheduler
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Which version are you running? Can you enabled debug logging for RM and see what's happening?
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Oct 15, 2012, at 2:44 AM, Radim Kolar wrote:
> i have simple 2 node cluster. one node with 2 GB and second with 1 GB RAM
>
> on node with 1 GB is running application master - no memory left, nothing runs on node with 2 GB RAM
>
> current application do not runs, it has only AM started and no resources for running mapper. If you take a look at screenshot from scheduler, interesting is that memory total is cluster metrics is just 1 GB.
>
> http://postimage.org/image/t3pqmz6af/
>
> its leak in cluster accounting?
Re: possible resource leak in capacity scheduler
Posted by Radim Kolar <hs...@filez.com>.
updating to trunk fixed this, or at least i can not reproduce it anymore.
Re: possible resource leak in capacity scheduler
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Which version are you running? Can you enabled debug logging for RM and see what's happening?
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Oct 15, 2012, at 2:44 AM, Radim Kolar wrote:
> i have simple 2 node cluster. one node with 2 GB and second with 1 GB RAM
>
> on node with 1 GB is running application master - no memory left, nothing runs on node with 2 GB RAM
>
> current application do not runs, it has only AM started and no resources for running mapper. If you take a look at screenshot from scheduler, interesting is that memory total is cluster metrics is just 1 GB.
>
> http://postimage.org/image/t3pqmz6af/
>
> its leak in cluster accounting?
Re: possible resource leak in capacity scheduler
Posted by Radim Kolar <hs...@filez.com>.
updating to trunk fixed this, or at least i can not reproduce it anymore.
Re: possible resource leak in capacity scheduler
Posted by Radim Kolar <hs...@filez.com>.
updating to trunk fixed this, or at least i can not reproduce it anymore.
Re: possible resource leak in capacity scheduler
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Which version are you running? Can you enabled debug logging for RM and see what's happening?
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Oct 15, 2012, at 2:44 AM, Radim Kolar wrote:
> i have simple 2 node cluster. one node with 2 GB and second with 1 GB RAM
>
> on node with 1 GB is running application master - no memory left, nothing runs on node with 2 GB RAM
>
> current application do not runs, it has only AM started and no resources for running mapper. If you take a look at screenshot from scheduler, interesting is that memory total is cluster metrics is just 1 GB.
>
> http://postimage.org/image/t3pqmz6af/
>
> its leak in cluster accounting?
Re: possible resource leak in capacity scheduler
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
Which version are you running? Can you enabled debug logging for RM and see what's happening?
Thanks,
+Vinod Kumar Vavilapalli
Hortonworks Inc.
http://hortonworks.com/
On Oct 15, 2012, at 2:44 AM, Radim Kolar wrote:
> i have simple 2 node cluster. one node with 2 GB and second with 1 GB RAM
>
> on node with 1 GB is running application master - no memory left, nothing runs on node with 2 GB RAM
>
> current application do not runs, it has only AM started and no resources for running mapper. If you take a look at screenshot from scheduler, interesting is that memory total is cluster metrics is just 1 GB.
>
> http://postimage.org/image/t3pqmz6af/
>
> its leak in cluster accounting?
Re: possible resource leak in capacity scheduler
Posted by Radim Kolar <hs...@filez.com>.
updating to trunk fixed this, or at least i can not reproduce it anymore.