You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Juraj jiv <fa...@gmail.com> on 2015/01/29 15:33:47 UTC
HDFS balancer ending with error
Hello,
I noticed our CDH5 cluster is not balanced and balancer role is missing. So
i added via cloudera manager new balancer role and clicked on rebalance in
hdfs menu. After some time task ended as failed.
In logs i can balancer started but when it want to start moving blocks all
failed with message like:
2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer
(Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284
with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through
10.xx.xx.14:50010: Premature EOF: no length prefix available
Any idea what is the problem about? Cluster is working fine so i have no
clue. Maybe i need restart HDFS service first?
Thanks,
JV
Re: HDFS balancer ending with error
Posted by Ravi Prakash <ra...@ymail.com>.
You can try running fsck.
On Thursday, January 29, 2015 6:34 AM, Juraj jiv <fa...@gmail.com> wrote:
Hello,
I noticed our CDH5 cluster is not balanced and balancer role is missing. So i added via cloudera manager new balancer role and clicked on rebalance in hdfs menu. After some time task ended as failed.
In logs i can balancer started but when it want to start moving blocks all failed with message like:
2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through 10.xx.xx.14:50010: Premature EOF: no length prefix availableAny idea what is the problem about? Cluster is working fine so i have no clue. Maybe i need restart HDFS service first?
Thanks,
JV
Re: HDFS balancer ending with error
Posted by Ravi Prakash <ra...@ymail.com>.
You can try running fsck.
On Thursday, January 29, 2015 6:34 AM, Juraj jiv <fa...@gmail.com> wrote:
Hello,
I noticed our CDH5 cluster is not balanced and balancer role is missing. So i added via cloudera manager new balancer role and clicked on rebalance in hdfs menu. After some time task ended as failed.
In logs i can balancer started but when it want to start moving blocks all failed with message like:
2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through 10.xx.xx.14:50010: Premature EOF: no length prefix availableAny idea what is the problem about? Cluster is working fine so i have no clue. Maybe i need restart HDFS service first?
Thanks,
JV
Re: HDFS balancer ending with error
Posted by Juraj jiv <fa...@gmail.com>.
Hello, restart cloudera cluster helped. After that balancer started
working. Dunno why, all fine now.
JV
On Fri, Jan 30, 2015 at 2:41 AM, Anurag Tangri <an...@yahoo.com>
wrote:
> Is your cluster fully upgraded to CDH5 ?
>
>
> Thanks,
> Anurag Tangri
>
> > On Jan 29, 2015, at 6:33 AM, Juraj jiv <fa...@gmail.com> wrote:
> >
> > Hello,
> > I noticed our CDH5 cluster is not balanced and balancer role is missing.
> So i added via cloudera manager new balancer role and clicked on rebalance
> in hdfs menu. After some time task ended as failed.
> >
> > In logs i can balancer started but when it want to start moving blocks
> all failed with message like:
> > 2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer
> (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with
> size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through
> 10.xx.xx.14:50010: Premature EOF: no length prefix available
> > Any idea what is the problem about? Cluster is working fine so i have no
> clue. Maybe i need restart HDFS service first?
> >
> > Thanks,
> > JV
>
Re: HDFS balancer ending with error
Posted by Juraj jiv <fa...@gmail.com>.
Hello, restart cloudera cluster helped. After that balancer started
working. Dunno why, all fine now.
JV
On Fri, Jan 30, 2015 at 2:41 AM, Anurag Tangri <an...@yahoo.com>
wrote:
> Is your cluster fully upgraded to CDH5 ?
>
>
> Thanks,
> Anurag Tangri
>
> > On Jan 29, 2015, at 6:33 AM, Juraj jiv <fa...@gmail.com> wrote:
> >
> > Hello,
> > I noticed our CDH5 cluster is not balanced and balancer role is missing.
> So i added via cloudera manager new balancer role and clicked on rebalance
> in hdfs menu. After some time task ended as failed.
> >
> > In logs i can balancer started but when it want to start moving blocks
> all failed with message like:
> > 2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer
> (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with
> size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through
> 10.xx.xx.14:50010: Premature EOF: no length prefix available
> > Any idea what is the problem about? Cluster is working fine so i have no
> clue. Maybe i need restart HDFS service first?
> >
> > Thanks,
> > JV
>
Re: HDFS balancer ending with error
Posted by Juraj jiv <fa...@gmail.com>.
Hello, restart cloudera cluster helped. After that balancer started
working. Dunno why, all fine now.
JV
On Fri, Jan 30, 2015 at 2:41 AM, Anurag Tangri <an...@yahoo.com>
wrote:
> Is your cluster fully upgraded to CDH5 ?
>
>
> Thanks,
> Anurag Tangri
>
> > On Jan 29, 2015, at 6:33 AM, Juraj jiv <fa...@gmail.com> wrote:
> >
> > Hello,
> > I noticed our CDH5 cluster is not balanced and balancer role is missing.
> So i added via cloudera manager new balancer role and clicked on rebalance
> in hdfs menu. After some time task ended as failed.
> >
> > In logs i can balancer started but when it want to start moving blocks
> all failed with message like:
> > 2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer
> (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with
> size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through
> 10.xx.xx.14:50010: Premature EOF: no length prefix available
> > Any idea what is the problem about? Cluster is working fine so i have no
> clue. Maybe i need restart HDFS service first?
> >
> > Thanks,
> > JV
>
Re: HDFS balancer ending with error
Posted by Juraj jiv <fa...@gmail.com>.
Hello, restart cloudera cluster helped. After that balancer started
working. Dunno why, all fine now.
JV
On Fri, Jan 30, 2015 at 2:41 AM, Anurag Tangri <an...@yahoo.com>
wrote:
> Is your cluster fully upgraded to CDH5 ?
>
>
> Thanks,
> Anurag Tangri
>
> > On Jan 29, 2015, at 6:33 AM, Juraj jiv <fa...@gmail.com> wrote:
> >
> > Hello,
> > I noticed our CDH5 cluster is not balanced and balancer role is missing.
> So i added via cloudera manager new balancer role and clicked on rebalance
> in hdfs menu. After some time task ended as failed.
> >
> > In logs i can balancer started but when it want to start moving blocks
> all failed with message like:
> > 2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer
> (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with
> size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through
> 10.xx.xx.14:50010: Premature EOF: no length prefix available
> > Any idea what is the problem about? Cluster is working fine so i have no
> clue. Maybe i need restart HDFS service first?
> >
> > Thanks,
> > JV
>
Re: HDFS balancer ending with error
Posted by Anurag Tangri <an...@yahoo.com>.
Is your cluster fully upgraded to CDH5 ?
Thanks,
Anurag Tangri
> On Jan 29, 2015, at 6:33 AM, Juraj jiv <fa...@gmail.com> wrote:
>
> Hello,
> I noticed our CDH5 cluster is not balanced and balancer role is missing. So i added via cloudera manager new balancer role and clicked on rebalance in hdfs menu. After some time task ended as failed.
>
> In logs i can balancer started but when it want to start moving blocks all failed with message like:
> 2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through 10.xx.xx.14:50010: Premature EOF: no length prefix available
> Any idea what is the problem about? Cluster is working fine so i have no clue. Maybe i need restart HDFS service first?
>
> Thanks,
> JV
Re: HDFS balancer ending with error
Posted by Anurag Tangri <an...@yahoo.com>.
Is your cluster fully upgraded to CDH5 ?
Thanks,
Anurag Tangri
> On Jan 29, 2015, at 6:33 AM, Juraj jiv <fa...@gmail.com> wrote:
>
> Hello,
> I noticed our CDH5 cluster is not balanced and balancer role is missing. So i added via cloudera manager new balancer role and clicked on rebalance in hdfs menu. After some time task ended as failed.
>
> In logs i can balancer started but when it want to start moving blocks all failed with message like:
> 2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through 10.xx.xx.14:50010: Premature EOF: no length prefix available
> Any idea what is the problem about? Cluster is working fine so i have no clue. Maybe i need restart HDFS service first?
>
> Thanks,
> JV
Re: HDFS balancer ending with error
Posted by Anurag Tangri <an...@yahoo.com>.
Is your cluster fully upgraded to CDH5 ?
Thanks,
Anurag Tangri
> On Jan 29, 2015, at 6:33 AM, Juraj jiv <fa...@gmail.com> wrote:
>
> Hello,
> I noticed our CDH5 cluster is not balanced and balancer role is missing. So i added via cloudera manager new balancer role and clicked on rebalance in hdfs menu. After some time task ended as failed.
>
> In logs i can balancer started but when it want to start moving blocks all failed with message like:
> 2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through 10.xx.xx.14:50010: Premature EOF: no length prefix available
> Any idea what is the problem about? Cluster is working fine so i have no clue. Maybe i need restart HDFS service first?
>
> Thanks,
> JV
Re: HDFS balancer ending with error
Posted by Ravi Prakash <ra...@ymail.com>.
You can try running fsck.
On Thursday, January 29, 2015 6:34 AM, Juraj jiv <fa...@gmail.com> wrote:
Hello,
I noticed our CDH5 cluster is not balanced and balancer role is missing. So i added via cloudera manager new balancer role and clicked on rebalance in hdfs menu. After some time task ended as failed.
In logs i can balancer started but when it want to start moving blocks all failed with message like:
2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through 10.xx.xx.14:50010: Premature EOF: no length prefix availableAny idea what is the problem about? Cluster is working fine so i have no clue. Maybe i need restart HDFS service first?
Thanks,
JV
Re: HDFS balancer ending with error
Posted by Ravi Prakash <ra...@ymail.com>.
You can try running fsck.
On Thursday, January 29, 2015 6:34 AM, Juraj jiv <fa...@gmail.com> wrote:
Hello,
I noticed our CDH5 cluster is not balanced and balancer role is missing. So i added via cloudera manager new balancer role and clicked on rebalance in hdfs menu. After some time task ended as failed.
In logs i can balancer started but when it want to start moving blocks all failed with message like:
2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through 10.xx.xx.14:50010: Premature EOF: no length prefix availableAny idea what is the problem about? Cluster is working fine so i have no clue. Maybe i need restart HDFS service first?
Thanks,
JV
Re: HDFS balancer ending with error
Posted by Anurag Tangri <an...@yahoo.com>.
Is your cluster fully upgraded to CDH5 ?
Thanks,
Anurag Tangri
> On Jan 29, 2015, at 6:33 AM, Juraj jiv <fa...@gmail.com> wrote:
>
> Hello,
> I noticed our CDH5 cluster is not balanced and balancer role is missing. So i added via cloudera manager new balancer role and clicked on rebalance in hdfs menu. After some time task ended as failed.
>
> In logs i can balancer started but when it want to start moving blocks all failed with message like:
> 2015-01-29 15:26:55,131 WARN [pool-4-thread-4] balancer.Balancer (Balancer.java:dispatch(362)) - Failed to move blk_1095182943_21451284 with size=43 from 10.xx.xx.14:50010 to 10.xx.xx.12:50010 through 10.xx.xx.14:50010: Premature EOF: no length prefix available
> Any idea what is the problem about? Cluster is working fine so i have no clue. Maybe i need restart HDFS service first?
>
> Thanks,
> JV