You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by lei liu <li...@gmail.com> on 2013/12/31 10:25:30 UTC
deadNodes in DFSInputStream
I use Hbase-0.94 and CDH-4.3.1
When RegionServer read data from loca datanode, if local datanode is dead,
the local datanode is add to deadNodes, and RegionServer read data from
remote datanode. But when local datanode is become live, RegionServer still
read data from remote datanode, that reduces the performance of RegionServer.
We need to on way that remove local datanode from deadNodes when the local
datanode is become live.
I can do it, please everybody give some advises.
Thanks,
LiuLei
Re: deadNodes in DFSInputStream
Posted by Haosong Huang <ha...@gmail.com>.
Why the status of HDFS-4273 is still "Unresolved"?
HDFS-5540<https://issues.apache.org/jira/browse/HDFS-5540> is
fixed now.
On Wed, Jan 1, 2014 at 6:12 AM, Colin McCabe <cm...@alumni.cmu.edu> wrote:
> Take a look at HDFS-4273, which fixes some issues with the read retry
> logic.
>
> cheers,
> Colin
>
> On Tue, Dec 31, 2013 at 1:25 AM, lei liu <li...@gmail.com> wrote:
> > I use Hbase-0.94 and CDH-4.3.1
> > When RegionServer read data from loca datanode, if local datanode is
> dead,
> > the local datanode is add to deadNodes, and RegionServer read data from
> > remote datanode. But when local datanode is become live, RegionServer
> still
> > read data from remote datanode, that reduces the performance of
> RegionServer.
> > We need to on way that remove local datanode from deadNodes when the
> local
> > datanode is become live.
> >
> > I can do it, please everybody give some advises.
> >
> >
> > Thanks,
> >
> > LiuLei
>
--
Best Regards,
Haosdent Huang
Re: deadNodes in DFSInputStream
Posted by Colin McCabe <cm...@alumni.cmu.edu>.
Take a look at HDFS-4273, which fixes some issues with the read retry logic.
cheers,
Colin
On Tue, Dec 31, 2013 at 1:25 AM, lei liu <li...@gmail.com> wrote:
> I use Hbase-0.94 and CDH-4.3.1
> When RegionServer read data from loca datanode, if local datanode is dead,
> the local datanode is add to deadNodes, and RegionServer read data from
> remote datanode. But when local datanode is become live, RegionServer still
> read data from remote datanode, that reduces the performance of RegionServer.
> We need to on way that remove local datanode from deadNodes when the local
> datanode is become live.
>
> I can do it, please everybody give some advises.
>
>
> Thanks,
>
> LiuLei