You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by norbi <no...@rocknob.de> on 2014/08/20 16:14:16 UTC
hdfs dfsclient, possible to force storage datanode ?
hi list,
we have 52 DNs and more hundred clients they are store and read data
from hdfs. one rack has 3 DNs and about 15 clients.
it is possible to force (if space is available) that these 15 clients
prefer the 3 DNs located in there own rack to store and read data?
racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is
allready in use, but this does not help in this case
thanks
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by norbi <no...@rocknob.de>.
can't find infos about that in 2.5 documentation and changelog?
Am 22.08.2014 um 09:27 schrieb Tirupati Reddy:
> Hadoop 2.5
>
> On Thursday, August 21, 2014, norbi <norbi@rocknob.de
> <ma...@rocknob.de>> wrote:
>
> hadoop 2.0 (cloudera cdh 4.7)
>
> Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
>
> Which version are you using?
>
> Regards,
> Yi Liu
>
>
> -----Original Message-----
> From: norbi [mailto:norbi@rocknob.de]
> Sent: Wednesday, August 20, 2014 10:14 PM
> To: user@hadoop.apache.org
> Subject: hdfs dfsclient, possible to force storage datanode ?
>
> hi list,
>
> we have 52 DNs and more hundred clients they are store and
> read data from hdfs. one rack has 3 DNs and about 15 clients.
>
> it is possible to force (if space is available) that these 15
> clients prefer the 3 DNs located in there own rack to store
> and read data?
>
> racklocation.conf with "org.apache.hadoop.net
> <http://org.apache.hadoop.net>.NetworkTopology" is allready in
> use, but this does not help in this case
>
> thanks
>
>
>
>
> --
> Tirru
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by norbi <no...@rocknob.de>.
can't find infos about that in 2.5 documentation and changelog?
Am 22.08.2014 um 09:27 schrieb Tirupati Reddy:
> Hadoop 2.5
>
> On Thursday, August 21, 2014, norbi <norbi@rocknob.de
> <ma...@rocknob.de>> wrote:
>
> hadoop 2.0 (cloudera cdh 4.7)
>
> Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
>
> Which version are you using?
>
> Regards,
> Yi Liu
>
>
> -----Original Message-----
> From: norbi [mailto:norbi@rocknob.de]
> Sent: Wednesday, August 20, 2014 10:14 PM
> To: user@hadoop.apache.org
> Subject: hdfs dfsclient, possible to force storage datanode ?
>
> hi list,
>
> we have 52 DNs and more hundred clients they are store and
> read data from hdfs. one rack has 3 DNs and about 15 clients.
>
> it is possible to force (if space is available) that these 15
> clients prefer the 3 DNs located in there own rack to store
> and read data?
>
> racklocation.conf with "org.apache.hadoop.net
> <http://org.apache.hadoop.net>.NetworkTopology" is allready in
> use, but this does not help in this case
>
> thanks
>
>
>
>
> --
> Tirru
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by norbi <no...@rocknob.de>.
can't find infos about that in 2.5 documentation and changelog?
Am 22.08.2014 um 09:27 schrieb Tirupati Reddy:
> Hadoop 2.5
>
> On Thursday, August 21, 2014, norbi <norbi@rocknob.de
> <ma...@rocknob.de>> wrote:
>
> hadoop 2.0 (cloudera cdh 4.7)
>
> Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
>
> Which version are you using?
>
> Regards,
> Yi Liu
>
>
> -----Original Message-----
> From: norbi [mailto:norbi@rocknob.de]
> Sent: Wednesday, August 20, 2014 10:14 PM
> To: user@hadoop.apache.org
> Subject: hdfs dfsclient, possible to force storage datanode ?
>
> hi list,
>
> we have 52 DNs and more hundred clients they are store and
> read data from hdfs. one rack has 3 DNs and about 15 clients.
>
> it is possible to force (if space is available) that these 15
> clients prefer the 3 DNs located in there own rack to store
> and read data?
>
> racklocation.conf with "org.apache.hadoop.net
> <http://org.apache.hadoop.net>.NetworkTopology" is allready in
> use, but this does not help in this case
>
> thanks
>
>
>
>
> --
> Tirru
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by norbi <no...@rocknob.de>.
can't find infos about that in 2.5 documentation and changelog?
Am 22.08.2014 um 09:27 schrieb Tirupati Reddy:
> Hadoop 2.5
>
> On Thursday, August 21, 2014, norbi <norbi@rocknob.de
> <ma...@rocknob.de>> wrote:
>
> hadoop 2.0 (cloudera cdh 4.7)
>
> Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
>
> Which version are you using?
>
> Regards,
> Yi Liu
>
>
> -----Original Message-----
> From: norbi [mailto:norbi@rocknob.de]
> Sent: Wednesday, August 20, 2014 10:14 PM
> To: user@hadoop.apache.org
> Subject: hdfs dfsclient, possible to force storage datanode ?
>
> hi list,
>
> we have 52 DNs and more hundred clients they are store and
> read data from hdfs. one rack has 3 DNs and about 15 clients.
>
> it is possible to force (if space is available) that these 15
> clients prefer the 3 DNs located in there own rack to store
> and read data?
>
> racklocation.conf with "org.apache.hadoop.net
> <http://org.apache.hadoop.net>.NetworkTopology" is allready in
> use, but this does not help in this case
>
> thanks
>
>
>
>
> --
> Tirru
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by Tirupati Reddy <re...@gmail.com>.
Hadoop 2.5
On Thursday, August 21, 2014, norbi <no...@rocknob.de> wrote:
> hadoop 2.0 (cloudera cdh 4.7)
>
> Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
>
>> Which version are you using?
>>
>> Regards,
>> Yi Liu
>>
>>
>> -----Original Message-----
>> From: norbi [mailto:norbi@rocknob.de]
>> Sent: Wednesday, August 20, 2014 10:14 PM
>> To: user@hadoop.apache.org
>> Subject: hdfs dfsclient, possible to force storage datanode ?
>>
>> hi list,
>>
>> we have 52 DNs and more hundred clients they are store and read data from
>> hdfs. one rack has 3 DNs and about 15 clients.
>>
>> it is possible to force (if space is available) that these 15 clients
>> prefer the 3 DNs located in there own rack to store and read data?
>>
>> racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is
>> allready in use, but this does not help in this case
>>
>> thanks
>>
>
>
--
Tirru
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by Tirupati Reddy <re...@gmail.com>.
Hadoop 2.5
On Thursday, August 21, 2014, norbi <no...@rocknob.de> wrote:
> hadoop 2.0 (cloudera cdh 4.7)
>
> Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
>
>> Which version are you using?
>>
>> Regards,
>> Yi Liu
>>
>>
>> -----Original Message-----
>> From: norbi [mailto:norbi@rocknob.de]
>> Sent: Wednesday, August 20, 2014 10:14 PM
>> To: user@hadoop.apache.org
>> Subject: hdfs dfsclient, possible to force storage datanode ?
>>
>> hi list,
>>
>> we have 52 DNs and more hundred clients they are store and read data from
>> hdfs. one rack has 3 DNs and about 15 clients.
>>
>> it is possible to force (if space is available) that these 15 clients
>> prefer the 3 DNs located in there own rack to store and read data?
>>
>> racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is
>> allready in use, but this does not help in this case
>>
>> thanks
>>
>
>
--
Tirru
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by Tirupati Reddy <re...@gmail.com>.
Hadoop 2.5
On Thursday, August 21, 2014, norbi <no...@rocknob.de> wrote:
> hadoop 2.0 (cloudera cdh 4.7)
>
> Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
>
>> Which version are you using?
>>
>> Regards,
>> Yi Liu
>>
>>
>> -----Original Message-----
>> From: norbi [mailto:norbi@rocknob.de]
>> Sent: Wednesday, August 20, 2014 10:14 PM
>> To: user@hadoop.apache.org
>> Subject: hdfs dfsclient, possible to force storage datanode ?
>>
>> hi list,
>>
>> we have 52 DNs and more hundred clients they are store and read data from
>> hdfs. one rack has 3 DNs and about 15 clients.
>>
>> it is possible to force (if space is available) that these 15 clients
>> prefer the 3 DNs located in there own rack to store and read data?
>>
>> racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is
>> allready in use, but this does not help in this case
>>
>> thanks
>>
>
>
--
Tirru
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by Tirupati Reddy <re...@gmail.com>.
Hadoop 2.5
On Thursday, August 21, 2014, norbi <no...@rocknob.de> wrote:
> hadoop 2.0 (cloudera cdh 4.7)
>
> Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
>
>> Which version are you using?
>>
>> Regards,
>> Yi Liu
>>
>>
>> -----Original Message-----
>> From: norbi [mailto:norbi@rocknob.de]
>> Sent: Wednesday, August 20, 2014 10:14 PM
>> To: user@hadoop.apache.org
>> Subject: hdfs dfsclient, possible to force storage datanode ?
>>
>> hi list,
>>
>> we have 52 DNs and more hundred clients they are store and read data from
>> hdfs. one rack has 3 DNs and about 15 clients.
>>
>> it is possible to force (if space is available) that these 15 clients
>> prefer the 3 DNs located in there own rack to store and read data?
>>
>> racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is
>> allready in use, but this does not help in this case
>>
>> thanks
>>
>
>
--
Tirru
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by norbi <no...@rocknob.de>.
hadoop 2.0 (cloudera cdh 4.7)
Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
> Which version are you using?
>
> Regards,
> Yi Liu
>
>
> -----Original Message-----
> From: norbi [mailto:norbi@rocknob.de]
> Sent: Wednesday, August 20, 2014 10:14 PM
> To: user@hadoop.apache.org
> Subject: hdfs dfsclient, possible to force storage datanode ?
>
> hi list,
>
> we have 52 DNs and more hundred clients they are store and read data from hdfs. one rack has 3 DNs and about 15 clients.
>
> it is possible to force (if space is available) that these 15 clients prefer the 3 DNs located in there own rack to store and read data?
>
> racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is allready in use, but this does not help in this case
>
> thanks
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by norbi <no...@rocknob.de>.
hadoop 2.0 (cloudera cdh 4.7)
Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
> Which version are you using?
>
> Regards,
> Yi Liu
>
>
> -----Original Message-----
> From: norbi [mailto:norbi@rocknob.de]
> Sent: Wednesday, August 20, 2014 10:14 PM
> To: user@hadoop.apache.org
> Subject: hdfs dfsclient, possible to force storage datanode ?
>
> hi list,
>
> we have 52 DNs and more hundred clients they are store and read data from hdfs. one rack has 3 DNs and about 15 clients.
>
> it is possible to force (if space is available) that these 15 clients prefer the 3 DNs located in there own rack to store and read data?
>
> racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is allready in use, but this does not help in this case
>
> thanks
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by norbi <no...@rocknob.de>.
hadoop 2.0 (cloudera cdh 4.7)
Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
> Which version are you using?
>
> Regards,
> Yi Liu
>
>
> -----Original Message-----
> From: norbi [mailto:norbi@rocknob.de]
> Sent: Wednesday, August 20, 2014 10:14 PM
> To: user@hadoop.apache.org
> Subject: hdfs dfsclient, possible to force storage datanode ?
>
> hi list,
>
> we have 52 DNs and more hundred clients they are store and read data from hdfs. one rack has 3 DNs and about 15 clients.
>
> it is possible to force (if space is available) that these 15 clients prefer the 3 DNs located in there own rack to store and read data?
>
> racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is allready in use, but this does not help in this case
>
> thanks
Re: hdfs dfsclient, possible to force storage datanode ?
Posted by norbi <no...@rocknob.de>.
hadoop 2.0 (cloudera cdh 4.7)
Am 21.08.2014 um 16:23 schrieb Liu, Yi A:
> Which version are you using?
>
> Regards,
> Yi Liu
>
>
> -----Original Message-----
> From: norbi [mailto:norbi@rocknob.de]
> Sent: Wednesday, August 20, 2014 10:14 PM
> To: user@hadoop.apache.org
> Subject: hdfs dfsclient, possible to force storage datanode ?
>
> hi list,
>
> we have 52 DNs and more hundred clients they are store and read data from hdfs. one rack has 3 DNs and about 15 clients.
>
> it is possible to force (if space is available) that these 15 clients prefer the 3 DNs located in there own rack to store and read data?
>
> racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is allready in use, but this does not help in this case
>
> thanks
RE: hdfs dfsclient, possible to force storage datanode ?
Posted by "Liu, Yi A" <yi...@intel.com>.
Which version are you using?
Regards,
Yi Liu
-----Original Message-----
From: norbi [mailto:norbi@rocknob.de]
Sent: Wednesday, August 20, 2014 10:14 PM
To: user@hadoop.apache.org
Subject: hdfs dfsclient, possible to force storage datanode ?
hi list,
we have 52 DNs and more hundred clients they are store and read data from hdfs. one rack has 3 DNs and about 15 clients.
it is possible to force (if space is available) that these 15 clients prefer the 3 DNs located in there own rack to store and read data?
racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is allready in use, but this does not help in this case
thanks
RE: hdfs dfsclient, possible to force storage datanode ?
Posted by "Liu, Yi A" <yi...@intel.com>.
Which version are you using?
Regards,
Yi Liu
-----Original Message-----
From: norbi [mailto:norbi@rocknob.de]
Sent: Wednesday, August 20, 2014 10:14 PM
To: user@hadoop.apache.org
Subject: hdfs dfsclient, possible to force storage datanode ?
hi list,
we have 52 DNs and more hundred clients they are store and read data from hdfs. one rack has 3 DNs and about 15 clients.
it is possible to force (if space is available) that these 15 clients prefer the 3 DNs located in there own rack to store and read data?
racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is allready in use, but this does not help in this case
thanks
RE: hdfs dfsclient, possible to force storage datanode ?
Posted by "Liu, Yi A" <yi...@intel.com>.
Which version are you using?
Regards,
Yi Liu
-----Original Message-----
From: norbi [mailto:norbi@rocknob.de]
Sent: Wednesday, August 20, 2014 10:14 PM
To: user@hadoop.apache.org
Subject: hdfs dfsclient, possible to force storage datanode ?
hi list,
we have 52 DNs and more hundred clients they are store and read data from hdfs. one rack has 3 DNs and about 15 clients.
it is possible to force (if space is available) that these 15 clients prefer the 3 DNs located in there own rack to store and read data?
racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is allready in use, but this does not help in this case
thanks
RE: hdfs dfsclient, possible to force storage datanode ?
Posted by "Liu, Yi A" <yi...@intel.com>.
Which version are you using?
Regards,
Yi Liu
-----Original Message-----
From: norbi [mailto:norbi@rocknob.de]
Sent: Wednesday, August 20, 2014 10:14 PM
To: user@hadoop.apache.org
Subject: hdfs dfsclient, possible to force storage datanode ?
hi list,
we have 52 DNs and more hundred clients they are store and read data from hdfs. one rack has 3 DNs and about 15 clients.
it is possible to force (if space is available) that these 15 clients prefer the 3 DNs located in there own rack to store and read data?
racklocation.conf with "org.apache.hadoop.net.NetworkTopology" is allready in use, but this does not help in this case
thanks