You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by "Natarajan, Prabakaran 1. (NSN - IN/Bangalore)" <pr...@nsn.com> on 2014/06/12 07:59:59 UTC
Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N
RE: Hadoop SAN Storage reuse
Posted by "Natarajan, Prabakaran 1. (NSN - IN/Bangalore)" <pr...@nsn.com>.
Great, Thanks.
Thanks and Regards
Prabakaran.N aka NP
nsn, Bangalore
When "I" is replaced by "We" - even Illness becomes "Wellness"
From: ext John Lilley [mailto:john.lilley@redpoint.net]
Sent: Friday, June 13, 2014 3:34 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop SAN Storage reuse
Hadoop performs best when each node has exclusive use of its disk. Therefore, if you have a choice, try to provision exclusive use of individual spindles on your SAN and map each one to a separate mount on your Hadoop nodes. Anything other than that will tend to produce poor performance due to disk contention.
john
From: Natarajan, Prabakaran 1. (NSN - IN/Bangalore) [mailto:prabakaran.1.natarajan@nsn.com]
Sent: Thursday, June 12, 2014 12:00 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N
RE: Hadoop SAN Storage reuse
Posted by "Natarajan, Prabakaran 1. (NSN - IN/Bangalore)" <pr...@nsn.com>.
Great, Thanks.
Thanks and Regards
Prabakaran.N aka NP
nsn, Bangalore
When "I" is replaced by "We" - even Illness becomes "Wellness"
From: ext John Lilley [mailto:john.lilley@redpoint.net]
Sent: Friday, June 13, 2014 3:34 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop SAN Storage reuse
Hadoop performs best when each node has exclusive use of its disk. Therefore, if you have a choice, try to provision exclusive use of individual spindles on your SAN and map each one to a separate mount on your Hadoop nodes. Anything other than that will tend to produce poor performance due to disk contention.
john
From: Natarajan, Prabakaran 1. (NSN - IN/Bangalore) [mailto:prabakaran.1.natarajan@nsn.com]
Sent: Thursday, June 12, 2014 12:00 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N
RE: Hadoop SAN Storage reuse
Posted by "Natarajan, Prabakaran 1. (NSN - IN/Bangalore)" <pr...@nsn.com>.
Great, Thanks.
Thanks and Regards
Prabakaran.N aka NP
nsn, Bangalore
When "I" is replaced by "We" - even Illness becomes "Wellness"
From: ext John Lilley [mailto:john.lilley@redpoint.net]
Sent: Friday, June 13, 2014 3:34 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop SAN Storage reuse
Hadoop performs best when each node has exclusive use of its disk. Therefore, if you have a choice, try to provision exclusive use of individual spindles on your SAN and map each one to a separate mount on your Hadoop nodes. Anything other than that will tend to produce poor performance due to disk contention.
john
From: Natarajan, Prabakaran 1. (NSN - IN/Bangalore) [mailto:prabakaran.1.natarajan@nsn.com]
Sent: Thursday, June 12, 2014 12:00 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N
RE: Hadoop SAN Storage reuse
Posted by "Natarajan, Prabakaran 1. (NSN - IN/Bangalore)" <pr...@nsn.com>.
Great, Thanks.
Thanks and Regards
Prabakaran.N aka NP
nsn, Bangalore
When "I" is replaced by "We" - even Illness becomes "Wellness"
From: ext John Lilley [mailto:john.lilley@redpoint.net]
Sent: Friday, June 13, 2014 3:34 AM
To: user@hadoop.apache.org
Subject: RE: Hadoop SAN Storage reuse
Hadoop performs best when each node has exclusive use of its disk. Therefore, if you have a choice, try to provision exclusive use of individual spindles on your SAN and map each one to a separate mount on your Hadoop nodes. Anything other than that will tend to produce poor performance due to disk contention.
john
From: Natarajan, Prabakaran 1. (NSN - IN/Bangalore) [mailto:prabakaran.1.natarajan@nsn.com]
Sent: Thursday, June 12, 2014 12:00 AM
To: user@hadoop.apache.org<ma...@hadoop.apache.org>
Subject: Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N
RE: Hadoop SAN Storage reuse
Posted by John Lilley <jo...@redpoint.net>.
Hadoop performs best when each node has exclusive use of its disk. Therefore, if you have a choice, try to provision exclusive use of individual spindles on your SAN and map each one to a separate mount on your Hadoop nodes. Anything other than that will tend to produce poor performance due to disk contention.
john
From: Natarajan, Prabakaran 1. (NSN - IN/Bangalore) [mailto:prabakaran.1.natarajan@nsn.com]
Sent: Thursday, June 12, 2014 12:00 AM
To: user@hadoop.apache.org
Subject: Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N
RE: Hadoop SAN Storage reuse
Posted by John Lilley <jo...@redpoint.net>.
Hadoop performs best when each node has exclusive use of its disk. Therefore, if you have a choice, try to provision exclusive use of individual spindles on your SAN and map each one to a separate mount on your Hadoop nodes. Anything other than that will tend to produce poor performance due to disk contention.
john
From: Natarajan, Prabakaran 1. (NSN - IN/Bangalore) [mailto:prabakaran.1.natarajan@nsn.com]
Sent: Thursday, June 12, 2014 12:00 AM
To: user@hadoop.apache.org
Subject: Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N
RE: Hadoop SAN Storage reuse
Posted by John Lilley <jo...@redpoint.net>.
Hadoop performs best when each node has exclusive use of its disk. Therefore, if you have a choice, try to provision exclusive use of individual spindles on your SAN and map each one to a separate mount on your Hadoop nodes. Anything other than that will tend to produce poor performance due to disk contention.
john
From: Natarajan, Prabakaran 1. (NSN - IN/Bangalore) [mailto:prabakaran.1.natarajan@nsn.com]
Sent: Thursday, June 12, 2014 12:00 AM
To: user@hadoop.apache.org
Subject: Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N
RE: Hadoop SAN Storage reuse
Posted by John Lilley <jo...@redpoint.net>.
Hadoop performs best when each node has exclusive use of its disk. Therefore, if you have a choice, try to provision exclusive use of individual spindles on your SAN and map each one to a separate mount on your Hadoop nodes. Anything other than that will tend to produce poor performance due to disk contention.
john
From: Natarajan, Prabakaran 1. (NSN - IN/Bangalore) [mailto:prabakaran.1.natarajan@nsn.com]
Sent: Thursday, June 12, 2014 12:00 AM
To: user@hadoop.apache.org
Subject: Hadoop SAN Storage reuse
Hi
I know SAN storage is not recommended for Hadoop. But we don't want waste - already existing SAN Storage.
How can we make use of SAN Storage for Hadoop - what are the best methods, can a Ethernet upgrade helps,...?
Thanks
Prabakaran.N