What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Hi,

Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of
decent blades, a few years old. Should I even thy to think of what to do
with them, given that one can use dedicated servers and Amazon's EC2?

Thank you. Sincerely,
Mark

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Thank you again for your advice. I may be asking the group for more once it
becomes real :)

Cheers,
Mark

On Sat, Dec 22, 2012 at 7:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> You do not absolutely need more ram.  You do not know your workload yet. A
> standard hadoop machine has 8 disks 16 GB RAM, 8 cores.
>
> In the old days, you would dedicate map slots and reduce slots map 3 map 1
> reduce in your case. Give each of them 256 RAM for child jvm ops. So you
> needed more ram in that case that you have 8 cores, but you do not.
>
> In the end blades are not the ideal hadoop machine because users usually
> want many disks for lots of IO, but it is ok for kicking around.
>
>
> On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Edward, thank you for the practical recommendations. I am going to visit
>> the cluster in its current home in a few days, and I will keep this in
>> mind. Meanwhile, my specs are below
>>
>> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
>> Infiniband NICs, 4GB RAM
>>
>> 1 HP cluster controller with SCSI controller
>>
>> 1 HP RSA20 storage array with approx 1Tb of storage
>>
>> Cisco Infiniband 20Gbit optical network router
>>
>> In Compaq racks with four 30 amp 220 volt circuits
>>
>> All wiring and cabling.
>>
>> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
>> master nodes is bearable, but any memory upgrade on the complete cluster
>> will sure cost, when multiplied by 50.
>>
>> Thank you. Sincerely,
>> Mark
>>
>> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>>
>>> Three year old blade center is ok. A three year old blade is probably a
>>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>>> provider in your price range.
>>>
>>> Especially if you can get the hardware at a low initial cost you crush
>>> the cloud providers. Buying your own gear takes about a year to recoup
>>> costs over amazons pay per use model.
>>>
>>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>>> crushing word count at home your power bill is gonna get $.
>>>
>>>
>>>
>>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>>> wrote:
>>> > True!
>>> >
>>> > I am thinking of either my (small) office, or actually hosting for
>>> under $500/month.
>>> >
>>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>>> wrote:
>>> >>
>>> >> You will also be raided by the DEA- too much power for a residence.
>>> >>
>>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>>> michael_segel@hotmail.com> wrote:
>>> >>>
>>> >>> While Ted ignores that the world is going to end before X-Mas, he
>>> does hit the crux of the matter head on.
>>> >>> If you don't have a place to put it, the cost of setting it up would
>>> kill you, not to mention that you can get newer hardware which is better
>>> suited for less.
>>> >>> Having said that... if you live in the frozen tundra like Montana,
>>> or some place like ... er Canada or Siberia... , it may make more sense to
>>> use it to heat your home with it.
>>> >>> Just think of the side benefits from all that potential additional
>>> compute power....  :-P
>>> >>
>>> >> I can say from experience that the sound of a bunch of servers in a
>>> home setting is a novel one that is probably unlike anything you have known
>>> before.
>>> >> If you haven't experienced that, then taking on these servers could
>>> be classified as novelty seeking behavior.
>>> >
>>> >
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

The infiniband connection to the disk unit might help with the I/O issue.
 The memory is a bit tight, but should be possible to make it work.


On Sat, Dec 22, 2012 at 5:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> You do not absolutely need more ram.  You do not know your workload yet. A
> standard hadoop machine has 8 disks 16 GB RAM, 8 cores.
>
> In the old days, you would dedicate map slots and reduce slots map 3 map 1
> reduce in your case. Give each of them 256 RAM for child jvm ops. So you
> needed more ram in that case that you have 8 cores, but you do not.
>
> In the end blades are not the ideal hadoop machine because users usually
> want many disks for lots of IO, but it is ok for kicking around.
>
>
> On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Edward, thank you for the practical recommendations. I am going to visit
>> the cluster in its current home in a few days, and I will keep this in
>> mind. Meanwhile, my specs are below
>>
>> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
>> Infiniband NICs, 4GB RAM
>>
>> 1 HP cluster controller with SCSI controller
>>
>> 1 HP RSA20 storage array with approx 1Tb of storage
>>
>> Cisco Infiniband 20Gbit optical network router
>>
>> In Compaq racks with four 30 amp 220 volt circuits
>>
>> All wiring and cabling.
>>
>> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
>> master nodes is bearable, but any memory upgrade on the complete cluster
>> will sure cost, when multiplied by 50.
>>
>> Thank you. Sincerely,
>> Mark
>>
>> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>>
>>> Three year old blade center is ok. A three year old blade is probably a
>>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>>> provider in your price range.
>>>
>>> Especially if you can get the hardware at a low initial cost you crush
>>> the cloud providers. Buying your own gear takes about a year to recoup
>>> costs over amazons pay per use model.
>>>
>>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>>> crushing word count at home your power bill is gonna get $.
>>>
>>>
>>>
>>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>>> wrote:
>>> > True!
>>> >
>>> > I am thinking of either my (small) office, or actually hosting for
>>> under $500/month.
>>> >
>>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>>> wrote:
>>> >>
>>> >> You will also be raided by the DEA- too much power for a residence.
>>> >>
>>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>>> michael_segel@hotmail.com> wrote:
>>> >>>
>>> >>> While Ted ignores that the world is going to end before X-Mas, he
>>> does hit the crux of the matter head on.
>>> >>> If you don't have a place to put it, the cost of setting it up would
>>> kill you, not to mention that you can get newer hardware which is better
>>> suited for less.
>>> >>> Having said that... if you live in the frozen tundra like Montana,
>>> or some place like ... er Canada or Siberia... , it may make more sense to
>>> use it to heat your home with it.
>>> >>> Just think of the side benefits from all that potential additional
>>> compute power....  :-P
>>> >>
>>> >> I can say from experience that the sound of a bunch of servers in a
>>> home setting is a novel one that is probably unlike anything you have known
>>> before.
>>> >> If you haven't experienced that, then taking on these servers could
>>> be classified as novelty seeking behavior.
>>> >
>>> >
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Thank you again for your advice. I may be asking the group for more once it
becomes real :)

Cheers,
Mark

On Sat, Dec 22, 2012 at 7:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> You do not absolutely need more ram.  You do not know your workload yet. A
> standard hadoop machine has 8 disks 16 GB RAM, 8 cores.
>
> In the old days, you would dedicate map slots and reduce slots map 3 map 1
> reduce in your case. Give each of them 256 RAM for child jvm ops. So you
> needed more ram in that case that you have 8 cores, but you do not.
>
> In the end blades are not the ideal hadoop machine because users usually
> want many disks for lots of IO, but it is ok for kicking around.
>
>
> On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Edward, thank you for the practical recommendations. I am going to visit
>> the cluster in its current home in a few days, and I will keep this in
>> mind. Meanwhile, my specs are below
>>
>> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
>> Infiniband NICs, 4GB RAM
>>
>> 1 HP cluster controller with SCSI controller
>>
>> 1 HP RSA20 storage array with approx 1Tb of storage
>>
>> Cisco Infiniband 20Gbit optical network router
>>
>> In Compaq racks with four 30 amp 220 volt circuits
>>
>> All wiring and cabling.
>>
>> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
>> master nodes is bearable, but any memory upgrade on the complete cluster
>> will sure cost, when multiplied by 50.
>>
>> Thank you. Sincerely,
>> Mark
>>
>> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>>
>>> Three year old blade center is ok. A three year old blade is probably a
>>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>>> provider in your price range.
>>>
>>> Especially if you can get the hardware at a low initial cost you crush
>>> the cloud providers. Buying your own gear takes about a year to recoup
>>> costs over amazons pay per use model.
>>>
>>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>>> crushing word count at home your power bill is gonna get $.
>>>
>>>
>>>
>>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>>> wrote:
>>> > True!
>>> >
>>> > I am thinking of either my (small) office, or actually hosting for
>>> under $500/month.
>>> >
>>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>>> wrote:
>>> >>
>>> >> You will also be raided by the DEA- too much power for a residence.
>>> >>
>>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>>> michael_segel@hotmail.com> wrote:
>>> >>>
>>> >>> While Ted ignores that the world is going to end before X-Mas, he
>>> does hit the crux of the matter head on.
>>> >>> If you don't have a place to put it, the cost of setting it up would
>>> kill you, not to mention that you can get newer hardware which is better
>>> suited for less.
>>> >>> Having said that... if you live in the frozen tundra like Montana,
>>> or some place like ... er Canada or Siberia... , it may make more sense to
>>> use it to heat your home with it.
>>> >>> Just think of the side benefits from all that potential additional
>>> compute power....  :-P
>>> >>
>>> >> I can say from experience that the sound of a bunch of servers in a
>>> home setting is a novel one that is probably unlike anything you have known
>>> before.
>>> >> If you haven't experienced that, then taking on these servers could
>>> be classified as novelty seeking behavior.
>>> >
>>> >
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Thank you again for your advice. I may be asking the group for more once it
becomes real :)

Cheers,
Mark

On Sat, Dec 22, 2012 at 7:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> You do not absolutely need more ram.  You do not know your workload yet. A
> standard hadoop machine has 8 disks 16 GB RAM, 8 cores.
>
> In the old days, you would dedicate map slots and reduce slots map 3 map 1
> reduce in your case. Give each of them 256 RAM for child jvm ops. So you
> needed more ram in that case that you have 8 cores, but you do not.
>
> In the end blades are not the ideal hadoop machine because users usually
> want many disks for lots of IO, but it is ok for kicking around.
>
>
> On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Edward, thank you for the practical recommendations. I am going to visit
>> the cluster in its current home in a few days, and I will keep this in
>> mind. Meanwhile, my specs are below
>>
>> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
>> Infiniband NICs, 4GB RAM
>>
>> 1 HP cluster controller with SCSI controller
>>
>> 1 HP RSA20 storage array with approx 1Tb of storage
>>
>> Cisco Infiniband 20Gbit optical network router
>>
>> In Compaq racks with four 30 amp 220 volt circuits
>>
>> All wiring and cabling.
>>
>> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
>> master nodes is bearable, but any memory upgrade on the complete cluster
>> will sure cost, when multiplied by 50.
>>
>> Thank you. Sincerely,
>> Mark
>>
>> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>>
>>> Three year old blade center is ok. A three year old blade is probably a
>>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>>> provider in your price range.
>>>
>>> Especially if you can get the hardware at a low initial cost you crush
>>> the cloud providers. Buying your own gear takes about a year to recoup
>>> costs over amazons pay per use model.
>>>
>>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>>> crushing word count at home your power bill is gonna get $.
>>>
>>>
>>>
>>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>>> wrote:
>>> > True!
>>> >
>>> > I am thinking of either my (small) office, or actually hosting for
>>> under $500/month.
>>> >
>>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>>> wrote:
>>> >>
>>> >> You will also be raided by the DEA- too much power for a residence.
>>> >>
>>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>>> michael_segel@hotmail.com> wrote:
>>> >>>
>>> >>> While Ted ignores that the world is going to end before X-Mas, he
>>> does hit the crux of the matter head on.
>>> >>> If you don't have a place to put it, the cost of setting it up would
>>> kill you, not to mention that you can get newer hardware which is better
>>> suited for less.
>>> >>> Having said that... if you live in the frozen tundra like Montana,
>>> or some place like ... er Canada or Siberia... , it may make more sense to
>>> use it to heat your home with it.
>>> >>> Just think of the side benefits from all that potential additional
>>> compute power....  :-P
>>> >>
>>> >> I can say from experience that the sound of a bunch of servers in a
>>> home setting is a novel one that is probably unlike anything you have known
>>> before.
>>> >> If you haven't experienced that, then taking on these servers could
>>> be classified as novelty seeking behavior.
>>> >
>>> >
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

The infiniband connection to the disk unit might help with the I/O issue.
 The memory is a bit tight, but should be possible to make it work.


On Sat, Dec 22, 2012 at 5:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> You do not absolutely need more ram.  You do not know your workload yet. A
> standard hadoop machine has 8 disks 16 GB RAM, 8 cores.
>
> In the old days, you would dedicate map slots and reduce slots map 3 map 1
> reduce in your case. Give each of them 256 RAM for child jvm ops. So you
> needed more ram in that case that you have 8 cores, but you do not.
>
> In the end blades are not the ideal hadoop machine because users usually
> want many disks for lots of IO, but it is ok for kicking around.
>
>
> On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Edward, thank you for the practical recommendations. I am going to visit
>> the cluster in its current home in a few days, and I will keep this in
>> mind. Meanwhile, my specs are below
>>
>> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
>> Infiniband NICs, 4GB RAM
>>
>> 1 HP cluster controller with SCSI controller
>>
>> 1 HP RSA20 storage array with approx 1Tb of storage
>>
>> Cisco Infiniband 20Gbit optical network router
>>
>> In Compaq racks with four 30 amp 220 volt circuits
>>
>> All wiring and cabling.
>>
>> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
>> master nodes is bearable, but any memory upgrade on the complete cluster
>> will sure cost, when multiplied by 50.
>>
>> Thank you. Sincerely,
>> Mark
>>
>> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>>
>>> Three year old blade center is ok. A three year old blade is probably a
>>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>>> provider in your price range.
>>>
>>> Especially if you can get the hardware at a low initial cost you crush
>>> the cloud providers. Buying your own gear takes about a year to recoup
>>> costs over amazons pay per use model.
>>>
>>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>>> crushing word count at home your power bill is gonna get $.
>>>
>>>
>>>
>>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>>> wrote:
>>> > True!
>>> >
>>> > I am thinking of either my (small) office, or actually hosting for
>>> under $500/month.
>>> >
>>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>>> wrote:
>>> >>
>>> >> You will also be raided by the DEA- too much power for a residence.
>>> >>
>>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>>> michael_segel@hotmail.com> wrote:
>>> >>>
>>> >>> While Ted ignores that the world is going to end before X-Mas, he
>>> does hit the crux of the matter head on.
>>> >>> If you don't have a place to put it, the cost of setting it up would
>>> kill you, not to mention that you can get newer hardware which is better
>>> suited for less.
>>> >>> Having said that... if you live in the frozen tundra like Montana,
>>> or some place like ... er Canada or Siberia... , it may make more sense to
>>> use it to heat your home with it.
>>> >>> Just think of the side benefits from all that potential additional
>>> compute power....  :-P
>>> >>
>>> >> I can say from experience that the sound of a bunch of servers in a
>>> home setting is a novel one that is probably unlike anything you have known
>>> before.
>>> >> If you haven't experienced that, then taking on these servers could
>>> be classified as novelty seeking behavior.
>>> >
>>> >
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Thank you again for your advice. I may be asking the group for more once it
becomes real :)

Cheers,
Mark

On Sat, Dec 22, 2012 at 7:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> You do not absolutely need more ram.  You do not know your workload yet. A
> standard hadoop machine has 8 disks 16 GB RAM, 8 cores.
>
> In the old days, you would dedicate map slots and reduce slots map 3 map 1
> reduce in your case. Give each of them 256 RAM for child jvm ops. So you
> needed more ram in that case that you have 8 cores, but you do not.
>
> In the end blades are not the ideal hadoop machine because users usually
> want many disks for lots of IO, but it is ok for kicking around.
>
>
> On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Edward, thank you for the practical recommendations. I am going to visit
>> the cluster in its current home in a few days, and I will keep this in
>> mind. Meanwhile, my specs are below
>>
>> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
>> Infiniband NICs, 4GB RAM
>>
>> 1 HP cluster controller with SCSI controller
>>
>> 1 HP RSA20 storage array with approx 1Tb of storage
>>
>> Cisco Infiniband 20Gbit optical network router
>>
>> In Compaq racks with four 30 amp 220 volt circuits
>>
>> All wiring and cabling.
>>
>> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
>> master nodes is bearable, but any memory upgrade on the complete cluster
>> will sure cost, when multiplied by 50.
>>
>> Thank you. Sincerely,
>> Mark
>>
>> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>>
>>> Three year old blade center is ok. A three year old blade is probably a
>>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>>> provider in your price range.
>>>
>>> Especially if you can get the hardware at a low initial cost you crush
>>> the cloud providers. Buying your own gear takes about a year to recoup
>>> costs over amazons pay per use model.
>>>
>>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>>> crushing word count at home your power bill is gonna get $.
>>>
>>>
>>>
>>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>>> wrote:
>>> > True!
>>> >
>>> > I am thinking of either my (small) office, or actually hosting for
>>> under $500/month.
>>> >
>>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>>> wrote:
>>> >>
>>> >> You will also be raided by the DEA- too much power for a residence.
>>> >>
>>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>>> michael_segel@hotmail.com> wrote:
>>> >>>
>>> >>> While Ted ignores that the world is going to end before X-Mas, he
>>> does hit the crux of the matter head on.
>>> >>> If you don't have a place to put it, the cost of setting it up would
>>> kill you, not to mention that you can get newer hardware which is better
>>> suited for less.
>>> >>> Having said that... if you live in the frozen tundra like Montana,
>>> or some place like ... er Canada or Siberia... , it may make more sense to
>>> use it to heat your home with it.
>>> >>> Just think of the side benefits from all that potential additional
>>> compute power....  :-P
>>> >>
>>> >> I can say from experience that the sound of a bunch of servers in a
>>> home setting is a novel one that is probably unlike anything you have known
>>> before.
>>> >> If you haven't experienced that, then taking on these servers could
>>> be classified as novelty seeking behavior.
>>> >
>>> >
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

The infiniband connection to the disk unit might help with the I/O issue.
 The memory is a bit tight, but should be possible to make it work.


On Sat, Dec 22, 2012 at 5:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> You do not absolutely need more ram.  You do not know your workload yet. A
> standard hadoop machine has 8 disks 16 GB RAM, 8 cores.
>
> In the old days, you would dedicate map slots and reduce slots map 3 map 1
> reduce in your case. Give each of them 256 RAM for child jvm ops. So you
> needed more ram in that case that you have 8 cores, but you do not.
>
> In the end blades are not the ideal hadoop machine because users usually
> want many disks for lots of IO, but it is ok for kicking around.
>
>
> On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Edward, thank you for the practical recommendations. I am going to visit
>> the cluster in its current home in a few days, and I will keep this in
>> mind. Meanwhile, my specs are below
>>
>> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
>> Infiniband NICs, 4GB RAM
>>
>> 1 HP cluster controller with SCSI controller
>>
>> 1 HP RSA20 storage array with approx 1Tb of storage
>>
>> Cisco Infiniband 20Gbit optical network router
>>
>> In Compaq racks with four 30 amp 220 volt circuits
>>
>> All wiring and cabling.
>>
>> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
>> master nodes is bearable, but any memory upgrade on the complete cluster
>> will sure cost, when multiplied by 50.
>>
>> Thank you. Sincerely,
>> Mark
>>
>> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>>
>>> Three year old blade center is ok. A three year old blade is probably a
>>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>>> provider in your price range.
>>>
>>> Especially if you can get the hardware at a low initial cost you crush
>>> the cloud providers. Buying your own gear takes about a year to recoup
>>> costs over amazons pay per use model.
>>>
>>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>>> crushing word count at home your power bill is gonna get $.
>>>
>>>
>>>
>>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>>> wrote:
>>> > True!
>>> >
>>> > I am thinking of either my (small) office, or actually hosting for
>>> under $500/month.
>>> >
>>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>>> wrote:
>>> >>
>>> >> You will also be raided by the DEA- too much power for a residence.
>>> >>
>>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>>> michael_segel@hotmail.com> wrote:
>>> >>>
>>> >>> While Ted ignores that the world is going to end before X-Mas, he
>>> does hit the crux of the matter head on.
>>> >>> If you don't have a place to put it, the cost of setting it up would
>>> kill you, not to mention that you can get newer hardware which is better
>>> suited for less.
>>> >>> Having said that... if you live in the frozen tundra like Montana,
>>> or some place like ... er Canada or Siberia... , it may make more sense to
>>> use it to heat your home with it.
>>> >>> Just think of the side benefits from all that potential additional
>>> compute power....  :-P
>>> >>
>>> >> I can say from experience that the sound of a bunch of servers in a
>>> home setting is a novel one that is probably unlike anything you have known
>>> before.
>>> >> If you haven't experienced that, then taking on these servers could
>>> be classified as novelty seeking behavior.
>>> >
>>> >
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

The infiniband connection to the disk unit might help with the I/O issue.
 The memory is a bit tight, but should be possible to make it work.


On Sat, Dec 22, 2012 at 5:11 PM, Edward Capriolo <ed...@gmail.com>wrote:

> You do not absolutely need more ram.  You do not know your workload yet. A
> standard hadoop machine has 8 disks 16 GB RAM, 8 cores.
>
> In the old days, you would dedicate map slots and reduce slots map 3 map 1
> reduce in your case. Give each of them 256 RAM for child jvm ops. So you
> needed more ram in that case that you have 8 cores, but you do not.
>
> In the end blades are not the ideal hadoop machine because users usually
> want many disks for lots of IO, but it is ok for kicking around.
>
>
> On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Edward, thank you for the practical recommendations. I am going to visit
>> the cluster in its current home in a few days, and I will keep this in
>> mind. Meanwhile, my specs are below
>>
>> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
>> Infiniband NICs, 4GB RAM
>>
>> 1 HP cluster controller with SCSI controller
>>
>> 1 HP RSA20 storage array with approx 1Tb of storage
>>
>> Cisco Infiniband 20Gbit optical network router
>>
>> In Compaq racks with four 30 amp 220 volt circuits
>>
>> All wiring and cabling.
>>
>> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
>> master nodes is bearable, but any memory upgrade on the complete cluster
>> will sure cost, when multiplied by 50.
>>
>> Thank you. Sincerely,
>> Mark
>>
>> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>>
>>> Three year old blade center is ok. A three year old blade is probably a
>>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>>> provider in your price range.
>>>
>>> Especially if you can get the hardware at a low initial cost you crush
>>> the cloud providers. Buying your own gear takes about a year to recoup
>>> costs over amazons pay per use model.
>>>
>>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>>> crushing word count at home your power bill is gonna get $.
>>>
>>>
>>>
>>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>>> wrote:
>>> > True!
>>> >
>>> > I am thinking of either my (small) office, or actually hosting for
>>> under $500/month.
>>> >
>>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>>> wrote:
>>> >>
>>> >> You will also be raided by the DEA- too much power for a residence.
>>> >>
>>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>> >>
>>> >>
>>> >>
>>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>>> michael_segel@hotmail.com> wrote:
>>> >>>
>>> >>> While Ted ignores that the world is going to end before X-Mas, he
>>> does hit the crux of the matter head on.
>>> >>> If you don't have a place to put it, the cost of setting it up would
>>> kill you, not to mention that you can get newer hardware which is better
>>> suited for less.
>>> >>> Having said that... if you live in the frozen tundra like Montana,
>>> or some place like ... er Canada or Siberia... , it may make more sense to
>>> use it to heat your home with it.
>>> >>> Just think of the side benefits from all that potential additional
>>> compute power....  :-P
>>> >>
>>> >> I can say from experience that the sound of a bunch of servers in a
>>> home setting is a novel one that is probably unlike anything you have known
>>> before.
>>> >> If you haven't experienced that, then taking on these servers could
>>> be classified as novelty seeking behavior.
>>> >
>>> >
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Edward Capriolo <ed...@gmail.com>]

You do not absolutely need more ram.  You do not know your workload yet. A
standard hadoop machine has 8 disks 16 GB RAM, 8 cores.

In the old days, you would dedicate map slots and reduce slots map 3 map 1
reduce in your case. Give each of them 256 RAM for child jvm ops. So you
needed more ram in that case that you have 8 cores, but you do not.

In the end blades are not the ideal hadoop machine because users usually
want many disks for lots of IO, but it is ok for kicking around.

On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Edward, thank you for the practical recommendations. I am going to visit
> the cluster in its current home in a few days, and I will keep this in
> mind. Meanwhile, my specs are below
>
> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
> Infiniband NICs, 4GB RAM
>
> 1 HP cluster controller with SCSI controller
>
> 1 HP RSA20 storage array with approx 1Tb of storage
>
> Cisco Infiniband 20Gbit optical network router
>
> In Compaq racks with four 30 amp 220 volt circuits
>
> All wiring and cabling.
>
> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
> master nodes is bearable, but any memory upgrade on the complete cluster
> will sure cost, when multiplied by 50.
>
> Thank you. Sincerely,
> Mark
>
> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>
>> Three year old blade center is ok. A three year old blade is probably a
>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>> provider in your price range.
>>
>> Especially if you can get the hardware at a low initial cost you crush
>> the cloud providers. Buying your own gear takes about a year to recoup
>> costs over amazons pay per use model.
>>
>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>> crushing word count at home your power bill is gonna get $.
>>
>>
>>
>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>> wrote:
>> > True!
>> >
>> > I am thinking of either my (small) office, or actually hosting for
>> under $500/month.
>> >
>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>> wrote:
>> >>
>> >> You will also be raided by the DEA- too much power for a residence.
>> >>
>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>> >>
>> >>
>> >>
>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>> michael_segel@hotmail.com> wrote:
>> >>>
>> >>> While Ted ignores that the world is going to end before X-Mas, he
>> does hit the crux of the matter head on.
>> >>> If you don't have a place to put it, the cost of setting it up would
>> kill you, not to mention that you can get newer hardware which is better
>> suited for less.
>> >>> Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> >>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>> >>
>> >> I can say from experience that the sound of a bunch of servers in a
>> home setting is a novel one that is probably unlike anything you have known
>> before.
>> >> If you haven't experienced that, then taking on these servers could be
>> classified as novelty seeking behavior.
>> >
>> >
>>
>
>

Re: What should I do with a 48-node cluster

[Edward Capriolo <ed...@gmail.com>]

You do not absolutely need more ram.  You do not know your workload yet. A
standard hadoop machine has 8 disks 16 GB RAM, 8 cores.

In the old days, you would dedicate map slots and reduce slots map 3 map 1
reduce in your case. Give each of them 256 RAM for child jvm ops. So you
needed more ram in that case that you have 8 cores, but you do not.

In the end blades are not the ideal hadoop machine because users usually
want many disks for lots of IO, but it is ok for kicking around.

On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Edward, thank you for the practical recommendations. I am going to visit
> the cluster in its current home in a few days, and I will keep this in
> mind. Meanwhile, my specs are below
>
> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
> Infiniband NICs, 4GB RAM
>
> 1 HP cluster controller with SCSI controller
>
> 1 HP RSA20 storage array with approx 1Tb of storage
>
> Cisco Infiniband 20Gbit optical network router
>
> In Compaq racks with four 30 amp 220 volt circuits
>
> All wiring and cabling.
>
> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
> master nodes is bearable, but any memory upgrade on the complete cluster
> will sure cost, when multiplied by 50.
>
> Thank you. Sincerely,
> Mark
>
> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>
>> Three year old blade center is ok. A three year old blade is probably a
>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>> provider in your price range.
>>
>> Especially if you can get the hardware at a low initial cost you crush
>> the cloud providers. Buying your own gear takes about a year to recoup
>> costs over amazons pay per use model.
>>
>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>> crushing word count at home your power bill is gonna get $.
>>
>>
>>
>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>> wrote:
>> > True!
>> >
>> > I am thinking of either my (small) office, or actually hosting for
>> under $500/month.
>> >
>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>> wrote:
>> >>
>> >> You will also be raided by the DEA- too much power for a residence.
>> >>
>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>> >>
>> >>
>> >>
>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>> michael_segel@hotmail.com> wrote:
>> >>>
>> >>> While Ted ignores that the world is going to end before X-Mas, he
>> does hit the crux of the matter head on.
>> >>> If you don't have a place to put it, the cost of setting it up would
>> kill you, not to mention that you can get newer hardware which is better
>> suited for less.
>> >>> Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> >>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>> >>
>> >> I can say from experience that the sound of a bunch of servers in a
>> home setting is a novel one that is probably unlike anything you have known
>> before.
>> >> If you haven't experienced that, then taking on these servers could be
>> classified as novelty seeking behavior.
>> >
>> >
>>
>
>

Re: What should I do with a 48-node cluster

[Edward Capriolo <ed...@gmail.com>]

You do not absolutely need more ram.  You do not know your workload yet. A
standard hadoop machine has 8 disks 16 GB RAM, 8 cores.

In the old days, you would dedicate map slots and reduce slots map 3 map 1
reduce in your case. Give each of them 256 RAM for child jvm ops. So you
needed more ram in that case that you have 8 cores, but you do not.

In the end blades are not the ideal hadoop machine because users usually
want many disks for lots of IO, but it is ok for kicking around.

On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Edward, thank you for the practical recommendations. I am going to visit
> the cluster in its current home in a few days, and I will keep this in
> mind. Meanwhile, my specs are below
>
> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
> Infiniband NICs, 4GB RAM
>
> 1 HP cluster controller with SCSI controller
>
> 1 HP RSA20 storage array with approx 1Tb of storage
>
> Cisco Infiniband 20Gbit optical network router
>
> In Compaq racks with four 30 amp 220 volt circuits
>
> All wiring and cabling.
>
> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
> master nodes is bearable, but any memory upgrade on the complete cluster
> will sure cost, when multiplied by 50.
>
> Thank you. Sincerely,
> Mark
>
> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>
>> Three year old blade center is ok. A three year old blade is probably a
>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>> provider in your price range.
>>
>> Especially if you can get the hardware at a low initial cost you crush
>> the cloud providers. Buying your own gear takes about a year to recoup
>> costs over amazons pay per use model.
>>
>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>> crushing word count at home your power bill is gonna get $.
>>
>>
>>
>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>> wrote:
>> > True!
>> >
>> > I am thinking of either my (small) office, or actually hosting for
>> under $500/month.
>> >
>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>> wrote:
>> >>
>> >> You will also be raided by the DEA- too much power for a residence.
>> >>
>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>> >>
>> >>
>> >>
>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>> michael_segel@hotmail.com> wrote:
>> >>>
>> >>> While Ted ignores that the world is going to end before X-Mas, he
>> does hit the crux of the matter head on.
>> >>> If you don't have a place to put it, the cost of setting it up would
>> kill you, not to mention that you can get newer hardware which is better
>> suited for less.
>> >>> Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> >>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>> >>
>> >> I can say from experience that the sound of a bunch of servers in a
>> home setting is a novel one that is probably unlike anything you have known
>> before.
>> >> If you haven't experienced that, then taking on these servers could be
>> classified as novelty seeking behavior.
>> >
>> >
>>
>
>

Re: What should I do with a 48-node cluster

[Edward Capriolo <ed...@gmail.com>]

You do not absolutely need more ram.  You do not know your workload yet. A
standard hadoop machine has 8 disks 16 GB RAM, 8 cores.

In the old days, you would dedicate map slots and reduce slots map 3 map 1
reduce in your case. Give each of them 256 RAM for child jvm ops. So you
needed more ram in that case that you have 8 cores, but you do not.

In the end blades are not the ideal hadoop machine because users usually
want many disks for lots of IO, but it is ok for kicking around.

On Sat, Dec 22, 2012 at 7:53 PM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Edward, thank you for the practical recommendations. I am going to visit
> the cluster in its current home in a few days, and I will keep this in
> mind. Meanwhile, my specs are below
>
> 48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
> Infiniband NICs, 4GB RAM
>
> 1 HP cluster controller with SCSI controller
>
> 1 HP RSA20 storage array with approx 1Tb of storage
>
> Cisco Infiniband 20Gbit optical network router
>
> In Compaq racks with four 30 amp 220 volt circuits
>
> All wiring and cabling.
>
> I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
> master nodes is bearable, but any memory upgrade on the complete cluster
> will sure cost, when multiplied by 50.
>
> Thank you. Sincerely,
> Mark
>
> On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:
>
>> Three year old blade center is ok. A three year old blade is probably a
>> 64 bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
>> blade centers is about 8u or a quarter cabinet and you can find a hosting
>> provider in your price range.
>>
>> Especially if you can get the hardware at a low initial cost you crush
>> the cloud providers. Buying your own gear takes about a year to recoup
>> costs over amazons pay per use model.
>>
>> Blade centers are usually 20 to 30 amp fully loaded though so if your
>> crushing word count at home your power bill is gonna get $.
>>
>>
>>
>> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
>> wrote:
>> > True!
>> >
>> > I am thinking of either my (small) office, or actually hosting for
>> under $500/month.
>> >
>> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
>> wrote:
>> >>
>> >> You will also be raided by the DEA- too much power for a residence.
>> >>
>> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>> >>
>> >>
>> >>
>> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
>> michael_segel@hotmail.com> wrote:
>> >>>
>> >>> While Ted ignores that the world is going to end before X-Mas, he
>> does hit the crux of the matter head on.
>> >>> If you don't have a place to put it, the cost of setting it up would
>> kill you, not to mention that you can get newer hardware which is better
>> suited for less.
>> >>> Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> >>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>> >>
>> >> I can say from experience that the sound of a bunch of servers in a
>> home setting is a novel one that is probably unlike anything you have known
>> before.
>> >> If you haven't experienced that, then taking on these servers could be
>> classified as novelty seeking behavior.
>> >
>> >
>>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Edward, thank you for the practical recommendations. I am going to visit
the cluster in its current home in a few days, and I will keep this in
mind. Meanwhile, my specs are below

48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
Infiniband NICs, 4GB RAM

1 HP cluster controller with SCSI controller

1 HP RSA20 storage array with approx 1Tb of storage

Cisco Infiniband 20Gbit optical network router

In Compaq racks with four 30 amp 220 volt circuits

All wiring and cabling.

I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
master nodes is bearable, but any memory upgrade on the complete cluster
will sure cost, when multiplied by 50.

Thank you. Sincerely,
Mark

On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:

> Three year old blade center is ok. A three year old blade is probably a 64
> bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
> blade centers is about 8u or a quarter cabinet and you can find a hosting
> provider in your price range.
>
> Especially if you can get the hardware at a low initial cost you crush the
> cloud providers. Buying your own gear takes about a year to recoup costs
> over amazons pay per use model.
>
> Blade centers are usually 20 to 30 amp fully loaded though so if your
> crushing word count at home your power bill is gonna get $.
>
>
>
> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
> wrote:
> > True!
> >
> > I am thinking of either my (small) office, or actually hosting for under
> $500/month.
> >
> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
> wrote:
> >>
> >> You will also be raided by the DEA- too much power for a residence.
> >>
> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
> >>
> >>
> >>
> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
> michael_segel@hotmail.com> wrote:
> >>>
> >>> While Ted ignores that the world is going to end before X-Mas, he does
> hit the crux of the matter head on.
> >>> If you don't have a place to put it, the cost of setting it up would
> kill you, not to mention that you can get newer hardware which is better
> suited for less.
> >>> Having said that... if you live in the frozen tundra like Montana, or
> some place like ... er Canada or Siberia... , it may make more sense to use
> it to heat your home with it.
> >>> Just think of the side benefits from all that potential additional
> compute power....  :-P
> >>
> >> I can say from experience that the sound of a bunch of servers in a
> home setting is a novel one that is probably unlike anything you have known
> before.
> >> If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
> >
> >
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Edward, thank you for the practical recommendations. I am going to visit
the cluster in its current home in a few days, and I will keep this in
mind. Meanwhile, my specs are below

48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
Infiniband NICs, 4GB RAM

1 HP cluster controller with SCSI controller

1 HP RSA20 storage array with approx 1Tb of storage

Cisco Infiniband 20Gbit optical network router

In Compaq racks with four 30 amp 220 volt circuits

All wiring and cabling.

I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
master nodes is bearable, but any memory upgrade on the complete cluster
will sure cost, when multiplied by 50.

Thank you. Sincerely,
Mark

On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:

> Three year old blade center is ok. A three year old blade is probably a 64
> bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
> blade centers is about 8u or a quarter cabinet and you can find a hosting
> provider in your price range.
>
> Especially if you can get the hardware at a low initial cost you crush the
> cloud providers. Buying your own gear takes about a year to recoup costs
> over amazons pay per use model.
>
> Blade centers are usually 20 to 30 amp fully loaded though so if your
> crushing word count at home your power bill is gonna get $.
>
>
>
> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
> wrote:
> > True!
> >
> > I am thinking of either my (small) office, or actually hosting for under
> $500/month.
> >
> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
> wrote:
> >>
> >> You will also be raided by the DEA- too much power for a residence.
> >>
> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
> >>
> >>
> >>
> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
> michael_segel@hotmail.com> wrote:
> >>>
> >>> While Ted ignores that the world is going to end before X-Mas, he does
> hit the crux of the matter head on.
> >>> If you don't have a place to put it, the cost of setting it up would
> kill you, not to mention that you can get newer hardware which is better
> suited for less.
> >>> Having said that... if you live in the frozen tundra like Montana, or
> some place like ... er Canada or Siberia... , it may make more sense to use
> it to heat your home with it.
> >>> Just think of the side benefits from all that potential additional
> compute power....  :-P
> >>
> >> I can say from experience that the sound of a bunch of servers in a
> home setting is a novel one that is probably unlike anything you have known
> before.
> >> If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
> >
> >
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Edward, thank you for the practical recommendations. I am going to visit
the cluster in its current home in a few days, and I will keep this in
mind. Meanwhile, my specs are below

48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
Infiniband NICs, 4GB RAM

1 HP cluster controller with SCSI controller

1 HP RSA20 storage array with approx 1Tb of storage

Cisco Infiniband 20Gbit optical network router

In Compaq racks with four 30 amp 220 volt circuits

All wiring and cabling.

I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
master nodes is bearable, but any memory upgrade on the complete cluster
will sure cost, when multiplied by 50.

Thank you. Sincerely,
Mark

On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:

> Three year old blade center is ok. A three year old blade is probably a 64
> bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
> blade centers is about 8u or a quarter cabinet and you can find a hosting
> provider in your price range.
>
> Especially if you can get the hardware at a low initial cost you crush the
> cloud providers. Buying your own gear takes about a year to recoup costs
> over amazons pay per use model.
>
> Blade centers are usually 20 to 30 amp fully loaded though so if your
> crushing word count at home your power bill is gonna get $.
>
>
>
> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
> wrote:
> > True!
> >
> > I am thinking of either my (small) office, or actually hosting for under
> $500/month.
> >
> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
> wrote:
> >>
> >> You will also be raided by the DEA- too much power for a residence.
> >>
> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
> >>
> >>
> >>
> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
> michael_segel@hotmail.com> wrote:
> >>>
> >>> While Ted ignores that the world is going to end before X-Mas, he does
> hit the crux of the matter head on.
> >>> If you don't have a place to put it, the cost of setting it up would
> kill you, not to mention that you can get newer hardware which is better
> suited for less.
> >>> Having said that... if you live in the frozen tundra like Montana, or
> some place like ... er Canada or Siberia... , it may make more sense to use
> it to heat your home with it.
> >>> Just think of the side benefits from all that potential additional
> compute power....  :-P
> >>
> >> I can say from experience that the sound of a bunch of servers in a
> home setting is a novel one that is probably unlike anything you have known
> before.
> >> If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
> >
> >
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Edward, thank you for the practical recommendations. I am going to visit
the cluster in its current home in a few days, and I will keep this in
mind. Meanwhile, my specs are below

48 HP 1U blades, each has two 2.44 GHz. Dual core AMD Opterons with Cisco
Infiniband NICs, 4GB RAM

1 HP cluster controller with SCSI controller

1 HP RSA20 storage array with approx 1Tb of storage

Cisco Infiniband 20Gbit optical network router

In Compaq racks with four 30 amp 220 volt circuits

All wiring and cabling.

I am worried about 4 GB RAM on data nodes not being enough. Upgrading the
master nodes is bearable, but any memory upgrade on the complete cluster
will sure cost, when multiplied by 50.

Thank you. Sincerely,
Mark

On Fri, Dec 21, 2012 at 5:50 PM, Edward Capriolo <ed...@gmail.com>wrote:

> Three year old blade center is ok. A three year old blade is probably a 64
> bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
> blade centers is about 8u or a quarter cabinet and you can find a hosting
> provider in your price range.
>
> Especially if you can get the hardware at a low initial cost you crush the
> cloud providers. Buying your own gear takes about a year to recoup costs
> over amazons pay per use model.
>
> Blade centers are usually 20 to 30 amp fully loaded though so if your
> crushing word count at home your power bill is gonna get $.
>
>
>
> On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com>
> wrote:
> > True!
> >
> > I am thinking of either my (small) office, or actually hosting for under
> $500/month.
> >
> > On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com>
> wrote:
> >>
> >> You will also be raided by the DEA- too much power for a residence.
> >>
> >> On 12/20/2012 07:56 AM, Ted Dunning wrote:
> >>
> >>
> >>
> >> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <
> michael_segel@hotmail.com> wrote:
> >>>
> >>> While Ted ignores that the world is going to end before X-Mas, he does
> hit the crux of the matter head on.
> >>> If you don't have a place to put it, the cost of setting it up would
> kill you, not to mention that you can get newer hardware which is better
> suited for less.
> >>> Having said that... if you live in the frozen tundra like Montana, or
> some place like ... er Canada or Siberia... , it may make more sense to use
> it to heat your home with it.
> >>> Just think of the side benefits from all that potential additional
> compute power....  :-P
> >>
> >> I can say from experience that the sound of a bunch of servers in a
> home setting is a novel one that is probably unlike anything you have known
> before.
> >> If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
> >
> >
>

Re: What should I do with a 48-node cluster

[Edward Capriolo <ed...@gmail.com>]

Three year old blade center is ok. A three year old blade is probably a 64
bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
blade centers is about 8u or a quarter cabinet and you can find a hosting
provider in your price range.

Especially if you can get the hardware at a low initial cost you crush the
cloud providers. Buying your own gear takes about a year to recoup costs
over amazons pay per use model.

Blade centers are usually 20 to 30 amp fully loaded though so if your
crushing word count at home your power bill is gonna get $.


On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com> wrote:
> True!
>
> I am thinking of either my (small) office, or actually hosting for under
$500/month.
>
> On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:
>>
>> You will also be raided by the DEA- too much power for a residence.
>>
>> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>
>>
>>
>> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>
wrote:
>>>
>>> While Ted ignores that the world is going to end before X-Mas, he does
hit the crux of the matter head on.
>>> If you don't have a place to put it, the cost of setting it up would
kill you, not to mention that you can get newer hardware which is better
suited for less.
>>> Having said that... if you live in the frozen tundra like Montana, or
some place like ... er Canada or Siberia... , it may make more sense to use
it to heat your home with it.
>>> Just think of the side benefits from all that potential additional
compute power....  :-P
>>
>> I can say from experience that the sound of a bunch of servers in a home
setting is a novel one that is probably unlike anything you have known
before.
>> If you haven't experienced that, then taking on these servers could be
classified as novelty seeking behavior.
>
>

Re: What should I do with a 48-node cluster

[Edward Capriolo <ed...@gmail.com>]

Three year old blade center is ok. A three year old blade is probably a 64
bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
blade centers is about 8u or a quarter cabinet and you can find a hosting
provider in your price range.

Especially if you can get the hardware at a low initial cost you crush the
cloud providers. Buying your own gear takes about a year to recoup costs
over amazons pay per use model.

Blade centers are usually 20 to 30 amp fully loaded though so if your
crushing word count at home your power bill is gonna get $.


On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com> wrote:
> True!
>
> I am thinking of either my (small) office, or actually hosting for under
$500/month.
>
> On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:
>>
>> You will also be raided by the DEA- too much power for a residence.
>>
>> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>
>>
>>
>> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>
wrote:
>>>
>>> While Ted ignores that the world is going to end before X-Mas, he does
hit the crux of the matter head on.
>>> If you don't have a place to put it, the cost of setting it up would
kill you, not to mention that you can get newer hardware which is better
suited for less.
>>> Having said that... if you live in the frozen tundra like Montana, or
some place like ... er Canada or Siberia... , it may make more sense to use
it to heat your home with it.
>>> Just think of the side benefits from all that potential additional
compute power....  :-P
>>
>> I can say from experience that the sound of a bunch of servers in a home
setting is a novel one that is probably unlike anything you have known
before.
>> If you haven't experienced that, then taking on these servers could be
classified as novelty seeking behavior.
>
>

Re: What should I do with a 48-node cluster

[Edward Capriolo <ed...@gmail.com>]

Three year old blade center is ok. A three year old blade is probably a 64
bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
blade centers is about 8u or a quarter cabinet and you can find a hosting
provider in your price range.

Especially if you can get the hardware at a low initial cost you crush the
cloud providers. Buying your own gear takes about a year to recoup costs
over amazons pay per use model.

Blade centers are usually 20 to 30 amp fully loaded though so if your
crushing word count at home your power bill is gonna get $.


On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com> wrote:
> True!
>
> I am thinking of either my (small) office, or actually hosting for under
$500/month.
>
> On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:
>>
>> You will also be raided by the DEA- too much power for a residence.
>>
>> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>
>>
>>
>> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>
wrote:
>>>
>>> While Ted ignores that the world is going to end before X-Mas, he does
hit the crux of the matter head on.
>>> If you don't have a place to put it, the cost of setting it up would
kill you, not to mention that you can get newer hardware which is better
suited for less.
>>> Having said that... if you live in the frozen tundra like Montana, or
some place like ... er Canada or Siberia... , it may make more sense to use
it to heat your home with it.
>>> Just think of the side benefits from all that potential additional
compute power....  :-P
>>
>> I can say from experience that the sound of a bunch of servers in a home
setting is a novel one that is probably unlike anything you have known
before.
>> If you haven't experienced that, then taking on these servers could be
classified as novelty seeking behavior.
>
>

Re: What should I do with a 48-node cluster

[Edward Capriolo <ed...@gmail.com>]

Three year old blade center is ok. A three year old blade is probably a 64
bit machine. 2 to 4 gb RAM 2 SCSI disks. Maybe two socket two core. Two
blade centers is about 8u or a quarter cabinet and you can find a hosting
provider in your price range.

Especially if you can get the hardware at a low initial cost you crush the
cloud providers. Buying your own gear takes about a year to recoup costs
over amazons pay per use model.

Blade centers are usually 20 to 30 amp fully loaded though so if your
crushing word count at home your power bill is gonna get $.


On Friday, December 21, 2012, Mark Kerzner <ma...@shmsoft.com> wrote:
> True!
>
> I am thinking of either my (small) office, or actually hosting for under
$500/month.
>
> On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:
>>
>> You will also be raided by the DEA- too much power for a residence.
>>
>> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>>
>>
>>
>> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>
wrote:
>>>
>>> While Ted ignores that the world is going to end before X-Mas, he does
hit the crux of the matter head on.
>>> If you don't have a place to put it, the cost of setting it up would
kill you, not to mention that you can get newer hardware which is better
suited for less.
>>> Having said that... if you live in the frozen tundra like Montana, or
some place like ... er Canada or Siberia... , it may make more sense to use
it to heat your home with it.
>>> Just think of the side benefits from all that potential additional
compute power....  :-P
>>
>> I can say from experience that the sound of a bunch of servers in a home
setting is a novel one that is probably unlike anything you have known
before.
>> If you haven't experienced that, then taking on these servers could be
classified as novelty seeking behavior.
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

True!

I am thinking of either my (small) office, or actually hosting for under
$500/month.

On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

>  You will also be raided by the DEA- too much power for a residence.
>
>
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
>> While Ted ignores that the world is going to end before X-Mas, he does
>> hit the crux of the matter head on.
>>
>>  If you don't have a place to put it, the cost of setting it up would
>> kill you, not to mention that you can get newer hardware which is better
>> suited for less.
>>
>>  Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>>
>
>
>  I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
>  If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Jay,

my "nature" is Houston, TX, they will argue about who can "cool" whom :)

I am thinking of $500/month rack hosting.

Mark

On Sat, Dec 22, 2012 at 2:12 PM, Jay <ss...@yahoo.com> wrote:

> You can let nature cool it. I have mine behind the garage
> http://sphotos-b.xx.fbcdn.net/hphotos-snc7/463386_10151293008003232_1882563907_o.jpg
>
>   ------------------------------
> *From:* Michael Segel <mi...@hotmail.com>
> *To:* user@hadoop.apache.org
> *Sent:* Saturday, December 22, 2012 8:01 AM
>
> *Subject:* Re: What should I do with a 48-node cluster
>
> Uhm... not exactly.
>
> Power consumption is only part of it. ;-)
> Power consumption by itself is not enough to establish probable cause.
> If that were the case, there would be a lot of raids around the Xmas
> holidays ... ;-)
>
> Now don't ask me how I know this.... ;-P
>
> Having run a rack out of my second bedroom in an apartment for ~8-10
> years, I can tell you that yes, its noisy, it does heat the place, and that
> thanks to Moore's law, I was able to consolidate everything to a single 2
> CPU 8 core Xeon box 2+ years ago.
>
> Personally, I'd suggest that if you do take the equipment, that you
> consider how you plan to dispose of the hardware.  You can't just chuck it
> in to the trash anymore. (If you still have a Best Buy near you, they do
> recycle...)  Also think about the power requirements. You need to make sure
> you have a couple of circuits, some power conditioners, battery backup...
> etc ...   I was only running 8 nodes.  So YMMV.
>
>
> On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:
>
>  You will also be raided by the DEA- too much power for a residence.
>
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
> While Ted ignores that the world is going to end before X-Mas, he does hit
> the crux of the matter head on.
>
>  If you don't have a place to put it, the cost of setting it up would
> kill you, not to mention that you can get newer hardware which is better
> suited for less.
>
>  Having said that... if you live in the frozen tundra like Montana, or
> some place like ... er Canada or Siberia... , it may make more sense to use
> it to heat your home with it.
> Just think of the side benefits from all that potential additional compute
> power....  :-P
>
>
>
>  I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
>  If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>
>
>
>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Jay,

my "nature" is Houston, TX, they will argue about who can "cool" whom :)

I am thinking of $500/month rack hosting.

Mark

On Sat, Dec 22, 2012 at 2:12 PM, Jay <ss...@yahoo.com> wrote:

> You can let nature cool it. I have mine behind the garage
> http://sphotos-b.xx.fbcdn.net/hphotos-snc7/463386_10151293008003232_1882563907_o.jpg
>
>   ------------------------------
> *From:* Michael Segel <mi...@hotmail.com>
> *To:* user@hadoop.apache.org
> *Sent:* Saturday, December 22, 2012 8:01 AM
>
> *Subject:* Re: What should I do with a 48-node cluster
>
> Uhm... not exactly.
>
> Power consumption is only part of it. ;-)
> Power consumption by itself is not enough to establish probable cause.
> If that were the case, there would be a lot of raids around the Xmas
> holidays ... ;-)
>
> Now don't ask me how I know this.... ;-P
>
> Having run a rack out of my second bedroom in an apartment for ~8-10
> years, I can tell you that yes, its noisy, it does heat the place, and that
> thanks to Moore's law, I was able to consolidate everything to a single 2
> CPU 8 core Xeon box 2+ years ago.
>
> Personally, I'd suggest that if you do take the equipment, that you
> consider how you plan to dispose of the hardware.  You can't just chuck it
> in to the trash anymore. (If you still have a Best Buy near you, they do
> recycle...)  Also think about the power requirements. You need to make sure
> you have a couple of circuits, some power conditioners, battery backup...
> etc ...   I was only running 8 nodes.  So YMMV.
>
>
> On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:
>
>  You will also be raided by the DEA- too much power for a residence.
>
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
> While Ted ignores that the world is going to end before X-Mas, he does hit
> the crux of the matter head on.
>
>  If you don't have a place to put it, the cost of setting it up would
> kill you, not to mention that you can get newer hardware which is better
> suited for less.
>
>  Having said that... if you live in the frozen tundra like Montana, or
> some place like ... er Canada or Siberia... , it may make more sense to use
> it to heat your home with it.
> Just think of the side benefits from all that potential additional compute
> power....  :-P
>
>
>
>  I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
>  If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>
>
>
>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Jay,

my "nature" is Houston, TX, they will argue about who can "cool" whom :)

I am thinking of $500/month rack hosting.

Mark

On Sat, Dec 22, 2012 at 2:12 PM, Jay <ss...@yahoo.com> wrote:

> You can let nature cool it. I have mine behind the garage
> http://sphotos-b.xx.fbcdn.net/hphotos-snc7/463386_10151293008003232_1882563907_o.jpg
>
>   ------------------------------
> *From:* Michael Segel <mi...@hotmail.com>
> *To:* user@hadoop.apache.org
> *Sent:* Saturday, December 22, 2012 8:01 AM
>
> *Subject:* Re: What should I do with a 48-node cluster
>
> Uhm... not exactly.
>
> Power consumption is only part of it. ;-)
> Power consumption by itself is not enough to establish probable cause.
> If that were the case, there would be a lot of raids around the Xmas
> holidays ... ;-)
>
> Now don't ask me how I know this.... ;-P
>
> Having run a rack out of my second bedroom in an apartment for ~8-10
> years, I can tell you that yes, its noisy, it does heat the place, and that
> thanks to Moore's law, I was able to consolidate everything to a single 2
> CPU 8 core Xeon box 2+ years ago.
>
> Personally, I'd suggest that if you do take the equipment, that you
> consider how you plan to dispose of the hardware.  You can't just chuck it
> in to the trash anymore. (If you still have a Best Buy near you, they do
> recycle...)  Also think about the power requirements. You need to make sure
> you have a couple of circuits, some power conditioners, battery backup...
> etc ...   I was only running 8 nodes.  So YMMV.
>
>
> On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:
>
>  You will also be raided by the DEA- too much power for a residence.
>
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
> While Ted ignores that the world is going to end before X-Mas, he does hit
> the crux of the matter head on.
>
>  If you don't have a place to put it, the cost of setting it up would
> kill you, not to mention that you can get newer hardware which is better
> suited for less.
>
>  Having said that... if you live in the frozen tundra like Montana, or
> some place like ... er Canada or Siberia... , it may make more sense to use
> it to heat your home with it.
> Just think of the side benefits from all that potential additional compute
> power....  :-P
>
>
>
>  I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
>  If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>
>
>
>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Jay,

my "nature" is Houston, TX, they will argue about who can "cool" whom :)

I am thinking of $500/month rack hosting.

Mark

On Sat, Dec 22, 2012 at 2:12 PM, Jay <ss...@yahoo.com> wrote:

> You can let nature cool it. I have mine behind the garage
> http://sphotos-b.xx.fbcdn.net/hphotos-snc7/463386_10151293008003232_1882563907_o.jpg
>
>   ------------------------------
> *From:* Michael Segel <mi...@hotmail.com>
> *To:* user@hadoop.apache.org
> *Sent:* Saturday, December 22, 2012 8:01 AM
>
> *Subject:* Re: What should I do with a 48-node cluster
>
> Uhm... not exactly.
>
> Power consumption is only part of it. ;-)
> Power consumption by itself is not enough to establish probable cause.
> If that were the case, there would be a lot of raids around the Xmas
> holidays ... ;-)
>
> Now don't ask me how I know this.... ;-P
>
> Having run a rack out of my second bedroom in an apartment for ~8-10
> years, I can tell you that yes, its noisy, it does heat the place, and that
> thanks to Moore's law, I was able to consolidate everything to a single 2
> CPU 8 core Xeon box 2+ years ago.
>
> Personally, I'd suggest that if you do take the equipment, that you
> consider how you plan to dispose of the hardware.  You can't just chuck it
> in to the trash anymore. (If you still have a Best Buy near you, they do
> recycle...)  Also think about the power requirements. You need to make sure
> you have a couple of circuits, some power conditioners, battery backup...
> etc ...   I was only running 8 nodes.  So YMMV.
>
>
> On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:
>
>  You will also be raided by the DEA- too much power for a residence.
>
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
> While Ted ignores that the world is going to end before X-Mas, he does hit
> the crux of the matter head on.
>
>  If you don't have a place to put it, the cost of setting it up would
> kill you, not to mention that you can get newer hardware which is better
> suited for less.
>
>  Having said that... if you live in the frozen tundra like Montana, or
> some place like ... er Canada or Siberia... , it may make more sense to use
> it to heat your home with it.
> Just think of the side benefits from all that potential additional compute
> power....  :-P
>
>
>
>  I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
>  If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>
>
>
>
>
>

Re: What should I do with a 48-node cluster

[Jay <ss...@yahoo.com>]

You can let nature cool it. I have mine behind the garage http://sphotos-b.xx.fbcdn.net/hphotos-snc7/463386_10151293008003232_1882563907_o.jpg


________________________________
 From: Michael Segel <mi...@hotmail.com>
To: user@hadoop.apache.org 
Sent: Saturday, December 22, 2012 8:01 AM
Subject: Re: What should I do with a 48-node cluster
 

Uhm... not exactly. 

Power consumption is only part of it. ;-) 
Power consumption by itself is not enough to establish probable cause. 
If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) 

Now don't ask me how I know this.... ;-P

Having run a rack out of my second bedroom in an apartment for ~8-10 years, I can tell you that yes, its noisy, it does heat the place, and that thanks to Moore's law, I was able to consolidate everything to a single 2 CPU 8 core Xeon box 2+ years ago. 

Personally, I'd suggest that if you do take the equipment, that you consider how you plan to dispose of the hardware.  You can't just chuck it in to the trash anymore. (If you still have a Best Buy near you, they do recycle...)  Also think about the power requirements. You need to make sure you have a couple of circuits, some power conditioners, battery backup... etc ...   I was only running 8 nodes.  So YMMV. 



On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

You will also be raided by the DEA- too much power for a residence.
>
>On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>>
>>
>>
>>
>>On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com> wrote:
>>
>>While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on.  
>>>
>>>
>>>If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 
>>>
>>>
>>>Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
>>>Just think of the side benefits from all that potential additional compute power....  :-P
>>
>>
>>
>>
>>I can say from experience that the sound of a bunch of servers in a home setting is a novel one that is probably unlike anything you have known before.
>>
>>
>>If you haven't experienced that, then taking on these servers could be classified as novelty seeking behavior.
>

Re: What should I do with a 48-node cluster

[Jay <ss...@yahoo.com>]

You can let nature cool it. I have mine behind the garage http://sphotos-b.xx.fbcdn.net/hphotos-snc7/463386_10151293008003232_1882563907_o.jpg


________________________________
 From: Michael Segel <mi...@hotmail.com>
To: user@hadoop.apache.org 
Sent: Saturday, December 22, 2012 8:01 AM
Subject: Re: What should I do with a 48-node cluster
 

Uhm... not exactly. 

Power consumption is only part of it. ;-) 
Power consumption by itself is not enough to establish probable cause. 
If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) 

Now don't ask me how I know this.... ;-P

Having run a rack out of my second bedroom in an apartment for ~8-10 years, I can tell you that yes, its noisy, it does heat the place, and that thanks to Moore's law, I was able to consolidate everything to a single 2 CPU 8 core Xeon box 2+ years ago. 

Personally, I'd suggest that if you do take the equipment, that you consider how you plan to dispose of the hardware.  You can't just chuck it in to the trash anymore. (If you still have a Best Buy near you, they do recycle...)  Also think about the power requirements. You need to make sure you have a couple of circuits, some power conditioners, battery backup... etc ...   I was only running 8 nodes.  So YMMV. 



On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

You will also be raided by the DEA- too much power for a residence.
>
>On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>>
>>
>>
>>
>>On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com> wrote:
>>
>>While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on.  
>>>
>>>
>>>If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 
>>>
>>>
>>>Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
>>>Just think of the side benefits from all that potential additional compute power....  :-P
>>
>>
>>
>>
>>I can say from experience that the sound of a bunch of servers in a home setting is a novel one that is probably unlike anything you have known before.
>>
>>
>>If you haven't experienced that, then taking on these servers could be classified as novelty seeking behavior.
>

Re: What should I do with a 48-node cluster

[Jay <ss...@yahoo.com>]

You can let nature cool it. I have mine behind the garage http://sphotos-b.xx.fbcdn.net/hphotos-snc7/463386_10151293008003232_1882563907_o.jpg


________________________________
 From: Michael Segel <mi...@hotmail.com>
To: user@hadoop.apache.org 
Sent: Saturday, December 22, 2012 8:01 AM
Subject: Re: What should I do with a 48-node cluster
 

Uhm... not exactly. 

Power consumption is only part of it. ;-) 
Power consumption by itself is not enough to establish probable cause. 
If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) 

Now don't ask me how I know this.... ;-P

Having run a rack out of my second bedroom in an apartment for ~8-10 years, I can tell you that yes, its noisy, it does heat the place, and that thanks to Moore's law, I was able to consolidate everything to a single 2 CPU 8 core Xeon box 2+ years ago. 

Personally, I'd suggest that if you do take the equipment, that you consider how you plan to dispose of the hardware.  You can't just chuck it in to the trash anymore. (If you still have a Best Buy near you, they do recycle...)  Also think about the power requirements. You need to make sure you have a couple of circuits, some power conditioners, battery backup... etc ...   I was only running 8 nodes.  So YMMV. 



On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

You will also be raided by the DEA- too much power for a residence.
>
>On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>>
>>
>>
>>
>>On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com> wrote:
>>
>>While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on.  
>>>
>>>
>>>If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 
>>>
>>>
>>>Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
>>>Just think of the side benefits from all that potential additional compute power....  :-P
>>
>>
>>
>>
>>I can say from experience that the sound of a bunch of servers in a home setting is a novel one that is probably unlike anything you have known before.
>>
>>
>>If you haven't experienced that, then taking on these servers could be classified as novelty seeking behavior.
>

Re: What should I do with a 48-node cluster

[Jay <ss...@yahoo.com>]

You can let nature cool it. I have mine behind the garage http://sphotos-b.xx.fbcdn.net/hphotos-snc7/463386_10151293008003232_1882563907_o.jpg


________________________________
 From: Michael Segel <mi...@hotmail.com>
To: user@hadoop.apache.org 
Sent: Saturday, December 22, 2012 8:01 AM
Subject: Re: What should I do with a 48-node cluster
 

Uhm... not exactly. 

Power consumption is only part of it. ;-) 
Power consumption by itself is not enough to establish probable cause. 
If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) 

Now don't ask me how I know this.... ;-P

Having run a rack out of my second bedroom in an apartment for ~8-10 years, I can tell you that yes, its noisy, it does heat the place, and that thanks to Moore's law, I was able to consolidate everything to a single 2 CPU 8 core Xeon box 2+ years ago. 

Personally, I'd suggest that if you do take the equipment, that you consider how you plan to dispose of the hardware.  You can't just chuck it in to the trash anymore. (If you still have a Best Buy near you, they do recycle...)  Also think about the power requirements. You need to make sure you have a couple of circuits, some power conditioners, battery backup... etc ...   I was only running 8 nodes.  So YMMV. 



On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

You will also be raided by the DEA- too much power for a residence.
>
>On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>>
>>
>>
>>
>>On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com> wrote:
>>
>>While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on.  
>>>
>>>
>>>If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 
>>>
>>>
>>>Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
>>>Just think of the side benefits from all that potential additional compute power....  :-P
>>
>>
>>
>>
>>I can say from experience that the sound of a bunch of servers in a home setting is a novel one that is probably unlike anything you have known before.
>>
>>
>>If you haven't experienced that, then taking on these servers could be classified as novelty seeking behavior.
>

Re: What should I do with a 48-node cluster

[Michael Segel <mi...@hotmail.com>]

Uhm... not exactly. 

Power consumption is only part of it. ;-) 
Power consumption by itself is not enough to establish probable cause. 
If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) 

Now don't ask me how I know this.... ;-P

Having run a rack out of my second bedroom in an apartment for ~8-10 years, I can tell you that yes, its noisy, it does heat the place, and that thanks to Moore's law, I was able to consolidate everything to a single 2 CPU 8 core Xeon box 2+ years ago. 

Personally, I'd suggest that if you do take the equipment, that you consider how you plan to dispose of the hardware.  You can't just chuck it in to the trash anymore. (If you still have a Best Buy near you, they do recycle...)  Also think about the power requirements. You need to make sure you have a couple of circuits, some power conditioners, battery backup... etc ...   I was only running 8 nodes.  So YMMV. 


On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

> You will also be raided by the DEA- too much power for a residence.
> 
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>> 
>> 
>> 
>> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com> wrote:
>> While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. 
>> 
>> If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 
>> 
>> Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
>> Just think of the side benefits from all that potential additional compute power....  :-P
>> 
>> 
>> I can say from experience that the sound of a bunch of servers in a home setting is a novel one that is probably unlike anything you have known before.
>> 
>> If you haven't experienced that, then taking on these servers could be classified as novelty seeking behavior.
> 

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

True!

I am thinking of either my (small) office, or actually hosting for under
$500/month.

On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

>  You will also be raided by the DEA- too much power for a residence.
>
>
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
>> While Ted ignores that the world is going to end before X-Mas, he does
>> hit the crux of the matter head on.
>>
>>  If you don't have a place to put it, the cost of setting it up would
>> kill you, not to mention that you can get newer hardware which is better
>> suited for less.
>>
>>  Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>>
>
>
>  I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
>  If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>
>
>

Re: What should I do with a 48-node cluster

[Michael Segel <mi...@hotmail.com>]

Uhm... not exactly. 

Power consumption is only part of it. ;-) 
Power consumption by itself is not enough to establish probable cause. 
If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) 

Now don't ask me how I know this.... ;-P

Having run a rack out of my second bedroom in an apartment for ~8-10 years, I can tell you that yes, its noisy, it does heat the place, and that thanks to Moore's law, I was able to consolidate everything to a single 2 CPU 8 core Xeon box 2+ years ago. 

Personally, I'd suggest that if you do take the equipment, that you consider how you plan to dispose of the hardware.  You can't just chuck it in to the trash anymore. (If you still have a Best Buy near you, they do recycle...)  Also think about the power requirements. You need to make sure you have a couple of circuits, some power conditioners, battery backup... etc ...   I was only running 8 nodes.  So YMMV. 


On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

> You will also be raided by the DEA- too much power for a residence.
> 
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>> 
>> 
>> 
>> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com> wrote:
>> While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. 
>> 
>> If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 
>> 
>> Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
>> Just think of the side benefits from all that potential additional compute power....  :-P
>> 
>> 
>> I can say from experience that the sound of a bunch of servers in a home setting is a novel one that is probably unlike anything you have known before.
>> 
>> If you haven't experienced that, then taking on these servers could be classified as novelty seeking behavior.
> 

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

True!

I am thinking of either my (small) office, or actually hosting for under
$500/month.

On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

>  You will also be raided by the DEA- too much power for a residence.
>
>
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
>> While Ted ignores that the world is going to end before X-Mas, he does
>> hit the crux of the matter head on.
>>
>>  If you don't have a place to put it, the cost of setting it up would
>> kill you, not to mention that you can get newer hardware which is better
>> suited for less.
>>
>>  Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>>
>
>
>  I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
>  If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

True!

I am thinking of either my (small) office, or actually hosting for under
$500/month.

On Fri, Dec 21, 2012 at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

>  You will also be raided by the DEA- too much power for a residence.
>
>
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
>> While Ted ignores that the world is going to end before X-Mas, he does
>> hit the crux of the matter head on.
>>
>>  If you don't have a place to put it, the cost of setting it up would
>> kill you, not to mention that you can get newer hardware which is better
>> suited for less.
>>
>>  Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>>
>
>
>  I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
>  If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>
>
>

Re: What should I do with a 48-node cluster

[Michael Segel <mi...@hotmail.com>]

Uhm... not exactly. 

Power consumption is only part of it. ;-) 
Power consumption by itself is not enough to establish probable cause. 
If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) 

Now don't ask me how I know this.... ;-P

Having run a rack out of my second bedroom in an apartment for ~8-10 years, I can tell you that yes, its noisy, it does heat the place, and that thanks to Moore's law, I was able to consolidate everything to a single 2 CPU 8 core Xeon box 2+ years ago. 

Personally, I'd suggest that if you do take the equipment, that you consider how you plan to dispose of the hardware.  You can't just chuck it in to the trash anymore. (If you still have a Best Buy near you, they do recycle...)  Also think about the power requirements. You need to make sure you have a couple of circuits, some power conditioners, battery backup... etc ...   I was only running 8 nodes.  So YMMV. 


On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

> You will also be raided by the DEA- too much power for a residence.
> 
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>> 
>> 
>> 
>> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com> wrote:
>> While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. 
>> 
>> If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 
>> 
>> Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
>> Just think of the side benefits from all that potential additional compute power....  :-P
>> 
>> 
>> I can say from experience that the sound of a bunch of servers in a home setting is a novel one that is probably unlike anything you have known before.
>> 
>> If you haven't experienced that, then taking on these servers could be classified as novelty seeking behavior.
> 

Re: What should I do with a 48-node cluster

[Michael Segel <mi...@hotmail.com>]

Uhm... not exactly. 

Power consumption is only part of it. ;-) 
Power consumption by itself is not enough to establish probable cause. 
If that were the case, there would be a lot of raids around the Xmas holidays ... ;-) 

Now don't ask me how I know this.... ;-P

Having run a rack out of my second bedroom in an apartment for ~8-10 years, I can tell you that yes, its noisy, it does heat the place, and that thanks to Moore's law, I was able to consolidate everything to a single 2 CPU 8 core Xeon box 2+ years ago. 

Personally, I'd suggest that if you do take the equipment, that you consider how you plan to dispose of the hardware.  You can't just chuck it in to the trash anymore. (If you still have a Best Buy near you, they do recycle...)  Also think about the power requirements. You need to make sure you have a couple of circuits, some power conditioners, battery backup... etc ...   I was only running 8 nodes.  So YMMV. 


On Dec 21, 2012, at 1:37 PM, Lance Norskog <go...@gmail.com> wrote:

> You will also be raided by the DEA- too much power for a residence.
> 
> On 12/20/2012 07:56 AM, Ted Dunning wrote:
>> 
>> 
>> 
>> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com> wrote:
>> While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. 
>> 
>> If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 
>> 
>> Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
>> Just think of the side benefits from all that potential additional compute power....  :-P
>> 
>> 
>> I can say from experience that the sound of a bunch of servers in a home setting is a novel one that is probably unlike anything you have known before.
>> 
>> If you haven't experienced that, then taking on these servers could be classified as novelty seeking behavior.
> 

Re: What should I do with a 48-node cluster

[Lance Norskog <go...@gmail.com>]

You will also be raided by the DEA- too much power for a residence.

On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel 
> <michael_segel@hotmail.com <ma...@hotmail.com>> wrote:
>
>     While Ted ignores that the world is going to end before X-Mas, he
>     does hit the crux of the matter head on.
>
>     If you don't have a place to put it, the cost of setting it up
>     would kill you, not to mention that you can get newer hardware
>     which is better suited for less.
>
>     Having said that... if you live in the frozen tundra like Montana,
>     or some place like ... er Canada or Siberia... , it may make more
>     sense to use it to heat your home with it.
>     Just think of the side benefits from all that potential additional
>     compute power....  :-P
>
>
>
> I can say from experience that the sound of a bunch of servers in a 
> home setting is a novel one that is probably unlike anything you have 
> known before.
>
> If you haven't experienced that, then taking on these servers could be 
> classified as novelty seeking behavior.

Re: What should I do with a 48-node cluster

[Lance Norskog <go...@gmail.com>]

You will also be raided by the DEA- too much power for a residence.

On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel 
> <michael_segel@hotmail.com <ma...@hotmail.com>> wrote:
>
>     While Ted ignores that the world is going to end before X-Mas, he
>     does hit the crux of the matter head on.
>
>     If you don't have a place to put it, the cost of setting it up
>     would kill you, not to mention that you can get newer hardware
>     which is better suited for less.
>
>     Having said that... if you live in the frozen tundra like Montana,
>     or some place like ... er Canada or Siberia... , it may make more
>     sense to use it to heat your home with it.
>     Just think of the side benefits from all that potential additional
>     compute power....  :-P
>
>
>
> I can say from experience that the sound of a bunch of servers in a 
> home setting is a novel one that is probably unlike anything you have 
> known before.
>
> If you haven't experienced that, then taking on these servers could be 
> classified as novelty seeking behavior.

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

I had two servers at home, that's like a small airplane.

However, I have seen silent servers in a lab I am working in.

My price on that rack might be close to $0.

Then I could host a rack for $500/month. And if a machine breaks, I will
throw it away. So that makes for $ maintenance cost.

You see, I am still toying with the idea.

Thank you for everyone's answers.

Mark

On Thu, Dec 20, 2012 at 9:56 AM, Ted Dunning <td...@maprtech.com> wrote:

>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
>> While Ted ignores that the world is going to end before X-Mas, he does
>> hit the crux of the matter head on.
>>
>> If you don't have a place to put it, the cost of setting it up would kill
>> you, not to mention that you can get newer hardware which is better suited
>> for less.
>>
>> Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>>
>
>
> I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
> If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

I had two servers at home, that's like a small airplane.

However, I have seen silent servers in a lab I am working in.

My price on that rack might be close to $0.

Then I could host a rack for $500/month. And if a machine breaks, I will
throw it away. So that makes for $ maintenance cost.

You see, I am still toying with the idea.

Thank you for everyone's answers.

Mark

On Thu, Dec 20, 2012 at 9:56 AM, Ted Dunning <td...@maprtech.com> wrote:

>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
>> While Ted ignores that the world is going to end before X-Mas, he does
>> hit the crux of the matter head on.
>>
>> If you don't have a place to put it, the cost of setting it up would kill
>> you, not to mention that you can get newer hardware which is better suited
>> for less.
>>
>> Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>>
>
>
> I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
> If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>

Re: What should I do with a 48-node cluster

[Lance Norskog <go...@gmail.com>]

You will also be raided by the DEA- too much power for a residence.

On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel 
> <michael_segel@hotmail.com <ma...@hotmail.com>> wrote:
>
>     While Ted ignores that the world is going to end before X-Mas, he
>     does hit the crux of the matter head on.
>
>     If you don't have a place to put it, the cost of setting it up
>     would kill you, not to mention that you can get newer hardware
>     which is better suited for less.
>
>     Having said that... if you live in the frozen tundra like Montana,
>     or some place like ... er Canada or Siberia... , it may make more
>     sense to use it to heat your home with it.
>     Just think of the side benefits from all that potential additional
>     compute power....  :-P
>
>
>
> I can say from experience that the sound of a bunch of servers in a 
> home setting is a novel one that is probably unlike anything you have 
> known before.
>
> If you haven't experienced that, then taking on these servers could be 
> classified as novelty seeking behavior.

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

I had two servers at home, that's like a small airplane.

However, I have seen silent servers in a lab I am working in.

My price on that rack might be close to $0.

Then I could host a rack for $500/month. And if a machine breaks, I will
throw it away. So that makes for $ maintenance cost.

You see, I am still toying with the idea.

Thank you for everyone's answers.

Mark

On Thu, Dec 20, 2012 at 9:56 AM, Ted Dunning <td...@maprtech.com> wrote:

>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
>> While Ted ignores that the world is going to end before X-Mas, he does
>> hit the crux of the matter head on.
>>
>> If you don't have a place to put it, the cost of setting it up would kill
>> you, not to mention that you can get newer hardware which is better suited
>> for less.
>>
>> Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>>
>
>
> I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
> If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>

Re: What should I do with a 48-node cluster

[Lance Norskog <go...@gmail.com>]

You will also be raided by the DEA- too much power for a residence.

On 12/20/2012 07:56 AM, Ted Dunning wrote:
>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel 
> <michael_segel@hotmail.com <ma...@hotmail.com>> wrote:
>
>     While Ted ignores that the world is going to end before X-Mas, he
>     does hit the crux of the matter head on.
>
>     If you don't have a place to put it, the cost of setting it up
>     would kill you, not to mention that you can get newer hardware
>     which is better suited for less.
>
>     Having said that... if you live in the frozen tundra like Montana,
>     or some place like ... er Canada or Siberia... , it may make more
>     sense to use it to heat your home with it.
>     Just think of the side benefits from all that potential additional
>     compute power....  :-P
>
>
>
> I can say from experience that the sound of a bunch of servers in a 
> home setting is a novel one that is probably unlike anything you have 
> known before.
>
> If you haven't experienced that, then taking on these servers could be 
> classified as novelty seeking behavior.

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

I had two servers at home, that's like a small airplane.

However, I have seen silent servers in a lab I am working in.

My price on that rack might be close to $0.

Then I could host a rack for $500/month. And if a machine breaks, I will
throw it away. So that makes for $ maintenance cost.

You see, I am still toying with the idea.

Thank you for everyone's answers.

Mark

On Thu, Dec 20, 2012 at 9:56 AM, Ted Dunning <td...@maprtech.com> wrote:

>
>
>
> On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:
>
>> While Ted ignores that the world is going to end before X-Mas, he does
>> hit the crux of the matter head on.
>>
>> If you don't have a place to put it, the cost of setting it up would kill
>> you, not to mention that you can get newer hardware which is better suited
>> for less.
>>
>> Having said that... if you live in the frozen tundra like Montana, or
>> some place like ... er Canada or Siberia... , it may make more sense to use
>> it to heat your home with it.
>> Just think of the side benefits from all that potential additional
>> compute power....  :-P
>>
>
>
> I can say from experience that the sound of a bunch of servers in a home
> setting is a novel one that is probably unlike anything you have known
> before.
>
> If you haven't experienced that, then taking on these servers could be
> classified as novelty seeking behavior.
>

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:

> While Ted ignores that the world is going to end before X-Mas, he does hit
> the crux of the matter head on.
>
> If you don't have a place to put it, the cost of setting it up would kill
> you, not to mention that you can get newer hardware which is better suited
> for less.
>
> Having said that... if you live in the frozen tundra like Montana, or some
> place like ... er Canada or Siberia... , it may make more sense to use it
> to heat your home with it.
> Just think of the side benefits from all that potential additional compute
> power....  :-P
>


I can say from experience that the sound of a bunch of servers in a home
setting is a novel one that is probably unlike anything you have known
before.

If you haven't experienced that, then taking on these servers could be
classified as novelty seeking behavior.

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:

> While Ted ignores that the world is going to end before X-Mas, he does hit
> the crux of the matter head on.
>
> If you don't have a place to put it, the cost of setting it up would kill
> you, not to mention that you can get newer hardware which is better suited
> for less.
>
> Having said that... if you live in the frozen tundra like Montana, or some
> place like ... er Canada or Siberia... , it may make more sense to use it
> to heat your home with it.
> Just think of the side benefits from all that potential additional compute
> power....  :-P
>


I can say from experience that the sound of a bunch of servers in a home
setting is a novel one that is probably unlike anything you have known
before.

If you haven't experienced that, then taking on these servers could be
classified as novelty seeking behavior.

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:

> While Ted ignores that the world is going to end before X-Mas, he does hit
> the crux of the matter head on.
>
> If you don't have a place to put it, the cost of setting it up would kill
> you, not to mention that you can get newer hardware which is better suited
> for less.
>
> Having said that... if you live in the frozen tundra like Montana, or some
> place like ... er Canada or Siberia... , it may make more sense to use it
> to heat your home with it.
> Just think of the side benefits from all that potential additional compute
> power....  :-P
>


I can say from experience that the sound of a bunch of servers in a home
setting is a novel one that is probably unlike anything you have known
before.

If you haven't experienced that, then taking on these servers could be
classified as novelty seeking behavior.

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

On Thu, Dec 20, 2012 at 7:38 AM, Michael Segel <mi...@hotmail.com>wrote:

> While Ted ignores that the world is going to end before X-Mas, he does hit
> the crux of the matter head on.
>
> If you don't have a place to put it, the cost of setting it up would kill
> you, not to mention that you can get newer hardware which is better suited
> for less.
>
> Having said that... if you live in the frozen tundra like Montana, or some
> place like ... er Canada or Siberia... , it may make more sense to use it
> to heat your home with it.
> Just think of the side benefits from all that potential additional compute
> power....  :-P
>


I can say from experience that the sound of a bunch of servers in a home
setting is a novel one that is probably unlike anything you have known
before.

If you haven't experienced that, then taking on these servers could be
classified as novelty seeking behavior.

Re: What should I do with a 48-node cluster

[Michael Segel <mi...@hotmail.com>]

While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. 

If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 

Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
Just think of the side benefits from all that potential additional compute power....  :-P


On Dec 20, 2012, at 9:13 AM, Ted Dunning <td...@maprtech.com> wrote:

> 
> Depending on the node characteristics, these might actually not be all that much use.  Blades are usually designed assuming external storage like a SAN.  That means that they usually don't have much disk which makes them only OK for Hadoop work.
> 
> Also, what about the installation cost?  Do you have enough power and cooling to host these boxes?  The cost of ops could easily exceed the cost of the nodes in a short period of time.  Hardware is a deflationary asset as evidenced by the willingness of people to nearly give away old hardware.  Unfortunately, in many cases, the market price often really is a fair estimate of what it would take to get the same capacity in newer hardware.  
> 
> This hardware might be substantially under the market price.  That would be neat.  On the other hand, it sounds like this same throughput might be had with three 2U units with 12 drives and a single socket each.  The price on that is probably around $20K.  Is that a better or worse deal than you are getting?
> 
> 
> On Wed, Dec 19, 2012 at 7:17 PM, Mark Kerzner <ma...@shmsoft.com> wrote:
> Hi,
> 
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of decent blades, a few years old. Should I even thy to think of what to do with them, given that one can use dedicated servers and Amazon's EC2?
> 
> Thank you. Sincerely,
> Mark
> 

Re: What should I do with a 48-node cluster

[Michael Segel <mi...@hotmail.com>]

While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. 

If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 

Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
Just think of the side benefits from all that potential additional compute power....  :-P


On Dec 20, 2012, at 9:13 AM, Ted Dunning <td...@maprtech.com> wrote:

> 
> Depending on the node characteristics, these might actually not be all that much use.  Blades are usually designed assuming external storage like a SAN.  That means that they usually don't have much disk which makes them only OK for Hadoop work.
> 
> Also, what about the installation cost?  Do you have enough power and cooling to host these boxes?  The cost of ops could easily exceed the cost of the nodes in a short period of time.  Hardware is a deflationary asset as evidenced by the willingness of people to nearly give away old hardware.  Unfortunately, in many cases, the market price often really is a fair estimate of what it would take to get the same capacity in newer hardware.  
> 
> This hardware might be substantially under the market price.  That would be neat.  On the other hand, it sounds like this same throughput might be had with three 2U units with 12 drives and a single socket each.  The price on that is probably around $20K.  Is that a better or worse deal than you are getting?
> 
> 
> On Wed, Dec 19, 2012 at 7:17 PM, Mark Kerzner <ma...@shmsoft.com> wrote:
> Hi,
> 
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of decent blades, a few years old. Should I even thy to think of what to do with them, given that one can use dedicated servers and Amazon's EC2?
> 
> Thank you. Sincerely,
> Mark
> 

Re: What should I do with a 48-node cluster

[Michael Segel <mi...@hotmail.com>]

While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. 

If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 

Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
Just think of the side benefits from all that potential additional compute power....  :-P


On Dec 20, 2012, at 9:13 AM, Ted Dunning <td...@maprtech.com> wrote:

> 
> Depending on the node characteristics, these might actually not be all that much use.  Blades are usually designed assuming external storage like a SAN.  That means that they usually don't have much disk which makes them only OK for Hadoop work.
> 
> Also, what about the installation cost?  Do you have enough power and cooling to host these boxes?  The cost of ops could easily exceed the cost of the nodes in a short period of time.  Hardware is a deflationary asset as evidenced by the willingness of people to nearly give away old hardware.  Unfortunately, in many cases, the market price often really is a fair estimate of what it would take to get the same capacity in newer hardware.  
> 
> This hardware might be substantially under the market price.  That would be neat.  On the other hand, it sounds like this same throughput might be had with three 2U units with 12 drives and a single socket each.  The price on that is probably around $20K.  Is that a better or worse deal than you are getting?
> 
> 
> On Wed, Dec 19, 2012 at 7:17 PM, Mark Kerzner <ma...@shmsoft.com> wrote:
> Hi,
> 
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of decent blades, a few years old. Should I even thy to think of what to do with them, given that one can use dedicated servers and Amazon's EC2?
> 
> Thank you. Sincerely,
> Mark
> 

Re: What should I do with a 48-node cluster

[Michael Segel <mi...@hotmail.com>]

While Ted ignores that the world is going to end before X-Mas, he does hit the crux of the matter head on. 

If you don't have a place to put it, the cost of setting it up would kill you, not to mention that you can get newer hardware which is better suited for less. 

Having said that... if you live in the frozen tundra like Montana, or some place like ... er Canada or Siberia... , it may make more sense to use it to heat your home with it. 
Just think of the side benefits from all that potential additional compute power....  :-P


On Dec 20, 2012, at 9:13 AM, Ted Dunning <td...@maprtech.com> wrote:

> 
> Depending on the node characteristics, these might actually not be all that much use.  Blades are usually designed assuming external storage like a SAN.  That means that they usually don't have much disk which makes them only OK for Hadoop work.
> 
> Also, what about the installation cost?  Do you have enough power and cooling to host these boxes?  The cost of ops could easily exceed the cost of the nodes in a short period of time.  Hardware is a deflationary asset as evidenced by the willingness of people to nearly give away old hardware.  Unfortunately, in many cases, the market price often really is a fair estimate of what it would take to get the same capacity in newer hardware.  
> 
> This hardware might be substantially under the market price.  That would be neat.  On the other hand, it sounds like this same throughput might be had with three 2U units with 12 drives and a single socket each.  The price on that is probably around $20K.  Is that a better or worse deal than you are getting?
> 
> 
> On Wed, Dec 19, 2012 at 7:17 PM, Mark Kerzner <ma...@shmsoft.com> wrote:
> Hi,
> 
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of decent blades, a few years old. Should I even thy to think of what to do with them, given that one can use dedicated servers and Amazon's EC2?
> 
> Thank you. Sincerely,
> Mark
> 

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

Depending on the node characteristics, these might actually not be all that
much use.  Blades are usually designed assuming external storage like a
SAN.  That means that they usually don't have much disk which makes them
only OK for Hadoop work.

Also, what about the installation cost?  Do you have enough power and
cooling to host these boxes?  The cost of ops could easily exceed the cost
of the nodes in a short period of time.  Hardware is a deflationary asset
as evidenced by the willingness of people to nearly give away old hardware.
 Unfortunately, in many cases, the market price often really is a fair
estimate of what it would take to get the same capacity in newer hardware.

This hardware might be substantially under the market price.  That would be
neat.  On the other hand, it sounds like this same throughput might be had
with three 2U units with 12 drives and a single socket each.  The price on
that is probably around $20K.  Is that a better or worse deal than you are
getting?


On Wed, Dec 19, 2012 at 7:17 PM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Hi,
>
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
> of decent blades, a few years old. Should I even thy to think of what to do
> with them, given that one can use dedicated servers and Amazon's EC2?
>
> Thank you. Sincerely,
> Mark
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

I am toying with exactly that idea. My startup does Hadoop eDiscovery, only
we usually do it on EC2. Getting down to earth is exciting but worrying.

Mark

On Wed, Dec 19, 2012 at 9:32 PM, Mapred Learn <ma...@gmail.com>wrote:

> What about investing this cluster in a startup if u hv some awesomeideas :)
> Who knows how much you might gain over next few years :)
>
> Sent from my iPhone
>
> On Dec 19, 2012, at 7:29 PM, Mark Kerzner <ma...@shmsoft.com>
> wrote:
>
> Sure, I love hardware, but aren't the hosting costs prohibitively high?
>
> Mark
>
> On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com>wrote:
>
>> Hello sir,
>>
>>      If you think the deal fits in your budget, better go for it. It's
>> just a 1 time investment and provides you more control on your cluster than
>> AWS. You can get your hands dirty with some config & admin stuff as well,
>> in case you haven't touched that part yet. But, go for it iff you are
>> totally confident about the machines and the person you are dealing with.
>>
>> Best Regards,
>> Tariq
>> +91-9741563634
>>
>>
>> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:
>>
>>> Hi,
>>>
>>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
>>> of decent blades, a few years old. Should I even thy to think of what to do
>>> with them, given that one can use dedicated servers and Amazon's EC2?
>>>
>>> Thank you. Sincerely,
>>> Mark
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

I am toying with exactly that idea. My startup does Hadoop eDiscovery, only
we usually do it on EC2. Getting down to earth is exciting but worrying.

Mark

On Wed, Dec 19, 2012 at 9:32 PM, Mapred Learn <ma...@gmail.com>wrote:

> What about investing this cluster in a startup if u hv some awesomeideas :)
> Who knows how much you might gain over next few years :)
>
> Sent from my iPhone
>
> On Dec 19, 2012, at 7:29 PM, Mark Kerzner <ma...@shmsoft.com>
> wrote:
>
> Sure, I love hardware, but aren't the hosting costs prohibitively high?
>
> Mark
>
> On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com>wrote:
>
>> Hello sir,
>>
>>      If you think the deal fits in your budget, better go for it. It's
>> just a 1 time investment and provides you more control on your cluster than
>> AWS. You can get your hands dirty with some config & admin stuff as well,
>> in case you haven't touched that part yet. But, go for it iff you are
>> totally confident about the machines and the person you are dealing with.
>>
>> Best Regards,
>> Tariq
>> +91-9741563634
>>
>>
>> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:
>>
>>> Hi,
>>>
>>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
>>> of decent blades, a few years old. Should I even thy to think of what to do
>>> with them, given that one can use dedicated servers and Amazon's EC2?
>>>
>>> Thank you. Sincerely,
>>> Mark
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

I am toying with exactly that idea. My startup does Hadoop eDiscovery, only
we usually do it on EC2. Getting down to earth is exciting but worrying.

Mark

On Wed, Dec 19, 2012 at 9:32 PM, Mapred Learn <ma...@gmail.com>wrote:

> What about investing this cluster in a startup if u hv some awesomeideas :)
> Who knows how much you might gain over next few years :)
>
> Sent from my iPhone
>
> On Dec 19, 2012, at 7:29 PM, Mark Kerzner <ma...@shmsoft.com>
> wrote:
>
> Sure, I love hardware, but aren't the hosting costs prohibitively high?
>
> Mark
>
> On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com>wrote:
>
>> Hello sir,
>>
>>      If you think the deal fits in your budget, better go for it. It's
>> just a 1 time investment and provides you more control on your cluster than
>> AWS. You can get your hands dirty with some config & admin stuff as well,
>> in case you haven't touched that part yet. But, go for it iff you are
>> totally confident about the machines and the person you are dealing with.
>>
>> Best Regards,
>> Tariq
>> +91-9741563634
>>
>>
>> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:
>>
>>> Hi,
>>>
>>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
>>> of decent blades, a few years old. Should I even thy to think of what to do
>>> with them, given that one can use dedicated servers and Amazon's EC2?
>>>
>>> Thank you. Sincerely,
>>> Mark
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

I am toying with exactly that idea. My startup does Hadoop eDiscovery, only
we usually do it on EC2. Getting down to earth is exciting but worrying.

Mark

On Wed, Dec 19, 2012 at 9:32 PM, Mapred Learn <ma...@gmail.com>wrote:

> What about investing this cluster in a startup if u hv some awesomeideas :)
> Who knows how much you might gain over next few years :)
>
> Sent from my iPhone
>
> On Dec 19, 2012, at 7:29 PM, Mark Kerzner <ma...@shmsoft.com>
> wrote:
>
> Sure, I love hardware, but aren't the hosting costs prohibitively high?
>
> Mark
>
> On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com>wrote:
>
>> Hello sir,
>>
>>      If you think the deal fits in your budget, better go for it. It's
>> just a 1 time investment and provides you more control on your cluster than
>> AWS. You can get your hands dirty with some config & admin stuff as well,
>> in case you haven't touched that part yet. But, go for it iff you are
>> totally confident about the machines and the person you are dealing with.
>>
>> Best Regards,
>> Tariq
>> +91-9741563634
>>
>>
>> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:
>>
>>> Hi,
>>>
>>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
>>> of decent blades, a few years old. Should I even thy to think of what to do
>>> with them, given that one can use dedicated servers and Amazon's EC2?
>>>
>>> Thank you. Sincerely,
>>> Mark
>>>
>>
>>
>

Re: What should I do with a 48-node cluster

[Mapred Learn <ma...@gmail.com>]

What about investing this cluster in a startup if u hv some awesomeideas :)
Who knows how much you might gain over next few years :)

Sent from my iPhone

On Dec 19, 2012, at 7:29 PM, Mark Kerzner <ma...@shmsoft.com> wrote:

> Sure, I love hardware, but aren't the hosting costs prohibitively high?
> 
> Mark
> 
> On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com> wrote:
>> Hello sir,
>> 
>>      If you think the deal fits in your budget, better go for it. It's just a 1 time investment and provides you more control on your cluster than AWS. You can get your hands dirty with some config & admin stuff as well, in case you haven't touched that part yet. But, go for it iff you are totally confident about the machines and the person you are dealing with.
>> 
>> Best Regards,
>> Tariq
>> +91-9741563634
>> 
>> 
>> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com> wrote:
>>> Hi,
>>> 
>>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of decent blades, a few years old. Should I even thy to think of what to do with them, given that one can use dedicated servers and Amazon's EC2?
>>> 
>>> Thank you. Sincerely,
>>> Mark
> 

Re: What should I do with a 48-node cluster

[Mapred Learn <ma...@gmail.com>]

What about investing this cluster in a startup if u hv some awesomeideas :)
Who knows how much you might gain over next few years :)

Sent from my iPhone

On Dec 19, 2012, at 7:29 PM, Mark Kerzner <ma...@shmsoft.com> wrote:

> Sure, I love hardware, but aren't the hosting costs prohibitively high?
> 
> Mark
> 
> On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com> wrote:
>> Hello sir,
>> 
>>      If you think the deal fits in your budget, better go for it. It's just a 1 time investment and provides you more control on your cluster than AWS. You can get your hands dirty with some config & admin stuff as well, in case you haven't touched that part yet. But, go for it iff you are totally confident about the machines and the person you are dealing with.
>> 
>> Best Regards,
>> Tariq
>> +91-9741563634
>> 
>> 
>> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com> wrote:
>>> Hi,
>>> 
>>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of decent blades, a few years old. Should I even thy to think of what to do with them, given that one can use dedicated servers and Amazon's EC2?
>>> 
>>> Thank you. Sincerely,
>>> Mark
> 

Re: What should I do with a 48-node cluster

[Mapred Learn <ma...@gmail.com>]

What about investing this cluster in a startup if u hv some awesomeideas :)
Who knows how much you might gain over next few years :)

Sent from my iPhone

On Dec 19, 2012, at 7:29 PM, Mark Kerzner <ma...@shmsoft.com> wrote:

> Sure, I love hardware, but aren't the hosting costs prohibitively high?
> 
> Mark
> 
> On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com> wrote:
>> Hello sir,
>> 
>>      If you think the deal fits in your budget, better go for it. It's just a 1 time investment and provides you more control on your cluster than AWS. You can get your hands dirty with some config & admin stuff as well, in case you haven't touched that part yet. But, go for it iff you are totally confident about the machines and the person you are dealing with.
>> 
>> Best Regards,
>> Tariq
>> +91-9741563634
>> 
>> 
>> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com> wrote:
>>> Hi,
>>> 
>>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of decent blades, a few years old. Should I even thy to think of what to do with them, given that one can use dedicated servers and Amazon's EC2?
>>> 
>>> Thank you. Sincerely,
>>> Mark
> 

Re: What should I do with a 48-node cluster

[Mapred Learn <ma...@gmail.com>]

What about investing this cluster in a startup if u hv some awesomeideas :)
Who knows how much you might gain over next few years :)

Sent from my iPhone

On Dec 19, 2012, at 7:29 PM, Mark Kerzner <ma...@shmsoft.com> wrote:

> Sure, I love hardware, but aren't the hosting costs prohibitively high?
> 
> Mark
> 
> On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com> wrote:
>> Hello sir,
>> 
>>      If you think the deal fits in your budget, better go for it. It's just a 1 time investment and provides you more control on your cluster than AWS. You can get your hands dirty with some config & admin stuff as well, in case you haven't touched that part yet. But, go for it iff you are totally confident about the machines and the person you are dealing with.
>> 
>> Best Regards,
>> Tariq
>> +91-9741563634
>> 
>> 
>> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com> wrote:
>>> Hi,
>>> 
>>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster of decent blades, a few years old. Should I even thy to think of what to do with them, given that one can use dedicated servers and Amazon's EC2?
>>> 
>>> Thank you. Sincerely,
>>> Mark
> 

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Sure, I love hardware, but aren't the hosting costs prohibitively high?

Mark

On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com> wrote:

> Hello sir,
>
>      If you think the deal fits in your budget, better go for it. It's
> just a 1 time investment and provides you more control on your cluster than
> AWS. You can get your hands dirty with some config & admin stuff as well,
> in case you haven't touched that part yet. But, go for it iff you are
> totally confident about the machines and the person you are dealing with.
>
> Best Regards,
> Tariq
> +91-9741563634
>
>
> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Hi,
>>
>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
>> of decent blades, a few years old. Should I even thy to think of what to do
>> with them, given that one can use dedicated servers and Amazon's EC2?
>>
>> Thank you. Sincerely,
>> Mark
>>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Sure, I love hardware, but aren't the hosting costs prohibitively high?

Mark

On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com> wrote:

> Hello sir,
>
>      If you think the deal fits in your budget, better go for it. It's
> just a 1 time investment and provides you more control on your cluster than
> AWS. You can get your hands dirty with some config & admin stuff as well,
> in case you haven't touched that part yet. But, go for it iff you are
> totally confident about the machines and the person you are dealing with.
>
> Best Regards,
> Tariq
> +91-9741563634
>
>
> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Hi,
>>
>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
>> of decent blades, a few years old. Should I even thy to think of what to do
>> with them, given that one can use dedicated servers and Amazon's EC2?
>>
>> Thank you. Sincerely,
>> Mark
>>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Sure, I love hardware, but aren't the hosting costs prohibitively high?

Mark

On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com> wrote:

> Hello sir,
>
>      If you think the deal fits in your budget, better go for it. It's
> just a 1 time investment and provides you more control on your cluster than
> AWS. You can get your hands dirty with some config & admin stuff as well,
> in case you haven't touched that part yet. But, go for it iff you are
> totally confident about the machines and the person you are dealing with.
>
> Best Regards,
> Tariq
> +91-9741563634
>
>
> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Hi,
>>
>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
>> of decent blades, a few years old. Should I even thy to think of what to do
>> with them, given that one can use dedicated servers and Amazon's EC2?
>>
>> Thank you. Sincerely,
>> Mark
>>
>
>

Re: What should I do with a 48-node cluster

[Mark Kerzner <ma...@shmsoft.com>]

Sure, I love hardware, but aren't the hosting costs prohibitively high?

Mark

On Wed, Dec 19, 2012 at 9:23 PM, Mohammad Tariq <do...@gmail.com> wrote:

> Hello sir,
>
>      If you think the deal fits in your budget, better go for it. It's
> just a 1 time investment and provides you more control on your cluster than
> AWS. You can get your hands dirty with some config & admin stuff as well,
> in case you haven't touched that part yet. But, go for it iff you are
> totally confident about the machines and the person you are dealing with.
>
> Best Regards,
> Tariq
> +91-9741563634
>
>
> On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:
>
>> Hi,
>>
>> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
>> of decent blades, a few years old. Should I even thy to think of what to do
>> with them, given that one can use dedicated servers and Amazon's EC2?
>>
>> Thank you. Sincerely,
>> Mark
>>
>
>

Re: What should I do with a 48-node cluster

[Mohammad Tariq <do...@gmail.com>]

Hello sir,

     If you think the deal fits in your budget, better go for it. It's just
a 1 time investment and provides you more control on your cluster than AWS.
You can get your hands dirty with some config & admin stuff as well, in
case you haven't touched that part yet. But, go for it iff you are totally
confident about the machines and the person you are dealing with.

Best Regards,
Tariq
+91-9741563634


On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Hi,
>
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
> of decent blades, a few years old. Should I even thy to think of what to do
> with them, given that one can use dedicated servers and Amazon's EC2?
>
> Thank you. Sincerely,
> Mark
>

Re: What should I do with a 48-node cluster

[Mohammad Tariq <do...@gmail.com>]

Hello sir,

     If you think the deal fits in your budget, better go for it. It's just
a 1 time investment and provides you more control on your cluster than AWS.
You can get your hands dirty with some config & admin stuff as well, in
case you haven't touched that part yet. But, go for it iff you are totally
confident about the machines and the person you are dealing with.

Best Regards,
Tariq
+91-9741563634


On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Hi,
>
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
> of decent blades, a few years old. Should I even thy to think of what to do
> with them, given that one can use dedicated servers and Amazon's EC2?
>
> Thank you. Sincerely,
> Mark
>

Re: What should I do with a 48-node cluster

[Mohammad Tariq <do...@gmail.com>]

Hello sir,

     If you think the deal fits in your budget, better go for it. It's just
a 1 time investment and provides you more control on your cluster than AWS.
You can get your hands dirty with some config & admin stuff as well, in
case you haven't touched that part yet. But, go for it iff you are totally
confident about the machines and the person you are dealing with.

Best Regards,
Tariq
+91-9741563634


On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Hi,
>
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
> of decent blades, a few years old. Should I even thy to think of what to do
> with them, given that one can use dedicated servers and Amazon's EC2?
>
> Thank you. Sincerely,
> Mark
>

Re: What should I do with a 48-node cluster

[Mohammad Tariq <do...@gmail.com>]

Hello sir,

     If you think the deal fits in your budget, better go for it. It's just
a 1 time investment and provides you more control on your cluster than AWS.
You can get your hands dirty with some config & admin stuff as well, in
case you haven't touched that part yet. But, go for it iff you are totally
confident about the machines and the person you are dealing with.

Best Regards,
Tariq
+91-9741563634


On Thu, Dec 20, 2012 at 8:47 AM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Hi,
>
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
> of decent blades, a few years old. Should I even thy to think of what to do
> with them, given that one can use dedicated servers and Amazon's EC2?
>
> Thank you. Sincerely,
> Mark
>

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

Depending on the node characteristics, these might actually not be all that
much use.  Blades are usually designed assuming external storage like a
SAN.  That means that they usually don't have much disk which makes them
only OK for Hadoop work.

Also, what about the installation cost?  Do you have enough power and
cooling to host these boxes?  The cost of ops could easily exceed the cost
of the nodes in a short period of time.  Hardware is a deflationary asset
as evidenced by the willingness of people to nearly give away old hardware.
 Unfortunately, in many cases, the market price often really is a fair
estimate of what it would take to get the same capacity in newer hardware.

This hardware might be substantially under the market price.  That would be
neat.  On the other hand, it sounds like this same throughput might be had
with three 2U units with 12 drives and a single socket each.  The price on
that is probably around $20K.  Is that a better or worse deal than you are
getting?


On Wed, Dec 19, 2012 at 7:17 PM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Hi,
>
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
> of decent blades, a few years old. Should I even thy to think of what to do
> with them, given that one can use dedicated servers and Amazon's EC2?
>
> Thank you. Sincerely,
> Mark
>

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

Depending on the node characteristics, these might actually not be all that
much use.  Blades are usually designed assuming external storage like a
SAN.  That means that they usually don't have much disk which makes them
only OK for Hadoop work.

Also, what about the installation cost?  Do you have enough power and
cooling to host these boxes?  The cost of ops could easily exceed the cost
of the nodes in a short period of time.  Hardware is a deflationary asset
as evidenced by the willingness of people to nearly give away old hardware.
 Unfortunately, in many cases, the market price often really is a fair
estimate of what it would take to get the same capacity in newer hardware.

This hardware might be substantially under the market price.  That would be
neat.  On the other hand, it sounds like this same throughput might be had
with three 2U units with 12 drives and a single socket each.  The price on
that is probably around $20K.  Is that a better or worse deal than you are
getting?


On Wed, Dec 19, 2012 at 7:17 PM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Hi,
>
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
> of decent blades, a few years old. Should I even thy to think of what to do
> with them, given that one can use dedicated servers and Amazon's EC2?
>
> Thank you. Sincerely,
> Mark
>

Re: What should I do with a 48-node cluster

[Ted Dunning <td...@maprtech.com>]

Depending on the node characteristics, these might actually not be all that
much use.  Blades are usually designed assuming external storage like a
SAN.  That means that they usually don't have much disk which makes them
only OK for Hadoop work.

Also, what about the installation cost?  Do you have enough power and
cooling to host these boxes?  The cost of ops could easily exceed the cost
of the nodes in a short period of time.  Hardware is a deflationary asset
as evidenced by the willingness of people to nearly give away old hardware.
 Unfortunately, in many cases, the market price often really is a fair
estimate of what it would take to get the same capacity in newer hardware.

This hardware might be substantially under the market price.  That would be
neat.  On the other hand, it sounds like this same throughput might be had
with three 2U units with 12 drives and a single socket each.  The price on
that is probably around $20K.  Is that a better or worse deal than you are
getting?


On Wed, Dec 19, 2012 at 7:17 PM, Mark Kerzner <ma...@shmsoft.com>wrote:

> Hi,
>
> Someone wants to give me (OK, sell, but for the cheap) a 48-node cluster
> of decent blades, a few years old. Should I even thy to think of what to do
> with them, given that one can use dedicated servers and Amazon's EC2?
>
> Thank you. Sincerely,
> Mark
>