You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-user@hadoop.apache.org by Chris MacKenzie <st...@chrismackenziephotography.co.uk> on 2014/07/21 10:46:17 UTC
Is it a good idea to delete / move the default configuration xml file
?
Hi All,
I have just realised that my implementation of hadoop-2.4.1 is pulling in
all the default.xml files.
I have three copies of each in different directories, obviously at least
one of those is on the class path.
Anyway with all the effort to set up a site, it seems strange to me that I
would use settings I had no idea existed and that may not be how I would
choose to set them up.
Regards,
Chris MacKenzie
telephone: 0131 332 6967
email: studio@chrismackenziephotography.co.uk
corporate: www.chrismackenziephotography.co.uk
<http://www.chrismackenziephotography.co.uk/>
<http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
<http://www.linkedin.com/in/chrismackenziephotography/>
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris MacKenzie <st...@chrismackenziephotography.co.uk>.
Hi thanks for that, much appreciated.
I guess they are in the jar files then ;O) I was really surprised to see
the default configs pulled in, especially considering I thought I was in
full control, I did a file search on an installation and saw the files and
jumped to the wrong conclusion.
I feel like a real idiot some times, but there is so much conflicting
information out there that later you realise that questions asked seem non
sensical but at the time they feel valid ;O)
Thanks for your tolerance,
Chris MacKenzie
telephone: 0131 332 6967
email: studio@chrismackenziephotography.co.uk
corporate: www.chrismackenziephotography.co.uk
<http://www.chrismackenziephotography.co.uk/>
<http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
<http://www.linkedin.com/in/chrismackenziephotography/>
On 21/07/2014 09:46, "Chris MacKenzie"
<st...@chrismackenziephotography.co.uk> wrote:
>Hi All,
>
>I have just realised that my implementation of hadoop-2.4.1 is pulling in
>all the default.xml files.
>
>I have three copies of each in different directories, obviously at least
>one of those is on the class path.
>
>Anyway with all the effort to set up a site, it seems strange to me that I
>would use settings I had no idea existed and that may not be how I would
>choose to set them up.
>
>
>Regards,
>
>Chris MacKenzie
>telephone: 0131 332 6967
>email: studio@chrismackenziephotography.co.uk
>corporate: www.chrismackenziephotography.co.uk
><http://www.chrismackenziephotography.co.uk/>
><http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
><http://www.linkedin.com/in/chrismackenziephotography/>
>
>
Re: planning a cluster
Posted by Chris Mawata <ch...@gmail.com>.
If you plan to use it to learn how to program for Hadoop then pseudo
distributed (cluster of 1) will do. If you plan to use it to learn how to
administer a cluster then 4 or 5 nodes will allow experiments with
commissioning and decommissioning nodes, HA, Journaling, etc. If it is a
proof of concept cluster then it depends on the nature of the problem(s)
you want to solve.
On Jul 22, 2014 11:15 AM, "Adaryl "Bob" Wakefield, MBA" <
adaryl.wakefield@hotmail.com> wrote:
> Someone contacted me directly and suggested the book Hadoop Operations
> by Eric Sammer.
>
> Adaryl "Bob" Wakefield, MBA
> Principal
> Mass Street Analytics
> 913.938.6685
> www.linkedin.com/in/bobwakefieldmba
>
> *From:* YIMEN YIMGA Gael <ga...@sgcib.com>
> *Sent:* Tuesday, July 22, 2014 9:48 AM
> *To:* user@hadoop.apache.org
> *Subject:* RE: planning a cluster
>
>
> Hello,
>
>
>
> I can share a clue that i used to fix this.
>
>
>
> If you could calculate the number of nodes that you’ll need after a year,
> then you should make at the startup, a cluster with that number of node. J
>
>
>
> Warm regards
>
>
>
> *From:* Devaraj K [mailto:devaraj@apache.org]
> *Sent:* Tuesday 22 July 2014 16:46
> *To:* user@hadoop.apache.org
> *Subject:* Re: planning a cluster
>
>
>
> You may need to consider these things while choosing no of nodes for your
> cluster.
>
>
>
> 1. Data storage: how much data you are going to store in the cluster
>
> 2. Data processing : what is the processing you are going to do in the
> cluster
>
> 3. Each node hardware configurations
>
>
>
> On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <
> adaryl.wakefield@hotmail.com> wrote:
>
> What is the rule for determining how many nodes should be in your initial
> cluster?
>
> B.
>
>
>
>
>
> --
>
>
>
>
>
> Thanks
>
> Devaraj K
>
> *************************************************************************
> This message and any attachments (the "message") are confidential,
> intended solely for the addressee(s), and may contain legally privileged
> information.
> Any unauthorised use or dissemination is prohibited. E-mails are
> susceptible to alteration.
> Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall
> be liable for the message if altered, changed or
> falsified.
> Please visit http://swapdisclosure.sgcib.com for important information
> with respect to derivative products.
> ************
> Ce message et toutes les pieces jointes (ci-apres le "message") sont
> confidentiels et susceptibles de contenir des informations couvertes
> par le secret professionnel.
> Ce message est etabli a l'intention exclusive de ses destinataires. Toute
> utilisation ou diffusion non autorisee est interdite.
> Tout message electronique est susceptible d'alteration.
> La SOCIETE GENERALE et ses filiales declinent toute responsabilite au
> titre de ce message s'il a ete altere, deforme ou falsifie.
> Veuillez consulter le site http://swapdisclosure.sgcib.com afin de
> recueillir d'importantes informations sur les produits derives.
> *************************************************************************
>
Re: planning a cluster
Posted by Chris Mawata <ch...@gmail.com>.
If you plan to use it to learn how to program for Hadoop then pseudo
distributed (cluster of 1) will do. If you plan to use it to learn how to
administer a cluster then 4 or 5 nodes will allow experiments with
commissioning and decommissioning nodes, HA, Journaling, etc. If it is a
proof of concept cluster then it depends on the nature of the problem(s)
you want to solve.
On Jul 22, 2014 11:15 AM, "Adaryl "Bob" Wakefield, MBA" <
adaryl.wakefield@hotmail.com> wrote:
> Someone contacted me directly and suggested the book Hadoop Operations
> by Eric Sammer.
>
> Adaryl "Bob" Wakefield, MBA
> Principal
> Mass Street Analytics
> 913.938.6685
> www.linkedin.com/in/bobwakefieldmba
>
> *From:* YIMEN YIMGA Gael <ga...@sgcib.com>
> *Sent:* Tuesday, July 22, 2014 9:48 AM
> *To:* user@hadoop.apache.org
> *Subject:* RE: planning a cluster
>
>
> Hello,
>
>
>
> I can share a clue that i used to fix this.
>
>
>
> If you could calculate the number of nodes that you’ll need after a year,
> then you should make at the startup, a cluster with that number of node. J
>
>
>
> Warm regards
>
>
>
> *From:* Devaraj K [mailto:devaraj@apache.org]
> *Sent:* Tuesday 22 July 2014 16:46
> *To:* user@hadoop.apache.org
> *Subject:* Re: planning a cluster
>
>
>
> You may need to consider these things while choosing no of nodes for your
> cluster.
>
>
>
> 1. Data storage: how much data you are going to store in the cluster
>
> 2. Data processing : what is the processing you are going to do in the
> cluster
>
> 3. Each node hardware configurations
>
>
>
> On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <
> adaryl.wakefield@hotmail.com> wrote:
>
> What is the rule for determining how many nodes should be in your initial
> cluster?
>
> B.
>
>
>
>
>
> --
>
>
>
>
>
> Thanks
>
> Devaraj K
>
> *************************************************************************
> This message and any attachments (the "message") are confidential,
> intended solely for the addressee(s), and may contain legally privileged
> information.
> Any unauthorised use or dissemination is prohibited. E-mails are
> susceptible to alteration.
> Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall
> be liable for the message if altered, changed or
> falsified.
> Please visit http://swapdisclosure.sgcib.com for important information
> with respect to derivative products.
> ************
> Ce message et toutes les pieces jointes (ci-apres le "message") sont
> confidentiels et susceptibles de contenir des informations couvertes
> par le secret professionnel.
> Ce message est etabli a l'intention exclusive de ses destinataires. Toute
> utilisation ou diffusion non autorisee est interdite.
> Tout message electronique est susceptible d'alteration.
> La SOCIETE GENERALE et ses filiales declinent toute responsabilite au
> titre de ce message s'il a ete altere, deforme ou falsifie.
> Veuillez consulter le site http://swapdisclosure.sgcib.com afin de
> recueillir d'importantes informations sur les produits derives.
> *************************************************************************
>
Re: planning a cluster
Posted by Chris Mawata <ch...@gmail.com>.
If you plan to use it to learn how to program for Hadoop then pseudo
distributed (cluster of 1) will do. If you plan to use it to learn how to
administer a cluster then 4 or 5 nodes will allow experiments with
commissioning and decommissioning nodes, HA, Journaling, etc. If it is a
proof of concept cluster then it depends on the nature of the problem(s)
you want to solve.
On Jul 22, 2014 11:15 AM, "Adaryl "Bob" Wakefield, MBA" <
adaryl.wakefield@hotmail.com> wrote:
> Someone contacted me directly and suggested the book Hadoop Operations
> by Eric Sammer.
>
> Adaryl "Bob" Wakefield, MBA
> Principal
> Mass Street Analytics
> 913.938.6685
> www.linkedin.com/in/bobwakefieldmba
>
> *From:* YIMEN YIMGA Gael <ga...@sgcib.com>
> *Sent:* Tuesday, July 22, 2014 9:48 AM
> *To:* user@hadoop.apache.org
> *Subject:* RE: planning a cluster
>
>
> Hello,
>
>
>
> I can share a clue that i used to fix this.
>
>
>
> If you could calculate the number of nodes that you’ll need after a year,
> then you should make at the startup, a cluster with that number of node. J
>
>
>
> Warm regards
>
>
>
> *From:* Devaraj K [mailto:devaraj@apache.org]
> *Sent:* Tuesday 22 July 2014 16:46
> *To:* user@hadoop.apache.org
> *Subject:* Re: planning a cluster
>
>
>
> You may need to consider these things while choosing no of nodes for your
> cluster.
>
>
>
> 1. Data storage: how much data you are going to store in the cluster
>
> 2. Data processing : what is the processing you are going to do in the
> cluster
>
> 3. Each node hardware configurations
>
>
>
> On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <
> adaryl.wakefield@hotmail.com> wrote:
>
> What is the rule for determining how many nodes should be in your initial
> cluster?
>
> B.
>
>
>
>
>
> --
>
>
>
>
>
> Thanks
>
> Devaraj K
>
> *************************************************************************
> This message and any attachments (the "message") are confidential,
> intended solely for the addressee(s), and may contain legally privileged
> information.
> Any unauthorised use or dissemination is prohibited. E-mails are
> susceptible to alteration.
> Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall
> be liable for the message if altered, changed or
> falsified.
> Please visit http://swapdisclosure.sgcib.com for important information
> with respect to derivative products.
> ************
> Ce message et toutes les pieces jointes (ci-apres le "message") sont
> confidentiels et susceptibles de contenir des informations couvertes
> par le secret professionnel.
> Ce message est etabli a l'intention exclusive de ses destinataires. Toute
> utilisation ou diffusion non autorisee est interdite.
> Tout message electronique est susceptible d'alteration.
> La SOCIETE GENERALE et ses filiales declinent toute responsabilite au
> titre de ce message s'il a ete altere, deforme ou falsifie.
> Veuillez consulter le site http://swapdisclosure.sgcib.com afin de
> recueillir d'importantes informations sur les produits derives.
> *************************************************************************
>
Re: planning a cluster
Posted by Chris Mawata <ch...@gmail.com>.
If you plan to use it to learn how to program for Hadoop then pseudo
distributed (cluster of 1) will do. If you plan to use it to learn how to
administer a cluster then 4 or 5 nodes will allow experiments with
commissioning and decommissioning nodes, HA, Journaling, etc. If it is a
proof of concept cluster then it depends on the nature of the problem(s)
you want to solve.
On Jul 22, 2014 11:15 AM, "Adaryl "Bob" Wakefield, MBA" <
adaryl.wakefield@hotmail.com> wrote:
> Someone contacted me directly and suggested the book Hadoop Operations
> by Eric Sammer.
>
> Adaryl "Bob" Wakefield, MBA
> Principal
> Mass Street Analytics
> 913.938.6685
> www.linkedin.com/in/bobwakefieldmba
>
> *From:* YIMEN YIMGA Gael <ga...@sgcib.com>
> *Sent:* Tuesday, July 22, 2014 9:48 AM
> *To:* user@hadoop.apache.org
> *Subject:* RE: planning a cluster
>
>
> Hello,
>
>
>
> I can share a clue that i used to fix this.
>
>
>
> If you could calculate the number of nodes that you’ll need after a year,
> then you should make at the startup, a cluster with that number of node. J
>
>
>
> Warm regards
>
>
>
> *From:* Devaraj K [mailto:devaraj@apache.org]
> *Sent:* Tuesday 22 July 2014 16:46
> *To:* user@hadoop.apache.org
> *Subject:* Re: planning a cluster
>
>
>
> You may need to consider these things while choosing no of nodes for your
> cluster.
>
>
>
> 1. Data storage: how much data you are going to store in the cluster
>
> 2. Data processing : what is the processing you are going to do in the
> cluster
>
> 3. Each node hardware configurations
>
>
>
> On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <
> adaryl.wakefield@hotmail.com> wrote:
>
> What is the rule for determining how many nodes should be in your initial
> cluster?
>
> B.
>
>
>
>
>
> --
>
>
>
>
>
> Thanks
>
> Devaraj K
>
> *************************************************************************
> This message and any attachments (the "message") are confidential,
> intended solely for the addressee(s), and may contain legally privileged
> information.
> Any unauthorised use or dissemination is prohibited. E-mails are
> susceptible to alteration.
> Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall
> be liable for the message if altered, changed or
> falsified.
> Please visit http://swapdisclosure.sgcib.com for important information
> with respect to derivative products.
> ************
> Ce message et toutes les pieces jointes (ci-apres le "message") sont
> confidentiels et susceptibles de contenir des informations couvertes
> par le secret professionnel.
> Ce message est etabli a l'intention exclusive de ses destinataires. Toute
> utilisation ou diffusion non autorisee est interdite.
> Tout message electronique est susceptible d'alteration.
> La SOCIETE GENERALE et ses filiales declinent toute responsabilite au
> titre de ce message s'il a ete altere, deforme ou falsifie.
> Veuillez consulter le site http://swapdisclosure.sgcib.com afin de
> recueillir d'importantes informations sur les produits derives.
> *************************************************************************
>
Re: planning a cluster
Posted by "Adaryl \"Bob\" Wakefield, MBA" <ad...@hotmail.com>.
Someone contacted me directly and suggested the book Hadoop Operations by Eric Sammer.
Adaryl "Bob" Wakefield, MBA
Principal
Mass Street Analytics
913.938.6685
www.linkedin.com/in/bobwakefieldmba
From: YIMEN YIMGA Gael
Sent: Tuesday, July 22, 2014 9:48 AM
To: user@hadoop.apache.org
Subject: RE: planning a cluster
Hello,
I can share a clue that i used to fix this.
If you could calculate the number of nodes that you’ll need after a year, then you should make at the startup, a cluster with that number of node. J
Warm regards
From: Devaraj K [mailto:devaraj@apache.org]
Sent: Tuesday 22 July 2014 16:46
To: user@hadoop.apache.org
Subject: Re: planning a cluster
You may need to consider these things while choosing no of nodes for your cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <ad...@hotmail.com> wrote:
What is the rule for determining how many nodes should be in your initial cluster?
B.
--
Thanks
Devaraj K
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information.
Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration.
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes
par le secret professionnel.
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration.
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
Re: planning a cluster
Posted by "Adaryl \"Bob\" Wakefield, MBA" <ad...@hotmail.com>.
Someone contacted me directly and suggested the book Hadoop Operations by Eric Sammer.
Adaryl "Bob" Wakefield, MBA
Principal
Mass Street Analytics
913.938.6685
www.linkedin.com/in/bobwakefieldmba
From: YIMEN YIMGA Gael
Sent: Tuesday, July 22, 2014 9:48 AM
To: user@hadoop.apache.org
Subject: RE: planning a cluster
Hello,
I can share a clue that i used to fix this.
If you could calculate the number of nodes that you’ll need after a year, then you should make at the startup, a cluster with that number of node. J
Warm regards
From: Devaraj K [mailto:devaraj@apache.org]
Sent: Tuesday 22 July 2014 16:46
To: user@hadoop.apache.org
Subject: Re: planning a cluster
You may need to consider these things while choosing no of nodes for your cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <ad...@hotmail.com> wrote:
What is the rule for determining how many nodes should be in your initial cluster?
B.
--
Thanks
Devaraj K
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information.
Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration.
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes
par le secret professionnel.
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration.
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
Re: planning a cluster
Posted by "Adaryl \"Bob\" Wakefield, MBA" <ad...@hotmail.com>.
Someone contacted me directly and suggested the book Hadoop Operations by Eric Sammer.
Adaryl "Bob" Wakefield, MBA
Principal
Mass Street Analytics
913.938.6685
www.linkedin.com/in/bobwakefieldmba
From: YIMEN YIMGA Gael
Sent: Tuesday, July 22, 2014 9:48 AM
To: user@hadoop.apache.org
Subject: RE: planning a cluster
Hello,
I can share a clue that i used to fix this.
If you could calculate the number of nodes that you’ll need after a year, then you should make at the startup, a cluster with that number of node. J
Warm regards
From: Devaraj K [mailto:devaraj@apache.org]
Sent: Tuesday 22 July 2014 16:46
To: user@hadoop.apache.org
Subject: Re: planning a cluster
You may need to consider these things while choosing no of nodes for your cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <ad...@hotmail.com> wrote:
What is the rule for determining how many nodes should be in your initial cluster?
B.
--
Thanks
Devaraj K
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information.
Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration.
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes
par le secret professionnel.
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration.
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
Re: planning a cluster
Posted by "Adaryl \"Bob\" Wakefield, MBA" <ad...@hotmail.com>.
Someone contacted me directly and suggested the book Hadoop Operations by Eric Sammer.
Adaryl "Bob" Wakefield, MBA
Principal
Mass Street Analytics
913.938.6685
www.linkedin.com/in/bobwakefieldmba
From: YIMEN YIMGA Gael
Sent: Tuesday, July 22, 2014 9:48 AM
To: user@hadoop.apache.org
Subject: RE: planning a cluster
Hello,
I can share a clue that i used to fix this.
If you could calculate the number of nodes that you’ll need after a year, then you should make at the startup, a cluster with that number of node. J
Warm regards
From: Devaraj K [mailto:devaraj@apache.org]
Sent: Tuesday 22 July 2014 16:46
To: user@hadoop.apache.org
Subject: Re: planning a cluster
You may need to consider these things while choosing no of nodes for your cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <ad...@hotmail.com> wrote:
What is the rule for determining how many nodes should be in your initial cluster?
B.
--
Thanks
Devaraj K
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information.
Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration.
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes
par le secret professionnel.
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration.
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
RE: planning a cluster
Posted by YIMEN YIMGA Gael <ga...@sgcib.com>.
Hello,
I can share a clue that i used to fix this.
If you could calculate the number of nodes that you’ll need after a year, then you should make at the startup, a cluster with that number of node. ☺
Warm regards
From: Devaraj K [mailto:devaraj@apache.org]
Sent: Tuesday 22 July 2014 16:46
To: user@hadoop.apache.org
Subject: Re: planning a cluster
You may need to consider these things while choosing no of nodes for your cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <ad...@hotmail.com>> wrote:
What is the rule for determining how many nodes should be in your initial cluster?
B.
--
Thanks
Devaraj K
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information.
Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration.
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes
par le secret professionnel.
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration.
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
RE: planning a cluster
Posted by YIMEN YIMGA Gael <ga...@sgcib.com>.
Hello,
I can share a clue that i used to fix this.
If you could calculate the number of nodes that you’ll need after a year, then you should make at the startup, a cluster with that number of node. ☺
Warm regards
From: Devaraj K [mailto:devaraj@apache.org]
Sent: Tuesday 22 July 2014 16:46
To: user@hadoop.apache.org
Subject: Re: planning a cluster
You may need to consider these things while choosing no of nodes for your cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <ad...@hotmail.com>> wrote:
What is the rule for determining how many nodes should be in your initial cluster?
B.
--
Thanks
Devaraj K
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information.
Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration.
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes
par le secret professionnel.
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration.
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
RE: planning a cluster
Posted by YIMEN YIMGA Gael <ga...@sgcib.com>.
Hello,
I can share a clue that i used to fix this.
If you could calculate the number of nodes that you’ll need after a year, then you should make at the startup, a cluster with that number of node. ☺
Warm regards
From: Devaraj K [mailto:devaraj@apache.org]
Sent: Tuesday 22 July 2014 16:46
To: user@hadoop.apache.org
Subject: Re: planning a cluster
You may need to consider these things while choosing no of nodes for your cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <ad...@hotmail.com>> wrote:
What is the rule for determining how many nodes should be in your initial cluster?
B.
--
Thanks
Devaraj K
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information.
Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration.
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes
par le secret professionnel.
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration.
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
RE: planning a cluster
Posted by YIMEN YIMGA Gael <ga...@sgcib.com>.
Hello,
I can share a clue that i used to fix this.
If you could calculate the number of nodes that you’ll need after a year, then you should make at the startup, a cluster with that number of node. ☺
Warm regards
From: Devaraj K [mailto:devaraj@apache.org]
Sent: Tuesday 22 July 2014 16:46
To: user@hadoop.apache.org
Subject: Re: planning a cluster
You may need to consider these things while choosing no of nodes for your cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <ad...@hotmail.com>> wrote:
What is the rule for determining how many nodes should be in your initial cluster?
B.
--
Thanks
Devaraj K
*************************************************************************
This message and any attachments (the "message") are confidential, intended solely for the addressee(s), and may contain legally privileged information.
Any unauthorised use or dissemination is prohibited. E-mails are susceptible to alteration.
Neither SOCIETE GENERALE nor any of its subsidiaries or affiliates shall be liable for the message if altered, changed or
falsified.
Please visit http://swapdisclosure.sgcib.com for important information with respect to derivative products.
************
Ce message et toutes les pieces jointes (ci-apres le "message") sont confidentiels et susceptibles de contenir des informations couvertes
par le secret professionnel.
Ce message est etabli a l'intention exclusive de ses destinataires. Toute utilisation ou diffusion non autorisee est interdite.
Tout message electronique est susceptible d'alteration.
La SOCIETE GENERALE et ses filiales declinent toute responsabilite au titre de ce message s'il a ete altere, deforme ou falsifie.
Veuillez consulter le site http://swapdisclosure.sgcib.com afin de recueillir d'importantes informations sur les produits derives.
*************************************************************************
Re: planning a cluster
Posted by Devaraj K <de...@apache.org>.
You may need to consider these things while choosing no of nodes for your
cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the
cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <
adaryl.wakefield@hotmail.com> wrote:
> What is the rule for determining how many nodes should be in your
> initial cluster?
> B.
>
--
Thanks
Devaraj K
Re: planning a cluster
Posted by Devaraj K <de...@apache.org>.
You may need to consider these things while choosing no of nodes for your
cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the
cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <
adaryl.wakefield@hotmail.com> wrote:
> What is the rule for determining how many nodes should be in your
> initial cluster?
> B.
>
--
Thanks
Devaraj K
Re: planning a cluster
Posted by Devaraj K <de...@apache.org>.
You may need to consider these things while choosing no of nodes for your
cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the
cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <
adaryl.wakefield@hotmail.com> wrote:
> What is the rule for determining how many nodes should be in your
> initial cluster?
> B.
>
--
Thanks
Devaraj K
Re: planning a cluster
Posted by Devaraj K <de...@apache.org>.
You may need to consider these things while choosing no of nodes for your
cluster.
1. Data storage: how much data you are going to store in the cluster
2. Data processing : what is the processing you are going to do in the
cluster
3. Each node hardware configurations
On Mon, Jul 21, 2014 at 11:50 PM, Adaryl "Bob" Wakefield, MBA <
adaryl.wakefield@hotmail.com> wrote:
> What is the rule for determining how many nodes should be in your
> initial cluster?
> B.
>
--
Thanks
Devaraj K
planning a cluster
Posted by "Adaryl \"Bob\" Wakefield, MBA" <ad...@hotmail.com>.
What is the rule for determining how many nodes should be in your initial cluster?
B.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Mawata <ch...@gmail.com>.
I suspect someone wanted to read through them to know tge defaults.
Chris
On Jul 21, 2014 2:16 PM, "Chris Nauroth" <cn...@hortonworks.com> wrote:
> That's a good point. I'm not sure how bare *-default.xml files would be
> showing up on a deployment outside the jars.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
>
> On Mon, Jul 21, 2014 at 11:12 AM, Chris Mawata <ch...@gmail.com>
> wrote:
>
>> Aren't the *-default.xml files supposed to be inside the jars rather than
>> loose files?
>> Cheers
>> Chris Mawata
>> On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com>
>> wrote:
>>
>>> I recommend against deleting or moving *-default.xml, because these
>>> files may be supplying reasonable default values for configuration
>>> properties that you haven't set in *-site.xml. We also put defaults into
>>> the code itself in case a configuration property is found to be completely
>>> missing, but I'm not aware of any actual testing of deployments that have
>>> deleted *-default.xml.
>>>
>>> Chris Nauroth
>>> Hortonworks
>>> http://hortonworks.com/
>>>
>>>
>>>
>>> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
>>> studio@chrismackenziephotography.co.uk> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have just realised that my implementation of hadoop-2.4.1 is pulling
>>>> in
>>>> all the default.xml files.
>>>>
>>>> I have three copies of each in different directories, obviously at least
>>>> one of those is on the class path.
>>>>
>>>> Anyway with all the effort to set up a site, it seems strange to me
>>>> that I
>>>> would use settings I had no idea existed and that may not be how I would
>>>> choose to set them up.
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Chris MacKenzie
>>>> telephone: 0131 332 6967
>>>> email: studio@chrismackenziephotography.co.uk
>>>> corporate: www.chrismackenziephotography.co.uk
>>>> <http://www.chrismackenziephotography.co.uk/>
>>>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>>>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>>>
>>>>
>>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Mawata <ch...@gmail.com>.
I suspect someone wanted to read through them to know tge defaults.
Chris
On Jul 21, 2014 2:16 PM, "Chris Nauroth" <cn...@hortonworks.com> wrote:
> That's a good point. I'm not sure how bare *-default.xml files would be
> showing up on a deployment outside the jars.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
>
> On Mon, Jul 21, 2014 at 11:12 AM, Chris Mawata <ch...@gmail.com>
> wrote:
>
>> Aren't the *-default.xml files supposed to be inside the jars rather than
>> loose files?
>> Cheers
>> Chris Mawata
>> On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com>
>> wrote:
>>
>>> I recommend against deleting or moving *-default.xml, because these
>>> files may be supplying reasonable default values for configuration
>>> properties that you haven't set in *-site.xml. We also put defaults into
>>> the code itself in case a configuration property is found to be completely
>>> missing, but I'm not aware of any actual testing of deployments that have
>>> deleted *-default.xml.
>>>
>>> Chris Nauroth
>>> Hortonworks
>>> http://hortonworks.com/
>>>
>>>
>>>
>>> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
>>> studio@chrismackenziephotography.co.uk> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have just realised that my implementation of hadoop-2.4.1 is pulling
>>>> in
>>>> all the default.xml files.
>>>>
>>>> I have three copies of each in different directories, obviously at least
>>>> one of those is on the class path.
>>>>
>>>> Anyway with all the effort to set up a site, it seems strange to me
>>>> that I
>>>> would use settings I had no idea existed and that may not be how I would
>>>> choose to set them up.
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Chris MacKenzie
>>>> telephone: 0131 332 6967
>>>> email: studio@chrismackenziephotography.co.uk
>>>> corporate: www.chrismackenziephotography.co.uk
>>>> <http://www.chrismackenziephotography.co.uk/>
>>>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>>>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>>>
>>>>
>>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Mawata <ch...@gmail.com>.
I suspect someone wanted to read through them to know tge defaults.
Chris
On Jul 21, 2014 2:16 PM, "Chris Nauroth" <cn...@hortonworks.com> wrote:
> That's a good point. I'm not sure how bare *-default.xml files would be
> showing up on a deployment outside the jars.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
>
> On Mon, Jul 21, 2014 at 11:12 AM, Chris Mawata <ch...@gmail.com>
> wrote:
>
>> Aren't the *-default.xml files supposed to be inside the jars rather than
>> loose files?
>> Cheers
>> Chris Mawata
>> On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com>
>> wrote:
>>
>>> I recommend against deleting or moving *-default.xml, because these
>>> files may be supplying reasonable default values for configuration
>>> properties that you haven't set in *-site.xml. We also put defaults into
>>> the code itself in case a configuration property is found to be completely
>>> missing, but I'm not aware of any actual testing of deployments that have
>>> deleted *-default.xml.
>>>
>>> Chris Nauroth
>>> Hortonworks
>>> http://hortonworks.com/
>>>
>>>
>>>
>>> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
>>> studio@chrismackenziephotography.co.uk> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have just realised that my implementation of hadoop-2.4.1 is pulling
>>>> in
>>>> all the default.xml files.
>>>>
>>>> I have three copies of each in different directories, obviously at least
>>>> one of those is on the class path.
>>>>
>>>> Anyway with all the effort to set up a site, it seems strange to me
>>>> that I
>>>> would use settings I had no idea existed and that may not be how I would
>>>> choose to set them up.
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Chris MacKenzie
>>>> telephone: 0131 332 6967
>>>> email: studio@chrismackenziephotography.co.uk
>>>> corporate: www.chrismackenziephotography.co.uk
>>>> <http://www.chrismackenziephotography.co.uk/>
>>>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>>>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>>>
>>>>
>>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Mawata <ch...@gmail.com>.
I suspect someone wanted to read through them to know tge defaults.
Chris
On Jul 21, 2014 2:16 PM, "Chris Nauroth" <cn...@hortonworks.com> wrote:
> That's a good point. I'm not sure how bare *-default.xml files would be
> showing up on a deployment outside the jars.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
>
> On Mon, Jul 21, 2014 at 11:12 AM, Chris Mawata <ch...@gmail.com>
> wrote:
>
>> Aren't the *-default.xml files supposed to be inside the jars rather than
>> loose files?
>> Cheers
>> Chris Mawata
>> On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com>
>> wrote:
>>
>>> I recommend against deleting or moving *-default.xml, because these
>>> files may be supplying reasonable default values for configuration
>>> properties that you haven't set in *-site.xml. We also put defaults into
>>> the code itself in case a configuration property is found to be completely
>>> missing, but I'm not aware of any actual testing of deployments that have
>>> deleted *-default.xml.
>>>
>>> Chris Nauroth
>>> Hortonworks
>>> http://hortonworks.com/
>>>
>>>
>>>
>>> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
>>> studio@chrismackenziephotography.co.uk> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have just realised that my implementation of hadoop-2.4.1 is pulling
>>>> in
>>>> all the default.xml files.
>>>>
>>>> I have three copies of each in different directories, obviously at least
>>>> one of those is on the class path.
>>>>
>>>> Anyway with all the effort to set up a site, it seems strange to me
>>>> that I
>>>> would use settings I had no idea existed and that may not be how I would
>>>> choose to set them up.
>>>>
>>>>
>>>> Regards,
>>>>
>>>> Chris MacKenzie
>>>> telephone: 0131 332 6967
>>>> email: studio@chrismackenziephotography.co.uk
>>>> corporate: www.chrismackenziephotography.co.uk
>>>> <http://www.chrismackenziephotography.co.uk/>
>>>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>>>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>>>
>>>>
>>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Nauroth <cn...@hortonworks.com>.
That's a good point. I'm not sure how bare *-default.xml files would be
showing up on a deployment outside the jars.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Mon, Jul 21, 2014 at 11:12 AM, Chris Mawata <ch...@gmail.com>
wrote:
> Aren't the *-default.xml files supposed to be inside the jars rather than
> loose files?
> Cheers
> Chris Mawata
> On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com>
> wrote:
>
>> I recommend against deleting or moving *-default.xml, because these files
>> may be supplying reasonable default values for configuration properties
>> that you haven't set in *-site.xml. We also put defaults into the code
>> itself in case a configuration property is found to be completely missing,
>> but I'm not aware of any actual testing of deployments that have deleted
>> *-default.xml.
>>
>> Chris Nauroth
>> Hortonworks
>> http://hortonworks.com/
>>
>>
>>
>> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
>> studio@chrismackenziephotography.co.uk> wrote:
>>
>>> Hi All,
>>>
>>> I have just realised that my implementation of hadoop-2.4.1 is pulling in
>>> all the default.xml files.
>>>
>>> I have three copies of each in different directories, obviously at least
>>> one of those is on the class path.
>>>
>>> Anyway with all the effort to set up a site, it seems strange to me that
>>> I
>>> would use settings I had no idea existed and that may not be how I would
>>> choose to set them up.
>>>
>>>
>>> Regards,
>>>
>>> Chris MacKenzie
>>> telephone: 0131 332 6967
>>> email: studio@chrismackenziephotography.co.uk
>>> corporate: www.chrismackenziephotography.co.uk
>>> <http://www.chrismackenziephotography.co.uk/>
>>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>>
>>>
>>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Nauroth <cn...@hortonworks.com>.
That's a good point. I'm not sure how bare *-default.xml files would be
showing up on a deployment outside the jars.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Mon, Jul 21, 2014 at 11:12 AM, Chris Mawata <ch...@gmail.com>
wrote:
> Aren't the *-default.xml files supposed to be inside the jars rather than
> loose files?
> Cheers
> Chris Mawata
> On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com>
> wrote:
>
>> I recommend against deleting or moving *-default.xml, because these files
>> may be supplying reasonable default values for configuration properties
>> that you haven't set in *-site.xml. We also put defaults into the code
>> itself in case a configuration property is found to be completely missing,
>> but I'm not aware of any actual testing of deployments that have deleted
>> *-default.xml.
>>
>> Chris Nauroth
>> Hortonworks
>> http://hortonworks.com/
>>
>>
>>
>> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
>> studio@chrismackenziephotography.co.uk> wrote:
>>
>>> Hi All,
>>>
>>> I have just realised that my implementation of hadoop-2.4.1 is pulling in
>>> all the default.xml files.
>>>
>>> I have three copies of each in different directories, obviously at least
>>> one of those is on the class path.
>>>
>>> Anyway with all the effort to set up a site, it seems strange to me that
>>> I
>>> would use settings I had no idea existed and that may not be how I would
>>> choose to set them up.
>>>
>>>
>>> Regards,
>>>
>>> Chris MacKenzie
>>> telephone: 0131 332 6967
>>> email: studio@chrismackenziephotography.co.uk
>>> corporate: www.chrismackenziephotography.co.uk
>>> <http://www.chrismackenziephotography.co.uk/>
>>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>>
>>>
>>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Nauroth <cn...@hortonworks.com>.
That's a good point. I'm not sure how bare *-default.xml files would be
showing up on a deployment outside the jars.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Mon, Jul 21, 2014 at 11:12 AM, Chris Mawata <ch...@gmail.com>
wrote:
> Aren't the *-default.xml files supposed to be inside the jars rather than
> loose files?
> Cheers
> Chris Mawata
> On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com>
> wrote:
>
>> I recommend against deleting or moving *-default.xml, because these files
>> may be supplying reasonable default values for configuration properties
>> that you haven't set in *-site.xml. We also put defaults into the code
>> itself in case a configuration property is found to be completely missing,
>> but I'm not aware of any actual testing of deployments that have deleted
>> *-default.xml.
>>
>> Chris Nauroth
>> Hortonworks
>> http://hortonworks.com/
>>
>>
>>
>> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
>> studio@chrismackenziephotography.co.uk> wrote:
>>
>>> Hi All,
>>>
>>> I have just realised that my implementation of hadoop-2.4.1 is pulling in
>>> all the default.xml files.
>>>
>>> I have three copies of each in different directories, obviously at least
>>> one of those is on the class path.
>>>
>>> Anyway with all the effort to set up a site, it seems strange to me that
>>> I
>>> would use settings I had no idea existed and that may not be how I would
>>> choose to set them up.
>>>
>>>
>>> Regards,
>>>
>>> Chris MacKenzie
>>> telephone: 0131 332 6967
>>> email: studio@chrismackenziephotography.co.uk
>>> corporate: www.chrismackenziephotography.co.uk
>>> <http://www.chrismackenziephotography.co.uk/>
>>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>>
>>>
>>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Nauroth <cn...@hortonworks.com>.
That's a good point. I'm not sure how bare *-default.xml files would be
showing up on a deployment outside the jars.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Mon, Jul 21, 2014 at 11:12 AM, Chris Mawata <ch...@gmail.com>
wrote:
> Aren't the *-default.xml files supposed to be inside the jars rather than
> loose files?
> Cheers
> Chris Mawata
> On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com>
> wrote:
>
>> I recommend against deleting or moving *-default.xml, because these files
>> may be supplying reasonable default values for configuration properties
>> that you haven't set in *-site.xml. We also put defaults into the code
>> itself in case a configuration property is found to be completely missing,
>> but I'm not aware of any actual testing of deployments that have deleted
>> *-default.xml.
>>
>> Chris Nauroth
>> Hortonworks
>> http://hortonworks.com/
>>
>>
>>
>> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
>> studio@chrismackenziephotography.co.uk> wrote:
>>
>>> Hi All,
>>>
>>> I have just realised that my implementation of hadoop-2.4.1 is pulling in
>>> all the default.xml files.
>>>
>>> I have three copies of each in different directories, obviously at least
>>> one of those is on the class path.
>>>
>>> Anyway with all the effort to set up a site, it seems strange to me that
>>> I
>>> would use settings I had no idea existed and that may not be how I would
>>> choose to set them up.
>>>
>>>
>>> Regards,
>>>
>>> Chris MacKenzie
>>> telephone: 0131 332 6967
>>> email: studio@chrismackenziephotography.co.uk
>>> corporate: www.chrismackenziephotography.co.uk
>>> <http://www.chrismackenziephotography.co.uk/>
>>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>>
>>>
>>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Mawata <ch...@gmail.com>.
Aren't the *-default.xml files supposed to be inside the jars rather than
loose files?
Cheers
Chris Mawata
On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com> wrote:
> I recommend against deleting or moving *-default.xml, because these files
> may be supplying reasonable default values for configuration properties
> that you haven't set in *-site.xml. We also put defaults into the code
> itself in case a configuration property is found to be completely missing,
> but I'm not aware of any actual testing of deployments that have deleted
> *-default.xml.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
>
> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
> studio@chrismackenziephotography.co.uk> wrote:
>
>> Hi All,
>>
>> I have just realised that my implementation of hadoop-2.4.1 is pulling in
>> all the default.xml files.
>>
>> I have three copies of each in different directories, obviously at least
>> one of those is on the class path.
>>
>> Anyway with all the effort to set up a site, it seems strange to me that I
>> would use settings I had no idea existed and that may not be how I would
>> choose to set them up.
>>
>>
>> Regards,
>>
>> Chris MacKenzie
>> telephone: 0131 332 6967
>> email: studio@chrismackenziephotography.co.uk
>> corporate: www.chrismackenziephotography.co.uk
>> <http://www.chrismackenziephotography.co.uk/>
>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
planning a cluster
Posted by "Adaryl \"Bob\" Wakefield, MBA" <ad...@hotmail.com>.
What is the rule for determining how many nodes should be in your initial cluster?
B.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Mawata <ch...@gmail.com>.
Aren't the *-default.xml files supposed to be inside the jars rather than
loose files?
Cheers
Chris Mawata
On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com> wrote:
> I recommend against deleting or moving *-default.xml, because these files
> may be supplying reasonable default values for configuration properties
> that you haven't set in *-site.xml. We also put defaults into the code
> itself in case a configuration property is found to be completely missing,
> but I'm not aware of any actual testing of deployments that have deleted
> *-default.xml.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
>
> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
> studio@chrismackenziephotography.co.uk> wrote:
>
>> Hi All,
>>
>> I have just realised that my implementation of hadoop-2.4.1 is pulling in
>> all the default.xml files.
>>
>> I have three copies of each in different directories, obviously at least
>> one of those is on the class path.
>>
>> Anyway with all the effort to set up a site, it seems strange to me that I
>> would use settings I had no idea existed and that may not be how I would
>> choose to set them up.
>>
>>
>> Regards,
>>
>> Chris MacKenzie
>> telephone: 0131 332 6967
>> email: studio@chrismackenziephotography.co.uk
>> corporate: www.chrismackenziephotography.co.uk
>> <http://www.chrismackenziephotography.co.uk/>
>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
planning a cluster
Posted by "Adaryl \"Bob\" Wakefield, MBA" <ad...@hotmail.com>.
What is the rule for determining how many nodes should be in your initial cluster?
B.
planning a cluster
Posted by "Adaryl \"Bob\" Wakefield, MBA" <ad...@hotmail.com>.
What is the rule for determining how many nodes should be in your initial cluster?
B.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Mawata <ch...@gmail.com>.
Aren't the *-default.xml files supposed to be inside the jars rather than
loose files?
Cheers
Chris Mawata
On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com> wrote:
> I recommend against deleting or moving *-default.xml, because these files
> may be supplying reasonable default values for configuration properties
> that you haven't set in *-site.xml. We also put defaults into the code
> itself in case a configuration property is found to be completely missing,
> but I'm not aware of any actual testing of deployments that have deleted
> *-default.xml.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
>
> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
> studio@chrismackenziephotography.co.uk> wrote:
>
>> Hi All,
>>
>> I have just realised that my implementation of hadoop-2.4.1 is pulling in
>> all the default.xml files.
>>
>> I have three copies of each in different directories, obviously at least
>> one of those is on the class path.
>>
>> Anyway with all the effort to set up a site, it seems strange to me that I
>> would use settings I had no idea existed and that may not be how I would
>> choose to set them up.
>>
>>
>> Regards,
>>
>> Chris MacKenzie
>> telephone: 0131 332 6967
>> email: studio@chrismackenziephotography.co.uk
>> corporate: www.chrismackenziephotography.co.uk
>> <http://www.chrismackenziephotography.co.uk/>
>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Mawata <ch...@gmail.com>.
Aren't the *-default.xml files supposed to be inside the jars rather than
loose files?
Cheers
Chris Mawata
On Jul 21, 2014 12:59 PM, "Chris Nauroth" <cn...@hortonworks.com> wrote:
> I recommend against deleting or moving *-default.xml, because these files
> may be supplying reasonable default values for configuration properties
> that you haven't set in *-site.xml. We also put defaults into the code
> itself in case a configuration property is found to be completely missing,
> but I'm not aware of any actual testing of deployments that have deleted
> *-default.xml.
>
> Chris Nauroth
> Hortonworks
> http://hortonworks.com/
>
>
>
> On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
> studio@chrismackenziephotography.co.uk> wrote:
>
>> Hi All,
>>
>> I have just realised that my implementation of hadoop-2.4.1 is pulling in
>> all the default.xml files.
>>
>> I have three copies of each in different directories, obviously at least
>> one of those is on the class path.
>>
>> Anyway with all the effort to set up a site, it seems strange to me that I
>> would use settings I had no idea existed and that may not be how I would
>> choose to set them up.
>>
>>
>> Regards,
>>
>> Chris MacKenzie
>> telephone: 0131 332 6967
>> email: studio@chrismackenziephotography.co.uk
>> corporate: www.chrismackenziephotography.co.uk
>> <http://www.chrismackenziephotography.co.uk/>
>> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
>> <http://www.linkedin.com/in/chrismackenziephotography/>
>>
>>
>>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Nauroth <cn...@hortonworks.com>.
I recommend against deleting or moving *-default.xml, because these files
may be supplying reasonable default values for configuration properties
that you haven't set in *-site.xml. We also put defaults into the code
itself in case a configuration property is found to be completely missing,
but I'm not aware of any actual testing of deployments that have deleted
*-default.xml.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
studio@chrismackenziephotography.co.uk> wrote:
> Hi All,
>
> I have just realised that my implementation of hadoop-2.4.1 is pulling in
> all the default.xml files.
>
> I have three copies of each in different directories, obviously at least
> one of those is on the class path.
>
> Anyway with all the effort to set up a site, it seems strange to me that I
> would use settings I had no idea existed and that may not be how I would
> choose to set them up.
>
>
> Regards,
>
> Chris MacKenzie
> telephone: 0131 332 6967
> email: studio@chrismackenziephotography.co.uk
> corporate: www.chrismackenziephotography.co.uk
> <http://www.chrismackenziephotography.co.uk/>
> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
> <http://www.linkedin.com/in/chrismackenziephotography/>
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris MacKenzie <st...@chrismackenziephotography.co.uk>.
Hi thanks for that, much appreciated.
I guess they are in the jar files then ;O) I was really surprised to see
the default configs pulled in, especially considering I thought I was in
full control, I did a file search on an installation and saw the files and
jumped to the wrong conclusion.
I feel like a real idiot some times, but there is so much conflicting
information out there that later you realise that questions asked seem non
sensical but at the time they feel valid ;O)
Thanks for your tolerance,
Chris MacKenzie
telephone: 0131 332 6967
email: studio@chrismackenziephotography.co.uk
corporate: www.chrismackenziephotography.co.uk
<http://www.chrismackenziephotography.co.uk/>
<http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
<http://www.linkedin.com/in/chrismackenziephotography/>
On 21/07/2014 09:46, "Chris MacKenzie"
<st...@chrismackenziephotography.co.uk> wrote:
>Hi All,
>
>I have just realised that my implementation of hadoop-2.4.1 is pulling in
>all the default.xml files.
>
>I have three copies of each in different directories, obviously at least
>one of those is on the class path.
>
>Anyway with all the effort to set up a site, it seems strange to me that I
>would use settings I had no idea existed and that may not be how I would
>choose to set them up.
>
>
>Regards,
>
>Chris MacKenzie
>telephone: 0131 332 6967
>email: studio@chrismackenziephotography.co.uk
>corporate: www.chrismackenziephotography.co.uk
><http://www.chrismackenziephotography.co.uk/>
><http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
><http://www.linkedin.com/in/chrismackenziephotography/>
>
>
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris MacKenzie <st...@chrismackenziephotography.co.uk>.
Hi thanks for that, much appreciated.
I guess they are in the jar files then ;O) I was really surprised to see
the default configs pulled in, especially considering I thought I was in
full control, I did a file search on an installation and saw the files and
jumped to the wrong conclusion.
I feel like a real idiot some times, but there is so much conflicting
information out there that later you realise that questions asked seem non
sensical but at the time they feel valid ;O)
Thanks for your tolerance,
Chris MacKenzie
telephone: 0131 332 6967
email: studio@chrismackenziephotography.co.uk
corporate: www.chrismackenziephotography.co.uk
<http://www.chrismackenziephotography.co.uk/>
<http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
<http://www.linkedin.com/in/chrismackenziephotography/>
On 21/07/2014 09:46, "Chris MacKenzie"
<st...@chrismackenziephotography.co.uk> wrote:
>Hi All,
>
>I have just realised that my implementation of hadoop-2.4.1 is pulling in
>all the default.xml files.
>
>I have three copies of each in different directories, obviously at least
>one of those is on the class path.
>
>Anyway with all the effort to set up a site, it seems strange to me that I
>would use settings I had no idea existed and that may not be how I would
>choose to set them up.
>
>
>Regards,
>
>Chris MacKenzie
>telephone: 0131 332 6967
>email: studio@chrismackenziephotography.co.uk
>corporate: www.chrismackenziephotography.co.uk
><http://www.chrismackenziephotography.co.uk/>
><http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
><http://www.linkedin.com/in/chrismackenziephotography/>
>
>
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Nauroth <cn...@hortonworks.com>.
I recommend against deleting or moving *-default.xml, because these files
may be supplying reasonable default values for configuration properties
that you haven't set in *-site.xml. We also put defaults into the code
itself in case a configuration property is found to be completely missing,
but I'm not aware of any actual testing of deployments that have deleted
*-default.xml.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
studio@chrismackenziephotography.co.uk> wrote:
> Hi All,
>
> I have just realised that my implementation of hadoop-2.4.1 is pulling in
> all the default.xml files.
>
> I have three copies of each in different directories, obviously at least
> one of those is on the class path.
>
> Anyway with all the effort to set up a site, it seems strange to me that I
> would use settings I had no idea existed and that may not be how I would
> choose to set them up.
>
>
> Regards,
>
> Chris MacKenzie
> telephone: 0131 332 6967
> email: studio@chrismackenziephotography.co.uk
> corporate: www.chrismackenziephotography.co.uk
> <http://www.chrismackenziephotography.co.uk/>
> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
> <http://www.linkedin.com/in/chrismackenziephotography/>
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Nauroth <cn...@hortonworks.com>.
I recommend against deleting or moving *-default.xml, because these files
may be supplying reasonable default values for configuration properties
that you haven't set in *-site.xml. We also put defaults into the code
itself in case a configuration property is found to be completely missing,
but I'm not aware of any actual testing of deployments that have deleted
*-default.xml.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
studio@chrismackenziephotography.co.uk> wrote:
> Hi All,
>
> I have just realised that my implementation of hadoop-2.4.1 is pulling in
> all the default.xml files.
>
> I have three copies of each in different directories, obviously at least
> one of those is on the class path.
>
> Anyway with all the effort to set up a site, it seems strange to me that I
> would use settings I had no idea existed and that may not be how I would
> choose to set them up.
>
>
> Regards,
>
> Chris MacKenzie
> telephone: 0131 332 6967
> email: studio@chrismackenziephotography.co.uk
> corporate: www.chrismackenziephotography.co.uk
> <http://www.chrismackenziephotography.co.uk/>
> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
> <http://www.linkedin.com/in/chrismackenziephotography/>
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris Nauroth <cn...@hortonworks.com>.
I recommend against deleting or moving *-default.xml, because these files
may be supplying reasonable default values for configuration properties
that you haven't set in *-site.xml. We also put defaults into the code
itself in case a configuration property is found to be completely missing,
but I'm not aware of any actual testing of deployments that have deleted
*-default.xml.
Chris Nauroth
Hortonworks
http://hortonworks.com/
On Mon, Jul 21, 2014 at 1:46 AM, Chris MacKenzie <
studio@chrismackenziephotography.co.uk> wrote:
> Hi All,
>
> I have just realised that my implementation of hadoop-2.4.1 is pulling in
> all the default.xml files.
>
> I have three copies of each in different directories, obviously at least
> one of those is on the class path.
>
> Anyway with all the effort to set up a site, it seems strange to me that I
> would use settings I had no idea existed and that may not be how I would
> choose to set them up.
>
>
> Regards,
>
> Chris MacKenzie
> telephone: 0131 332 6967
> email: studio@chrismackenziephotography.co.uk
> corporate: www.chrismackenziephotography.co.uk
> <http://www.chrismackenziephotography.co.uk/>
> <http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
> <http://www.linkedin.com/in/chrismackenziephotography/>
>
>
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Is it a good idea to delete / move the default configuration xml
file ?
Posted by Chris MacKenzie <st...@chrismackenziephotography.co.uk>.
Hi thanks for that, much appreciated.
I guess they are in the jar files then ;O) I was really surprised to see
the default configs pulled in, especially considering I thought I was in
full control, I did a file search on an installation and saw the files and
jumped to the wrong conclusion.
I feel like a real idiot some times, but there is so much conflicting
information out there that later you realise that questions asked seem non
sensical but at the time they feel valid ;O)
Thanks for your tolerance,
Chris MacKenzie
telephone: 0131 332 6967
email: studio@chrismackenziephotography.co.uk
corporate: www.chrismackenziephotography.co.uk
<http://www.chrismackenziephotography.co.uk/>
<http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
<http://www.linkedin.com/in/chrismackenziephotography/>
On 21/07/2014 09:46, "Chris MacKenzie"
<st...@chrismackenziephotography.co.uk> wrote:
>Hi All,
>
>I have just realised that my implementation of hadoop-2.4.1 is pulling in
>all the default.xml files.
>
>I have three copies of each in different directories, obviously at least
>one of those is on the class path.
>
>Anyway with all the effort to set up a site, it seems strange to me that I
>would use settings I had no idea existed and that may not be how I would
>choose to set them up.
>
>
>Regards,
>
>Chris MacKenzie
>telephone: 0131 332 6967
>email: studio@chrismackenziephotography.co.uk
>corporate: www.chrismackenziephotography.co.uk
><http://www.chrismackenziephotography.co.uk/>
><http://plus.google.com/+ChrismackenziephotographyCoUk/posts>
><http://www.linkedin.com/in/chrismackenziephotography/>
>
>