You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-user@hadoop.apache.org by visioner sadak <vi...@gmail.com> on 2012/08/20 09:56:06 UTC
Hadoop Federation help
Hello experts,
Need some help, does the latest stable release 1.0.3 has hadoop federation
(in which we can have multiple name nodes), can the problem of large small
file uploads(http://www.cloudera.com/blog/2009/02/the-small-files-problem/)
be solved if we use this version with hadoop federation as we get name
nodes in clusters
Re: Hadoop Federation help
Posted by ankush gupta <an...@gmail.com>.
unsubscribe
Re: Hadoop Federation help
Posted by visioner sadak <vi...@gmail.com>.
Thanks Harsh
saw tht federation is available in release 0.23.0 (
http://hadoop.apache.org/common/releases.html) so thought that it must be
in 1.0.x as it is latest stable than 0.23.0...
yeah but for small file i think will have to go by HAR only,but are HAR's
mutable in newer versions
or its still immutable...
On Mon, Aug 20, 2012 at 2:21 PM, Harsh J <ha...@cloudera.com> wrote:
> Apache Hadoop 1.x does not have Federated NameNodes. It is however
> present in the Apache Hadoop 2.x releases. NameNodes can indeed scale
> with federated setups, but for faster bulk processing it is still not
> a good idea to keep around tiny files when you can have them bigger.
>
> On Mon, Aug 20, 2012 at 1:26 PM, visioner sadak
> <vi...@gmail.com> wrote:
> > Hello experts,
> >
> > Need some help, does the latest stable release 1.0.3 has hadoop
> federation
> > (in which we can have multiple name nodes), can the problem of large
> small
> > file uploads(
> http://www.cloudera.com/blog/2009/02/the-small-files-problem/)
> > be solved if we use this version with hadoop federation as we get name
> nodes
> > in clusters
>
>
>
> --
> Harsh J
>
Re: Hadoop Federation help
Posted by Harsh J <ha...@cloudera.com>.
Apache Hadoop 1.x does not have Federated NameNodes. It is however
present in the Apache Hadoop 2.x releases. NameNodes can indeed scale
with federated setups, but for faster bulk processing it is still not
a good idea to keep around tiny files when you can have them bigger.
On Mon, Aug 20, 2012 at 1:26 PM, visioner sadak
<vi...@gmail.com> wrote:
> Hello experts,
>
> Need some help, does the latest stable release 1.0.3 has hadoop federation
> (in which we can have multiple name nodes), can the problem of large small
> file uploads(http://www.cloudera.com/blog/2009/02/the-small-files-problem/)
> be solved if we use this version with hadoop federation as we get name nodes
> in clusters
--
Harsh J