XML Files Design Question

[Barney Frank <ba...@gmail.com>]

Yes, I have taken the lazy way and am asking for opinions.

I am currently using Hbase for my application and now am considering some
other uses.

My application will be storing thousands of XML files used for
configuration.  It uses thousands since it is multitenant.  Most customers
will be in the hundreds.

Presently I store these on the whatever file system the application server
happens to be running on.  I would like to move them to a resource that
could be better shared.  My thought is either to store them in an hbase
table or store them directly into hadoop.

File sizes should be less than 100KB.  Response time is not critical.

Pros? Cons? Gotchas? Opinions?

RE: XML Files Design Question

[Jonathan Gray <jg...@facebook.com>]

I'd recommend HBase over HDFS with file sizes in that range.

It will be faster and far more scalable while inheriting the same durability guarantees you get from HDFS.

> -----Original Message-----
> From: Barney Frank [mailto:barneyfranks1@gmail.com]
> Sent: Monday, November 08, 2010 11:04 AM
> To: user@hbase.apache.org
> Subject: XML Files Design Question
> 
> Yes, I have taken the lazy way and am asking for opinions.
> 
> I am currently using Hbase for my application and now am considering
> some
> other uses.
> 
> My application will be storing thousands of XML files used for
> configuration.  It uses thousands since it is multitenant.  Most
> customers
> will be in the hundreds.
> 
> Presently I store these on the whatever file system the application
> server
> happens to be running on.  I would like to move them to a resource that
> could be better shared.  My thought is either to store them in an hbase
> table or store them directly into hadoop.
> 
> File sizes should be less than 100KB.  Response time is not critical.
> 
> Pros? Cons? Gotchas? Opinions?