You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by David Koch <og...@googlemail.com> on 2014/03/26 18:10:18 UTC
HBase on top of Google Cloud Storage
Hi,
Naive question: What would be required to get HBase to run on the Google
Cloud Storage filesystem (GFS) ? Is it even possible, given the properties
of GFS?
There is a Hadoop
connector<https://developers.google.com/hadoop/google-cloud-storage-connector>but
I gather HBase is tightly integrated with HDFS.
Regards,
/David
Re: HBase on top of Google Cloud Storage
Posted by Andrew Purtell <ap...@apache.org>.
On Thu, Mar 27, 2014 at 5:41 AM, David Koch <og...@googlemail.com> wrote:
> > "FileSystem.append is unsupported. If you choose Google Cloud Storage as
> > your default file
> > system<
> >
> https://developers.google.com/hadoop/setting-up-a-hadoop-cluster#choosingafilesystem
> > >,
> >
>
> Thanks for your answer, does HBase use this operation under the hood?
>
Yes, for the write ahead log.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)
Re: HBase on top of Google Cloud Storage
Posted by David Koch <og...@googlemail.com>.
>
>
> "FileSystem.append is unsupported. If you choose Google Cloud Storage as
> your default file
> system<
> https://developers.google.com/hadoop/setting-up-a-hadoop-cluster#choosingafilesystem
> >,
>
Thanks for your answer, does HBase use this operation under the hood?
/David
Re: HBase on top of Google Cloud Storage
Posted by Andrew Purtell <ap...@apache.org>.
According to
https://developers.google.com/hadoop/google-cloud-storage-connector:
"FileSystem.append is unsupported. If you choose Google Cloud Storage as
your default file
system<https://developers.google.com/hadoop/setting-up-a-hadoop-cluster#choosingafilesystem>,
you might need to update your MapReduce to avoid using the append method."
So, the answer is: append support in GFS, at a minimum, therefore unlikely
to happen.
But this is a naive answer :-) since I'm not familiar with the Google
cloud.
On Wed, Mar 26, 2014 at 10:10 AM, David Koch <og...@googlemail.com> wrote:
> Hi,
>
> Naive question: What would be required to get HBase to run on the Google
> Cloud Storage filesystem (GFS) ? Is it even possible, given the properties
> of GFS?
>
> There is a Hadoop
> connector<
> https://developers.google.com/hadoop/google-cloud-storage-connector>but
> I gather HBase is tightly integrated with HDFS.
>
> Regards,
>
> /David
>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet Hein
(via Tom White)