Defining WAL location within HDFS outside of rootdir

[Anthony Nguyen <an...@gmail.com>]

Hi all,

Is it possible to define explicitly where the WAL / oldWAL is stored,
separate from where rootdir is? If not, would it break anything for me to
change HBase to allow for this? The context is to optimize the WAL location
for the use case of a shared filesystem.

Thanks!

Re: Defining WAL location within HDFS outside of rootdir

[Ted Yu <yu...@gmail.com>]

Anthony:
bq. optimize the WAL location for the use case of a shared filesystem

Can you tell us more about the nature of the shared filesystem ?
Just want to understand your use case.

If you have Hadoop system that supports tiered storage policies, this may
be of interest to you:
HBASE-12848

Cheers

On Mon, Sep 14, 2015 at 2:08 PM, Vladimir Rodionov <vl...@gmail.com>
wrote:

> Hi, Anthony
> Short answer - it is not possible. Feel free to submit a patch. Make sure
> you find all places in the code
> where log / old directory path is constructed. I think Mattheo Bartozzi is
> working on a unified RS file system
> so you will need to align your patch with his work.
>
> -Vlad
>
> On Mon, Sep 14, 2015 at 1:03 PM, Anthony Nguyen <
> anthony.an.nguyen@gmail.com
> > wrote:
>
> > Hi all,
> >
> > Is it possible to define explicitly where the WAL / oldWAL is stored,
> > separate from where rootdir is? If not, would it break anything for me to
> > change HBase to allow for this? The context is to optimize the WAL
> location
> > for the use case of a shared filesystem.
> >
> > Thanks!
> >
>

Re: Defining WAL location within HDFS outside of rootdir

[Vladimir Rodionov <vl...@gmail.com>]

Hi, Anthony
Short answer - it is not possible. Feel free to submit a patch. Make sure
you find all places in the code
where log / old directory path is constructed. I think Mattheo Bartozzi is
working on a unified RS file system
so you will need to align your patch with his work.

-Vlad

On Mon, Sep 14, 2015 at 1:03 PM, Anthony Nguyen <anthony.an.nguyen@gmail.com
> wrote:

> Hi all,
>
> Is it possible to define explicitly where the WAL / oldWAL is stored,
> separate from where rootdir is? If not, would it break anything for me to
> change HBase to allow for this? The context is to optimize the WAL location
> for the use case of a shared filesystem.
>
> Thanks!
>