WAL log folder issue in YARN mode

[Ray <ra...@cisco.com>]

When I deployed ignite as a YARN application with persistent store enabled.
The WAL logs are under the
/yarn/nm/usercache/username/appcache/application_appid/container_containerID/ignite/apache-ignite-fabric-2.1.0-bin/work/db/wal/.
But when ignite is restarted using YARN, a new appid will be created so the
WAL in the old app will not be copied to the new app.
I tried setting IGNITE_WORK_DIR to a local directory and IGNITE_RELEASES_DIR
to a hdfs directory hoping ignite will save the WAL logs to these folders,
but it does not.
Please advice me how to solve this issue.

Thanks



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: WAL log folder issue in YARN mode

[Denis Magda <dm...@apache.org>]

Hi Ray,

Sure you can manage an Ignite cluster with the persistence enabled in YARN. Change a path for storage files and its WALs using PersistentStoreConfiguration. This example shows how to achieve this:
https://apacheignite.readme.io/docs/durable-memory-tuning#section-separate-disk-device-for-wal

Please let me know if the suggestion works, I’ll update the YARN deployment configuration on Ignite side.

—
Denis

> On Sep 20, 2017, at 7:40 AM, Ray <ra...@cisco.com> wrote:
> 
> Hi Ilya,
> 
> I want to use YARN to launch Ignite because YARN is easy to manage.
> And there's other service in our cluster and I want to use YARN as a unified
> resource manager.
> 
> So what you're telling me is that if I deploy Ignite on YARN there's no way
> to utilize the native persistent store feature, right?
> 
> 
> I think if user want to deploy Ignite on YARN, it's only reasonable to move
> the Ignite native persistent store from local file system to HDFS.
> Otherwise Ignite on YARN lacks this feature and might be very important to a
> lot of users.
> 
> Thanks
> 
> 
> 
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: WAL log folder issue in YARN mode

[Ray <ra...@cisco.com>]

Hi Ilya,

I want to use YARN to launch Ignite because YARN is easy to manage.
And there's other service in our cluster and I want to use YARN as a unified
resource manager.

So what you're telling me is that if I deploy Ignite on YARN there's no way
to utilize the native persistent store feature, right?


I think if user want to deploy Ignite on YARN, it's only reasonable to move
the Ignite native persistent store from local file system to HDFS.
Otherwise Ignite on YARN lacks this feature and might be very important to a
lot of users.

Thanks



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: WAL log folder issue in YARN mode

[Ilya Kasnacheev <il...@gmail.com>]

Hello Ray,

After a brief glance, I have figured out that YARN expects all its tasks to
use HDFS for data storage and not the local system, which is considered
ephemeral.

You can use Ignite *with* HDFS but I doubt you can use Ignite native
persistence persist to HDFS, really.

Please tell me what you are trying to accomplish by this setup? Do you want
to use YARN just as a launcher for Ignite?

Regards,

-- 
Ilya Kasnacheev

2017-09-20 9:58 GMT+03:00 Ray <ra...@cisco.com>:

> When I deployed ignite as a YARN application with persistent store enabled.
> The WAL logs are under the
> /yarn/nm/usercache/username/appcache/application_appid/
> container_containerID/ignite/apache-ignite-fabric-2.1.0-bin/work/db/wal/.
> But when ignite is restarted using YARN, a new appid will be created so the
> WAL in the old app will not be copied to the new app.
> I tried setting IGNITE_WORK_DIR to a local directory and
> IGNITE_RELEASES_DIR
> to a hdfs directory hoping ignite will save the WAL logs to these folders,
> but it does not.
> Please advice me how to solve this issue.
>
> Thanks
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>