Yardstick benchmarking on Ignite with Persistent store

[amol wagh <aw...@gmail.com>]

Hello,

I recently started experimenting with Apache Ignite. I want to experiment
the persistent store feature in particular. I am running Apache Ignite and
I successfully tried example programs for persisting data on SSD. Now, I
want run yardstick benchmarks in similar configuration, I followed the same
configuration steps like I followed for examples but no luck. I can not see
data on SSD that I have mounted.

So question are 1) Does Yardstick benchmarks have implementation to write
data to storage device.
2) If yes, how to configure or do we need any modification to benchmarks?

here are couple of line I followed in java code-
- setPersistenceEnabled to true
- setCustomStoragePath to custom location
- setWalArchivePath to custom
- setWlPath to custom
- set data store configuration
-start ignite server


Thanks,
AW

Re: Yardstick benchmarking on Ignite with Persistent store

[awagh1 <aw...@gmail.com>]

Hi Ilya,

Thanks for reply again! Looks like my issue is now solved. 
You and Denis were correct I was missing "ignite.active" statement in my
code

I modified my IgniteNode.java under Ignite-yardstick benchmark source code
as to work.

if(args.persistentStoreEnabled())
        {
            DataStorageConfiguration pcCfg = new DataStorageConfiguration();
            BenchmarkUtils.println("@@@@@@@@@@@HERE@@@@@@@@@@@");
            //AMOL
           
pcCfg.getDefaultDataRegionConfiguration().setPersistenceEnabled(true);
            pcCfg.setStoragePath("/srv/ssd/GG/");
            pcCfg.setWalArchivePath("/srv/ssd/GG/WalArchive");
            pcCfg.setWalPath("/srv/ssd/GG/WAL");
            c.setDataStorageConfiguration(pcCfg);
        }
        //AMOL
        ignite = Ignition.start(c);
        ignite.active(true);



Thank you so much!!!

-Amol



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Yardstick benchmarking on Ignite with Persistent store

[Ilya Kasnacheev <il...@gmail.com>]

Hello!

Please share your Yardstick test with persistence enabled so that we can
have a look.

Send the code in userlist message or put to github in gist or repository.

Regards,

-- 
Ilya Kasnacheev

2017-12-16 2:42 GMT+03:00 awagh1 <aw...@gmail.com>:

> Thanks for reply Ilya!
>
> Yes I ran with pds option. After looking at run logs for Yardstick logs
> looks like there is no failure message like in link you sent. It shows end
> to end run is complete and graphs are generated too.
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: Yardstick benchmarking on Ignite with Persistent store

[awagh1 <aw...@gmail.com>]

Thanks for reply Ilya!

Yes I ran with pds option. After looking at run logs for Yardstick logs
looks like there is no failure message like in link you sent. It shows end
to end run is complete and graphs are generated too.



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Yardstick benchmarking on Ignite with Persistent store

[Denis Magda <dm...@apache.org>]

Here is you can find several cluster activation options:
https://apacheignite.readme.io/docs/cluster-activation <https://apacheignite.readme.io/docs/cluster-activation>

—
Denis

> On Dec 15, 2017, at 6:42 AM, ilya.kasnacheev <il...@gmail.com> wrote:
> 
> Hello Amol!
> 
> After starting persistent cluster, you need to activate it. Unless you
> activate it no information can be written or read.
> 
> See https://issues.apache.org/jira/browse/IGNITE-5534 for proposed
> improvement.
> 
> What you can do is either start server nodes and activate them via
> bin/control.sh --activate, or do ignite.active(true) in your custom
> Yardstick benchmarks.
> 
> After that Yardstick should work OK with Persistent store.
> 
> Regards,
> 
> 
> 
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Yardstick benchmarking on Ignite with Persistent store

["ilya.kasnacheev" <il...@gmail.com>]

Hello Amol!

After starting persistent cluster, you need to activate it. Unless you
activate it no information can be written or read.

See https://issues.apache.org/jira/browse/IGNITE-5534 for proposed
improvement.

What you can do is either start server nodes and activate them via
bin/control.sh --activate, or do ignite.active(true) in your custom
Yardstick benchmarks.

After that Yardstick should work OK with Persistent store.

Regards,



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/