Apache Ignite Clientside NearCache and Serverside Eviction blocking cluster

[pvprsd <pr...@blueyonder.com>]

Hi All,

We have recently enabled Eviction on Ignite server nodes. We were using
ignite nearcache for ignite client nodes.

Due to nearcache, the server side cache-entries are not getting evicted.
Eventually this leads to off-cache full, and "Too many attempts to evict
data page" error and ignite cluster stopped responding. We have given enough
memory to ignite server nodes i.e. 4+4gb for heap and off-heap.

From debugging the server code, it looks like the near-cache enforces the
entries to maintain the client-node id; and due to this those entries are
not getting evicted from server.

When the clientside the entries got evicted (with clientside LRU eviction),
it seems the client-node reference in serverside entry is not getting
cleared. Hence after sometime it leads to ignite getting blocked. This is
consistently happening.

Either I am doing some thing wrong with the ignite configurations, OR there
is a bug in the ignite with this combination.

Can you please guide me, on how to find resolution to this problem.

Thanks,
Prasad





--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Apache Ignite Clientside NearCache and Serverside Eviction blocking cluster

[Вячеслав Коптилин <sl...@gmail.com>]

Hello Prasad,

Sorry for the late reply.

I checked your reproducer and it looks good to me.
And yes, this behavior looks like a bug. I filed a Jira ticket in order to
address this issue: https://issues.apache.org/jira/browse/IGNITE-13858
You can enable ignite native persistence in order to overcome this issue.

Thanks,
Slava.

пт, 4 дек. 2020 г. в 08:58, pvprsd <pr...@blueyonder.com>:

> Hi Slava,
>
> Did you get a chance to look into the issue? Please let us know if there
> are
> configuration problems. We need to have both the features in our current
> implementation for better performance.
>
> Thanks,
> Prasad
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: Apache Ignite Clientside NearCache and Serverside Eviction blocking cluster

[pvprsd <pr...@blueyonder.com>]

Hi Slava,

Did you get a chance to look into the issue? Please let us know if there are
configuration problems. We need to have both the features in our current
implementation for better performance.

Thanks,
Prasad




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Webinar: How to Use Spark With Apache Ignite for Big Data Processing

[andrei <ae...@gmail.com>]

Hi Igniters!

I'm going to talk about Apache Ignite Spark integration and run live 
demo examples during the following webinar:

https://www.gridgain.com/resources/webinars/how-use-spark-apache-ignite-big-data-processing 
<https://www.gridgain.com/resources/webinars/how-use-spark-apache-ignite-big-data-processing>

If you'd like to learn more about the existing API, take a look at some 
use cases, or just ask a few questions, feel free to join the webinar.

BR,
Andrei

Re: Apache Ignite Clientside NearCache and Serverside Eviction blocking cluster

[Вячеслав Коптилин <sl...@gmail.com>]

Hello Prasad,

I will take a look and file a ticket if needed.

Thanks,
S.

пн, 23 нояб. 2020 г. в 19:23, pvprsd <pr...@blueyonder.com>:

> Hi,
>
> Did anyone get a chance to look into this issue? Is this supported
> configuration for ignite? As these 2 (clientside NearCache and serverside
> eviction) are very common features, I am wondering many projects should be
> using this combination.
>
> Can this be reported as a defect for ignite, if there is no configuration
> fix for this problem?
>
> Many thanks in advance.
>
> Thanks,
> Prasad
>
>
>
>
> --
> Sent from: http://apache-ignite-users.70518.x6.nabble.com/
>

Re: Apache Ignite Clientside NearCache and Serverside Eviction blocking cluster

[pvprsd <pr...@blueyonder.com>]

Hi,

Did anyone get a chance to look into this issue? Is this supported
configuration for ignite? As these 2 (clientside NearCache and serverside
eviction) are very common features, I am wondering many projects should be
using this combination.

Can this be reported as a defect for ignite, if there is no configuration
fix for this problem?

Many thanks in advance.

Thanks,
Prasad




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Apache Ignite Clientside NearCache and Serverside Eviction blocking cluster

[pvprsd <pr...@blueyonder.com>]

Hi,

I have created a sample reproducer using examples files. I am using ignite
2.8.0 version.

Here I have updated server configurations in ExampleNodeStartup.java, and
client configurations in CacheClientBinaryPutGetExample.java files.

Server is configured with eviction-enabled, and client is configured with
near-cache. Client keeps adding more entries to the cache. Server stores all
the entries, and when memory utilization reached 90%, it should evict the
LRU entries from server cache in this use-case. 

In 7-8 minutes, the server is not able to evict the data and showing the
warning "Too many failed attempts to evict page: 30".

I am attaching the updated files for your reference. Can you please review
and provide your recommendations.

Ignite_Blocker_Issue.zip
<http://apache-ignite-users.70518.x6.nabble.com/file/t3000/Ignite_Blocker_Issue.zip>  

Thanks,
Prasad




--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/