You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@ignite.apache.org by Kobe <rk...@mailcity.com> on 2016/02/08 02:34:55 UTC

IGFS: Data cache size

Hello...

I am instantiating a single node IGFS cluster to begin with. I am trying to
determine the available space of the fiesystem based on the parameter

          <property name="blockSize" value="#{128 * 1024}"/>
          <property name="perNodeBatchSize" value="512"/>
          <property name="perNodeParallelBatchCount" value="16"/>

           
           <property name="prefetchBlocks" value="32"/>


and 
       public CacheConfiguration<K,V> setStartSize(int startSize)

Please help me understand these parameters, their units and how they
determine the space of the in-memory filesystem.

thankx,

/Kobe



--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/IGFS-Data-cache-size-tp2875.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: IGFS: Data cache size

Posted by Vladimir Ozerov <vo...@gridgain.com>.

Hi Kobe,

That is right. Essentially, IGFS is a cache. And any Ignite cache could
occupy any amount of memory unless constrained in some way.

Vladimir.

On Tue, Feb 9, 2016 at 11:51 PM, Kobe <rk...@mailcity.com> wrote:

> Vladimir -
>
> That means that an instance of IGFS can occupy all of the heap of the JVM
> unless constrained using
>
>   * <bean class="org.apache.ignite.configuration.FileSystemConfiguration">
>        <property name="maxSpaceSize" value="#{4 * 1024 * 1024 * 1024}"/>
>    </bean>
> *
> Is this correct?
>
> Thanks,
>
> /Kobe
>
>
> Vladimir Ozerov wrote
> > Hi Kobe,
> >
> > Actually, none of these parameters manage IGFS size.
> >
> > Please take a look at
> > org.apache.ignite.configuration.FileSystemConfiguration.getMaxSpaceSize()
> > method.
> > This value defines how much space in bytes IGFS can take on that node.
> You
> > can either set it to some positive value in bytes, or leave default
> value.
> > in the latter case Ignite will use between 50-80% of available heap as
> > maximum IGFS size (see GridCacheAdapter constructor for exact size
> > calculation logic).
> >
> > Please let me know if you have any further questions.
> >
> > Vladimir.
> >
> > On Mon, Feb 8, 2016 at 4:34 AM, Kobe &lt;
>
> > rk_@
>
> > &gt; wrote:
> >
> >> Hello...
> >>
> >> I am instantiating a single node IGFS cluster to begin with. I am trying
> >> to
> >> determine the available space of the fiesystem based on the parameter
> >>
> >>
> > <property name="blockSize" value="#{128 * 1024}"/>
> >>
> > <property name="perNodeBatchSize" value="512"/>
> >>
> > <property name="perNodeParallelBatchCount" value="16"/>
> >>
> >>
> >>
> > <property name="prefetchBlocks" value="32"/>
> >>
> >>
> >> and
> >>        public CacheConfiguration&lt;K,V&gt; setStartSize(int startSize)
> >>
> >> Please help me understand these parameters, their units and how they
> >> determine the space of the in-memory filesystem.
> >>
> >> thankx,
> >>
> >> /Kobe
> >>
> >>
> >>
> >> --
> >> View this message in context:
> >>
> http://apache-ignite-users.70518.x6.nabble.com/IGFS-Data-cache-size-tp2875.html
> >> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
> >>
>
>
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/IGFS-Data-cache-size-tp2875p2910.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>

Re: IGFS: Data cache size

Posted by Kobe <rk...@mailcity.com>.

Vladimir -

That means that an instance of IGFS can occupy all of the heap of the JVM
unless constrained using 

  * <bean class="org.apache.ignite.configuration.FileSystemConfiguration">
       <property name="maxSpaceSize" value="#{4 * 1024 * 1024 * 1024}"/>
   </bean>
*
Is this correct?

Thanks,

/Kobe


Vladimir Ozerov wrote
> Hi Kobe,
> 
> Actually, none of these parameters manage IGFS size.
> 
> Please take a look at
> org.apache.ignite.configuration.FileSystemConfiguration.getMaxSpaceSize()
> method.
> This value defines how much space in bytes IGFS can take on that node. You
> can either set it to some positive value in bytes, or leave default value.
> in the latter case Ignite will use between 50-80% of available heap as
> maximum IGFS size (see GridCacheAdapter constructor for exact size
> calculation logic).
> 
> Please let me know if you have any further questions.
> 
> Vladimir.
> 
> On Mon, Feb 8, 2016 at 4:34 AM, Kobe &lt;

> rk_@

> &gt; wrote:
> 
>> Hello...
>>
>> I am instantiating a single node IGFS cluster to begin with. I am trying
>> to
>> determine the available space of the fiesystem based on the parameter
>>
>>           
> <property name="blockSize" value="#{128 * 1024}"/>
>>           
> <property name="perNodeBatchSize" value="512"/>
>>           
> <property name="perNodeParallelBatchCount" value="16"/>
>>
>>
>>            
> <property name="prefetchBlocks" value="32"/>
>>
>>
>> and
>>        public CacheConfiguration&lt;K,V&gt; setStartSize(int startSize)
>>
>> Please help me understand these parameters, their units and how they
>> determine the space of the in-memory filesystem.
>>
>> thankx,
>>
>> /Kobe
>>
>>
>>
>> --
>> View this message in context:
>> http://apache-ignite-users.70518.x6.nabble.com/IGFS-Data-cache-size-tp2875.html
>> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>>





--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/IGFS-Data-cache-size-tp2875p2910.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: IGFS: Data cache size

Posted by Vladimir Ozerov <vo...@gridgain.com>.

Hi Kobe,

Actually, none of these parameters manage IGFS size.

Please take a look at
org.apache.ignite.configuration.FileSystemConfiguration.getMaxSpaceSize()
method.
This value defines how much space in bytes IGFS can take on that node. You
can either set it to some positive value in bytes, or leave default value.
in the latter case Ignite will use between 50-80% of available heap as
maximum IGFS size (see GridCacheAdapter constructor for exact size
calculation logic).

Please let me know if you have any further questions.

Vladimir.

On Mon, Feb 8, 2016 at 4:34 AM, Kobe <rk...@mailcity.com> wrote:

> Hello...
>
> I am instantiating a single node IGFS cluster to begin with. I am trying to
> determine the available space of the fiesystem based on the parameter
>
>           <property name="blockSize" value="#{128 * 1024}"/>
>           <property name="perNodeBatchSize" value="512"/>
>           <property name="perNodeParallelBatchCount" value="16"/>
>
>
>            <property name="prefetchBlocks" value="32"/>
>
>
> and
>        public CacheConfiguration<K,V> setStartSize(int startSize)
>
> Please help me understand these parameters, their units and how they
> determine the space of the in-memory filesystem.
>
> thankx,
>
> /Kobe
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/IGFS-Data-cache-size-tp2875.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>