transaction latencies especially for queries with casandra as persistence

[Navneet Kumar <na...@gmail.com>]

Hi Navneet,

 

As discussed here is brief information of our use case and observations.
Request your inputs to overcome these

 

We are using Cassandra database with very simple table schema which consists
two columns of type string and both the columns length is less than 16
characters, first column is Primary Key and all queries/updates performed
using it. This table holds around billion records.

 

To optimize the transaction latencies especially for queries, we are
evaluating to use Apache Ignite as caching layer on top of underlying
Cassandra database.

 

Attached is the sample ignite configuration file, while loading table into
cache we have foreseen heavy memory usage and unable to cache full data.

 

Need your help in identifying the RAM requirements to cache the whole data
into memory and also let us know if any changes needed in ignite
configurations to improve the performance and to optimize the resource
utilization.

 

Please let us know if any further details needed.

 

Regards,

Navneet




The below is the XML which I override:
--------------------------------------->>
<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
	xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
	xsi:schemaLocation="http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd">

	<bean
		class="org.apache.ignite.cache.store.cassandra.datasource.DataSource"
		name="cassandra">
		<property name="contactPoints"
			value="vmc0293,vmc0294,vmc0302" />
	</bean>

	<bean class="org.apache.ignite.configuration.IgniteConfiguration">
		<property name="cacheConfiguration">
			<list>
				<bean
					class="org.apache.ignite.configuration.CacheConfiguration">
					<property name="cacheMode" value="PARTITIONED" />
					
					<property name="backups" value="0" />

					<property name="name" value="msisdn_sub_cs" />
					<property name="readThrough" value="true" />
					<property name="writeThrough" value="true" />
					<property name="sqlSchema" value="msisdn_sub_cs" />
					<property name="indexedTypes">
						<list>
							<value type="java.lang.Class">java.lang.String</value>
							<value type="java.lang.Class">java.lang.String</value>
						</list>
					</property>
					<property name="cacheStoreFactory">
						<bean
						
class="org.apache.ignite.cache.store.cassandra.CassandraCacheStoreFactory">
							<property name="dataSource" ref="cassandra" />
							<property name="persistenceSettings">
								<bean
								
class="org.apache.ignite.cache.store.cassandra.persistence.KeyValuePersistenceSettings">
									<constructor-arg type="java.lang.String">
										<value></value>
									</constructor-arg>
								</bean>
							</property>
						</bean>
					</property>
				</bean>
			</list>
		</property>
		
		<property name="discoverySpi">
			<bean
				class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
				<property name="ipFinder">
					
					
					
					<bean
					
class="org.apache.ignite.spi.discovery.tcp.ipfinder.multicast.TcpDiscoveryMulticastIpFinder">
						<property name="addresses">
							<list>
								
								<value>10.61.217.13:47500..47509</value>
								<value>10.61.217.14:47500..47509</value>
								<value>10.61.217.22:47500..47509</value>
							</list>
						</property>
					</bean>
				</property>
			</bean>
		</property>

		
		<property name="dataStorageConfiguration">
			<bean
				class="org.apache.ignite.configuration.DataStorageConfiguration">
				
				<property name="defaultDataRegionConfiguration">
					<bean
						class="org.apache.ignite.configuration.DataRegionConfiguration">
						<property name="name" value="Default_Region" />
						
						<property name="maxSize"
							value="#{20L * 1024 * 1024 * 1024}" />
					</bean>
				</property>
			</bean>
		</property>

		
	</bean>
</beans>



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/