You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by fluffy <fh...@gmail.com> on 2015/06/12 18:33:47 UTC
Re: Trouble Enabling Query Indexing
Hey Leroy,
I'm having the same issue with the latest release. Did you ever find a
solution or this?
Thanks,
Florian
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p473.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Trouble Enabling Query Indexing
Posted by leroyJr <mi...@gmail.com>.
Fluffy,
We ended up using the @ScalarCacheQuerySqlField annotation that dsetrakyan
suggested. Additionally we had limited success depending on the key type
being indexed.
Take a look at
http://apache-ignite-users.70518.x6.nabble.com/SQL-query-question-tc426.html
When we used Scala's Int as a key it would fail. If we used Java Integer it
worked. I believe the Ignite folks will be addressing this in an upcoming
release.
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p477.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Trouble Enabling Query Indexing
Posted by fluffy <fh...@gmail.com>.
Val,
I removed the Cache Config in the XML file and still don't get indexing.
Here's the error I see int he startup logs:
[10:33:26,574][WARN ][main][GridIndexingManager] Indexing is disabled (to
enable please configure GridIndexingSpi).
...
[10:33:31,121][WARN ][main][root] Logging at DEBUG level without checking if
DEBUG level is enabled: Loop - Caught:javax.cache.CacheException: Indexing
is disabled for cache: Points
[10:33:31,121][WARN ][main][root] Logging at DEBUG level without checking if
DEBUG level is enabled:
org.apache.ignite.internal.processors.cache.IgniteCacheProxy.validate(IgniteCacheProxy.java:545)
[10:33:31,121][WARN ][main][root] Logging at DEBUG level without checking if
DEBUG level is enabled:
org.apache.ignite.internal.processors.cache.IgniteCacheProxy.query(IgniteCacheProxy.java:493)
[10:33:31,121][WARN ][main][root] Logging at DEBUG level without checking if
DEBUG level is enabled:
com.gometrics.grid.test.TestCacheConfig.main(TestCacheConfig.java:53)
and here's my spring config now... Almost nothing in it:
<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:util="http://www.springframework.org/schema/util"
xsi:schemaLocation="
http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/util
http://www.springframework.org/schema/util/spring-util.xsd">
<bean id="ignite.cfg"
class="org.apache.ignite.configuration.IgniteConfiguration">
<property name="peerClassLoadingEnabled" value="false"/>
<property name="marshaller">
<bean
class="org.apache.ignite.marshaller.optimized.OptimizedMarshaller">
<property name="requireSerializable" value="false"/>
</bean>
</property>
<property name="discoverySpi">
<bean
class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
<property name="ipFinder">
<bean
class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
<property name="addresses">
<list>
<value>127.0.0.1:47500..47509</value>
</list>
</property>
</bean>
</property>
</bean>
</property>
</bean>
</beans>
Any ideas?
Thanks much,
Florian
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p489.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Trouble Enabling Query Indexing
Posted by Valentin Kulichenko <va...@gmail.com>.
Fluffy,
Cache is created only once and with only one version of config (it can be
taken declared in XML or in code - doesn't matter). And in case there is a
cache configuration in initial Ignite config, it will be created on node
startup, so all other attempts to create a cache with the same name
dynamically after node is already started will fail. In case you use
getOrCreateCache method with modified configuration, it will get existing
cache instead of creating a new one, therefore this configuration will be
ignored.
-Val
On Sat, Jun 13, 2015 at 4:59 AM, fluffy <fh...@gmail.com> wrote:
> Val,
>
> never mind, I think that did it. I had to make a couple of other changes in
> my environment, but that I think allowed indexing to work again.
>
> I never realized that the Spring XML definition and the java DSL of a Cache
> are mutually exclusive? From GridGain I was used to specifying the basics
> in
> Spring XML and then just modifying it in Java when necessary....
>
> The documentation says that XMl and Java are mutually exclusive for the
> Index MetaData stuff, but in terms of CacheConfiguration, does it pick a
> Spring XML configuration over a Java configuration and then ignore Java?
>
> Thanks much
>
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p490.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>
Re: Trouble Enabling Query Indexing
Posted by fluffy <fh...@gmail.com>.
Val,
never mind, I think that did it. I had to make a couple of other changes in
my environment, but that I think allowed indexing to work again.
I never realized that the Spring XML definition and the java DSL of a Cache
are mutually exclusive? From GridGain I was used to specifying the basics in
Spring XML and then just modifying it in Java when necessary....
The documentation says that XMl and Java are mutually exclusive for the
Index MetaData stuff, but in terms of CacheConfiguration, does it pick a
Spring XML configuration over a Java configuration and then ignore Java?
Thanks much
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p490.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Trouble Enabling Query Indexing
Posted by Valentin Kulichenko <va...@gmail.com>.
Fluffy,
You have a cache configuration in both code and XML. The one in XML is
actually used, but it doesn't provide indexed types. Your code
configuration looks correct, so I think you should simply remove it from
XML.
-Val
On Fri, Jun 12, 2015 at 1:39 PM, fluffy <fh...@gmail.com> wrote:
> I have a very very simple example. And based on everything I know and see
> in
> the documentation, indexing should work on this with no problems. Here's
> the
> code. I'm also attaching the Spring Config File.
>
> Any help would be much appreciated....
>
> ----------------------
>
> Source Code
>
> ----------------------
> /packagegrid.test;
>
> import org.apache.ignite.*;
> import org.apache.ignite.cache.query.QueryCursor;
> import org.apache.ignite.cache.query.SqlFieldsQuery;
> import org.apache.ignite.cache.query.annotations.QuerySqlField;
> import org.apache.ignite.configuration.CacheConfiguration;
> import org.apache.ignite.logger.log4j.Log4JLogger;
>
> import java.io.Serializable;
> import java.util.Collection;
> import java.util.Iterator;
> import java.util.List;
> import java.util.UUID;
>
> public class TestCacheConfig {
>
> public static void main(String[] args) throws IgniteException,
> InterruptedException {
>
> Ignite ignite;
> IgniteLogger log = new Log4JLogger();
>
> boolean rungrid=true;
>
> try {
>
> log.debug("STARTING GRID....");
> ignite = Ignition.start("<grid-cache.xml");
> ignite.configuration().setNetworkTimeout(5000);
> ignite.configuration().setClientMode(false);
>
> CacheConfiguration<UUID, BasicGridPoint> pointCfg = new
> CacheConfiguration<>("Points");
>
> pointCfg.setName("Points");
> pointCfg.setIndexedTypes(UUID.class, BasicGridPoint.class);
>
> IgniteCache<String, BasicGridPoint> pointCache =
> ignite.cache("Points");
> pointCache.put("dsadsa-dsadsa-dsasd",new BasicGridPoint());
>
> while (rungrid) {
>
> try {
> log.debug("-------------------------------");
> log.debug(" # of Nodes: " +
> ignite.cluster().nodes().size());//+" | Grid Size: "+
> g.cache(CACHE_NAME).keySet().size());
> log.debug(" Local Node ID: " +
> ignite.cluster().localNode().id());
> log.debug(" Global Point Cache Keys: " +
> pointCache.size());
> log.debug("-------------------------------");
>
>
> SqlFieldsQuery PointTypeQuery = new
> SqlFieldsQuery("select distinct Type from BasicGridPoint");
> try (QueryCursor<List<?>> cursor =
> pointCache.query(PointTypeQuery)) {
> Collection<List<?>> PointTypesRaw =
> cursor.getAll();
> Iterator PointCountIter = PointTypesRaw.iterator();
> while (PointCountIter.hasNext()) {
> List tmpList = (List) PointCountIter.next();
> Iterator ListIter = tmpList.iterator();
> while (ListIter.hasNext()) {
> String type = (String) ListIter.next();
> System.out.print("Type: " + type);
> }
> }
> }
>
> Thread.sleep(10000);
> } catch (Exception e) {
> log.debug("Loop - Caught:" + e.toString());
> for (int i=0; i<e.getStackTrace().length; i++)
> log.debug(e.getStackTrace()[i].toString());
> Thread.sleep(10000);
> }
> }
>
> //Stopping Grid and associated subprocesses
> log.debug("Shutting things down...");
>
> Ignition.stop(true);
>
>
> } catch (Exception e) {
> log.debug("Main - Caught:" + e.toString());
> }
>
> }
> public static class BasicGridPoint implements Serializable {
>
> @QuerySqlField
> private String Type;
> @QuerySqlField
> private String Ident;
>
>
> public String getType() {
> return Type;
> }
>
> public void setType(String pointType) {
> Type = pointType;
> }
>
> public String getIdent() {
> return Ident;
> }
>
> public void setIdent(String ident) {
> Ident = ident;
> }
> }
>
> }
>
> ----------------------------
>
> Spring config
>
> ---------------------------
>
> <?xml version="1.0" encoding="UTF-8"?>
>
> <beans xmlns="http://www.springframework.org/schema/beans"
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
> xmlns:util="http://www.springframework.org/schema/util"
> xsi:schemaLocation="
> http://www.springframework.org/schema/beans
> http://www.springframework.org/schema/beans/spring-beans.xsd
> http://www.springframework.org/schema/util
> http://www.springframework.org/schema/util/spring-util.xsd">
> <bean id="ignite.cfg"
> class="org.apache.ignite.configuration.IgniteConfiguration">
>
>
> <property name="peerClassLoadingEnabled" value="false"/>
>
> <property name="marshaller">
> <bean
> class="org.apache.ignite.marshaller.optimized.OptimizedMarshaller">
>
> <property name="requireSerializable" value="false"/>
> </bean>
> </property>
>
>
> <property name="cacheConfiguration">
>
> <list>
> <bean
> class="org.apache.ignite.configuration.CacheConfiguration">
> <property name="name" value="Points"/>
> <property name="cacheMode" value="PARTITIONED"/>
> <property name="atomicityMode" value="ATOMIC"/>
> <property name="backups" value="0"/>
> <property name="offHeapMaxMemory" value="0"/>
> <property name="startSize" value="3000000"/>
> </bean>
> </list>
> </property>
>
> <property name="discoverySpi">
> <bean
> class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
> <property name="ipFinder">
> <bean
>
> class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
> <property name="addresses">
> <list>
> <value>127.0.0.1:47500..47509</value>
> </list>
> </property>
> </bean>
> </property>
> </bean>
> </property>
>
> </bean>
>
> </beans>
> /
>
>
>
>
> --
> View this message in context:
> http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p481.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>
Re: Trouble Enabling Query Indexing
Posted by fluffy <fh...@gmail.com>.
I have a very very simple example. And based on everything I know and see in
the documentation, indexing should work on this with no problems. Here's the
code. I'm also attaching the Spring Config File.
Any help would be much appreciated....
----------------------
Source Code
----------------------
/packagegrid.test;
import org.apache.ignite.*;
import org.apache.ignite.cache.query.QueryCursor;
import org.apache.ignite.cache.query.SqlFieldsQuery;
import org.apache.ignite.cache.query.annotations.QuerySqlField;
import org.apache.ignite.configuration.CacheConfiguration;
import org.apache.ignite.logger.log4j.Log4JLogger;
import java.io.Serializable;
import java.util.Collection;
import java.util.Iterator;
import java.util.List;
import java.util.UUID;
public class TestCacheConfig {
public static void main(String[] args) throws IgniteException,
InterruptedException {
Ignite ignite;
IgniteLogger log = new Log4JLogger();
boolean rungrid=true;
try {
log.debug("STARTING GRID....");
ignite = Ignition.start("<grid-cache.xml");
ignite.configuration().setNetworkTimeout(5000);
ignite.configuration().setClientMode(false);
CacheConfiguration<UUID, BasicGridPoint> pointCfg = new
CacheConfiguration<>("Points");
pointCfg.setName("Points");
pointCfg.setIndexedTypes(UUID.class, BasicGridPoint.class);
IgniteCache<String, BasicGridPoint> pointCache =
ignite.cache("Points");
pointCache.put("dsadsa-dsadsa-dsasd",new BasicGridPoint());
while (rungrid) {
try {
log.debug("-------------------------------");
log.debug(" # of Nodes: " +
ignite.cluster().nodes().size());//+" | Grid Size: "+
g.cache(CACHE_NAME).keySet().size());
log.debug(" Local Node ID: " +
ignite.cluster().localNode().id());
log.debug(" Global Point Cache Keys: " +
pointCache.size());
log.debug("-------------------------------");
SqlFieldsQuery PointTypeQuery = new
SqlFieldsQuery("select distinct Type from BasicGridPoint");
try (QueryCursor<List<?>> cursor =
pointCache.query(PointTypeQuery)) {
Collection<List<?>> PointTypesRaw =
cursor.getAll();
Iterator PointCountIter = PointTypesRaw.iterator();
while (PointCountIter.hasNext()) {
List tmpList = (List) PointCountIter.next();
Iterator ListIter = tmpList.iterator();
while (ListIter.hasNext()) {
String type = (String) ListIter.next();
System.out.print("Type: " + type);
}
}
}
Thread.sleep(10000);
} catch (Exception e) {
log.debug("Loop - Caught:" + e.toString());
for (int i=0; i<e.getStackTrace().length; i++)
log.debug(e.getStackTrace()[i].toString());
Thread.sleep(10000);
}
}
//Stopping Grid and associated subprocesses
log.debug("Shutting things down...");
Ignition.stop(true);
} catch (Exception e) {
log.debug("Main - Caught:" + e.toString());
}
}
public static class BasicGridPoint implements Serializable {
@QuerySqlField
private String Type;
@QuerySqlField
private String Ident;
public String getType() {
return Type;
}
public void setType(String pointType) {
Type = pointType;
}
public String getIdent() {
return Ident;
}
public void setIdent(String ident) {
Ident = ident;
}
}
}
----------------------------
Spring config
---------------------------
<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:util="http://www.springframework.org/schema/util"
xsi:schemaLocation="
http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/util
http://www.springframework.org/schema/util/spring-util.xsd">
<bean id="ignite.cfg"
class="org.apache.ignite.configuration.IgniteConfiguration">
<property name="peerClassLoadingEnabled" value="false"/>
<property name="marshaller">
<bean
class="org.apache.ignite.marshaller.optimized.OptimizedMarshaller">
<property name="requireSerializable" value="false"/>
</bean>
</property>
<property name="cacheConfiguration">
<list>
<bean
class="org.apache.ignite.configuration.CacheConfiguration">
<property name="name" value="Points"/>
<property name="cacheMode" value="PARTITIONED"/>
<property name="atomicityMode" value="ATOMIC"/>
<property name="backups" value="0"/>
<property name="offHeapMaxMemory" value="0"/>
<property name="startSize" value="3000000"/>
</bean>
</list>
</property>
<property name="discoverySpi">
<bean
class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
<property name="ipFinder">
<bean
class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
<property name="addresses">
<list>
<value>127.0.0.1:47500..47509</value>
</list>
</property>
</bean>
</property>
</bean>
</property>
</bean>
</beans>
/
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p481.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Trouble Enabling Query Indexing
Posted by fluffy <fh...@gmail.com>.
D.,
our entire source is in java and I am no Scala expert. Is there a Java
equivalent?
One other thing to note, this problem seemed to start occuring after I
changed my maven compile to not package with all dependencies. What I find
funny is that the 'ignite-indexing' package doesn't actually provide any
source files when you are just using the '@QuerySqlField' and basic Indexing
functions.
I saw another thread that said this type of problem may be solved by
including the 'ignite-indexing' dependency?
Unfortunately I can't package everything in a single jar due to some other
issues...
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p478.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Trouble Enabling Query Indexing
Posted by dsetrakyan <ds...@apache.org>.
fluffy wrote
> I'm having the same issue with the latest release. Did you ever find a
> solution or this?
Forian, does the solution provided in this thread with
@ScacheCacheQuerySqlField annotation work for you?
D.
-----
D.
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Trouble-Enabling-Query-Indexing-tp377p474.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.