You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@geode.apache.org by "Barry Oglesby (JIRA)" <ji...@apache.org> on 2017/03/17 23:42:41 UTC
[jira] [Created] (GEODE-2689) If a region containing a Lucene index
is created in one group and altered in another, a member in the other group
will fail to start
Barry Oglesby created GEODE-2689:
------------------------------------
Summary: If a region containing a Lucene index is created in one group and altered in another, a member in the other group will fail to start
Key: GEODE-2689
URL: https://issues.apache.org/jira/browse/GEODE-2689
Project: Geode
Issue Type: Bug
Components: lucene
Reporter: Barry Oglesby
Steps to reproduce:
- create lucene index --name=full_index --region=data --field=field1
- create region --name=data --type=PARTITION_REDUNDANT
- alter region --name=data --cache-listener=TestCacheListener --group=group1
At this point, the cluster config xml looks like:
{noformat}
[info 2017/03/15 17:04:17.375 PDT server3 <main> tid=0x1]
***************************************************************
Configuration for 'cluster'
Jar files to deployed
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<cache xmlns="http://geode.apache.org/schema/cache" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" copy-on-read="false" is-server="false" lock-lease="120" lock-timeout="60" search-timeout="300" version="1.0" xsi:schemaLocation="http://geode.apache.org/schema/cache http://geode.apache.org/schema/cache/cache-1.0.xsd">
<region name="data">
<region-attributes async-event-queue-ids="full_index#_data" data-policy="partition">
<partition-attributes redundant-copies="1"/>
</region-attributes>
<lucene:index xmlns:lucene="http://geode.apache.org/schema/lucene" name="full_index">
<lucene:field analyzer="org.apache.lucene.analysis.standard.StandardAnalyzer" name="field1"/>
</lucene:index>
</region>
</cache>
***************************************************************
Configuration for 'group1'
Jar files to deployed
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<cache xmlns="http://geode.apache.org/schema/cache" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" copy-on-read="false" is-server="false" lock-lease="120" lock-timeout="60" search-timeout="300" version="1.0" xsi:schemaLocation="http://geode.apache.org/schema/cache http://geode.apache.org/schema/cache/cache-1.0.xsd">
<region name="data">
<region-attributes async-event-queue-ids="full_index#_data" data-policy="partition">
<partition-attributes redundant-copies="1"/>
<cache-listener>
<class-name>TestCacheListener</class-name>
</cache-listener>
</region-attributes>
<lucene:index xmlns:lucene="http://geode.apache.org/schema/lucene" name="full_index">
<lucene:field analyzer="org.apache.lucene.analysis.standard.StandardAnalyzer" name="field1"/>
</lucene:index>
</region>
</cache>
{noformat}
If a member is started in the group (group1 in this case), it will fail to start with the following error:
{noformat}
[error 2017/03/15 17:04:19.715 PDT <main> tid=0x1] Lucene index already exists in region
Exception in thread "main" java.lang.IllegalArgumentException: Lucene index already exists in region
at org.apache.geode.cache.lucene.internal.LuceneServiceImpl.registerDefinedIndex(LuceneServiceImpl.java:201)
at org.apache.geode.cache.lucene.internal.LuceneServiceImpl.createIndex(LuceneServiceImpl.java:154)
at org.apache.geode.cache.lucene.internal.xml.LuceneIndexCreation.beforeCreate(LuceneIndexCreation.java:85)
at org.apache.geode.internal.cache.extension.SimpleExtensionPoint.beforeCreate(SimpleExtensionPoint.java:77)
at org.apache.geode.internal.cache.xmlcache.RegionCreation.createRoot(RegionCreation.java:252)
at org.apache.geode.internal.cache.xmlcache.CacheCreation.initializeRegions(CacheCreation.java:544)
at org.apache.geode.internal.cache.xmlcache.CacheCreation.create(CacheCreation.java:495)
at org.apache.geode.internal.cache.xmlcache.CacheXmlParser.create(CacheXmlParser.java:343)
at org.apache.geode.internal.cache.GemFireCacheImpl.loadCacheXml(GemFireCacheImpl.java:4479)
at org.apache.geode.internal.cache.ClusterConfigurationLoader.applyClusterXmlConfiguration(ClusterConfigurationLoader.java:129)
at org.apache.geode.internal.cache.GemFireCacheImpl.initialize(GemFireCacheImpl.java:1243)
at org.apache.geode.internal.cache.GemFireCacheImpl.basicCreate(GemFireCacheImpl.java:798)
at org.apache.geode.internal.cache.GemFireCacheImpl.create(GemFireCacheImpl.java:783)
at org.apache.geode.cache.CacheFactory.create(CacheFactory.java:178)
at org.apache.geode.cache.CacheFactory.create(CacheFactory.java:218)
at TestBase.initializeServerCache(TestBase.java:22)
at TestServer.main(TestServer.java:7)
{noformat}
I made a quick change in {{LuceneIndexCreation beforeCreate}} to just log the {{IllegalArgumentException}}. I'm not sure if this is good enough or not.
{noformat}
public void beforeCreate(Extensible<Region<?, ?>> source, Cache cache) {
LuceneServiceImpl service = (LuceneServiceImpl) LuceneServiceProvider.get(cache);
Analyzer analyzer = this.fieldAnalyzers == null ? new StandardAnalyzer()
: new PerFieldAnalyzerWrapper(new StandardAnalyzer(), this.fieldAnalyzers);
try {
service.createIndex(getName(), getRegionPath(), analyzer, this.fieldAnalyzers,
getFieldNames());
} catch (IllegalArgumentException e) {
// log a warning or info here
}
}
{noformat}
We might want to create a {{LuceneIndexExistsException}} to catch here. We also might want to compare the indexes to see that they are the same.
btw - this same test with OQL works:
In the OQL case, the cluster config looks like:
{noformat}
[info 2017/03/15 17:14:12.364 PDT server3 <main> tid=0x1]
***************************************************************
Configuration for 'cluster'
Jar files to deployed
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<cache xmlns="http://geode.apache.org/schema/cache" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" copy-on-read="false" is-server="false" lock-lease="120" lock-timeout="60" search-timeout="300" version="1.0" xsi:schemaLocation="http://geode.apache.org/schema/cache http://geode.apache.org/schema/cache/cache-1.0.xsd">
<region name="data">
<region-attributes data-policy="partition">
<partition-attributes redundant-copies="1"/>
</region-attributes>
<index expression="cusip" from-clause="/data" key-index="false" name="cusip" type="range"/>
</region>
</cache>
***************************************************************
Configuration for 'group1'
Jar files to deployed
<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<cache xmlns="http://geode.apache.org/schema/cache" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" copy-on-read="false" is-server="false" lock-lease="120" lock-timeout="60" search-timeout="300" version="1.0" xsi:schemaLocation="http://geode.apache.org/schema/cache http://geode.apache.org/schema/cache/cache-1.0.xsd">
<region name="data">
<region-attributes data-policy="partition">
<partition-attributes redundant-copies="1"/>
<cache-listener>
<class-name>TestCacheListener</class-name>
</cache-listener>
</region-attributes>
<index expression="cusip" from-clause="/data" key-index="false" name="cusip" type="range"/>
</region>
</cache>
{noformat}
When the member is started, an {{IndexNameConflictException}} is thrown in {{PartitionedRegion createIndex}}:
{noformat}
org.apache.geode.cache.query.IndexNameConflictException: Index named ' cusip ' already exists.
at org.apache.geode.internal.cache.PartitionedRegion.createIndex(PartitionedRegion.java:8632)
at org.apache.geode.internal.cache.PartitionedRegion.createIndex(PartitionedRegion.java:8580)
at org.apache.geode.cache.query.internal.DefaultQueryService.createIndex(DefaultQueryService.java:190)
at org.apache.geode.cache.query.internal.DefaultQueryService.createIndex(DefaultQueryService.java:153)
at org.apache.geode.internal.cache.LocalRegion.createOQLIndexes(LocalRegion.java:2490)
at org.apache.geode.internal.cache.LocalRegion.createOQLIndexes(LocalRegion.java:2423)
at org.apache.geode.internal.cache.PartitionedRegion.initPRInternals(PartitionedRegion.java:917)
at org.apache.geode.internal.cache.PartitionedRegion.initialize(PartitionedRegion.java:1057)
{noformat}
And handled in {{LocalRegion createOQLIndexes}} like:
{noformat}
} catch (Exception ex) {
logger.info("Failed to create index {} on region {} with exception: {}",
icd.getIndexName(), this.getFullPath(), ex);
{noformat}
Which logs a message like:
{noformat}
[info 2017/03/15 17:14:13.376 PDT server3 <main> tid=0x1] Failed to create index cusip on region /data with exception: org.apache.geode.cache.query.IndexNameConflictException: Index named ' cusip ' already exists.
{noformat}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)