You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Erick Erickson <er...@gmail.com> on 2016/10/27 04:42:25 UTC

Problem with fetchindex perhaps? Or at least a scary message

Setup:

I have a 5.3.1 techproducts example (renamed to "tech"). Start the
techproducts example solr 6x on another port. Index some stuff to my
5.3.1 instance and then issue:

http://localhost:8983/solr/techproducts/replication?command=fetchindex&masterUrl=http://localhost:8981/solr/tech

So far, so good, the index is replicated just fine.

Now index docs on "tech" and re-issue the fetchindex command. The
index replicates, but then the stack trace below comes out in the
logs. I don't know whether this happens in earlier 6x versions. Should
we be looking at this before we cut 6.3? Is it worth a JIRA? One thing
that concerns me is that the state of the last replication won't be
written. Of course it could be something wonky with my testing, I ran
across this testing something totally different (fetchindex into a
SolrCloud replica if you must know)....

WARN  - 2016-10-27 04:00:22.924; [   x:techproducts]
org.apache.solr.handler.IndexFetcher; Exception while updating
statistics

java.nio.file.FileAlreadyExistsException:
/Users/Erick/apache/solr/lucene-solr-6x/solr/example/techproducts/solr/techproducts/data/replication.properties

at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88)

at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)

at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)

at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)

at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)

at java.nio.file.Files.newOutputStream(Files.java:216)

at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:413)

at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:409)

at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:253)

at org.apache.lucene.store.NRTCachingDirectory.createOutput(NRTCachingDirectory.java:157)

at org.apache.solr.handler.IndexFetcher.logReplicationTimeAndConfFiles(IndexFetcher.java:675)

at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:487)

at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:251)

at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397)

at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$146(ReplicationHandler.java:279)

at org.apache.solr.handler.ReplicationHandler$$Lambda$61/140045219.run(Unknown
Source)

at java.lang.Thread.run(Thread.java:745)

INFO  - 2016-10-27 04:00:22.925; [   x:techproducts]
org.apache.solr.handler.IndexFetcher; removing old index directory
NRTCachingDirectory(MMapDirectory@/Users/Erick/apache/solr/lucene-solr-6x/solr/example/techproducts/solr/techproducts/data/index.20161027035949763
lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e50cd1;
maxCacheMB=48.0 maxMergeSizeMB=4.0)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: Problem with fetchindex perhaps? Or at least a scary message

Posted by Erick Erickson <er...@gmail.com>.
OK, this is SOLR-9859 I think, so we can ignore it.

On Wed, Oct 26, 2016 at 9:42 PM, Erick Erickson <er...@gmail.com> wrote:
> Setup:
>
> I have a 5.3.1 techproducts example (renamed to "tech"). Start the
> techproducts example solr 6x on another port. Index some stuff to my
> 5.3.1 instance and then issue:
>
> http://localhost:8983/solr/techproducts/replication?command=fetchindex&masterUrl=http://localhost:8981/solr/tech
>
> So far, so good, the index is replicated just fine.
>
> Now index docs on "tech" and re-issue the fetchindex command. The
> index replicates, but then the stack trace below comes out in the
> logs. I don't know whether this happens in earlier 6x versions. Should
> we be looking at this before we cut 6.3? Is it worth a JIRA? One thing
> that concerns me is that the state of the last replication won't be
> written. Of course it could be something wonky with my testing, I ran
> across this testing something totally different (fetchindex into a
> SolrCloud replica if you must know)....
>
> WARN  - 2016-10-27 04:00:22.924; [   x:techproducts]
> org.apache.solr.handler.IndexFetcher; Exception while updating
> statistics
>
> java.nio.file.FileAlreadyExistsException:
> /Users/Erick/apache/solr/lucene-solr-6x/solr/example/techproducts/solr/techproducts/data/replication.properties
>
> at sun.nio.fs.UnixException.translateToIOException(UnixException.java:88)
>
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
>
> at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
>
> at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214)
>
> at java.nio.file.spi.FileSystemProvider.newOutputStream(FileSystemProvider.java:434)
>
> at java.nio.file.Files.newOutputStream(Files.java:216)
>
> at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:413)
>
> at org.apache.lucene.store.FSDirectory$FSIndexOutput.<init>(FSDirectory.java:409)
>
> at org.apache.lucene.store.FSDirectory.createOutput(FSDirectory.java:253)
>
> at org.apache.lucene.store.NRTCachingDirectory.createOutput(NRTCachingDirectory.java:157)
>
> at org.apache.solr.handler.IndexFetcher.logReplicationTimeAndConfFiles(IndexFetcher.java:675)
>
> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:487)
>
> at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:251)
>
> at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:397)
>
> at org.apache.solr.handler.ReplicationHandler.lambda$handleRequestBody$146(ReplicationHandler.java:279)
>
> at org.apache.solr.handler.ReplicationHandler$$Lambda$61/140045219.run(Unknown
> Source)
>
> at java.lang.Thread.run(Thread.java:745)
>
> INFO  - 2016-10-27 04:00:22.925; [   x:techproducts]
> org.apache.solr.handler.IndexFetcher; removing old index directory
> NRTCachingDirectory(MMapDirectory@/Users/Erick/apache/solr/lucene-solr-6x/solr/example/techproducts/solr/techproducts/data/index.20161027035949763
> lockFactory=org.apache.lucene.store.NativeFSLockFactory@7e50cd1;
> maxCacheMB=48.0 maxMergeSizeMB=4.0)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org