You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Andrew Clegg <an...@gmail.com> on 2009/08/17 14:25:54 UTC

'Connection reset' in DataImportHandler Development Console

Hi folks,

I'm trying to use the Debug Now button in the development console to test
the effects of some changes in my data import config (see attached).

However, each time I click it, the right-hand frame fails to load -- it just
gets replaced with the standard 'connection reset' message from Firefox, as
if the server's dropped the HTTP connection.

Everything else seems okay -- I can run queries in Solr Admin without any
problems, and all the other buttons in the dev console work -- status,
document count, reload config etc.

There's nothing suspicious in Tomcat's catalina.out either. If I hit Reload
Config, then Status, then Debug Now, I get this:


17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImportHandler
processConfiguration
INFO: Processing configuration from solrconfig.xml: {config=dataconfig.xml}
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
loadDataConfig
INFO: Data Configuration loaded successfully
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: id is a required field in SolrSchema . But not found in DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: title is a required field in SolrSchema . But not found in DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: doc_type is a required field in SolrSchema . But not found in
DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: id is a required field in SolrSchema . But not found in DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: title is a required field in SolrSchema . But not found in DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: doc_type is a required field in SolrSchema . But not found in
DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: id is a required field in SolrSchema . But not found in DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: title is a required field in SolrSchema . But not found in DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: doc_type is a required field in SolrSchema . But not found in
DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: id is a required field in SolrSchema . But not found in DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: title is a required field in SolrSchema . But not found in DataConfig
17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
verifyWithSchema
INFO: doc_type is a required field in SolrSchema . But not found in
DataConfig
17-Aug-2009 13:12:12 org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select
params={clean=false&command=reload-config&commit=true&qt=/dataimport}
status=0 QTime=5 
17-Aug-2009 13:12:21 org.apache.solr.core.SolrCore execute
INFO: [] webapp=/solr path=/select
params={clean=false&command=status&commit=true&qt=/dataimport} status=0
QTime=0 


(The warnings are because the doc_type field comes out of the JDBC result
set automatically by column name -- this isn't a problem.)

Also, there's no entry in the Tomcat access log for the debug request
either, just the first two:


[17/Aug/2009:13:12:12 +0100] HTTP/1.1 cookie:- request:-  GET /solr/select
200 ?clean=false&commit=true&qt=%2Fdataimport&command=reload-config GET
/solr/select?clean=false&commit=t
rue&qt=%2Fdataimport&command=reload-config HTTP/1.1
[17/Aug/2009:13:12:21 +0100] HTTP/1.1 cookie:- request:-  GET /solr/select
200 ?clean=false&commit=true&qt=%2Fdataimport&command=status GET
/solr/select?clean=false&commit=true&qt=
%2Fdataimport&command=status HTTP/1.1


PS... Nightly build, 30th of July.

Thanks,

Andrew.

http://www.nabble.com/file/p25005850/dataconfig.xml dataconfig.xml 
-- 
View this message in context: http://www.nabble.com/%27Connection-reset%27-in-DataImportHandler-Development-Console-tp25005850p25005850.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: 'Connection reset' in DataImportHandler Development Console

Posted by Noble Paul നോബിള്‍ नोब्ळ् <no...@corp.aol.com>.
The debug tool for DIH dires queries in sync mode. it waits fro the
import to complete for the page to show up. If the process takes long
you r likely to see the connection reset message.

For get about debug. what exactly do you want to do?

2009/8/17 Noble Paul നോബിള്‍  नोब्ळ् <no...@corp.aol.com>:
> apparently I do not see any command full-import, delta-import being
> fired. Is that true?
>
> On Mon, Aug 17, 2009 at 5:55 PM, Andrew Clegg<an...@gmail.com> wrote:
>>
>> Hi folks,
>>
>> I'm trying to use the Debug Now button in the development console to test
>> the effects of some changes in my data import config (see attached).
>>
>> However, each time I click it, the right-hand frame fails to load -- it just
>> gets replaced with the standard 'connection reset' message from Firefox, as
>> if the server's dropped the HTTP connection.
>>
>> Everything else seems okay -- I can run queries in Solr Admin without any
>> problems, and all the other buttons in the dev console work -- status,
>> document count, reload config etc.
>>
>> There's nothing suspicious in Tomcat's catalina.out either. If I hit Reload
>> Config, then Status, then Debug Now, I get this:
>>
>>
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImportHandler
>> processConfiguration
>> INFO: Processing configuration from solrconfig.xml: {config=dataconfig.xml}
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> loadDataConfig
>> INFO: Data Configuration loaded successfully
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: id is a required field in SolrSchema . But not found in DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: title is a required field in SolrSchema . But not found in DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: doc_type is a required field in SolrSchema . But not found in
>> DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: id is a required field in SolrSchema . But not found in DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: title is a required field in SolrSchema . But not found in DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: doc_type is a required field in SolrSchema . But not found in
>> DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: id is a required field in SolrSchema . But not found in DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: title is a required field in SolrSchema . But not found in DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: doc_type is a required field in SolrSchema . But not found in
>> DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: id is a required field in SolrSchema . But not found in DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: title is a required field in SolrSchema . But not found in DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
>> verifyWithSchema
>> INFO: doc_type is a required field in SolrSchema . But not found in
>> DataConfig
>> 17-Aug-2009 13:12:12 org.apache.solr.core.SolrCore execute
>> INFO: [] webapp=/solr path=/select
>> params={clean=false&command=reload-config&commit=true&qt=/dataimport}
>> status=0 QTime=5
>> 17-Aug-2009 13:12:21 org.apache.solr.core.SolrCore execute
>> INFO: [] webapp=/solr path=/select
>> params={clean=false&command=status&commit=true&qt=/dataimport} status=0
>> QTime=0
>>
>>
>> (The warnings are because the doc_type field comes out of the JDBC result
>> set automatically by column name -- this isn't a problem.)
>>
>> Also, there's no entry in the Tomcat access log for the debug request
>> either, just the first two:
>>
>>
>> [17/Aug/2009:13:12:12 +0100] HTTP/1.1 cookie:- request:-  GET /solr/select
>> 200 ?clean=false&commit=true&qt=%2Fdataimport&command=reload-config GET
>> /solr/select?clean=false&commit=t
>> rue&qt=%2Fdataimport&command=reload-config HTTP/1.1
>> [17/Aug/2009:13:12:21 +0100] HTTP/1.1 cookie:- request:-  GET /solr/select
>> 200 ?clean=false&commit=true&qt=%2Fdataimport&command=status GET
>> /solr/select?clean=false&commit=true&qt=
>> %2Fdataimport&command=status HTTP/1.1
>>
>>
>> PS... Nightly build, 30th of July.
>>
>> Thanks,
>>
>> Andrew.
>>
>> http://www.nabble.com/file/p25005850/dataconfig.xml dataconfig.xml
>> --
>> View this message in context: http://www.nabble.com/%27Connection-reset%27-in-DataImportHandler-Development-Console-tp25005850p25005850.html
>> Sent from the Solr - User mailing list archive at Nabble.com.
>>
>>
>
>
>
> --
> -----------------------------------------------------
> Noble Paul | Principal Engineer| AOL | http://aol.com
>



-- 
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com

Re: 'Connection reset' in DataImportHandler Development Console

Posted by Andrew Clegg <an...@gmail.com>.


aerox7 wrote:
> 
> Hi Andrew,
> I download the last build of solr (1.4) and i have the same probleme with
> DebugNow in Dataimport dev Console. have you found a solution ?
> 

Sorry about slow reply, I've been on holiday. No, I never found a solution,
it worked in some nightlies but not in others, if I remember correctly. I
haven't tried it in 1.4 yet, I got around my problem another way.

Andrew.

-- 
View this message in context: http://old.nabble.com/%27Connection-reset%27-in-DataImportHandler-Development-Console-tp25005850p26779966.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: 'Connection reset' in DataImportHandler Development Console

Posted by aerox7 <am...@me.com>.
Hi Andrew,
I download the last build of solr (1.4) and i have the same probleme with
DebugNow in Dataimport dev Console. have you found a solution ?

thank you

Andrew Clegg wrote:
> 
> 
> 
> Noble Paul നോബിള്‍  नोब्ळ्-2 wrote:
>> 
>> apparently I do not see any command full-import, delta-import being
>> fired. Is that true?
>> 
> 
> It seems that way -- they're not appearing in the logs. I've tried Debug
> Now with both full and delta selected from the dropdown, no difference
> either way.
> 
> If I click the Full Import button it starts an import okay. I don't have
> to Full Import manually every time I want to debug a config change do I?
> That's not what the docs say. (A full import takes about 6 or 7 hours...)
> 
> Thanks,
> 
> Andrew.
> 

-- 
View this message in context: http://old.nabble.com/%27Connection-reset%27-in-DataImportHandler-Development-Console-tp25005850p26545401.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: 'Connection reset' in DataImportHandler Development Console

Posted by Andrew Clegg <an...@gmail.com>.


Noble Paul നോബിള്‍  नोब्ळ्-2 wrote:
> 
> apparently I do not see any command full-import, delta-import being
> fired. Is that true?
> 

It seems that way -- they're not appearing in the logs. I've tried Debug Now
with both full and delta selected from the dropdown, no difference either
way.

If I click the Full Import button it starts an import okay. I don't have to
Full Import manually every time I want to debug a config change do I? That's
not what the docs say. (A full import takes about 6 or 7 hours...)

Thanks,

Andrew.
-- 
View this message in context: http://www.nabble.com/%27Connection-reset%27-in-DataImportHandler-Development-Console-tp25005850p25006284.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: 'Connection reset' in DataImportHandler Development Console

Posted by Noble Paul നോബിള്‍ नोब्ळ् <no...@corp.aol.com>.
apparently I do not see any command full-import, delta-import being
fired. Is that true?

On Mon, Aug 17, 2009 at 5:55 PM, Andrew Clegg<an...@gmail.com> wrote:
>
> Hi folks,
>
> I'm trying to use the Debug Now button in the development console to test
> the effects of some changes in my data import config (see attached).
>
> However, each time I click it, the right-hand frame fails to load -- it just
> gets replaced with the standard 'connection reset' message from Firefox, as
> if the server's dropped the HTTP connection.
>
> Everything else seems okay -- I can run queries in Solr Admin without any
> problems, and all the other buttons in the dev console work -- status,
> document count, reload config etc.
>
> There's nothing suspicious in Tomcat's catalina.out either. If I hit Reload
> Config, then Status, then Debug Now, I get this:
>
>
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImportHandler
> processConfiguration
> INFO: Processing configuration from solrconfig.xml: {config=dataconfig.xml}
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> loadDataConfig
> INFO: Data Configuration loaded successfully
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: id is a required field in SolrSchema . But not found in DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: title is a required field in SolrSchema . But not found in DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: doc_type is a required field in SolrSchema . But not found in
> DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: id is a required field in SolrSchema . But not found in DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: title is a required field in SolrSchema . But not found in DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: doc_type is a required field in SolrSchema . But not found in
> DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: id is a required field in SolrSchema . But not found in DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: title is a required field in SolrSchema . But not found in DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: doc_type is a required field in SolrSchema . But not found in
> DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: id is a required field in SolrSchema . But not found in DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: title is a required field in SolrSchema . But not found in DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.handler.dataimport.DataImporter
> verifyWithSchema
> INFO: doc_type is a required field in SolrSchema . But not found in
> DataConfig
> 17-Aug-2009 13:12:12 org.apache.solr.core.SolrCore execute
> INFO: [] webapp=/solr path=/select
> params={clean=false&command=reload-config&commit=true&qt=/dataimport}
> status=0 QTime=5
> 17-Aug-2009 13:12:21 org.apache.solr.core.SolrCore execute
> INFO: [] webapp=/solr path=/select
> params={clean=false&command=status&commit=true&qt=/dataimport} status=0
> QTime=0
>
>
> (The warnings are because the doc_type field comes out of the JDBC result
> set automatically by column name -- this isn't a problem.)
>
> Also, there's no entry in the Tomcat access log for the debug request
> either, just the first two:
>
>
> [17/Aug/2009:13:12:12 +0100] HTTP/1.1 cookie:- request:-  GET /solr/select
> 200 ?clean=false&commit=true&qt=%2Fdataimport&command=reload-config GET
> /solr/select?clean=false&commit=t
> rue&qt=%2Fdataimport&command=reload-config HTTP/1.1
> [17/Aug/2009:13:12:21 +0100] HTTP/1.1 cookie:- request:-  GET /solr/select
> 200 ?clean=false&commit=true&qt=%2Fdataimport&command=status GET
> /solr/select?clean=false&commit=true&qt=
> %2Fdataimport&command=status HTTP/1.1
>
>
> PS... Nightly build, 30th of July.
>
> Thanks,
>
> Andrew.
>
> http://www.nabble.com/file/p25005850/dataconfig.xml dataconfig.xml
> --
> View this message in context: http://www.nabble.com/%27Connection-reset%27-in-DataImportHandler-Development-Console-tp25005850p25005850.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>
>



-- 
-----------------------------------------------------
Noble Paul | Principal Engineer| AOL | http://aol.com