how to debug dataimporthandler

[cyang2010 <ys...@hotmail.com>]

I wonder how to run dataimporthandler in debug mode.  Currently i can't get
data correctly into index through dataimporthandler, especially a timestamp
column to solr date field.  I want to debug the process.

According to this wiki page:

Commands
The handler exposes all its API as http requests . The following are the
possible operations 
•full-import : Full Import operation can be started by hitting the URL
http://:/solr/dataimport?command=full-import 
...
■clean : (default 'true'). Tells whether to clean up the index before the
indexing is started 
■commit: (default 'true'). Tells whether to commit after the operation 
■optimize: (default 'true'). Tells whether to optimize after the operation 
■debug : (default false). Runs in debug mode.It is used by the interactive
development mode (see here) 
■Please note that in debug mode, documents are never committed
automatically. If you want to run debug mode and commit the results too, add
'commit=true' as a request parameter. 


Therefore, i run 

http://:/solr/dataimport?command=full-import &debug=true

Not only i didn't see log with "DEBUG" level, but also it crashes my machine
a few times.   I was surprised it can even do that ...

Did someone ever try to debug the process before?  What is your experience
with it?



--
View this message in context: http://lucene.472066.n3.nabble.com/how-to-debug-dataimporthandler-tp2611506p2611506.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: how to debug dataimporthandler

[PeterKerk <ve...@hotmail.com>]

Tried your steps, but failed. Could you perhaps have a look at my post here:
http://lucene.472066.n3.nabble.com/org-apache-solr-handler-dataimport-DataImportHandlerException-Unable-to-execute-query-td4108227.html



--
View this message in context: http://lucene.472066.n3.nabble.com/how-to-debug-dataimporthandler-tp2611506p4108676.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: how to debug dataimporthandler

[Stefan Matheis <ma...@googlemail.com>]

Hey,

normally .. if i have problems with dih:

* i start having a look at the mysql-query-log, to check which queries
are executed.
* re-run the query myself, verify the return data
* Activate http://wiki.apache.org/solr/DataImportHandler#LogTransformer
and log the important data, check console output

yet, this was debugging enough for all my problems :)

Regards
Stefan

On Wed, Mar 2, 2011 at 7:28 AM, cyang2010 <ys...@hotmail.com> wrote:
> I wonder how to run dataimporthandler in debug mode.  Currently i can't get
> data correctly into index through dataimporthandler, especially a timestamp
> column to solr date field.  I want to debug the process.
>
> According to this wiki page:
>
> Commands
> The handler exposes all its API as http requests . The following are the
> possible operations
> •full-import : Full Import operation can be started by hitting the URL
> http://:/solr/dataimport?command=full-import
> ...
> ■clean : (default 'true'). Tells whether to clean up the index before the
> indexing is started
> ■commit: (default 'true'). Tells whether to commit after the operation
> ■optimize: (default 'true'). Tells whether to optimize after the operation
> ■debug : (default false). Runs in debug mode.It is used by the interactive
> development mode (see here)
> ■Please note that in debug mode, documents are never committed
> automatically. If you want to run debug mode and commit the results too, add
> 'commit=true' as a request parameter.
>
>
> Therefore, i run
>
> http://:/solr/dataimport?command=full-import &debug=true
>
> Not only i didn't see log with "DEBUG" level, but also it crashes my machine
> a few times.   I was surprised it can even do that ...
>
> Did someone ever try to debug the process before?  What is your experience
> with it?
>
>
>
> --
> View this message in context: http://lucene.472066.n3.nabble.com/how-to-debug-dataimporthandler-tp2611506p2611506.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>