You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Pulkit Singhal <pu...@gmail.com> on 2011/10/01 23:02:31 UTC

Bug in DIH?

Its rather strange stacktrace(at the bottom).
An entire 10000+ dataset finishes up only to end up crashing & burning
due to a log statement :)

Based on what I can tell from the stacktrace and the 4.x trunk source
code, it seems that the follwoign log statement dies:
    //LogUpdateProcessorFactory.java:188
    log.info( ""+toLog + " 0 " + (elapsed) );

Eventually at the strict cast:
    //NamedList.java:127
    return (String)nvPairs.get(idx << 1);

I was wondering what kind of mistaken data would I have ended up
getting misplaced into:
    //LogUpdateProcessorFactory.java:76
    private final NamedList<Object> toLog;

To cause the java.util.ArrayList cannot be cast to java.lang.String issue?
Could it be due to the multivalued fields that I'm trying to index?
Is this a bug or just a mistake in how I use DIH, please let me know
your thoughts!

SEVERE: Full Import failed:java.lang.ClassCastException:
java.util.ArrayList cannot be cast to java.lang.String
        at org.apache.solr.common.util.NamedList.getName(NamedList.java:127)
        at org.apache.solr.common.util.NamedList.toString(NamedList.java:263)
        at java.lang.String.valueOf(String.java:2826)
        at java.lang.StringBuilder.append(StringBuilder.java:115)
        at org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:188)
        at org.apache.solr.handler.dataimport.SolrWriter.close(SolrWriter.java:57)
        at org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:265)
        at org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:372)
        at org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:440)
        at org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:421)

Re: Bug in DIH?

Posted by Pulkit Singhal <pu...@gmail.com>.
Thanks Lance, its logged as:
https://issues.apache.org/jira/browse/SOLR-2804

- Pulkit

On Sat, Oct 1, 2011 at 8:59 PM, Lance Norskog <go...@gmail.com> wrote:
> Should bugs in LogProcessor should be ignored by DIH? They are not required
> to index data, right?
>
> Please open an issue for this. The fix should have two parts:
> 1) fix the exception
> 2) log and ignore exceptions in the LogProcessor
>
> On Sat, Oct 1, 2011 at 2:02 PM, Pulkit Singhal <pu...@gmail.com>wrote:
>
>> Its rather strange stacktrace(at the bottom).
>> An entire 10000+ dataset finishes up only to end up crashing & burning
>> due to a log statement :)
>>
>> Based on what I can tell from the stacktrace and the 4.x trunk source
>> code, it seems that the follwoign log statement dies:
>>    //LogUpdateProcessorFactory.java:188
>>    log.info( ""+toLog + " 0 " + (elapsed) );
>>
>> Eventually at the strict cast:
>>    //NamedList.java:127
>>    return (String)nvPairs.get(idx << 1);
>>
>> I was wondering what kind of mistaken data would I have ended up
>> getting misplaced into:
>>    //LogUpdateProcessorFactory.java:76
>>    private final NamedList<Object> toLog;
>>
>> To cause the java.util.ArrayList cannot be cast to java.lang.String issue?
>> Could it be due to the multivalued fields that I'm trying to index?
>> Is this a bug or just a mistake in how I use DIH, please let me know
>> your thoughts!
>>
>> SEVERE: Full Import failed:java.lang.ClassCastException:
>> java.util.ArrayList cannot be cast to java.lang.String
>>        at org.apache.solr.common.util.NamedList.getName(NamedList.java:127)
>>        at
>> org.apache.solr.common.util.NamedList.toString(NamedList.java:263)
>>        at java.lang.String.valueOf(String.java:2826)
>>        at java.lang.StringBuilder.append(StringBuilder.java:115)
>>        at
>> org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:188)
>>        at
>> org.apache.solr.handler.dataimport.SolrWriter.close(SolrWriter.java:57)
>>        at
>> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:265)
>>        at
>> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:372)
>>        at
>> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:440)
>>        at
>> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:421)
>>
>
>
>
> --
> Lance Norskog
> goksron@gmail.com
>

Re: Bug in DIH?

Posted by Lance Norskog <go...@gmail.com>.
Should bugs in LogProcessor should be ignored by DIH? They are not required
to index data, right?

Please open an issue for this. The fix should have two parts:
1) fix the exception
2) log and ignore exceptions in the LogProcessor

On Sat, Oct 1, 2011 at 2:02 PM, Pulkit Singhal <pu...@gmail.com>wrote:

> Its rather strange stacktrace(at the bottom).
> An entire 10000+ dataset finishes up only to end up crashing & burning
> due to a log statement :)
>
> Based on what I can tell from the stacktrace and the 4.x trunk source
> code, it seems that the follwoign log statement dies:
>    //LogUpdateProcessorFactory.java:188
>    log.info( ""+toLog + " 0 " + (elapsed) );
>
> Eventually at the strict cast:
>    //NamedList.java:127
>    return (String)nvPairs.get(idx << 1);
>
> I was wondering what kind of mistaken data would I have ended up
> getting misplaced into:
>    //LogUpdateProcessorFactory.java:76
>    private final NamedList<Object> toLog;
>
> To cause the java.util.ArrayList cannot be cast to java.lang.String issue?
> Could it be due to the multivalued fields that I'm trying to index?
> Is this a bug or just a mistake in how I use DIH, please let me know
> your thoughts!
>
> SEVERE: Full Import failed:java.lang.ClassCastException:
> java.util.ArrayList cannot be cast to java.lang.String
>        at org.apache.solr.common.util.NamedList.getName(NamedList.java:127)
>        at
> org.apache.solr.common.util.NamedList.toString(NamedList.java:263)
>        at java.lang.String.valueOf(String.java:2826)
>        at java.lang.StringBuilder.append(StringBuilder.java:115)
>        at
> org.apache.solr.update.processor.LogUpdateProcessor.finish(LogUpdateProcessorFactory.java:188)
>        at
> org.apache.solr.handler.dataimport.SolrWriter.close(SolrWriter.java:57)
>        at
> org.apache.solr.handler.dataimport.DocBuilder.execute(DocBuilder.java:265)
>        at
> org.apache.solr.handler.dataimport.DataImporter.doFullImport(DataImporter.java:372)
>        at
> org.apache.solr.handler.dataimport.DataImporter.runCmd(DataImporter.java:440)
>        at
> org.apache.solr.handler.dataimport.DataImporter$1.run(DataImporter.java:421)
>



-- 
Lance Norskog
goksron@gmail.com