You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Jamshaid Ashraf <ja...@gmail.com> on 2013/08/20 11:21:29 UTC

Error while importing HBase data to Solr using the DataImportHandler

Hi,

I want to import HBase(0.90.4) data to solr 4.3.0 using DIH (Data import
handler) for this I used "https://code.google.com/p/hbase-solr-dataimport/"
project. Whenever I run data import handler "
http://localhost:8080/solr/#/collection1/dataimport" it throws following
error in log.

*Jar:*
hbase-solr-dataimport-0.0.1.jar

*Error:*
Full Import failed:java.lang.NoClassDefFoundError:
org/apache/hadoop/hbase/HBaseConfiguration

Your early response would be appreciated!

Thanks & Regards,
Jamshaid

Re: Error while importing HBase data to Solr using the DataImportHandler

Posted by ppatel <pa...@gmail.com>.
Hi,

Can you provide me an example of data-config.xml? because with my Hbase
configuration, I am getting
Full Import failed:java.lang.RuntimeException: java.lang.RuntimeException:
org.apache.solr.handler.dataimport.DataImportHandlerException:
java.lang.NoSuchMethodError:
org.apache.hadoop.net.NetUtils.getInputStream(Ljava/net/Socket;)Ljava/io/InputStream;

AND

Exception while processing: item document :
SolrInputDocument[]:org.apache.solr.handler.dataimport.DataImportHandlerException:
Unable to execute SCANNER: [tableName=Item, startRow=null, stopRow=null,
columns=[{Item|r}, {Item|m}, {Item|u}]] Processing Document # 1

Mine data-config.xml:

<dataConfig>

<dataSource type="HbaseDataSource" name="HBase" host="127.0.0.1" port="2181"
/>

    <document name="Item">

        <entity name="item" 
                pk="ROW_KEY"
                dataSource="HBase"
                processor="HbaseEntityProcessor"
                tableName="Item" 
                onError="abort"
            columns="Item|r,
                     Item|m,
                     Item|u"
            query="scan 'Item', {COLUMNS => ['r','m', 'u']}"
            deltaImportQuery=""
            deltaQuery="" >
            
            <field column="ROW_KEY" name="id" />
            <field column="r" name="r" />
            <field column="m" name="m" />
            <field column="u" name="u" />
            
        </entity>


    </document>
</dataConfig>

Please respond me ASAP.

Thanks in advance!!




--
View this message in context: http://lucene.472066.n3.nabble.com/Error-while-importing-HBase-data-to-Solr-using-the-DataImportHandler-tp4085613p4089402.html
Sent from the Solr - User mailing list archive at Nabble.com.

Re: Error while importing HBase data to Solr using the DataImportHandler

Posted by Jamshaid Ashraf <ja...@gmail.com>.
Thanks tamanjit!

Issue is resolved I just further added following jars as well:

hbase-0.90.4.jar
hadoop-core-0.20-append-r1056497.jar
zookeeper-3.4.5.jar

Regards,
Jamshaid


On Tue, Aug 20, 2013 at 2:32 PM, tamanjit.bindra@yahoo.co.in <
tamanjit.bindra@yahoo.co.in> wrote:

> You would need to add the jar that is missing to the Solr web-inf\lib
> folder.
> You can do that using winzip etc into the lib folder of solr.war. Then you
> need to redeployed the changed solr.war and restart your webcontainer.
>
> The jar is available here:
>
> http://code.google.com/p/hbase-solr-dataimport/downloads/detail?name=hbase-solr-dataimport-0.0.1.jar&can=2&q=
> <
> http://code.google.com/p/hbase-solr-dataimport/downloads/detail?name=hbase-solr-dataimport-0.0.1.jar&can=2&q=
> >
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Error-while-importing-HBase-data-to-Solr-using-the-DataImportHandler-tp4085613p4085616.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>

Re: Error while importing HBase data to Solr using the DataImportHandler

Posted by "tamanjit.bindra@yahoo.co.in" <ta...@yahoo.co.in>.
You would need to add the jar that is missing to the Solr web-inf\lib folder.
You can do that using winzip etc into the lib folder of solr.war. Then you
need to redeployed the changed solr.war and restart your webcontainer.

The jar is available here:
http://code.google.com/p/hbase-solr-dataimport/downloads/detail?name=hbase-solr-dataimport-0.0.1.jar&can=2&q=
<http://code.google.com/p/hbase-solr-dataimport/downloads/detail?name=hbase-solr-dataimport-0.0.1.jar&can=2&q=>  



--
View this message in context: http://lucene.472066.n3.nabble.com/Error-while-importing-HBase-data-to-Solr-using-the-DataImportHandler-tp4085613p4085616.html
Sent from the Solr - User mailing list archive at Nabble.com.