You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@solr.apache.org by Neha Gupta <ne...@uni-jena.de> on 2022/04/05 10:55:17 UTC
Need help with DIH plugin SOLR
Dear Solr Community,
Need your help.
I am running SOLR(8.11) as a standalone (on Windows) and want to index
from the relational database(Postgres) and as such i tried to install
DIH plugin by following the instructions given at: -
https://github.com/rohitbemax/dataimporthandler
I am stuck at step "Add the configurations and reload the collection"
sh zkcli.sh -z localhost:9983 -cmd putfile
"/configs/products.AUTOCREATED/data-config.xml" data-config.xml
I am getting error : -
*Error: Could not find or load main class org.apache.solr.cloud.ZkCLI*
Request you to please help me with this.
Thanks and Regards
Neha Gupta
Re: Need help with DIH plugin SOLR
Posted by Neha Gupta <ne...@uni-jena.de>.
Thanks Dominique...will look into it.
On 06/04/2022 22:56, Dominique Bejean wrote:
> Hi,
>
> I suggest to take a look at Apache Nifi ETL in order to replace DIH. It can
> read and write into Solr,
>
> Dominique
>
> Le mer. 6 avr. 2022 à 12:44, Jan Høydahl <ja...@cominvent.com> a écrit :
>
>> Hi,
>>
>> The upcoming 9.0 release does not have DIH. And it is unclear whether the
>> plugin on github will be updated to work with 9.0, if it does, you may of
>> course use it.
>> But the common recommendation is to replace DIH with some other DB
>> indexing tool outside of Solr. Either find some tool that supports Solr
>> OOTB, like Apache ManifoldCF, or perhaps better, roll your own client code
>> reading from DB and pushing documents to Solr.
>>
>> Jan
>>
>>> 6. apr. 2022 kl. 11:29 skrev Neha Gupta <ne...@uni-jena.de>:
>>>
>>> Ok Thanks a lot.
>>>
>>> I have one more question even with SOLR 8.11, the data import handler is
>> coming but yes there is a message on GUI that it is deprecated and will be
>> removed in the future version.
>>> Can we use that for indexing relational database as i am able to index a
>> part of my data with the default one which is coming with SOLR 8.11 without
>> any DIH package installed?
>>>
>>> PS: - Our data is static and won't change in future. Need to re-index
>> only when indexed data in SOLR goes corrupt.
>>>
>>> Thanks and Regards
>>>
>>> Neha Gupta
>>>
>>>
>>> On 05/04/2022 15:27, James Greene wrote:
>>>> Stand alone mode does not use zookeeper, you do not need to upload
>> configs
>>>> using zkcli.sh.
>>>>
>>>>
>>>>
>>>> On Tue, Apr 5, 2022, 6:55 AM Neha Gupta <ne...@uni-jena.de> wrote:
>>>>
>>>>> Dear Solr Community,
>>>>>
>>>>> Need your help.
>>>>> I am running SOLR(8.11) as a standalone (on Windows) and want to index
>>>>> from the relational database(Postgres) and as such i tried to install
>>>>> DIH plugin by following the instructions given at: -
>>>>> https://github.com/rohitbemax/dataimporthandler
>>>>>
>>>>> I am stuck at step "Add the configurations and reload the collection"
>>>>>
>>>>> sh zkcli.sh -z localhost:9983 -cmd putfile
>>>>> "/configs/products.AUTOCREATED/data-config.xml" data-config.xml
>>>>>
>>>>> I am getting error : -
>>>>> *Error: Could not find or load main class org.apache.solr.cloud.ZkCLI*
>>>>>
>>>>>
>>>>>
>>>>> Request you to please help me with this.
>>>>>
>>>>>
>>>>> Thanks and Regards
>>>>> Neha Gupta
>>>>>
>>
Re: Need help with DIH plugin SOLR
Posted by dmitri maziuk <dm...@gmail.com>.
On 2022-04-08 4:45 PM, Mike Drob wrote:
> Hi Dominique,
>
> Are there any guides available on using Nifi ETL with Solr? What do you
> consider to be good references for it?
ETL is likely an overkill for DIH, about the only reason you'd use it is
if you can use a scripting language.
Dima
Re: Need help with DIH plugin SOLR
Posted by Mike Drob <md...@mdrob.com>.
Hi Dominique,
Are there any guides available on using Nifi ETL with Solr? What do you
consider to be good references for it?
Thanks,
Mike
On Wed, Apr 6, 2022 at 3:56 PM Dominique Bejean <do...@eolya.fr>
wrote:
> Hi,
>
> I suggest to take a look at Apache Nifi ETL in order to replace DIH. It can
> read and write into Solr,
>
> Dominique
>
> Le mer. 6 avr. 2022 à 12:44, Jan Høydahl <ja...@cominvent.com> a écrit :
>
> > Hi,
> >
> > The upcoming 9.0 release does not have DIH. And it is unclear whether the
> > plugin on github will be updated to work with 9.0, if it does, you may of
> > course use it.
> > But the common recommendation is to replace DIH with some other DB
> > indexing tool outside of Solr. Either find some tool that supports Solr
> > OOTB, like Apache ManifoldCF, or perhaps better, roll your own client
> code
> > reading from DB and pushing documents to Solr.
> >
> > Jan
> >
> > > 6. apr. 2022 kl. 11:29 skrev Neha Gupta <ne...@uni-jena.de>:
> > >
> > > Ok Thanks a lot.
> > >
> > > I have one more question even with SOLR 8.11, the data import handler
> is
> > coming but yes there is a message on GUI that it is deprecated and will
> be
> > removed in the future version.
> > >
> > > Can we use that for indexing relational database as i am able to index
> a
> > part of my data with the default one which is coming with SOLR 8.11
> without
> > any DIH package installed?
> > >
> > >
> > > PS: - Our data is static and won't change in future. Need to re-index
> > only when indexed data in SOLR goes corrupt.
> > >
> > >
> > > Thanks and Regards
> > >
> > > Neha Gupta
> > >
> > >
> > > On 05/04/2022 15:27, James Greene wrote:
> > >> Stand alone mode does not use zookeeper, you do not need to upload
> > configs
> > >> using zkcli.sh.
> > >>
> > >>
> > >>
> > >> On Tue, Apr 5, 2022, 6:55 AM Neha Gupta <ne...@uni-jena.de>
> wrote:
> > >>
> > >>> Dear Solr Community,
> > >>>
> > >>> Need your help.
> > >>> I am running SOLR(8.11) as a standalone (on Windows) and want to
> index
> > >>> from the relational database(Postgres) and as such i tried to install
> > >>> DIH plugin by following the instructions given at: -
> > >>> https://github.com/rohitbemax/dataimporthandler
> > >>>
> > >>> I am stuck at step "Add the configurations and reload the collection"
> > >>>
> > >>> sh zkcli.sh -z localhost:9983 -cmd putfile
> > >>> "/configs/products.AUTOCREATED/data-config.xml" data-config.xml
> > >>>
> > >>> I am getting error : -
> > >>> *Error: Could not find or load main class
> org.apache.solr.cloud.ZkCLI*
> > >>>
> > >>>
> > >>>
> > >>> Request you to please help me with this.
> > >>>
> > >>>
> > >>> Thanks and Regards
> > >>> Neha Gupta
> > >>>
> >
> >
>
Re: Need help with DIH plugin SOLR
Posted by Dominique Bejean <do...@eolya.fr>.
Hi,
I suggest to take a look at Apache Nifi ETL in order to replace DIH. It can
read and write into Solr,
Dominique
Le mer. 6 avr. 2022 à 12:44, Jan Høydahl <ja...@cominvent.com> a écrit :
> Hi,
>
> The upcoming 9.0 release does not have DIH. And it is unclear whether the
> plugin on github will be updated to work with 9.0, if it does, you may of
> course use it.
> But the common recommendation is to replace DIH with some other DB
> indexing tool outside of Solr. Either find some tool that supports Solr
> OOTB, like Apache ManifoldCF, or perhaps better, roll your own client code
> reading from DB and pushing documents to Solr.
>
> Jan
>
> > 6. apr. 2022 kl. 11:29 skrev Neha Gupta <ne...@uni-jena.de>:
> >
> > Ok Thanks a lot.
> >
> > I have one more question even with SOLR 8.11, the data import handler is
> coming but yes there is a message on GUI that it is deprecated and will be
> removed in the future version.
> >
> > Can we use that for indexing relational database as i am able to index a
> part of my data with the default one which is coming with SOLR 8.11 without
> any DIH package installed?
> >
> >
> > PS: - Our data is static and won't change in future. Need to re-index
> only when indexed data in SOLR goes corrupt.
> >
> >
> > Thanks and Regards
> >
> > Neha Gupta
> >
> >
> > On 05/04/2022 15:27, James Greene wrote:
> >> Stand alone mode does not use zookeeper, you do not need to upload
> configs
> >> using zkcli.sh.
> >>
> >>
> >>
> >> On Tue, Apr 5, 2022, 6:55 AM Neha Gupta <ne...@uni-jena.de> wrote:
> >>
> >>> Dear Solr Community,
> >>>
> >>> Need your help.
> >>> I am running SOLR(8.11) as a standalone (on Windows) and want to index
> >>> from the relational database(Postgres) and as such i tried to install
> >>> DIH plugin by following the instructions given at: -
> >>> https://github.com/rohitbemax/dataimporthandler
> >>>
> >>> I am stuck at step "Add the configurations and reload the collection"
> >>>
> >>> sh zkcli.sh -z localhost:9983 -cmd putfile
> >>> "/configs/products.AUTOCREATED/data-config.xml" data-config.xml
> >>>
> >>> I am getting error : -
> >>> *Error: Could not find or load main class org.apache.solr.cloud.ZkCLI*
> >>>
> >>>
> >>>
> >>> Request you to please help me with this.
> >>>
> >>>
> >>> Thanks and Regards
> >>> Neha Gupta
> >>>
>
>
Re: Need help with DIH plugin SOLR
Posted by Jan Høydahl <ja...@cominvent.com>.
Hi,
The upcoming 9.0 release does not have DIH. And it is unclear whether the plugin on github will be updated to work with 9.0, if it does, you may of course use it.
But the common recommendation is to replace DIH with some other DB indexing tool outside of Solr. Either find some tool that supports Solr OOTB, like Apache ManifoldCF, or perhaps better, roll your own client code reading from DB and pushing documents to Solr.
Jan
> 6. apr. 2022 kl. 11:29 skrev Neha Gupta <ne...@uni-jena.de>:
>
> Ok Thanks a lot.
>
> I have one more question even with SOLR 8.11, the data import handler is coming but yes there is a message on GUI that it is deprecated and will be removed in the future version.
>
> Can we use that for indexing relational database as i am able to index a part of my data with the default one which is coming with SOLR 8.11 without any DIH package installed?
>
>
> PS: - Our data is static and won't change in future. Need to re-index only when indexed data in SOLR goes corrupt.
>
>
> Thanks and Regards
>
> Neha Gupta
>
>
> On 05/04/2022 15:27, James Greene wrote:
>> Stand alone mode does not use zookeeper, you do not need to upload configs
>> using zkcli.sh.
>>
>>
>>
>> On Tue, Apr 5, 2022, 6:55 AM Neha Gupta <ne...@uni-jena.de> wrote:
>>
>>> Dear Solr Community,
>>>
>>> Need your help.
>>> I am running SOLR(8.11) as a standalone (on Windows) and want to index
>>> from the relational database(Postgres) and as such i tried to install
>>> DIH plugin by following the instructions given at: -
>>> https://github.com/rohitbemax/dataimporthandler
>>>
>>> I am stuck at step "Add the configurations and reload the collection"
>>>
>>> sh zkcli.sh -z localhost:9983 -cmd putfile
>>> "/configs/products.AUTOCREATED/data-config.xml" data-config.xml
>>>
>>> I am getting error : -
>>> *Error: Could not find or load main class org.apache.solr.cloud.ZkCLI*
>>>
>>>
>>>
>>> Request you to please help me with this.
>>>
>>>
>>> Thanks and Regards
>>> Neha Gupta
>>>
Re: Need help with DIH plugin SOLR
Posted by Neha Gupta <ne...@uni-jena.de>.
Ok Thanks a lot.
I have one more question even with SOLR 8.11, the data import handler is
coming but yes there is a message on GUI that it is deprecated and will
be removed in the future version.
Can we use that for indexing relational database as i am able to index a
part of my data with the default one which is coming with SOLR 8.11
without any DIH package installed?
PS: - Our data is static and won't change in future. Need to re-index
only when indexed data in SOLR goes corrupt.
Thanks and Regards
Neha Gupta
On 05/04/2022 15:27, James Greene wrote:
> Stand alone mode does not use zookeeper, you do not need to upload configs
> using zkcli.sh.
>
>
>
> On Tue, Apr 5, 2022, 6:55 AM Neha Gupta <ne...@uni-jena.de> wrote:
>
>> Dear Solr Community,
>>
>> Need your help.
>> I am running SOLR(8.11) as a standalone (on Windows) and want to index
>> from the relational database(Postgres) and as such i tried to install
>> DIH plugin by following the instructions given at: -
>> https://github.com/rohitbemax/dataimporthandler
>>
>> I am stuck at step "Add the configurations and reload the collection"
>>
>> sh zkcli.sh -z localhost:9983 -cmd putfile
>> "/configs/products.AUTOCREATED/data-config.xml" data-config.xml
>>
>> I am getting error : -
>> *Error: Could not find or load main class org.apache.solr.cloud.ZkCLI*
>>
>>
>>
>> Request you to please help me with this.
>>
>>
>> Thanks and Regards
>> Neha Gupta
>>
Re: Need help with DIH plugin SOLR
Posted by James Greene <ja...@jamesaustingreene.com>.
Stand alone mode does not use zookeeper, you do not need to upload configs
using zkcli.sh.
On Tue, Apr 5, 2022, 6:55 AM Neha Gupta <ne...@uni-jena.de> wrote:
> Dear Solr Community,
>
> Need your help.
> I am running SOLR(8.11) as a standalone (on Windows) and want to index
> from the relational database(Postgres) and as such i tried to install
> DIH plugin by following the instructions given at: -
> https://github.com/rohitbemax/dataimporthandler
>
> I am stuck at step "Add the configurations and reload the collection"
>
> sh zkcli.sh -z localhost:9983 -cmd putfile
> "/configs/products.AUTOCREATED/data-config.xml" data-config.xml
>
> I am getting error : -
> *Error: Could not find or load main class org.apache.solr.cloud.ZkCLI*
>
>
>
> Request you to please help me with this.
>
>
> Thanks and Regards
> Neha Gupta
>