You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by RaviKiran Moola <ra...@radiant.digital> on 2020/04/17 15:43:08 UTC
RE: Indexing data from multiple data sources
Hi,
Greetings!!!
We are working on indexing data from multiple data sources (MySQL & MSSQL) in a single collection. We specified data source details like connection details along with the required fields for both data sources in a single data config file, along with specified required fields details in the managed schema and here fetching the same columns from both data sources by specifying the common “unique key”.
Unable to index the data from the data sources using solr.
Here I’m attaching the data config file and screenshot.
Data config file:
<dataConfig>
<dataSource type="Jdbc-1" driver="com.mysql.jdbc.Driver" url="jdbc:mysql://182.74.133.92:3306/ra_dev" user="devuser" password="Welcome_009" batchSize="1" />
<dataSource type="Jdbc-2" driver="com.microsoft.sqlserver.jdbc.SQLServerDriver" url="jdbc:sqlserver://182.74.133.92;databasename=BB_SOLR" user="matuser" password="MatDev:07"/>
<document name="mbc details">
<entity name="ra_details" dataSource="Jdbc-1" query="SELECT MBC_NUMBER,ACTIVE_FLAG FROM mbc_tbl">
<field column="MBC_NUMBER" name="MBC_NUMBER"/>
<field column="ACTIVE_FLAG" name="ACTIVE_FLAG"/>
<entity name="mbc_details" dataSource="Jdbc-2" query="SELECT MBC_NUMBER,ACTIVE_FLAG FROM mbc_tbl">
<field column="MBC_NUMBER" name="MBC_NUMBER"/>
<field column="ACTIVE_FLAG" name="ACTIVE_FLAG"/>
</entity>
</entity>
</document>
</dataConfig>
Thanks & Regards,
Ravikiran Moola
+91-9494924492
Re: Indexing data from multiple data sources
Posted by Charlie Hull <ch...@flax.co.uk>.
The link you quote is Sematext's mirror of the Apache solr-user mailing
list. There are others also providing copies of this list. As the cat is
very much out of the bag your best course of action is to change all the
logins and passwords that have been leaked and review your security
procedures.
Cheers
Charlie
On 18/04/2020 13:27, RaviKiran Moola wrote:
> Hi,
> Greetings of the day!!!
>
> Unfortunately we have enclosed our database source details in the Solr
> community post while sending our queries to solr support as mentioned
> in the below mail.
>
> We find that it has been posted with this link
> https://sematext.com/opensee/m/Solr/eHNlswSd1vD6AF?subj=RE+Indexing+data+from+multiple+data+sources
>
> As it is open to the world, what we are requesting here is, could you
> please remove that post as-soon-as possible before it creates any
> sucurity issues for us.
>
> Your help is very very appreciable!!!
>
> FYI.....
> Here I'm attaching the below screenshot
>
>
>
>
> Thanks & Regards,
>
> Ravikiran Moola
>
>
> ------------------------------------------------------------------------
> *From:* RaviKiran Moola
> *Sent:* Friday, April 17, 2020 9:13 PM
> *To:* solr-user@lucene.apache.org <so...@lucene.apache.org>
> *Subject:* RE: Indexing data from multiple data sources
> Hi,
>
> Greetings!!!
>
> We are working on indexing data from multiple data sources (MySQL &
> MSSQL) in a single collection. We specified data source details like
> connection details along with the required fields for both data
> sources in a single data config file, along with specified required
> fields details in the managed schema and here fetching the same
> columns from both data sources by specifying the common “unique key”.
>
> Unable to index the data from the data sources using solr.
>
> Here I’m attaching the data config file and screenshot.
>
> Data config file:
> <dataConfig>
> <dataSource type="Jdbc-1" driver="com.mysql.jdbc.Driver"
> url="jdbc:mysql://182.74.133.92:3306/ra_dev" user="devuser"
> password="Welcome_009" batchSize="1" />
> <dataSource type="Jdbc-2"
> driver="com.microsoft.sqlserver.jdbc.SQLServerDriver"
> url="jdbc:sqlserver://182.74.133.92;databasename=BB_SOLR"
> user="matuser" password="MatDev:07"/>
> <document name="mbc details">
> <entity name="ra_details" dataSource="Jdbc-1" query="SELECT
> MBC_NUMBER,ACTIVE_FLAG FROM mbc_tbl">
> <field column="MBC_NUMBER" name="MBC_NUMBER"/>
> <field column="ACTIVE_FLAG" name="ACTIVE_FLAG"/>
> <entity name="mbc_details" dataSource="Jdbc-2" query="SELECT
> MBC_NUMBER,ACTIVE_FLAG FROM mbc_tbl">
> <field column="MBC_NUMBER" name="MBC_NUMBER"/>
> <field column="ACTIVE_FLAG" name="ACTIVE_FLAG"/>
> </entity>
> </entity>
> </document>
> </dataConfig>
>
>
> Thanks & Regards,
>
> Ravikiran Moola
>
> +91-9494924492
>
>
--
Charlie Hull
OpenSource Connections, previously Flax
tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828
web: www.o19s.com
Re: Indexing data from multiple data sources
Posted by RaviKiran Moola <ra...@radiant.digital>.
Hi,
Greetings of the day!!!
Unfortunately we have enclosed our database source details in the Solr community post while sending our queries to solr support as mentioned in the below mail.
We find that it has been posted with this link https://sematext.com/opensee/m/Solr/eHNlswSd1vD6AF?subj=RE+Indexing+data+from+multiple+data+sources
As it is open to the world, what we are requesting here is, could you please remove that post as-soon-as possible before it creates any sucurity issues for us.
Your help is very very appreciable!!!
FYI.....
Here I'm attaching the below screenshot
[cid:6ccc253a-a590-4e89-b5de-fd9a59d88aba]
Thanks & Regards,
Ravikiran Moola
________________________________
From: RaviKiran Moola
Sent: Friday, April 17, 2020 9:13 PM
To: solr-user@lucene.apache.org <so...@lucene.apache.org>
Subject: RE: Indexing data from multiple data sources
Hi,
Greetings!!!
We are working on indexing data from multiple data sources (MySQL & MSSQL) in a single collection. We specified data source details like connection details along with the required fields for both data sources in a single data config file, along with specified required fields details in the managed schema and here fetching the same columns from both data sources by specifying the common “unique key”.
Unable to index the data from the data sources using solr.
Here I’m attaching the data config file and screenshot.
Data config file:
<dataConfig>
<dataSource type="Jdbc-1" driver="com.mysql.jdbc.Driver" url="jdbc:mysql://182.74.133.92:3306/ra_dev" user="devuser" password="Welcome_009" batchSize="1" />
<dataSource type="Jdbc-2" driver="com.microsoft.sqlserver.jdbc.SQLServerDriver" url="jdbc:sqlserver://182.74.133.92;databasename=BB_SOLR" user="matuser" password="MatDev:07"/>
<document name="mbc details">
<entity name="ra_details" dataSource="Jdbc-1" query="SELECT MBC_NUMBER,ACTIVE_FLAG FROM mbc_tbl">
<field column="MBC_NUMBER" name="MBC_NUMBER"/>
<field column="ACTIVE_FLAG" name="ACTIVE_FLAG"/>
<entity name="mbc_details" dataSource="Jdbc-2" query="SELECT MBC_NUMBER,ACTIVE_FLAG FROM mbc_tbl">
<field column="MBC_NUMBER" name="MBC_NUMBER"/>
<field column="ACTIVE_FLAG" name="ACTIVE_FLAG"/>
</entity>
</entity>
</document>
</dataConfig>
Thanks & Regards,
Ravikiran Moola
+91-9494924492
Re: Indexing data from multiple data sources
Posted by Jörn Franke <jo...@gmail.com>.
What does your Solr.log say? Any error ?
> Am 17.04.2020 um 20:22 schrieb RaviKiran Moola <ra...@radiant.digital>:
>
>
> Hi,
>
> Greetings!!!
>
> We are working on indexing data from multiple data sources (MySQL & MSSQL) in a single collection. We specified data source details like connection details along with the required fields for both data sources in a single data config file, along with specified required fields details in the managed schema and here fetching the same columns from both data sources by specifying the common “unique key”.
>
> Unable to index the data from the data sources using solr.
>
> Here I’m attaching the data config file and screenshot.
>
> Data config file:
> <dataConfig>
> <dataSource type="Jdbc-1" driver="com.mysql.jdbc.Driver" url="jdbc:mysql://182.74.133.92:3306/ra_dev" user="devuser" password="Welcome_009" batchSize="1" />
> <dataSource type="Jdbc-2" driver="com.microsoft.sqlserver.jdbc.SQLServerDriver" url="jdbc:sqlserver://182.74.133.92;databasename=BB_SOLR" user="matuser" password="MatDev:07"/>
> <document name="mbc details">
> <entity name="ra_details" dataSource="Jdbc-1" query="SELECT MBC_NUMBER,ACTIVE_FLAG FROM mbc_tbl">
> <field column="MBC_NUMBER" name="MBC_NUMBER"/>
> <field column="ACTIVE_FLAG" name="ACTIVE_FLAG"/>
> <entity name="mbc_details" dataSource="Jdbc-2" query="SELECT MBC_NUMBER,ACTIVE_FLAG FROM mbc_tbl">
> <field column="MBC_NUMBER" name="MBC_NUMBER"/>
> <field column="ACTIVE_FLAG" name="ACTIVE_FLAG"/>
> </entity>
> </entity>
> </document>
> </dataConfig>
>
>
> Thanks & Regards,
> Ravikiran Moola
> +91-9494924492
>