You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by matthew sporleder <ms...@gmail.com> on 2020/05/13 23:39:36 UTC

DIH nested entity repeating query in verbose output

I am attempting to use nested entities to populate documents from
different tables and verbose/debug output is showing repeated queries
on import.  The doc number repeats the sqls.

"verbose-output":
[ "entity:parent",
..
[ "document#5", [
...
"entity:nested1", [
"query", "SELECT body AS nested1 FROM table WHERE p_id = '1234'",
"query", "SELECT body AS nested1 FROM table WHERE p_id = '1234'",
"query", "SELECT body AS nested1 FROM table WHERE p_id = '1234'",
"query", "SELECT body AS nested1 FROM table WHERE p_id = '1234",
"query", "SELECT body AS nested1 FROM table WHERE p_id = '1234",
"time-taken", "0:0:0.1",
"time-taken", "0:0:0.1",
"time-taken", "0:0:0.1",
"time-taken", "0:0:0.1",
"time-taken", "0:0:0.1" ],


The counts appears to be correct?
Requests: 61 , Fetched: 20 , Skipped: 0 , Processed: 20


I have a config like:

<entity
  dataSource="database"
  name="parent"
  pk="id"
  query="SELECT .."
  deltaImportQuery="SELECT.."
  deltaQuery="SELECT.."
  >
  <entity
    name="child1"
    query="SELECT body AS nested1 FROM table WHERE p_id = '${parent.id}'
    deltaQuery=...
    parentDeltaQuery=...
    etc
  >
  </entity>
  <entity
    name="child2"
    query="SELECT body AS nested2 FROM table WHERE p_id = '${parent.id}'
    deltaQuery=...
    parentDeltaQuery=...
    etc
  >
  </entity>
  <entity
    name="child3"
    query="SELECT body AS nested3 FROM table WHERE p_id = '${parent.id}'
    deltaQuery=...
    parentDeltaQuery=...
    etc
  >
  </entity>


</entity>

Re: DIH nested entity repeating query in verbose output

Posted by matthew sporleder <ms...@gmail.com>.

I think this is just an issue in the verbose/debug output.  tcpdump
does not show the same issue.

On Wed, May 13, 2020 at 7:39 PM matthew sporleder <ms...@gmail.com> wrote:
>
> I am attempting to use nested entities to populate documents from
> different tables and verbose/debug output is showing repeated queries
> on import.  The doc number repeats the sqls.
>
> "verbose-output":
> [ "entity:parent",
> ..
> [ "document#5", [
> ...
> "entity:nested1", [
> "query", "SELECT body AS nested1 FROM table WHERE p_id = '1234'",
> "query", "SELECT body AS nested1 FROM table WHERE p_id = '1234'",
> "query", "SELECT body AS nested1 FROM table WHERE p_id = '1234'",
> "query", "SELECT body AS nested1 FROM table WHERE p_id = '1234",
> "query", "SELECT body AS nested1 FROM table WHERE p_id = '1234",
> "time-taken", "0:0:0.1",
> "time-taken", "0:0:0.1",
> "time-taken", "0:0:0.1",
> "time-taken", "0:0:0.1",
> "time-taken", "0:0:0.1" ],
>
>
> The counts appears to be correct?
> Requests: 61 , Fetched: 20 , Skipped: 0 , Processed: 20
>
>
> I have a config like:
>
> <entity
>   dataSource="database"
>   name="parent"
>   pk="id"
>   query="SELECT .."
>   deltaImportQuery="SELECT.."
>   deltaQuery="SELECT.."
>   >
>   <entity
>     name="child1"
>     query="SELECT body AS nested1 FROM table WHERE p_id = '${parent.id}'
>     deltaQuery=...
>     parentDeltaQuery=...
>     etc
>   >
>   </entity>
>   <entity
>     name="child2"
>     query="SELECT body AS nested2 FROM table WHERE p_id = '${parent.id}'
>     deltaQuery=...
>     parentDeltaQuery=...
>     etc
>   >
>   </entity>
>   <entity
>     name="child3"
>     query="SELECT body AS nested3 FROM table WHERE p_id = '${parent.id}'
>     deltaQuery=...
>     parentDeltaQuery=...
>     etc
>   >
>   </entity>
>
>
> </entity>