You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Kojo <rb...@gmail.com> on 2018/09/13 13:25:08 UTC
Streaming Expressions - gatherNodes
Hi,
If I try to feed gatherNodes with more than 25000 tuples, it gives me empty
result-set.
gatherNodes(projects,
search(projects, zkHost="localhost:9983",qt="/select", rows=30000,
q=*:*, fl="id", sort="id asc"),
walk="id->parent_id",
gather="id",
)
Response:
{ "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 4499 } ] } }
This works:
search(graph_auxilios, zkHost="localhost:9983",qt="/select", rows=30000,
q=*:*, fl="id", sort="id asc"),
If I feed the gatherNodes with less tuples, lets say, 25000, it works.
Is it an expected behaviour?
I am on Solr 6.6. And my box has 128Gb RAM. The only infra that is still
not set right is that I am using standalone Zookeper.
Re: Streaming Expressions - gatherNodes
Posted by Kojo <rb...@gmail.com>.
Joel,
The result of the expressions are right. The problem was that I was
expecting wrong return values.
I was not using the "scatter" parameter, and by default the gatterNodes
emits only the leaf nodes. So while I increased the input to the function,
it was resolving the nodes at the level zero only (branches), not showing
any leaves result. When I decrease the input, some nodes didn´r resolve at
the branches leaves, resolving at the leaves, counting some nodes.
I will perform more tests, but I think that everything is working fine.
Thanks for your patience and sorry for the false alarm.
Koji
Em qui, 13 de set de 2018 às 14:22, Kojo <rb...@gmail.com> escreveu:
> I can do that.
> I tell you when I open the Jira.
>
>
>
> Em qui, 13 de set de 2018 às 14:05, Joel Bernstein <jo...@gmail.com>
> escreveu:
>
>> I'll have to take a look and see if I can reproduce this exact behavior.
>> Let's create a jira ticket so we can track the discussion.
>>
>>
>> Joel Bernstein
>> http://joelsolr.blogspot.com/
>>
>>
>> On Thu, Sep 13, 2018 at 1:03 PM Kojo <rb...@gmail.com> wrote:
>>
>> > Same query feeding 25000 tuples to gatherNodes:
>> >
>> > gatherNodes(graph_auxilios,
>> > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
>> rows=25000,
>> > q=*:*, fl="numero_processo", sort="numero_processo asc"),
>> > walk="numero_processo->projeto_pai",
>> > gather="numero_processo",
>> > )
>> >
>> >
>> > About 350 nodes returned. This is the last one:
>> >
>> > {
>> > "node": "97/13422-6",
>> > "collection": "graph_auxilios",
>> > "field": "numero_processo",
>> > "level": 1
>> > },
>> > {
>> > "EOF": true,
>> > "RESPONSE_TIME": 3996
>> > }
>> > ]
>> > }
>> > }
>> >
>> >
>> >
>> > This is the log:
>> >
>> > INFO - 2018-09-13 16:55:05.949; [c:graph_auxilios s:shard6 r:core_node3
>> > x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
>> > [graph_auxilios_shard6_replica1] webapp=/solr path=/export
>> >
>> >
>> params={q={!terms+f%3Dprojeto_pai}95/07551-2,95/07553-5,95/07554-1,95/07555-8,95/07557-0,95/07561-8,95/07571-3,95/07572-0,95/07575-9,95/07583-1,95/07591-4,95/07592-0,95/07595-0,95/07619-6,95/07624-0,95/07631-6,95/07633-9,95/07635-1,95/07637-4,95/07639-7,95/07641-1,95/07646-3,95/07648-6,95/07650-0,95/07652-3,95/07653-0,95/07654-6,95/07660-6,95/07661-2,95/07662-9,95/07665-8,95/07666-4,95/07667-0,95/07668-7,95/07669-3,95/07672-4,95/07673-0,95/07674-7,95/07675-3,95/07682-0,95/07686-5,95/07688-8,95/07689-4,95/07692-5,95/07695-4,95/07698-3,95/07699-0,95/07700-8,95/07706-6,95/07711-0,95/07712-6,95/07717-8,95/07726-7,95/07729-6,95/07730-4,95/07739-1,95/07741-6,95/07745-1,95/07746-8,95/07748-0,95/07750-5,95/07755-7,95/07757-0,95/07759-2,95/07763-0,95/07764-6,95/07765-2,95/07767-5,95/07768-1,95/07769-8,95/07775-8,95/07784-7,95/07789-9,95/07796-5,95/07799-4,95/07802-5,95/07803-1,95/07807-7,95/07812-0,95/07813-7,95/07821-0,95/07824-9,95/07826-1,95/07828-4,95/07830-9,95/07831-5,95/07833-8,95/07834-4,95/07838-0,95/07839-6,95/07840-4,95/07843-3,95/07844-0,95/07849-1,95/07851-6,95/07852-2,95/07853-9,95/07855-1,95/07858-0,95/07868-6,95/07869-2,95/07873-0,95/07874-6,95/07876-9,95/07877-5,95/07881-2,95/07883-5,95/07884-1,95/07885-8,95/07886-4,95/07888-7,95/07892-4,95/07902-0,95/07914-8,95/07915-4,95/07917-7,95/07920-8,95/07922-0,95/07928-9,95/07930-3,95/07949-6,95/07951-0,95/07952-7,95/07960-0,95/07961-6,95/07962-2,95/07969-7,95/07981-7,95/07986-9,95/07997-0,95/08000-0,95/08001-6,95/08003-9,95/08008-0,95/08021-7,95/08034-1,95/08038-7,95/08041-8,95/08042-4,95/08046-0,95/08049-9,95/08050-7,95/08051-3,95/08053-6,95/08056-5,95/08063-1,95/08066-0,95/08070-8,95/08073-7,95/08078-9,95/08080-3,95/08092-1,95/08099-6,95/08105-6,95/08106-2,95/08108-5,95/08114-5,95/08118-0,95/08119-7,95/08120-5,95/08123-4,95/08128-6,95/08132-3,95/08134-6,95/08135-2,95/08155-3,95/08156-0,95/08158-2,95/08164-2,95/08165-9,95/08166-5,95/08169-4,95/08171-9,95/08184-3,95/08188-9,95/08191-0,95/08209-6,95/08218-5,95/08235-7,95/08248-1,95/08250-6,95/08254-1,95/08273-6,95/08275-9,95/08277-1,95/08280-2,95/08281-9,95/08287-7,95/08294-3,95/08297-2,95/08301-0,95/08304-9,95/08333-9,95/08336-8,95/08339-7,95/08342-8,95/08343-4,95/08346-3,95/08382-0,95/08386-5,95/08414-9,95/08415-5,95/08453-4,95/08471-2,95/08472-9,95/08475-8,95/08503-1,95/08505-4,95/08524-9,95/08560-5,95/08569-2,95/08583-5,95/08592-4,95/08601-3,95/08634-9,95/08640-9,95/08654-0,95/08706-0,95/08707-6,95/08713-6,95/08717-1,95/08725-4,95/08737-2,95/08746-1,95/08752-1,95/08775-1,95/08798-1,95/08806-4,95/08823-6,95/08856-1,95/08860-9,95/08865-0,95/08872-7,95/08875-6,95/08881-6,95/08908-1,95/08917-0,95/08918-7,95/08955-0,95/08969-0,95/08973-8,95/08990-0,95/09023-3,95/09045-7,95/09058-1,95/09068-7,95/09080-7,95/09085-9,95/09101-4,95/09108-9,95/09135-6,95/09156-3,95/09159-2,95/09160-0,95/09167-5,95/09202-5,95/09207-7,95/09222-6,95/09260-5,95/09263-4,95/09269-2,95/09290-1,95/09305-9,95/09311-9,95/09319-0,95/09329-5,95/09330-3,95/09361-6,95/09379-2,95/09382-3,95/09417-1,95/09432-0,95/09440-3,95/09531-9,95/09538-3,95/09545-0,95/09552-6,95/09557-8,95/09576-2,95/09577-9,95/09584-5,95/09590-5,95/09599-2,95/09607-5,95/09608-1,95/09625-3,95/09637-1,95/09660-3,95/09716-9,95/09727-0,95/09744-2,95/09755-4,95/09756-0,95/09777-8,95/09780-9,95/09795-6,95/09809-7,95/09810-5,95/09812-8,95/09825-2,95/09836-4,95/09843-0,95/09889-0,95/09896-7,95/09898-0,95/09906-2,95/09916-8,95/09921-1,95/09968-8,95/09969-4,95/09976-0,95/09977-7,95/09980-8,95/09982-0,95/09997-8,95/09998-4,96/00003-2,96/00027-9,96/00030-0,96/00039-7,96/00042-8,96/00074-7,96/00083-6,96/00106-6,96/00119-0,96/00122-1,96/00123-8,96/00125-0,96/00136-2,96/00139-1,96/00159-2,96/00170-6,96/00183-0,96/00187-6,96/00190-7,96/00192-0,96/00193-6,96/00194-2,96/00220-3,96/00225-5,96/00230-9,96/00234-4,96/00246-2,96/00261-1,96/00263-4,96/00301-3,96/00335-5,96/00345-0,96/00351-0,96/00359-1,96/00362-2,96/00389-8,96/00393-5,96/00395-8,96/00413-6,96/00421-9,96/00425-4,96/00431-4,96/00434-3,96/00437-2,96/00446-1,96/00453-8,96/00470-0,96/00489-2,96/00518-2,96/00533-1,96/00544-3,96/00554-9,96/00568-0,96/00589-7,96/00592-8,96/00596-3,96/00603-0,96/00604-6,96/00612-9,96/00613-5,96/00621-8,96/00640-2,96/00641-9,96/00657-2,96/00675-0,96/00699-7,96/00700-5,96/00703-4,96/00753-1,96/00756-0,96/00768-9,96/00769-5,96/00770-3,96/00773-2,96/00779-0,96/00782-1,96/00793-3,96/00829-8,96/00830-6,96/00832-9,96/00837-0,96/00852-0,96/00873-7&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
>> > hits=4 status=0 QTime=1
>> >
>> >
>> > Reading your last msg again, I am not sure that you were asking a
>> different
>> > question than this logs I sent now.
>> >
>> > I can run different tests if you need more information.
>> >
>> > Thanks for your help Joel.
>> >
>> >
>> >
>> >
>> > Em qui, 13 de set de 2018 às 13:50, Joel Bernstein <jo...@gmail.com>
>> > escreveu:
>> >
>> > > I see that the hits=0 in this log request. Are there log requests that
>> > show
>> > > results found for one of these queries?
>> > >
>> > >
>> > > Joel Bernstein
>> > > http://joelsolr.blogspot.com/
>> > >
>> > >
>> > > On Thu, Sep 13, 2018 at 10:15 AM Kojo <rb...@gmail.com> wrote:
>> > >
>> > > > I have just run this expression:
>> > > >
>> > > >
>> > > > gatherNodes(graph_auxilios,
>> > > > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
>> > > rows=30000,
>> > > > q=*:*, fl="numero_processo", sort="numero_processo asc"),
>> > > > walk="numero_processo->projeto_pai",
>> > > > gather="numero_processo",
>> > > > )
>> > > >
>> > > >
>> > > >
>> > > > This is the response:
>> > > >
>> > > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 5091 }
>> ] }
>> > }
>> > > >
>> > > >
>> > > >
>> > > > Many logs until it stops quietly. This is the last line on
>> > > > /opt/solr-6.6.2/example/cloud/node1/logs
>> > > >
>> > > > INFO - 2018-09-13 14:09:20.783; [c:graph_auxilios s:shard6
>> > r:core_node3
>> > > > x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
>> > > > [graph_auxilios_shard6_replica1] webapp=/solr path=/export
>> > > >
>> > > >
>> > >
>> >
>> params={q={!terms+f%3Dprojeto_pai}16/25417-0,16/25418-6,16/25423-0,16/25425-2,16/25426-9,16/25429-8,16/25436-4,16/25437-0,16/25441-8,16/25442-4,16/25446-0,16/25448-2,16/25450-7,16/25452-0,16/25457-1,16/25459-4,16/25463-1,16/25464-8,16/25467-7,16/25468-3,16/25469-0,16/25471-4,16/25474-3,16/25475-0,16/25476-6,16/25478-9,16/25480-3,16/25483-2,16/25484-9,16/25485-5,16/25486-1,16/25489-0,16/25490-9,16/25498-0,16/25499-6,16/25500-4,16/25501-0,16/25502-7,16/25504-0,16/25506-2,16/25509-1,16/25520-5,16/25521-1,16/25524-0,16/25526-3,16/25528-6,16/25529-2,16/25531-7,16/25532-3,16/25533-0,16/25535-2,16/25537-5,16/25538-1,16/25540-6,16/25544-1,16/25546-4,16/25549-3,16/25551-8,16/25556-0,16/25557-6,16/25562-0,16/25563-6,16/25565-9,16/25573-1,16/25574-8,16/25583-7,16/25590-3,16/25594-9,16/25599-0,16/25600-9,16/25604-4,16/25609-6,16/25610-4,16/25611-0,16/25613-3,16/25615-6,16/25617-9,16/25619-1,16/25621-6,16/25626-8,16/25632-8,16/25634-0,16/25635-7,16/25637-0,16/25639-2,16/25642-3,16/25644-6,16/25647-5,16/25651-2,16/25652-9,16/25658-7,16/25659-3,16/25661-8,16/25669-9,16/25676-5,16/25680-2,16/25681-9,16/25682-5,16/25683-1,16/25685-4,16/25686-0,16/25687-7,16/25698-9,16/25703-2,16/25705-5,16/25706-1,16/25708-4,16/25717-3,16/25729-1,16/25730-0,16/25734-5,16/25735-1,16/25737-4,16/25745-7,16/25747-0,16/25749-2,16/25750-0,16/25751-7,16/25755-2,16/25764-1,16/25766-4,16/25769-3,16/25771-8,16/25776-0,16/25778-2,16/25779-9,16/25782-0,16/25783-6,16/25784-2,16/25785-9,16/25791-9,16/25793-1,16/25795-4,16/25798-3,16/25800-8,16/25806-6,16/25810-3,16/25813-2,16/25817-8,16/25821-5,16/25824-4,16/25826-7,16/25831-0,16/25832-7,16/25833-3,16/25836-2,16/25837-9,16/25840-0,16/25845-1,16/25847-4,16/25851-1,16/25853-4,16/25855-7,16/25861-7,16/25864-6,16/25865-2,16/25866-9,16/25867-5,16/25868-1,16/25870-6,16/25876-4,16/25878-7,16/25882-4,16/25883-0,16/25884-7,16/25891-3,16/25893-6,16/25894-2,16/25895-9,16/25896-5,16/25898-8,16/25900-2,16/25901-9,16/25905-4,16/25907-7,16/25910-8,16/25913-7,16/25914-3,16/25915-0,16/25916-6,16/25917-2,16/25919-5,16/25920-3,16/25925-5,16/25926-1,16/25928-4,16/25929-0,16/25931-5,16/25933-8,16/25935-0,16/25938-0,16/25945-6,16/25946-2,16/25947-9,16/25952-2,16/25953-9,16/25955-1,16/25959-7,16/25962-8,16/25963-4,16/25964-0,16/25965-7,16/25967-0,16/25968-6,16/25969-2,16/25970-0,16/25971-7,16/25979-8,16/25984-1,16/25985-8,16/25986-4,16/25987-0,16/25988-7,16/25990-1,16/25996-0,16/25999-9,16/26000-5,16/26001-1,16/26003-4,16/26011-7,16/26012-3,16/26013-0,16/26014-6,16/26016-9,16/26022-9,16/26024-1,16/26026-4,16/26028-7,16/26029-3,16/26030-1,16/26031-8,16/26032-4,16/26033-0,16/26034-7,16/26035-3,16/26040-7,16/26041-3,16/26043-6,16/26044-2,16/26050-2,16/26054-8,16/26055-4,16/26060-8,16/26061-4,16/26064-3,16/26069-5,16/26071-0,16/26076-1,16/26080-9,16/26081-5,16/26082-1,16/26083-8,16/26095-6,16/26098-5,16/26101-6,16/26103-9,16/26108-0,16/26110-5,16/26113-4,16/26117-0,16/26118-6,16/26121-7,16/26123-0,16/26124-6,16/26130-6,16/26132-9,16/26135-8,16/26140-1,16/26145-3,16/26148-2,16/26151-3,16/26154-2,16/26156-5,16/26158-8,16/26160-2,16/26167-7,16/26169-0,16/26170-8,16/26171-4,16/26172-0,16/26173-7,16/26176-6,16/26177-2,16/26182-6,16/26183-2,16/26184-9,16/26189-0,16/26196-7,16/26198-0,16/26200-4,16/26201-0,16/26209-1,16/26212-2,16/26215-1,16/26216-8,16/26220-5,16/26221-1,16/26230-0,16/26234-6,16/26239-8,16/26240-6,16/26243-5,16/26244-1,16/26250-1,16/26252-4,16/26255-3,16/26263-6,16/26274-8,16/26275-4,16/26281-4,16/26288-9,16/26289-5,16/26290-3,16/50001-1,16/50003-4,16/50004-0,16/50005-7,16/50006-3,16/50007-0,16/50008-6,16/50009-2,16/50010-0,16/50011-7,16/50013-0,16/50014-6,16/50015-2,16/50016-9,16/50018-1,16/50019-8,16/50020-6,16/50021-2,16/50022-9,16/50023-5,16/50033-0,16/50034-7,16/50035-3,16/50038-2,16/50039-9,16/50040-7,16/50041-3,16/50042-0,16/50043-6,16/50044-2,16/50050-2,16/50052-5,16/50054-8,16/50055-4,16/50060-8,16/50062-0,16/50067-2,16/50068-9,16/50070-3,16/50077-8,16/50080-9,16/50082-1,16/50083-8,16/50097-9,16/50108-0,16/50109-7,16/50112-8,16/50121-7,16/50123-0,16/50127-5,16/50137-0,16/50142-4,16/50143-0,16/50144-7,16/50147-6,16/50148-2,16/50150-7,16/50154-2,16/50158-8,16/50160-2,16/50161-9,16/50162-5,16/50163-1,16/50164-8,16/50167-7,16/50172-0,16/50173-7,16/50175-0,16/50178-9,16/50180-3,16/50183-2,16/50185-5,16/50186-1,16/50187-8,16/50188-4,16/50189-0,16/50192-1,16/50193-8,16/50195-0,16/50196-7,16/50197-3,16/50198-0,16/50199-6,16/50200-4,16/50201-0,16/50204-0,16/50205-6&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
>> > > > hits=0 status=0 QTime=2
>> > > >
>> > > >
>> > > >
>> > > > Four nodes seems to stop logging at the same time when it returns
>> empty
>> > > > result.
>> > > >
>> > > > Em qui, 13 de set de 2018 às 10:34, Joel Bernstein <
>> joelsolr@gmail.com
>> > >
>> > > > escreveu:
>> > > >
>> > > > > That's odd behavior. What do the logs look like? This will
>> produce a
>> > > > series
>> > > > > of queries against the projects collection. Are you seeing those
>> in
>> > the
>> > > > > logs? Any errors?
>> > > > >
>> > > > > Joel Bernstein
>> > > > > http://joelsolr.blogspot.com/
>> > > > >
>> > > > >
>> > > > > On Thu, Sep 13, 2018 at 9:25 AM Kojo <rb...@gmail.com> wrote:
>> > > > >
>> > > > > > Hi,
>> > > > > >
>> > > > > > If I try to feed gatherNodes with more than 25000 tuples, it
>> gives
>> > me
>> > > > > empty
>> > > > > > result-set.
>> > > > > >
>> > > > > > gatherNodes(projects,
>> > > > > > search(projects, zkHost="localhost:9983",qt="/select",
>> > rows=30000,
>> > > > > > q=*:*, fl="id", sort="id asc"),
>> > > > > > walk="id->parent_id",
>> > > > > > gather="id",
>> > > > > > )
>> > > > > >
>> > > > > > Response:
>> > > > > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME":
>> 4499 }
>> > ]
>> > > }
>> > > > }
>> > > > > >
>> > > > > >
>> > > > > > This works:
>> > > > > > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
>> > > > rows=30000,
>> > > > > > q=*:*, fl="id", sort="id asc"),
>> > > > > >
>> > > > > > If I feed the gatherNodes with less tuples, lets say, 25000, it
>> > > works.
>> > > > > >
>> > > > > > Is it an expected behaviour?
>> > > > > >
>> > > > > > I am on Solr 6.6. And my box has 128Gb RAM. The only infra that
>> is
>> > > > still
>> > > > > > not set right is that I am using standalone Zookeper.
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>
Re: Streaming Expressions - gatherNodes
Posted by Kojo <rb...@gmail.com>.
I can do that.
I tell you when I open the Jira.
Em qui, 13 de set de 2018 às 14:05, Joel Bernstein <jo...@gmail.com>
escreveu:
> I'll have to take a look and see if I can reproduce this exact behavior.
> Let's create a jira ticket so we can track the discussion.
>
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
>
> On Thu, Sep 13, 2018 at 1:03 PM Kojo <rb...@gmail.com> wrote:
>
> > Same query feeding 25000 tuples to gatherNodes:
> >
> > gatherNodes(graph_auxilios,
> > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
> rows=25000,
> > q=*:*, fl="numero_processo", sort="numero_processo asc"),
> > walk="numero_processo->projeto_pai",
> > gather="numero_processo",
> > )
> >
> >
> > About 350 nodes returned. This is the last one:
> >
> > {
> > "node": "97/13422-6",
> > "collection": "graph_auxilios",
> > "field": "numero_processo",
> > "level": 1
> > },
> > {
> > "EOF": true,
> > "RESPONSE_TIME": 3996
> > }
> > ]
> > }
> > }
> >
> >
> >
> > This is the log:
> >
> > INFO - 2018-09-13 16:55:05.949; [c:graph_auxilios s:shard6 r:core_node3
> > x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
> > [graph_auxilios_shard6_replica1] webapp=/solr path=/export
> >
> >
> params={q={!terms+f%3Dprojeto_pai}95/07551-2,95/07553-5,95/07554-1,95/07555-8,95/07557-0,95/07561-8,95/07571-3,95/07572-0,95/07575-9,95/07583-1,95/07591-4,95/07592-0,95/07595-0,95/07619-6,95/07624-0,95/07631-6,95/07633-9,95/07635-1,95/07637-4,95/07639-7,95/07641-1,95/07646-3,95/07648-6,95/07650-0,95/07652-3,95/07653-0,95/07654-6,95/07660-6,95/07661-2,95/07662-9,95/07665-8,95/07666-4,95/07667-0,95/07668-7,95/07669-3,95/07672-4,95/07673-0,95/07674-7,95/07675-3,95/07682-0,95/07686-5,95/07688-8,95/07689-4,95/07692-5,95/07695-4,95/07698-3,95/07699-0,95/07700-8,95/07706-6,95/07711-0,95/07712-6,95/07717-8,95/07726-7,95/07729-6,95/07730-4,95/07739-1,95/07741-6,95/07745-1,95/07746-8,95/07748-0,95/07750-5,95/07755-7,95/07757-0,95/07759-2,95/07763-0,95/07764-6,95/07765-2,95/07767-5,95/07768-1,95/07769-8,95/07775-8,95/07784-7,95/07789-9,95/07796-5,95/07799-4,95/07802-5,95/07803-1,95/07807-7,95/07812-0,95/07813-7,95/07821-0,95/07824-9,95/07826-1,95/07828-4,95/07830-9,95/07831-5,95/07833-8,95/07834-4,95/07838-0,95/07839-6,95/07840-4,95/07843-3,95/07844-0,95/07849-1,95/07851-6,95/07852-2,95/07853-9,95/07855-1,95/07858-0,95/07868-6,95/07869-2,95/07873-0,95/07874-6,95/07876-9,95/07877-5,95/07881-2,95/07883-5,95/07884-1,95/07885-8,95/07886-4,95/07888-7,95/07892-4,95/07902-0,95/07914-8,95/07915-4,95/07917-7,95/07920-8,95/07922-0,95/07928-9,95/07930-3,95/07949-6,95/07951-0,95/07952-7,95/07960-0,95/07961-6,95/07962-2,95/07969-7,95/07981-7,95/07986-9,95/07997-0,95/08000-0,95/08001-6,95/08003-9,95/08008-0,95/08021-7,95/08034-1,95/08038-7,95/08041-8,95/08042-4,95/08046-0,95/08049-9,95/08050-7,95/08051-3,95/08053-6,95/08056-5,95/08063-1,95/08066-0,95/08070-8,95/08073-7,95/08078-9,95/08080-3,95/08092-1,95/08099-6,95/08105-6,95/08106-2,95/08108-5,95/08114-5,95/08118-0,95/08119-7,95/08120-5,95/08123-4,95/08128-6,95/08132-3,95/08134-6,95/08135-2,95/08155-3,95/08156-0,95/08158-2,95/08164-2,95/08165-9,95/08166-5,95/08169-4,95/08171-9,95/08184-3,95/08188-9,95/08191-0,95/08209-6,95/08218-5,95/08235-7,95/08248-1,95/08250-6,95/08254-1,95/08273-6,95/08275-9,95/08277-1,95/08280-2,95/08281-9,95/08287-7,95/08294-3,95/08297-2,95/08301-0,95/08304-9,95/08333-9,95/08336-8,95/08339-7,95/08342-8,95/08343-4,95/08346-3,95/08382-0,95/08386-5,95/08414-9,95/08415-5,95/08453-4,95/08471-2,95/08472-9,95/08475-8,95/08503-1,95/08505-4,95/08524-9,95/08560-5,95/08569-2,95/08583-5,95/08592-4,95/08601-3,95/08634-9,95/08640-9,95/08654-0,95/08706-0,95/08707-6,95/08713-6,95/08717-1,95/08725-4,95/08737-2,95/08746-1,95/08752-1,95/08775-1,95/08798-1,95/08806-4,95/08823-6,95/08856-1,95/08860-9,95/08865-0,95/08872-7,95/08875-6,95/08881-6,95/08908-1,95/08917-0,95/08918-7,95/08955-0,95/08969-0,95/08973-8,95/08990-0,95/09023-3,95/09045-7,95/09058-1,95/09068-7,95/09080-7,95/09085-9,95/09101-4,95/09108-9,95/09135-6,95/09156-3,95/09159-2,95/09160-0,95/09167-5,95/09202-5,95/09207-7,95/09222-6,95/09260-5,95/09263-4,95/09269-2,95/09290-1,95/09305-9,95/09311-9,95/09319-0,95/09329-5,95/09330-3,95/09361-6,95/09379-2,95/09382-3,95/09417-1,95/09432-0,95/09440-3,95/09531-9,95/09538-3,95/09545-0,95/09552-6,95/09557-8,95/09576-2,95/09577-9,95/09584-5,95/09590-5,95/09599-2,95/09607-5,95/09608-1,95/09625-3,95/09637-1,95/09660-3,95/09716-9,95/09727-0,95/09744-2,95/09755-4,95/09756-0,95/09777-8,95/09780-9,95/09795-6,95/09809-7,95/09810-5,95/09812-8,95/09825-2,95/09836-4,95/09843-0,95/09889-0,95/09896-7,95/09898-0,95/09906-2,95/09916-8,95/09921-1,95/09968-8,95/09969-4,95/09976-0,95/09977-7,95/09980-8,95/09982-0,95/09997-8,95/09998-4,96/00003-2,96/00027-9,96/00030-0,96/00039-7,96/00042-8,96/00074-7,96/00083-6,96/00106-6,96/00119-0,96/00122-1,96/00123-8,96/00125-0,96/00136-2,96/00139-1,96/00159-2,96/00170-6,96/00183-0,96/00187-6,96/00190-7,96/00192-0,96/00193-6,96/00194-2,96/00220-3,96/00225-5,96/00230-9,96/00234-4,96/00246-2,96/00261-1,96/00263-4,96/00301-3,96/00335-5,96/00345-0,96/00351-0,96/00359-1,96/00362-2,96/00389-8,96/00393-5,96/00395-8,96/00413-6,96/00421-9,96/00425-4,96/00431-4,96/00434-3,96/00437-2,96/00446-1,96/00453-8,96/00470-0,96/00489-2,96/00518-2,96/00533-1,96/00544-3,96/00554-9,96/00568-0,96/00589-7,96/00592-8,96/00596-3,96/00603-0,96/00604-6,96/00612-9,96/00613-5,96/00621-8,96/00640-2,96/00641-9,96/00657-2,96/00675-0,96/00699-7,96/00700-5,96/00703-4,96/00753-1,96/00756-0,96/00768-9,96/00769-5,96/00770-3,96/00773-2,96/00779-0,96/00782-1,96/00793-3,96/00829-8,96/00830-6,96/00832-9,96/00837-0,96/00852-0,96/00873-7&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
> > hits=4 status=0 QTime=1
> >
> >
> > Reading your last msg again, I am not sure that you were asking a
> different
> > question than this logs I sent now.
> >
> > I can run different tests if you need more information.
> >
> > Thanks for your help Joel.
> >
> >
> >
> >
> > Em qui, 13 de set de 2018 às 13:50, Joel Bernstein <jo...@gmail.com>
> > escreveu:
> >
> > > I see that the hits=0 in this log request. Are there log requests that
> > show
> > > results found for one of these queries?
> > >
> > >
> > > Joel Bernstein
> > > http://joelsolr.blogspot.com/
> > >
> > >
> > > On Thu, Sep 13, 2018 at 10:15 AM Kojo <rb...@gmail.com> wrote:
> > >
> > > > I have just run this expression:
> > > >
> > > >
> > > > gatherNodes(graph_auxilios,
> > > > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
> > > rows=30000,
> > > > q=*:*, fl="numero_processo", sort="numero_processo asc"),
> > > > walk="numero_processo->projeto_pai",
> > > > gather="numero_processo",
> > > > )
> > > >
> > > >
> > > >
> > > > This is the response:
> > > >
> > > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 5091 } ]
> }
> > }
> > > >
> > > >
> > > >
> > > > Many logs until it stops quietly. This is the last line on
> > > > /opt/solr-6.6.2/example/cloud/node1/logs
> > > >
> > > > INFO - 2018-09-13 14:09:20.783; [c:graph_auxilios s:shard6
> > r:core_node3
> > > > x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
> > > > [graph_auxilios_shard6_replica1] webapp=/solr path=/export
> > > >
> > > >
> > >
> >
> params={q={!terms+f%3Dprojeto_pai}16/25417-0,16/25418-6,16/25423-0,16/25425-2,16/25426-9,16/25429-8,16/25436-4,16/25437-0,16/25441-8,16/25442-4,16/25446-0,16/25448-2,16/25450-7,16/25452-0,16/25457-1,16/25459-4,16/25463-1,16/25464-8,16/25467-7,16/25468-3,16/25469-0,16/25471-4,16/25474-3,16/25475-0,16/25476-6,16/25478-9,16/25480-3,16/25483-2,16/25484-9,16/25485-5,16/25486-1,16/25489-0,16/25490-9,16/25498-0,16/25499-6,16/25500-4,16/25501-0,16/25502-7,16/25504-0,16/25506-2,16/25509-1,16/25520-5,16/25521-1,16/25524-0,16/25526-3,16/25528-6,16/25529-2,16/25531-7,16/25532-3,16/25533-0,16/25535-2,16/25537-5,16/25538-1,16/25540-6,16/25544-1,16/25546-4,16/25549-3,16/25551-8,16/25556-0,16/25557-6,16/25562-0,16/25563-6,16/25565-9,16/25573-1,16/25574-8,16/25583-7,16/25590-3,16/25594-9,16/25599-0,16/25600-9,16/25604-4,16/25609-6,16/25610-4,16/25611-0,16/25613-3,16/25615-6,16/25617-9,16/25619-1,16/25621-6,16/25626-8,16/25632-8,16/25634-0,16/25635-7,16/25637-0,16/25639-2,16/25642-3,16/25644-6,16/25647-5,16/25651-2,16/25652-9,16/25658-7,16/25659-3,16/25661-8,16/25669-9,16/25676-5,16/25680-2,16/25681-9,16/25682-5,16/25683-1,16/25685-4,16/25686-0,16/25687-7,16/25698-9,16/25703-2,16/25705-5,16/25706-1,16/25708-4,16/25717-3,16/25729-1,16/25730-0,16/25734-5,16/25735-1,16/25737-4,16/25745-7,16/25747-0,16/25749-2,16/25750-0,16/25751-7,16/25755-2,16/25764-1,16/25766-4,16/25769-3,16/25771-8,16/25776-0,16/25778-2,16/25779-9,16/25782-0,16/25783-6,16/25784-2,16/25785-9,16/25791-9,16/25793-1,16/25795-4,16/25798-3,16/25800-8,16/25806-6,16/25810-3,16/25813-2,16/25817-8,16/25821-5,16/25824-4,16/25826-7,16/25831-0,16/25832-7,16/25833-3,16/25836-2,16/25837-9,16/25840-0,16/25845-1,16/25847-4,16/25851-1,16/25853-4,16/25855-7,16/25861-7,16/25864-6,16/25865-2,16/25866-9,16/25867-5,16/25868-1,16/25870-6,16/25876-4,16/25878-7,16/25882-4,16/25883-0,16/25884-7,16/25891-3,16/25893-6,16/25894-2,16/25895-9,16/25896-5,16/25898-8,16/25900-2,16/25901-9,16/25905-4,16/25907-7,16/25910-8,16/25913-7,16/25914-3,16/25915-0,16/25916-6,16/25917-2,16/25919-5,16/25920-3,16/25925-5,16/25926-1,16/25928-4,16/25929-0,16/25931-5,16/25933-8,16/25935-0,16/25938-0,16/25945-6,16/25946-2,16/25947-9,16/25952-2,16/25953-9,16/25955-1,16/25959-7,16/25962-8,16/25963-4,16/25964-0,16/25965-7,16/25967-0,16/25968-6,16/25969-2,16/25970-0,16/25971-7,16/25979-8,16/25984-1,16/25985-8,16/25986-4,16/25987-0,16/25988-7,16/25990-1,16/25996-0,16/25999-9,16/26000-5,16/26001-1,16/26003-4,16/26011-7,16/26012-3,16/26013-0,16/26014-6,16/26016-9,16/26022-9,16/26024-1,16/26026-4,16/26028-7,16/26029-3,16/26030-1,16/26031-8,16/26032-4,16/26033-0,16/26034-7,16/26035-3,16/26040-7,16/26041-3,16/26043-6,16/26044-2,16/26050-2,16/26054-8,16/26055-4,16/26060-8,16/26061-4,16/26064-3,16/26069-5,16/26071-0,16/26076-1,16/26080-9,16/26081-5,16/26082-1,16/26083-8,16/26095-6,16/26098-5,16/26101-6,16/26103-9,16/26108-0,16/26110-5,16/26113-4,16/26117-0,16/26118-6,16/26121-7,16/26123-0,16/26124-6,16/26130-6,16/26132-9,16/26135-8,16/26140-1,16/26145-3,16/26148-2,16/26151-3,16/26154-2,16/26156-5,16/26158-8,16/26160-2,16/26167-7,16/26169-0,16/26170-8,16/26171-4,16/26172-0,16/26173-7,16/26176-6,16/26177-2,16/26182-6,16/26183-2,16/26184-9,16/26189-0,16/26196-7,16/26198-0,16/26200-4,16/26201-0,16/26209-1,16/26212-2,16/26215-1,16/26216-8,16/26220-5,16/26221-1,16/26230-0,16/26234-6,16/26239-8,16/26240-6,16/26243-5,16/26244-1,16/26250-1,16/26252-4,16/26255-3,16/26263-6,16/26274-8,16/26275-4,16/26281-4,16/26288-9,16/26289-5,16/26290-3,16/50001-1,16/50003-4,16/50004-0,16/50005-7,16/50006-3,16/50007-0,16/50008-6,16/50009-2,16/50010-0,16/50011-7,16/50013-0,16/50014-6,16/50015-2,16/50016-9,16/50018-1,16/50019-8,16/50020-6,16/50021-2,16/50022-9,16/50023-5,16/50033-0,16/50034-7,16/50035-3,16/50038-2,16/50039-9,16/50040-7,16/50041-3,16/50042-0,16/50043-6,16/50044-2,16/50050-2,16/50052-5,16/50054-8,16/50055-4,16/50060-8,16/50062-0,16/50067-2,16/50068-9,16/50070-3,16/50077-8,16/50080-9,16/50082-1,16/50083-8,16/50097-9,16/50108-0,16/50109-7,16/50112-8,16/50121-7,16/50123-0,16/50127-5,16/50137-0,16/50142-4,16/50143-0,16/50144-7,16/50147-6,16/50148-2,16/50150-7,16/50154-2,16/50158-8,16/50160-2,16/50161-9,16/50162-5,16/50163-1,16/50164-8,16/50167-7,16/50172-0,16/50173-7,16/50175-0,16/50178-9,16/50180-3,16/50183-2,16/50185-5,16/50186-1,16/50187-8,16/50188-4,16/50189-0,16/50192-1,16/50193-8,16/50195-0,16/50196-7,16/50197-3,16/50198-0,16/50199-6,16/50200-4,16/50201-0,16/50204-0,16/50205-6&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
> > > > hits=0 status=0 QTime=2
> > > >
> > > >
> > > >
> > > > Four nodes seems to stop logging at the same time when it returns
> empty
> > > > result.
> > > >
> > > > Em qui, 13 de set de 2018 às 10:34, Joel Bernstein <
> joelsolr@gmail.com
> > >
> > > > escreveu:
> > > >
> > > > > That's odd behavior. What do the logs look like? This will produce
> a
> > > > series
> > > > > of queries against the projects collection. Are you seeing those in
> > the
> > > > > logs? Any errors?
> > > > >
> > > > > Joel Bernstein
> > > > > http://joelsolr.blogspot.com/
> > > > >
> > > > >
> > > > > On Thu, Sep 13, 2018 at 9:25 AM Kojo <rb...@gmail.com> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > If I try to feed gatherNodes with more than 25000 tuples, it
> gives
> > me
> > > > > empty
> > > > > > result-set.
> > > > > >
> > > > > > gatherNodes(projects,
> > > > > > search(projects, zkHost="localhost:9983",qt="/select",
> > rows=30000,
> > > > > > q=*:*, fl="id", sort="id asc"),
> > > > > > walk="id->parent_id",
> > > > > > gather="id",
> > > > > > )
> > > > > >
> > > > > > Response:
> > > > > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 4499
> }
> > ]
> > > }
> > > > }
> > > > > >
> > > > > >
> > > > > > This works:
> > > > > > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
> > > > rows=30000,
> > > > > > q=*:*, fl="id", sort="id asc"),
> > > > > >
> > > > > > If I feed the gatherNodes with less tuples, lets say, 25000, it
> > > works.
> > > > > >
> > > > > > Is it an expected behaviour?
> > > > > >
> > > > > > I am on Solr 6.6. And my box has 128Gb RAM. The only infra that
> is
> > > > still
> > > > > > not set right is that I am using standalone Zookeper.
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Streaming Expressions - gatherNodes
Posted by Joel Bernstein <jo...@gmail.com>.
I'll have to take a look and see if I can reproduce this exact behavior.
Let's create a jira ticket so we can track the discussion.
Joel Bernstein
http://joelsolr.blogspot.com/
On Thu, Sep 13, 2018 at 1:03 PM Kojo <rb...@gmail.com> wrote:
> Same query feeding 25000 tuples to gatherNodes:
>
> gatherNodes(graph_auxilios,
> search(graph_auxilios, zkHost="localhost:9983",qt="/select", rows=25000,
> q=*:*, fl="numero_processo", sort="numero_processo asc"),
> walk="numero_processo->projeto_pai",
> gather="numero_processo",
> )
>
>
> About 350 nodes returned. This is the last one:
>
> {
> "node": "97/13422-6",
> "collection": "graph_auxilios",
> "field": "numero_processo",
> "level": 1
> },
> {
> "EOF": true,
> "RESPONSE_TIME": 3996
> }
> ]
> }
> }
>
>
>
> This is the log:
>
> INFO - 2018-09-13 16:55:05.949; [c:graph_auxilios s:shard6 r:core_node3
> x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
> [graph_auxilios_shard6_replica1] webapp=/solr path=/export
>
> params={q={!terms+f%3Dprojeto_pai}95/07551-2,95/07553-5,95/07554-1,95/07555-8,95/07557-0,95/07561-8,95/07571-3,95/07572-0,95/07575-9,95/07583-1,95/07591-4,95/07592-0,95/07595-0,95/07619-6,95/07624-0,95/07631-6,95/07633-9,95/07635-1,95/07637-4,95/07639-7,95/07641-1,95/07646-3,95/07648-6,95/07650-0,95/07652-3,95/07653-0,95/07654-6,95/07660-6,95/07661-2,95/07662-9,95/07665-8,95/07666-4,95/07667-0,95/07668-7,95/07669-3,95/07672-4,95/07673-0,95/07674-7,95/07675-3,95/07682-0,95/07686-5,95/07688-8,95/07689-4,95/07692-5,95/07695-4,95/07698-3,95/07699-0,95/07700-8,95/07706-6,95/07711-0,95/07712-6,95/07717-8,95/07726-7,95/07729-6,95/07730-4,95/07739-1,95/07741-6,95/07745-1,95/07746-8,95/07748-0,95/07750-5,95/07755-7,95/07757-0,95/07759-2,95/07763-0,95/07764-6,95/07765-2,95/07767-5,95/07768-1,95/07769-8,95/07775-8,95/07784-7,95/07789-9,95/07796-5,95/07799-4,95/07802-5,95/07803-1,95/07807-7,95/07812-0,95/07813-7,95/07821-0,95/07824-9,95/07826-1,95/07828-4,95/07830-9,95/07831-5,95/07833-8,95/07834-4,95/07838-0,95/07839-6,95/07840-4,95/07843-3,95/07844-0,95/07849-1,95/07851-6,95/07852-2,95/07853-9,95/07855-1,95/07858-0,95/07868-6,95/07869-2,95/07873-0,95/07874-6,95/07876-9,95/07877-5,95/07881-2,95/07883-5,95/07884-1,95/07885-8,95/07886-4,95/07888-7,95/07892-4,95/07902-0,95/07914-8,95/07915-4,95/07917-7,95/07920-8,95/07922-0,95/07928-9,95/07930-3,95/07949-6,95/07951-0,95/07952-7,95/07960-0,95/07961-6,95/07962-2,95/07969-7,95/07981-7,95/07986-9,95/07997-0,95/08000-0,95/08001-6,95/08003-9,95/08008-0,95/08021-7,95/08034-1,95/08038-7,95/08041-8,95/08042-4,95/08046-0,95/08049-9,95/08050-7,95/08051-3,95/08053-6,95/08056-5,95/08063-1,95/08066-0,95/08070-8,95/08073-7,95/08078-9,95/08080-3,95/08092-1,95/08099-6,95/08105-6,95/08106-2,95/08108-5,95/08114-5,95/08118-0,95/08119-7,95/08120-5,95/08123-4,95/08128-6,95/08132-3,95/08134-6,95/08135-2,95/08155-3,95/08156-0,95/08158-2,95/08164-2,95/08165-9,95/08166-5,95/08169-4,95/08171-9,95/08184-3,95/08188-9,95/08191-0,95/08209-6,95/08218-5,95/08235-7,95/08248-1,95/08250-6,95/08254-1,95/08273-6,95/08275-9,95/08277-1,95/08280-2,95/08281-9,95/08287-7,95/08294-3,95/08297-2,95/08301-0,95/08304-9,95/08333-9,95/08336-8,95/08339-7,95/08342-8,95/08343-4,95/08346-3,95/08382-0,95/08386-5,95/08414-9,95/08415-5,95/08453-4,95/08471-2,95/08472-9,95/08475-8,95/08503-1,95/08505-4,95/08524-9,95/08560-5,95/08569-2,95/08583-5,95/08592-4,95/08601-3,95/08634-9,95/08640-9,95/08654-0,95/08706-0,95/08707-6,95/08713-6,95/08717-1,95/08725-4,95/08737-2,95/08746-1,95/08752-1,95/08775-1,95/08798-1,95/08806-4,95/08823-6,95/08856-1,95/08860-9,95/08865-0,95/08872-7,95/08875-6,95/08881-6,95/08908-1,95/08917-0,95/08918-7,95/08955-0,95/08969-0,95/08973-8,95/08990-0,95/09023-3,95/09045-7,95/09058-1,95/09068-7,95/09080-7,95/09085-9,95/09101-4,95/09108-9,95/09135-6,95/09156-3,95/09159-2,95/09160-0,95/09167-5,95/09202-5,95/09207-7,95/09222-6,95/09260-5,95/09263-4,95/09269-2,95/09290-1,95/09305-9,95/09311-9,95/09319-0,95/09329-5,95/09330-3,95/09361-6,95/09379-2,95/09382-3,95/09417-1,95/09432-0,95/09440-3,95/09531-9,95/09538-3,95/09545-0,95/09552-6,95/09557-8,95/09576-2,95/09577-9,95/09584-5,95/09590-5,95/09599-2,95/09607-5,95/09608-1,95/09625-3,95/09637-1,95/09660-3,95/09716-9,95/09727-0,95/09744-2,95/09755-4,95/09756-0,95/09777-8,95/09780-9,95/09795-6,95/09809-7,95/09810-5,95/09812-8,95/09825-2,95/09836-4,95/09843-0,95/09889-0,95/09896-7,95/09898-0,95/09906-2,95/09916-8,95/09921-1,95/09968-8,95/09969-4,95/09976-0,95/09977-7,95/09980-8,95/09982-0,95/09997-8,95/09998-4,96/00003-2,96/00027-9,96/00030-0,96/00039-7,96/00042-8,96/00074-7,96/00083-6,96/00106-6,96/00119-0,96/00122-1,96/00123-8,96/00125-0,96/00136-2,96/00139-1,96/00159-2,96/00170-6,96/00183-0,96/00187-6,96/00190-7,96/00192-0,96/00193-6,96/00194-2,96/00220-3,96/00225-5,96/00230-9,96/00234-4,96/00246-2,96/00261-1,96/00263-4,96/00301-3,96/00335-5,96/00345-0,96/00351-0,96/00359-1,96/00362-2,96/00389-8,96/00393-5,96/00395-8,96/00413-6,96/00421-9,96/00425-4,96/00431-4,96/00434-3,96/00437-2,96/00446-1,96/00453-8,96/00470-0,96/00489-2,96/00518-2,96/00533-1,96/00544-3,96/00554-9,96/00568-0,96/00589-7,96/00592-8,96/00596-3,96/00603-0,96/00604-6,96/00612-9,96/00613-5,96/00621-8,96/00640-2,96/00641-9,96/00657-2,96/00675-0,96/00699-7,96/00700-5,96/00703-4,96/00753-1,96/00756-0,96/00768-9,96/00769-5,96/00770-3,96/00773-2,96/00779-0,96/00782-1,96/00793-3,96/00829-8,96/00830-6,96/00832-9,96/00837-0,96/00852-0,96/00873-7&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
> hits=4 status=0 QTime=1
>
>
> Reading your last msg again, I am not sure that you were asking a different
> question than this logs I sent now.
>
> I can run different tests if you need more information.
>
> Thanks for your help Joel.
>
>
>
>
> Em qui, 13 de set de 2018 às 13:50, Joel Bernstein <jo...@gmail.com>
> escreveu:
>
> > I see that the hits=0 in this log request. Are there log requests that
> show
> > results found for one of these queries?
> >
> >
> > Joel Bernstein
> > http://joelsolr.blogspot.com/
> >
> >
> > On Thu, Sep 13, 2018 at 10:15 AM Kojo <rb...@gmail.com> wrote:
> >
> > > I have just run this expression:
> > >
> > >
> > > gatherNodes(graph_auxilios,
> > > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
> > rows=30000,
> > > q=*:*, fl="numero_processo", sort="numero_processo asc"),
> > > walk="numero_processo->projeto_pai",
> > > gather="numero_processo",
> > > )
> > >
> > >
> > >
> > > This is the response:
> > >
> > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 5091 } ] }
> }
> > >
> > >
> > >
> > > Many logs until it stops quietly. This is the last line on
> > > /opt/solr-6.6.2/example/cloud/node1/logs
> > >
> > > INFO - 2018-09-13 14:09:20.783; [c:graph_auxilios s:shard6
> r:core_node3
> > > x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
> > > [graph_auxilios_shard6_replica1] webapp=/solr path=/export
> > >
> > >
> >
> params={q={!terms+f%3Dprojeto_pai}16/25417-0,16/25418-6,16/25423-0,16/25425-2,16/25426-9,16/25429-8,16/25436-4,16/25437-0,16/25441-8,16/25442-4,16/25446-0,16/25448-2,16/25450-7,16/25452-0,16/25457-1,16/25459-4,16/25463-1,16/25464-8,16/25467-7,16/25468-3,16/25469-0,16/25471-4,16/25474-3,16/25475-0,16/25476-6,16/25478-9,16/25480-3,16/25483-2,16/25484-9,16/25485-5,16/25486-1,16/25489-0,16/25490-9,16/25498-0,16/25499-6,16/25500-4,16/25501-0,16/25502-7,16/25504-0,16/25506-2,16/25509-1,16/25520-5,16/25521-1,16/25524-0,16/25526-3,16/25528-6,16/25529-2,16/25531-7,16/25532-3,16/25533-0,16/25535-2,16/25537-5,16/25538-1,16/25540-6,16/25544-1,16/25546-4,16/25549-3,16/25551-8,16/25556-0,16/25557-6,16/25562-0,16/25563-6,16/25565-9,16/25573-1,16/25574-8,16/25583-7,16/25590-3,16/25594-9,16/25599-0,16/25600-9,16/25604-4,16/25609-6,16/25610-4,16/25611-0,16/25613-3,16/25615-6,16/25617-9,16/25619-1,16/25621-6,16/25626-8,16/25632-8,16/25634-0,16/25635-7,16/25637-0,16/25639-2,16/25642-3,16/25644-6,16/25647-5,16/25651-2,16/25652-9,16/25658-7,16/25659-3,16/25661-8,16/25669-9,16/25676-5,16/25680-2,16/25681-9,16/25682-5,16/25683-1,16/25685-4,16/25686-0,16/25687-7,16/25698-9,16/25703-2,16/25705-5,16/25706-1,16/25708-4,16/25717-3,16/25729-1,16/25730-0,16/25734-5,16/25735-1,16/25737-4,16/25745-7,16/25747-0,16/25749-2,16/25750-0,16/25751-7,16/25755-2,16/25764-1,16/25766-4,16/25769-3,16/25771-8,16/25776-0,16/25778-2,16/25779-9,16/25782-0,16/25783-6,16/25784-2,16/25785-9,16/25791-9,16/25793-1,16/25795-4,16/25798-3,16/25800-8,16/25806-6,16/25810-3,16/25813-2,16/25817-8,16/25821-5,16/25824-4,16/25826-7,16/25831-0,16/25832-7,16/25833-3,16/25836-2,16/25837-9,16/25840-0,16/25845-1,16/25847-4,16/25851-1,16/25853-4,16/25855-7,16/25861-7,16/25864-6,16/25865-2,16/25866-9,16/25867-5,16/25868-1,16/25870-6,16/25876-4,16/25878-7,16/25882-4,16/25883-0,16/25884-7,16/25891-3,16/25893-6,16/25894-2,16/25895-9,16/25896-5,16/25898-8,16/25900-2,16/25901-9,16/25905-4,16/25907-7,16/25910-8,16/25913-7,16/25914-3,16/25915-0,16/25916-6,16/25917-2,16/25919-5,16/25920-3,16/25925-5,16/25926-1,16/25928-4,16/25929-0,16/25931-5,16/25933-8,16/25935-0,16/25938-0,16/25945-6,16/25946-2,16/25947-9,16/25952-2,16/25953-9,16/25955-1,16/25959-7,16/25962-8,16/25963-4,16/25964-0,16/25965-7,16/25967-0,16/25968-6,16/25969-2,16/25970-0,16/25971-7,16/25979-8,16/25984-1,16/25985-8,16/25986-4,16/25987-0,16/25988-7,16/25990-1,16/25996-0,16/25999-9,16/26000-5,16/26001-1,16/26003-4,16/26011-7,16/26012-3,16/26013-0,16/26014-6,16/26016-9,16/26022-9,16/26024-1,16/26026-4,16/26028-7,16/26029-3,16/26030-1,16/26031-8,16/26032-4,16/26033-0,16/26034-7,16/26035-3,16/26040-7,16/26041-3,16/26043-6,16/26044-2,16/26050-2,16/26054-8,16/26055-4,16/26060-8,16/26061-4,16/26064-3,16/26069-5,16/26071-0,16/26076-1,16/26080-9,16/26081-5,16/26082-1,16/26083-8,16/26095-6,16/26098-5,16/26101-6,16/26103-9,16/26108-0,16/26110-5,16/26113-4,16/26117-0,16/26118-6,16/26121-7,16/26123-0,16/26124-6,16/26130-6,16/26132-9,16/26135-8,16/26140-1,16/26145-3,16/26148-2,16/26151-3,16/26154-2,16/26156-5,16/26158-8,16/26160-2,16/26167-7,16/26169-0,16/26170-8,16/26171-4,16/26172-0,16/26173-7,16/26176-6,16/26177-2,16/26182-6,16/26183-2,16/26184-9,16/26189-0,16/26196-7,16/26198-0,16/26200-4,16/26201-0,16/26209-1,16/26212-2,16/26215-1,16/26216-8,16/26220-5,16/26221-1,16/26230-0,16/26234-6,16/26239-8,16/26240-6,16/26243-5,16/26244-1,16/26250-1,16/26252-4,16/26255-3,16/26263-6,16/26274-8,16/26275-4,16/26281-4,16/26288-9,16/26289-5,16/26290-3,16/50001-1,16/50003-4,16/50004-0,16/50005-7,16/50006-3,16/50007-0,16/50008-6,16/50009-2,16/50010-0,16/50011-7,16/50013-0,16/50014-6,16/50015-2,16/50016-9,16/50018-1,16/50019-8,16/50020-6,16/50021-2,16/50022-9,16/50023-5,16/50033-0,16/50034-7,16/50035-3,16/50038-2,16/50039-9,16/50040-7,16/50041-3,16/50042-0,16/50043-6,16/50044-2,16/50050-2,16/50052-5,16/50054-8,16/50055-4,16/50060-8,16/50062-0,16/50067-2,16/50068-9,16/50070-3,16/50077-8,16/50080-9,16/50082-1,16/50083-8,16/50097-9,16/50108-0,16/50109-7,16/50112-8,16/50121-7,16/50123-0,16/50127-5,16/50137-0,16/50142-4,16/50143-0,16/50144-7,16/50147-6,16/50148-2,16/50150-7,16/50154-2,16/50158-8,16/50160-2,16/50161-9,16/50162-5,16/50163-1,16/50164-8,16/50167-7,16/50172-0,16/50173-7,16/50175-0,16/50178-9,16/50180-3,16/50183-2,16/50185-5,16/50186-1,16/50187-8,16/50188-4,16/50189-0,16/50192-1,16/50193-8,16/50195-0,16/50196-7,16/50197-3,16/50198-0,16/50199-6,16/50200-4,16/50201-0,16/50204-0,16/50205-6&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
> > > hits=0 status=0 QTime=2
> > >
> > >
> > >
> > > Four nodes seems to stop logging at the same time when it returns empty
> > > result.
> > >
> > > Em qui, 13 de set de 2018 às 10:34, Joel Bernstein <joelsolr@gmail.com
> >
> > > escreveu:
> > >
> > > > That's odd behavior. What do the logs look like? This will produce a
> > > series
> > > > of queries against the projects collection. Are you seeing those in
> the
> > > > logs? Any errors?
> > > >
> > > > Joel Bernstein
> > > > http://joelsolr.blogspot.com/
> > > >
> > > >
> > > > On Thu, Sep 13, 2018 at 9:25 AM Kojo <rb...@gmail.com> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > If I try to feed gatherNodes with more than 25000 tuples, it gives
> me
> > > > empty
> > > > > result-set.
> > > > >
> > > > > gatherNodes(projects,
> > > > > search(projects, zkHost="localhost:9983",qt="/select",
> rows=30000,
> > > > > q=*:*, fl="id", sort="id asc"),
> > > > > walk="id->parent_id",
> > > > > gather="id",
> > > > > )
> > > > >
> > > > > Response:
> > > > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 4499 }
> ]
> > }
> > > }
> > > > >
> > > > >
> > > > > This works:
> > > > > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
> > > rows=30000,
> > > > > q=*:*, fl="id", sort="id asc"),
> > > > >
> > > > > If I feed the gatherNodes with less tuples, lets say, 25000, it
> > works.
> > > > >
> > > > > Is it an expected behaviour?
> > > > >
> > > > > I am on Solr 6.6. And my box has 128Gb RAM. The only infra that is
> > > still
> > > > > not set right is that I am using standalone Zookeper.
> > > > >
> > > >
> > >
> >
>
Re: Streaming Expressions - gatherNodes
Posted by Kojo <rb...@gmail.com>.
Same query feeding 25000 tuples to gatherNodes:
gatherNodes(graph_auxilios,
search(graph_auxilios, zkHost="localhost:9983",qt="/select", rows=25000,
q=*:*, fl="numero_processo", sort="numero_processo asc"),
walk="numero_processo->projeto_pai",
gather="numero_processo",
)
About 350 nodes returned. This is the last one:
{
"node": "97/13422-6",
"collection": "graph_auxilios",
"field": "numero_processo",
"level": 1
},
{
"EOF": true,
"RESPONSE_TIME": 3996
}
]
}
}
This is the log:
INFO - 2018-09-13 16:55:05.949; [c:graph_auxilios s:shard6 r:core_node3
x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
[graph_auxilios_shard6_replica1] webapp=/solr path=/export
params={q={!terms+f%3Dprojeto_pai}95/07551-2,95/07553-5,95/07554-1,95/07555-8,95/07557-0,95/07561-8,95/07571-3,95/07572-0,95/07575-9,95/07583-1,95/07591-4,95/07592-0,95/07595-0,95/07619-6,95/07624-0,95/07631-6,95/07633-9,95/07635-1,95/07637-4,95/07639-7,95/07641-1,95/07646-3,95/07648-6,95/07650-0,95/07652-3,95/07653-0,95/07654-6,95/07660-6,95/07661-2,95/07662-9,95/07665-8,95/07666-4,95/07667-0,95/07668-7,95/07669-3,95/07672-4,95/07673-0,95/07674-7,95/07675-3,95/07682-0,95/07686-5,95/07688-8,95/07689-4,95/07692-5,95/07695-4,95/07698-3,95/07699-0,95/07700-8,95/07706-6,95/07711-0,95/07712-6,95/07717-8,95/07726-7,95/07729-6,95/07730-4,95/07739-1,95/07741-6,95/07745-1,95/07746-8,95/07748-0,95/07750-5,95/07755-7,95/07757-0,95/07759-2,95/07763-0,95/07764-6,95/07765-2,95/07767-5,95/07768-1,95/07769-8,95/07775-8,95/07784-7,95/07789-9,95/07796-5,95/07799-4,95/07802-5,95/07803-1,95/07807-7,95/07812-0,95/07813-7,95/07821-0,95/07824-9,95/07826-1,95/07828-4,95/07830-9,95/07831-5,95/07833-8,95/07834-4,95/07838-0,95/07839-6,95/07840-4,95/07843-3,95/07844-0,95/07849-1,95/07851-6,95/07852-2,95/07853-9,95/07855-1,95/07858-0,95/07868-6,95/07869-2,95/07873-0,95/07874-6,95/07876-9,95/07877-5,95/07881-2,95/07883-5,95/07884-1,95/07885-8,95/07886-4,95/07888-7,95/07892-4,95/07902-0,95/07914-8,95/07915-4,95/07917-7,95/07920-8,95/07922-0,95/07928-9,95/07930-3,95/07949-6,95/07951-0,95/07952-7,95/07960-0,95/07961-6,95/07962-2,95/07969-7,95/07981-7,95/07986-9,95/07997-0,95/08000-0,95/08001-6,95/08003-9,95/08008-0,95/08021-7,95/08034-1,95/08038-7,95/08041-8,95/08042-4,95/08046-0,95/08049-9,95/08050-7,95/08051-3,95/08053-6,95/08056-5,95/08063-1,95/08066-0,95/08070-8,95/08073-7,95/08078-9,95/08080-3,95/08092-1,95/08099-6,95/08105-6,95/08106-2,95/08108-5,95/08114-5,95/08118-0,95/08119-7,95/08120-5,95/08123-4,95/08128-6,95/08132-3,95/08134-6,95/08135-2,95/08155-3,95/08156-0,95/08158-2,95/08164-2,95/08165-9,95/08166-5,95/08169-4,95/08171-9,95/08184-3,95/08188-9,95/08191-0,95/08209-6,95/08218-5,95/08235-7,95/08248-1,95/08250-6,95/08254-1,95/08273-6,95/08275-9,95/08277-1,95/08280-2,95/08281-9,95/08287-7,95/08294-3,95/08297-2,95/08301-0,95/08304-9,95/08333-9,95/08336-8,95/08339-7,95/08342-8,95/08343-4,95/08346-3,95/08382-0,95/08386-5,95/08414-9,95/08415-5,95/08453-4,95/08471-2,95/08472-9,95/08475-8,95/08503-1,95/08505-4,95/08524-9,95/08560-5,95/08569-2,95/08583-5,95/08592-4,95/08601-3,95/08634-9,95/08640-9,95/08654-0,95/08706-0,95/08707-6,95/08713-6,95/08717-1,95/08725-4,95/08737-2,95/08746-1,95/08752-1,95/08775-1,95/08798-1,95/08806-4,95/08823-6,95/08856-1,95/08860-9,95/08865-0,95/08872-7,95/08875-6,95/08881-6,95/08908-1,95/08917-0,95/08918-7,95/08955-0,95/08969-0,95/08973-8,95/08990-0,95/09023-3,95/09045-7,95/09058-1,95/09068-7,95/09080-7,95/09085-9,95/09101-4,95/09108-9,95/09135-6,95/09156-3,95/09159-2,95/09160-0,95/09167-5,95/09202-5,95/09207-7,95/09222-6,95/09260-5,95/09263-4,95/09269-2,95/09290-1,95/09305-9,95/09311-9,95/09319-0,95/09329-5,95/09330-3,95/09361-6,95/09379-2,95/09382-3,95/09417-1,95/09432-0,95/09440-3,95/09531-9,95/09538-3,95/09545-0,95/09552-6,95/09557-8,95/09576-2,95/09577-9,95/09584-5,95/09590-5,95/09599-2,95/09607-5,95/09608-1,95/09625-3,95/09637-1,95/09660-3,95/09716-9,95/09727-0,95/09744-2,95/09755-4,95/09756-0,95/09777-8,95/09780-9,95/09795-6,95/09809-7,95/09810-5,95/09812-8,95/09825-2,95/09836-4,95/09843-0,95/09889-0,95/09896-7,95/09898-0,95/09906-2,95/09916-8,95/09921-1,95/09968-8,95/09969-4,95/09976-0,95/09977-7,95/09980-8,95/09982-0,95/09997-8,95/09998-4,96/00003-2,96/00027-9,96/00030-0,96/00039-7,96/00042-8,96/00074-7,96/00083-6,96/00106-6,96/00119-0,96/00122-1,96/00123-8,96/00125-0,96/00136-2,96/00139-1,96/00159-2,96/00170-6,96/00183-0,96/00187-6,96/00190-7,96/00192-0,96/00193-6,96/00194-2,96/00220-3,96/00225-5,96/00230-9,96/00234-4,96/00246-2,96/00261-1,96/00263-4,96/00301-3,96/00335-5,96/00345-0,96/00351-0,96/00359-1,96/00362-2,96/00389-8,96/00393-5,96/00395-8,96/00413-6,96/00421-9,96/00425-4,96/00431-4,96/00434-3,96/00437-2,96/00446-1,96/00453-8,96/00470-0,96/00489-2,96/00518-2,96/00533-1,96/00544-3,96/00554-9,96/00568-0,96/00589-7,96/00592-8,96/00596-3,96/00603-0,96/00604-6,96/00612-9,96/00613-5,96/00621-8,96/00640-2,96/00641-9,96/00657-2,96/00675-0,96/00699-7,96/00700-5,96/00703-4,96/00753-1,96/00756-0,96/00768-9,96/00769-5,96/00770-3,96/00773-2,96/00779-0,96/00782-1,96/00793-3,96/00829-8,96/00830-6,96/00832-9,96/00837-0,96/00852-0,96/00873-7&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
hits=4 status=0 QTime=1
Reading your last msg again, I am not sure that you were asking a different
question than this logs I sent now.
I can run different tests if you need more information.
Thanks for your help Joel.
Em qui, 13 de set de 2018 às 13:50, Joel Bernstein <jo...@gmail.com>
escreveu:
> I see that the hits=0 in this log request. Are there log requests that show
> results found for one of these queries?
>
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
>
> On Thu, Sep 13, 2018 at 10:15 AM Kojo <rb...@gmail.com> wrote:
>
> > I have just run this expression:
> >
> >
> > gatherNodes(graph_auxilios,
> > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
> rows=30000,
> > q=*:*, fl="numero_processo", sort="numero_processo asc"),
> > walk="numero_processo->projeto_pai",
> > gather="numero_processo",
> > )
> >
> >
> >
> > This is the response:
> >
> > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 5091 } ] } }
> >
> >
> >
> > Many logs until it stops quietly. This is the last line on
> > /opt/solr-6.6.2/example/cloud/node1/logs
> >
> > INFO - 2018-09-13 14:09:20.783; [c:graph_auxilios s:shard6 r:core_node3
> > x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
> > [graph_auxilios_shard6_replica1] webapp=/solr path=/export
> >
> >
> params={q={!terms+f%3Dprojeto_pai}16/25417-0,16/25418-6,16/25423-0,16/25425-2,16/25426-9,16/25429-8,16/25436-4,16/25437-0,16/25441-8,16/25442-4,16/25446-0,16/25448-2,16/25450-7,16/25452-0,16/25457-1,16/25459-4,16/25463-1,16/25464-8,16/25467-7,16/25468-3,16/25469-0,16/25471-4,16/25474-3,16/25475-0,16/25476-6,16/25478-9,16/25480-3,16/25483-2,16/25484-9,16/25485-5,16/25486-1,16/25489-0,16/25490-9,16/25498-0,16/25499-6,16/25500-4,16/25501-0,16/25502-7,16/25504-0,16/25506-2,16/25509-1,16/25520-5,16/25521-1,16/25524-0,16/25526-3,16/25528-6,16/25529-2,16/25531-7,16/25532-3,16/25533-0,16/25535-2,16/25537-5,16/25538-1,16/25540-6,16/25544-1,16/25546-4,16/25549-3,16/25551-8,16/25556-0,16/25557-6,16/25562-0,16/25563-6,16/25565-9,16/25573-1,16/25574-8,16/25583-7,16/25590-3,16/25594-9,16/25599-0,16/25600-9,16/25604-4,16/25609-6,16/25610-4,16/25611-0,16/25613-3,16/25615-6,16/25617-9,16/25619-1,16/25621-6,16/25626-8,16/25632-8,16/25634-0,16/25635-7,16/25637-0,16/25639-2,16/25642-3,16/25644-6,16/25647-5,16/25651-2,16/25652-9,16/25658-7,16/25659-3,16/25661-8,16/25669-9,16/25676-5,16/25680-2,16/25681-9,16/25682-5,16/25683-1,16/25685-4,16/25686-0,16/25687-7,16/25698-9,16/25703-2,16/25705-5,16/25706-1,16/25708-4,16/25717-3,16/25729-1,16/25730-0,16/25734-5,16/25735-1,16/25737-4,16/25745-7,16/25747-0,16/25749-2,16/25750-0,16/25751-7,16/25755-2,16/25764-1,16/25766-4,16/25769-3,16/25771-8,16/25776-0,16/25778-2,16/25779-9,16/25782-0,16/25783-6,16/25784-2,16/25785-9,16/25791-9,16/25793-1,16/25795-4,16/25798-3,16/25800-8,16/25806-6,16/25810-3,16/25813-2,16/25817-8,16/25821-5,16/25824-4,16/25826-7,16/25831-0,16/25832-7,16/25833-3,16/25836-2,16/25837-9,16/25840-0,16/25845-1,16/25847-4,16/25851-1,16/25853-4,16/25855-7,16/25861-7,16/25864-6,16/25865-2,16/25866-9,16/25867-5,16/25868-1,16/25870-6,16/25876-4,16/25878-7,16/25882-4,16/25883-0,16/25884-7,16/25891-3,16/25893-6,16/25894-2,16/25895-9,16/25896-5,16/25898-8,16/25900-2,16/25901-9,16/25905-4,16/25907-7,16/25910-8,16/25913-7,16/25914-3,16/25915-0,16/25916-6,16/25917-2,16/25919-5,16/25920-3,16/25925-5,16/25926-1,16/25928-4,16/25929-0,16/25931-5,16/25933-8,16/25935-0,16/25938-0,16/25945-6,16/25946-2,16/25947-9,16/25952-2,16/25953-9,16/25955-1,16/25959-7,16/25962-8,16/25963-4,16/25964-0,16/25965-7,16/25967-0,16/25968-6,16/25969-2,16/25970-0,16/25971-7,16/25979-8,16/25984-1,16/25985-8,16/25986-4,16/25987-0,16/25988-7,16/25990-1,16/25996-0,16/25999-9,16/26000-5,16/26001-1,16/26003-4,16/26011-7,16/26012-3,16/26013-0,16/26014-6,16/26016-9,16/26022-9,16/26024-1,16/26026-4,16/26028-7,16/26029-3,16/26030-1,16/26031-8,16/26032-4,16/26033-0,16/26034-7,16/26035-3,16/26040-7,16/26041-3,16/26043-6,16/26044-2,16/26050-2,16/26054-8,16/26055-4,16/26060-8,16/26061-4,16/26064-3,16/26069-5,16/26071-0,16/26076-1,16/26080-9,16/26081-5,16/26082-1,16/26083-8,16/26095-6,16/26098-5,16/26101-6,16/26103-9,16/26108-0,16/26110-5,16/26113-4,16/26117-0,16/26118-6,16/26121-7,16/26123-0,16/26124-6,16/26130-6,16/26132-9,16/26135-8,16/26140-1,16/26145-3,16/26148-2,16/26151-3,16/26154-2,16/26156-5,16/26158-8,16/26160-2,16/26167-7,16/26169-0,16/26170-8,16/26171-4,16/26172-0,16/26173-7,16/26176-6,16/26177-2,16/26182-6,16/26183-2,16/26184-9,16/26189-0,16/26196-7,16/26198-0,16/26200-4,16/26201-0,16/26209-1,16/26212-2,16/26215-1,16/26216-8,16/26220-5,16/26221-1,16/26230-0,16/26234-6,16/26239-8,16/26240-6,16/26243-5,16/26244-1,16/26250-1,16/26252-4,16/26255-3,16/26263-6,16/26274-8,16/26275-4,16/26281-4,16/26288-9,16/26289-5,16/26290-3,16/50001-1,16/50003-4,16/50004-0,16/50005-7,16/50006-3,16/50007-0,16/50008-6,16/50009-2,16/50010-0,16/50011-7,16/50013-0,16/50014-6,16/50015-2,16/50016-9,16/50018-1,16/50019-8,16/50020-6,16/50021-2,16/50022-9,16/50023-5,16/50033-0,16/50034-7,16/50035-3,16/50038-2,16/50039-9,16/50040-7,16/50041-3,16/50042-0,16/50043-6,16/50044-2,16/50050-2,16/50052-5,16/50054-8,16/50055-4,16/50060-8,16/50062-0,16/50067-2,16/50068-9,16/50070-3,16/50077-8,16/50080-9,16/50082-1,16/50083-8,16/50097-9,16/50108-0,16/50109-7,16/50112-8,16/50121-7,16/50123-0,16/50127-5,16/50137-0,16/50142-4,16/50143-0,16/50144-7,16/50147-6,16/50148-2,16/50150-7,16/50154-2,16/50158-8,16/50160-2,16/50161-9,16/50162-5,16/50163-1,16/50164-8,16/50167-7,16/50172-0,16/50173-7,16/50175-0,16/50178-9,16/50180-3,16/50183-2,16/50185-5,16/50186-1,16/50187-8,16/50188-4,16/50189-0,16/50192-1,16/50193-8,16/50195-0,16/50196-7,16/50197-3,16/50198-0,16/50199-6,16/50200-4,16/50201-0,16/50204-0,16/50205-6&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
> > hits=0 status=0 QTime=2
> >
> >
> >
> > Four nodes seems to stop logging at the same time when it returns empty
> > result.
> >
> > Em qui, 13 de set de 2018 às 10:34, Joel Bernstein <jo...@gmail.com>
> > escreveu:
> >
> > > That's odd behavior. What do the logs look like? This will produce a
> > series
> > > of queries against the projects collection. Are you seeing those in the
> > > logs? Any errors?
> > >
> > > Joel Bernstein
> > > http://joelsolr.blogspot.com/
> > >
> > >
> > > On Thu, Sep 13, 2018 at 9:25 AM Kojo <rb...@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > If I try to feed gatherNodes with more than 25000 tuples, it gives me
> > > empty
> > > > result-set.
> > > >
> > > > gatherNodes(projects,
> > > > search(projects, zkHost="localhost:9983",qt="/select", rows=30000,
> > > > q=*:*, fl="id", sort="id asc"),
> > > > walk="id->parent_id",
> > > > gather="id",
> > > > )
> > > >
> > > > Response:
> > > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 4499 } ]
> }
> > }
> > > >
> > > >
> > > > This works:
> > > > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
> > rows=30000,
> > > > q=*:*, fl="id", sort="id asc"),
> > > >
> > > > If I feed the gatherNodes with less tuples, lets say, 25000, it
> works.
> > > >
> > > > Is it an expected behaviour?
> > > >
> > > > I am on Solr 6.6. And my box has 128Gb RAM. The only infra that is
> > still
> > > > not set right is that I am using standalone Zookeper.
> > > >
> > >
> >
>
Re: Streaming Expressions - gatherNodes
Posted by Joel Bernstein <jo...@gmail.com>.
I see that the hits=0 in this log request. Are there log requests that show
results found for one of these queries?
Joel Bernstein
http://joelsolr.blogspot.com/
On Thu, Sep 13, 2018 at 10:15 AM Kojo <rb...@gmail.com> wrote:
> I have just run this expression:
>
>
> gatherNodes(graph_auxilios,
> search(graph_auxilios, zkHost="localhost:9983",qt="/select", rows=30000,
> q=*:*, fl="numero_processo", sort="numero_processo asc"),
> walk="numero_processo->projeto_pai",
> gather="numero_processo",
> )
>
>
>
> This is the response:
>
> { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 5091 } ] } }
>
>
>
> Many logs until it stops quietly. This is the last line on
> /opt/solr-6.6.2/example/cloud/node1/logs
>
> INFO - 2018-09-13 14:09:20.783; [c:graph_auxilios s:shard6 r:core_node3
> x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
> [graph_auxilios_shard6_replica1] webapp=/solr path=/export
>
> params={q={!terms+f%3Dprojeto_pai}16/25417-0,16/25418-6,16/25423-0,16/25425-2,16/25426-9,16/25429-8,16/25436-4,16/25437-0,16/25441-8,16/25442-4,16/25446-0,16/25448-2,16/25450-7,16/25452-0,16/25457-1,16/25459-4,16/25463-1,16/25464-8,16/25467-7,16/25468-3,16/25469-0,16/25471-4,16/25474-3,16/25475-0,16/25476-6,16/25478-9,16/25480-3,16/25483-2,16/25484-9,16/25485-5,16/25486-1,16/25489-0,16/25490-9,16/25498-0,16/25499-6,16/25500-4,16/25501-0,16/25502-7,16/25504-0,16/25506-2,16/25509-1,16/25520-5,16/25521-1,16/25524-0,16/25526-3,16/25528-6,16/25529-2,16/25531-7,16/25532-3,16/25533-0,16/25535-2,16/25537-5,16/25538-1,16/25540-6,16/25544-1,16/25546-4,16/25549-3,16/25551-8,16/25556-0,16/25557-6,16/25562-0,16/25563-6,16/25565-9,16/25573-1,16/25574-8,16/25583-7,16/25590-3,16/25594-9,16/25599-0,16/25600-9,16/25604-4,16/25609-6,16/25610-4,16/25611-0,16/25613-3,16/25615-6,16/25617-9,16/25619-1,16/25621-6,16/25626-8,16/25632-8,16/25634-0,16/25635-7,16/25637-0,16/25639-2,16/25642-3,16/25644-6,16/25647-5,16/25651-2,16/25652-9,16/25658-7,16/25659-3,16/25661-8,16/25669-9,16/25676-5,16/25680-2,16/25681-9,16/25682-5,16/25683-1,16/25685-4,16/25686-0,16/25687-7,16/25698-9,16/25703-2,16/25705-5,16/25706-1,16/25708-4,16/25717-3,16/25729-1,16/25730-0,16/25734-5,16/25735-1,16/25737-4,16/25745-7,16/25747-0,16/25749-2,16/25750-0,16/25751-7,16/25755-2,16/25764-1,16/25766-4,16/25769-3,16/25771-8,16/25776-0,16/25778-2,16/25779-9,16/25782-0,16/25783-6,16/25784-2,16/25785-9,16/25791-9,16/25793-1,16/25795-4,16/25798-3,16/25800-8,16/25806-6,16/25810-3,16/25813-2,16/25817-8,16/25821-5,16/25824-4,16/25826-7,16/25831-0,16/25832-7,16/25833-3,16/25836-2,16/25837-9,16/25840-0,16/25845-1,16/25847-4,16/25851-1,16/25853-4,16/25855-7,16/25861-7,16/25864-6,16/25865-2,16/25866-9,16/25867-5,16/25868-1,16/25870-6,16/25876-4,16/25878-7,16/25882-4,16/25883-0,16/25884-7,16/25891-3,16/25893-6,16/25894-2,16/25895-9,16/25896-5,16/25898-8,16/25900-2,16/25901-9,16/25905-4,16/25907-7,16/25910-8,16/25913-7,16/25914-3,16/25915-0,16/25916-6,16/25917-2,16/25919-5,16/25920-3,16/25925-5,16/25926-1,16/25928-4,16/25929-0,16/25931-5,16/25933-8,16/25935-0,16/25938-0,16/25945-6,16/25946-2,16/25947-9,16/25952-2,16/25953-9,16/25955-1,16/25959-7,16/25962-8,16/25963-4,16/25964-0,16/25965-7,16/25967-0,16/25968-6,16/25969-2,16/25970-0,16/25971-7,16/25979-8,16/25984-1,16/25985-8,16/25986-4,16/25987-0,16/25988-7,16/25990-1,16/25996-0,16/25999-9,16/26000-5,16/26001-1,16/26003-4,16/26011-7,16/26012-3,16/26013-0,16/26014-6,16/26016-9,16/26022-9,16/26024-1,16/26026-4,16/26028-7,16/26029-3,16/26030-1,16/26031-8,16/26032-4,16/26033-0,16/26034-7,16/26035-3,16/26040-7,16/26041-3,16/26043-6,16/26044-2,16/26050-2,16/26054-8,16/26055-4,16/26060-8,16/26061-4,16/26064-3,16/26069-5,16/26071-0,16/26076-1,16/26080-9,16/26081-5,16/26082-1,16/26083-8,16/26095-6,16/26098-5,16/26101-6,16/26103-9,16/26108-0,16/26110-5,16/26113-4,16/26117-0,16/26118-6,16/26121-7,16/26123-0,16/26124-6,16/26130-6,16/26132-9,16/26135-8,16/26140-1,16/26145-3,16/26148-2,16/26151-3,16/26154-2,16/26156-5,16/26158-8,16/26160-2,16/26167-7,16/26169-0,16/26170-8,16/26171-4,16/26172-0,16/26173-7,16/26176-6,16/26177-2,16/26182-6,16/26183-2,16/26184-9,16/26189-0,16/26196-7,16/26198-0,16/26200-4,16/26201-0,16/26209-1,16/26212-2,16/26215-1,16/26216-8,16/26220-5,16/26221-1,16/26230-0,16/26234-6,16/26239-8,16/26240-6,16/26243-5,16/26244-1,16/26250-1,16/26252-4,16/26255-3,16/26263-6,16/26274-8,16/26275-4,16/26281-4,16/26288-9,16/26289-5,16/26290-3,16/50001-1,16/50003-4,16/50004-0,16/50005-7,16/50006-3,16/50007-0,16/50008-6,16/50009-2,16/50010-0,16/50011-7,16/50013-0,16/50014-6,16/50015-2,16/50016-9,16/50018-1,16/50019-8,16/50020-6,16/50021-2,16/50022-9,16/50023-5,16/50033-0,16/50034-7,16/50035-3,16/50038-2,16/50039-9,16/50040-7,16/50041-3,16/50042-0,16/50043-6,16/50044-2,16/50050-2,16/50052-5,16/50054-8,16/50055-4,16/50060-8,16/50062-0,16/50067-2,16/50068-9,16/50070-3,16/50077-8,16/50080-9,16/50082-1,16/50083-8,16/50097-9,16/50108-0,16/50109-7,16/50112-8,16/50121-7,16/50123-0,16/50127-5,16/50137-0,16/50142-4,16/50143-0,16/50144-7,16/50147-6,16/50148-2,16/50150-7,16/50154-2,16/50158-8,16/50160-2,16/50161-9,16/50162-5,16/50163-1,16/50164-8,16/50167-7,16/50172-0,16/50173-7,16/50175-0,16/50178-9,16/50180-3,16/50183-2,16/50185-5,16/50186-1,16/50187-8,16/50188-4,16/50189-0,16/50192-1,16/50193-8,16/50195-0,16/50196-7,16/50197-3,16/50198-0,16/50199-6,16/50200-4,16/50201-0,16/50204-0,16/50205-6&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
> hits=0 status=0 QTime=2
>
>
>
> Four nodes seems to stop logging at the same time when it returns empty
> result.
>
> Em qui, 13 de set de 2018 às 10:34, Joel Bernstein <jo...@gmail.com>
> escreveu:
>
> > That's odd behavior. What do the logs look like? This will produce a
> series
> > of queries against the projects collection. Are you seeing those in the
> > logs? Any errors?
> >
> > Joel Bernstein
> > http://joelsolr.blogspot.com/
> >
> >
> > On Thu, Sep 13, 2018 at 9:25 AM Kojo <rb...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > If I try to feed gatherNodes with more than 25000 tuples, it gives me
> > empty
> > > result-set.
> > >
> > > gatherNodes(projects,
> > > search(projects, zkHost="localhost:9983",qt="/select", rows=30000,
> > > q=*:*, fl="id", sort="id asc"),
> > > walk="id->parent_id",
> > > gather="id",
> > > )
> > >
> > > Response:
> > > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 4499 } ] }
> }
> > >
> > >
> > > This works:
> > > search(graph_auxilios, zkHost="localhost:9983",qt="/select",
> rows=30000,
> > > q=*:*, fl="id", sort="id asc"),
> > >
> > > If I feed the gatherNodes with less tuples, lets say, 25000, it works.
> > >
> > > Is it an expected behaviour?
> > >
> > > I am on Solr 6.6. And my box has 128Gb RAM. The only infra that is
> still
> > > not set right is that I am using standalone Zookeper.
> > >
> >
>
Re: Streaming Expressions - gatherNodes
Posted by Kojo <rb...@gmail.com>.
I have just run this expression:
gatherNodes(graph_auxilios,
search(graph_auxilios, zkHost="localhost:9983",qt="/select", rows=30000,
q=*:*, fl="numero_processo", sort="numero_processo asc"),
walk="numero_processo->projeto_pai",
gather="numero_processo",
)
This is the response:
{ "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 5091 } ] } }
Many logs until it stops quietly. This is the last line on
/opt/solr-6.6.2/example/cloud/node1/logs
INFO - 2018-09-13 14:09:20.783; [c:graph_auxilios s:shard6 r:core_node3
x:graph_auxilios_shard6_replica1] org.apache.solr.core.SolrCore;
[graph_auxilios_shard6_replica1] webapp=/solr path=/export
params={q={!terms+f%3Dprojeto_pai}16/25417-0,16/25418-6,16/25423-0,16/25425-2,16/25426-9,16/25429-8,16/25436-4,16/25437-0,16/25441-8,16/25442-4,16/25446-0,16/25448-2,16/25450-7,16/25452-0,16/25457-1,16/25459-4,16/25463-1,16/25464-8,16/25467-7,16/25468-3,16/25469-0,16/25471-4,16/25474-3,16/25475-0,16/25476-6,16/25478-9,16/25480-3,16/25483-2,16/25484-9,16/25485-5,16/25486-1,16/25489-0,16/25490-9,16/25498-0,16/25499-6,16/25500-4,16/25501-0,16/25502-7,16/25504-0,16/25506-2,16/25509-1,16/25520-5,16/25521-1,16/25524-0,16/25526-3,16/25528-6,16/25529-2,16/25531-7,16/25532-3,16/25533-0,16/25535-2,16/25537-5,16/25538-1,16/25540-6,16/25544-1,16/25546-4,16/25549-3,16/25551-8,16/25556-0,16/25557-6,16/25562-0,16/25563-6,16/25565-9,16/25573-1,16/25574-8,16/25583-7,16/25590-3,16/25594-9,16/25599-0,16/25600-9,16/25604-4,16/25609-6,16/25610-4,16/25611-0,16/25613-3,16/25615-6,16/25617-9,16/25619-1,16/25621-6,16/25626-8,16/25632-8,16/25634-0,16/25635-7,16/25637-0,16/25639-2,16/25642-3,16/25644-6,16/25647-5,16/25651-2,16/25652-9,16/25658-7,16/25659-3,16/25661-8,16/25669-9,16/25676-5,16/25680-2,16/25681-9,16/25682-5,16/25683-1,16/25685-4,16/25686-0,16/25687-7,16/25698-9,16/25703-2,16/25705-5,16/25706-1,16/25708-4,16/25717-3,16/25729-1,16/25730-0,16/25734-5,16/25735-1,16/25737-4,16/25745-7,16/25747-0,16/25749-2,16/25750-0,16/25751-7,16/25755-2,16/25764-1,16/25766-4,16/25769-3,16/25771-8,16/25776-0,16/25778-2,16/25779-9,16/25782-0,16/25783-6,16/25784-2,16/25785-9,16/25791-9,16/25793-1,16/25795-4,16/25798-3,16/25800-8,16/25806-6,16/25810-3,16/25813-2,16/25817-8,16/25821-5,16/25824-4,16/25826-7,16/25831-0,16/25832-7,16/25833-3,16/25836-2,16/25837-9,16/25840-0,16/25845-1,16/25847-4,16/25851-1,16/25853-4,16/25855-7,16/25861-7,16/25864-6,16/25865-2,16/25866-9,16/25867-5,16/25868-1,16/25870-6,16/25876-4,16/25878-7,16/25882-4,16/25883-0,16/25884-7,16/25891-3,16/25893-6,16/25894-2,16/25895-9,16/25896-5,16/25898-8,16/25900-2,16/25901-9,16/25905-4,16/25907-7,16/25910-8,16/25913-7,16/25914-3,16/25915-0,16/25916-6,16/25917-2,16/25919-5,16/25920-3,16/25925-5,16/25926-1,16/25928-4,16/25929-0,16/25931-5,16/25933-8,16/25935-0,16/25938-0,16/25945-6,16/25946-2,16/25947-9,16/25952-2,16/25953-9,16/25955-1,16/25959-7,16/25962-8,16/25963-4,16/25964-0,16/25965-7,16/25967-0,16/25968-6,16/25969-2,16/25970-0,16/25971-7,16/25979-8,16/25984-1,16/25985-8,16/25986-4,16/25987-0,16/25988-7,16/25990-1,16/25996-0,16/25999-9,16/26000-5,16/26001-1,16/26003-4,16/26011-7,16/26012-3,16/26013-0,16/26014-6,16/26016-9,16/26022-9,16/26024-1,16/26026-4,16/26028-7,16/26029-3,16/26030-1,16/26031-8,16/26032-4,16/26033-0,16/26034-7,16/26035-3,16/26040-7,16/26041-3,16/26043-6,16/26044-2,16/26050-2,16/26054-8,16/26055-4,16/26060-8,16/26061-4,16/26064-3,16/26069-5,16/26071-0,16/26076-1,16/26080-9,16/26081-5,16/26082-1,16/26083-8,16/26095-6,16/26098-5,16/26101-6,16/26103-9,16/26108-0,16/26110-5,16/26113-4,16/26117-0,16/26118-6,16/26121-7,16/26123-0,16/26124-6,16/26130-6,16/26132-9,16/26135-8,16/26140-1,16/26145-3,16/26148-2,16/26151-3,16/26154-2,16/26156-5,16/26158-8,16/26160-2,16/26167-7,16/26169-0,16/26170-8,16/26171-4,16/26172-0,16/26173-7,16/26176-6,16/26177-2,16/26182-6,16/26183-2,16/26184-9,16/26189-0,16/26196-7,16/26198-0,16/26200-4,16/26201-0,16/26209-1,16/26212-2,16/26215-1,16/26216-8,16/26220-5,16/26221-1,16/26230-0,16/26234-6,16/26239-8,16/26240-6,16/26243-5,16/26244-1,16/26250-1,16/26252-4,16/26255-3,16/26263-6,16/26274-8,16/26275-4,16/26281-4,16/26288-9,16/26289-5,16/26290-3,16/50001-1,16/50003-4,16/50004-0,16/50005-7,16/50006-3,16/50007-0,16/50008-6,16/50009-2,16/50010-0,16/50011-7,16/50013-0,16/50014-6,16/50015-2,16/50016-9,16/50018-1,16/50019-8,16/50020-6,16/50021-2,16/50022-9,16/50023-5,16/50033-0,16/50034-7,16/50035-3,16/50038-2,16/50039-9,16/50040-7,16/50041-3,16/50042-0,16/50043-6,16/50044-2,16/50050-2,16/50052-5,16/50054-8,16/50055-4,16/50060-8,16/50062-0,16/50067-2,16/50068-9,16/50070-3,16/50077-8,16/50080-9,16/50082-1,16/50083-8,16/50097-9,16/50108-0,16/50109-7,16/50112-8,16/50121-7,16/50123-0,16/50127-5,16/50137-0,16/50142-4,16/50143-0,16/50144-7,16/50147-6,16/50148-2,16/50150-7,16/50154-2,16/50158-8,16/50160-2,16/50161-9,16/50162-5,16/50163-1,16/50164-8,16/50167-7,16/50172-0,16/50173-7,16/50175-0,16/50178-9,16/50180-3,16/50183-2,16/50185-5,16/50186-1,16/50187-8,16/50188-4,16/50189-0,16/50192-1,16/50193-8,16/50195-0,16/50196-7,16/50197-3,16/50198-0,16/50199-6,16/50200-4,16/50201-0,16/50204-0,16/50205-6&distrib=false&fl=numero_processo,projeto_pai&sort=numero_processo+asc,projeto_pai+asc&wt=json&version=2.2}
hits=0 status=0 QTime=2
Four nodes seems to stop logging at the same time when it returns empty
result.
Em qui, 13 de set de 2018 às 10:34, Joel Bernstein <jo...@gmail.com>
escreveu:
> That's odd behavior. What do the logs look like? This will produce a series
> of queries against the projects collection. Are you seeing those in the
> logs? Any errors?
>
> Joel Bernstein
> http://joelsolr.blogspot.com/
>
>
> On Thu, Sep 13, 2018 at 9:25 AM Kojo <rb...@gmail.com> wrote:
>
> > Hi,
> >
> > If I try to feed gatherNodes with more than 25000 tuples, it gives me
> empty
> > result-set.
> >
> > gatherNodes(projects,
> > search(projects, zkHost="localhost:9983",qt="/select", rows=30000,
> > q=*:*, fl="id", sort="id asc"),
> > walk="id->parent_id",
> > gather="id",
> > )
> >
> > Response:
> > { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 4499 } ] } }
> >
> >
> > This works:
> > search(graph_auxilios, zkHost="localhost:9983",qt="/select", rows=30000,
> > q=*:*, fl="id", sort="id asc"),
> >
> > If I feed the gatherNodes with less tuples, lets say, 25000, it works.
> >
> > Is it an expected behaviour?
> >
> > I am on Solr 6.6. And my box has 128Gb RAM. The only infra that is still
> > not set right is that I am using standalone Zookeper.
> >
>
Re: Streaming Expressions - gatherNodes
Posted by Joel Bernstein <jo...@gmail.com>.
That's odd behavior. What do the logs look like? This will produce a series
of queries against the projects collection. Are you seeing those in the
logs? Any errors?
Joel Bernstein
http://joelsolr.blogspot.com/
On Thu, Sep 13, 2018 at 9:25 AM Kojo <rb...@gmail.com> wrote:
> Hi,
>
> If I try to feed gatherNodes with more than 25000 tuples, it gives me empty
> result-set.
>
> gatherNodes(projects,
> search(projects, zkHost="localhost:9983",qt="/select", rows=30000,
> q=*:*, fl="id", sort="id asc"),
> walk="id->parent_id",
> gather="id",
> )
>
> Response:
> { "result-set": { "docs": [ { "EOF": true, "RESPONSE_TIME": 4499 } ] } }
>
>
> This works:
> search(graph_auxilios, zkHost="localhost:9983",qt="/select", rows=30000,
> q=*:*, fl="id", sort="id asc"),
>
> If I feed the gatherNodes with less tuples, lets say, 25000, it works.
>
> Is it an expected behaviour?
>
> I am on Solr 6.6. And my box has 128Gb RAM. The only infra that is still
> not set right is that I am using standalone Zookeper.
>