You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@stormcrawler.apache.org by "jnioche (via GitHub)" <gi...@apache.org> on 2026/10/12 14:14:32 UTC

[PR] URLFrontier Spout: report the query time [stormcrawler]

jnioche opened a new pull request, #2235:
URL: https://github.com/apache/stormcrawler/pull/2235

   AbstractQueryingSpout registers spout_query_time_msec for its subclasses to record the duration of each query to the backend, which the OpenSearch, Solr and SQL spouts do. The URLFrontier Spout only logged it at debug level, so the metric was always empty.
   
   It now records the time from sending GetURLs to the end of its stream when the call completes.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@stormcrawler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Re: [PR] URLFrontier Spout: report the query time [stormcrawler]

Posted by "jnioche (via GitHub)" <gi...@apache.org>.
jnioche merged PR #2235:
URL: https://github.com/apache/stormcrawler/pull/2235


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscribe@stormcrawler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org