You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Ryan McKinley (Created) (JIRA)" <ji...@apache.org> on 2012/02/11 00:17:00 UTC
[jira] [Created] (SOLR-3121) Make new admin UI work better with big
indexes
Make new admin UI work better with big indexes
----------------------------------------------
Key: SOLR-3121
URL: https://issues.apache.org/jira/browse/SOLR-3121
Project: Solr
Issue Type: Improvement
Affects Versions: 4.0
Reporter: Ryan McKinley
Fix For: 4.0
As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-3121) Make new admin UI work better with
big indexes
Posted by "Ryan McKinley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13205997#comment-13205997 ]
Ryan McKinley commented on SOLR-3121:
-------------------------------------
I added this change in r1242998
Erick - can you test with some big instances? For me, things seem to be better...
Stefan - can you take a look at how I kind of messed up the histogram/terms styles?
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3121) Make new admin UI work better with big
indexes
Posted by "Erick Erickson (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Erick Erickson updated SOLR-3121:
---------------------------------
Attachment: (was: SOLR-3121.patch)
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3121) Make new admin UI work better with big
indexes
Posted by "Ryan McKinley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ryan McKinley updated SOLR-3121:
--------------------------------
Attachment: SOLR-3121-luke-admin-ui.patch
This cleans up the 'show' option in LukeRequestHandler adding an option to just get the index info (not the fields) for the single core stats stuff.
This is just a start to the larger issue, but an easy place to begin
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3121) Make new admin UI work better with big
indexes
Posted by "Ryan McKinley (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ryan McKinley updated SOLR-3121:
--------------------------------
Attachment: SOLR-3121-luke-admin-ui.patch
updated patch to load the terms dynamical
There is some funkyness with it, but I think it may be worth commiting and fixing in trunk
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3121) Make new admin UI work better with big
indexes
Posted by "Erick Erickson (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Erick Erickson updated SOLR-3121:
---------------------------------
Attachment: SOLR-3121.patch
Small change that restores the old Admin UI behavior.
NOTE: The old UI behavior is going to be slow for large indexes since it does the enumeration of all the fields when you click "schema browser". The right fix is to incorporate the new parameters in "the right place" in the old admin UI, but at least this doesn't change the old behavior, it just doesn't make it as nice as the new.
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch, SOLR-3121.patch, SOLR-3121.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-3121) Make new admin UI work better with
big indexes
Posted by "Erick Erickson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206869#comment-13206869 ]
Erick Erickson commented on SOLR-3121:
--------------------------------------
bq: I think we can even remove the old schema browser (linking to the new one) until we can get rid of the old one entirely
Doesn't this happen already? If I enter http://localhost:8983/ I go straight to the new UI, although it *does* have a link to the old UI and the old URL goes straight to the old Admin UI.
But yeah, it seems that cutting over to the new UI and letting the old one fade away (or just remove it) is what should be done. The problem is, though, that the new code is kind of intimidating if you're not fluent in js/jquery, but I suppose it's just a matter of getting used to it.
And SOLR-3116 is a known issue. I expect that SolrCloud will get a lot of traffic when 4.0 is released, so this seems critical if we're to really cut over.
Anyway, I'll commit this patch today sometime unless someone beats me to it.
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch, SOLR-3121.patch, SOLR-3121.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3121) Make new admin UI work better with big
indexes
Posted by "Erick Erickson (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Erick Erickson updated SOLR-3121:
---------------------------------
Attachment: SOLR-3121.patch
Ryan:
This looks great, it does what I'd hoped.
I've never been all that happy with how the LukeRequestHandler was organized, so I've attached a patch that builds on yours and refactors LukeRequestHandler a bit. The old structure would go out and do the detailed information-gathering and then use it later, overloading numTerms all over the place. The patch just tries to get the detailed info when it should. It does require the fl field to get detailed info at any time though.
Your patch changed the way we request fields, which made it possible to untangle the handler itself.
Take a look and let me know.
This re-structuring probably does NOT play nice with the old admin UI though, we really need to decide whether to stop worrying about the old UI and just cut over to this one. I know the new UI doesn't deal with cloud leaf-node expansion yet, see SOLR-3116.
And it seems like this handles SOLR-3094 too.
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch, SOLR-3121.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-3121) Make new admin UI work better with
big indexes
Posted by "Ryan McKinley (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13206661#comment-13206661 ]
Ryan McKinley commented on SOLR-3121:
-------------------------------------
I suggest we optimize for the new UI. We should refactor/restructure the LukeRequestHandler so that it is as good/efficient as it can be -- this is the advantage of a major release!
I think we can even remove the old schema browser (linking to the new one) until we can get rid of the old one entirely.
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch, SOLR-3121.patch, SOLR-3121.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Resolved] (SOLR-3121) Make new admin UI work better with
big indexes
Posted by "Ryan McKinley (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ryan McKinley resolved SOLR-3121.
---------------------------------
Resolution: Fixed
works well with big indexes now
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Updated] (SOLR-3121) Make new admin UI work better with big
indexes
Posted by "Erick Erickson (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Erick Erickson updated SOLR-3121:
---------------------------------
Attachment: (was: SOLR-3121.patch)
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch, SOLR-3121.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[jira] [Commented] (SOLR-3121) Make new admin UI work better with
big indexes
Posted by "Erick Erickson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/SOLR-3121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13207438#comment-13207438 ]
Erick Erickson commented on SOLR-3121:
--------------------------------------
I removed the patches I had attached yesterday, Ryan and I crossed wires. The refactoring of LukeRequestHandler is now done in SOLR-3132. This patch should be applied first!
> Make new admin UI work better with big indexes
> ----------------------------------------------
>
> Key: SOLR-3121
> URL: https://issues.apache.org/jira/browse/SOLR-3121
> Project: Solr
> Issue Type: Improvement
> Affects Versions: 4.0
> Reporter: Ryan McKinley
> Fix For: 4.0
>
> Attachments: SOLR-3121-luke-admin-ui.patch, SOLR-3121-luke-admin-ui.patch
>
>
> As reported in SOLR-2667, the admin UI gets pretty bad with big indexes. Mostly this seems the fault of excessive calls to luke and not limiting the number of terms
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org