You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Robert Muir (JIRA)" <ji...@apache.org> on 2011/06/01 12:07:47 UTC

[jira] [Created] (SOLR-2567) Solr should default to TieredMergePolicy

Solr should default to TieredMergePolicy
----------------------------------------

                 Key: SOLR-2567
                 URL: https://issues.apache.org/jira/browse/SOLR-2567
             Project: Solr
          Issue Type: Bug
          Components: update
            Reporter: Robert Muir
             Fix For: 3.3, 4.0


even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated SOLR-2567:
------------------------------

    Attachment: SOLR-2567.patch

updated the patch, to check onOrAfter 3.3.

Also it applies mergefactor and compoundfile to TieredMergePolicy.

I think this is ready to commit.

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042426#comment-13042426 ] 

Yonik Seeley commented on SOLR-2567:
------------------------------------

bq. the patch currently adjusts the default based on luceneMatchVersion, but this is confusing if we release 3.2 that "disagrees" with lucene's actual 3.2 defaults.

I don't think all of Solr's defaults need to match Lucene's defaults in general - we can take it on a case-by-case basis.  In this case, a TieredMergePolicy default certainly does make sense.  I'm not even sure it needed to be linked to luceneMatchVersion... it's a rare solr user that would depend on the specifics of merging or docid behavioral changes.

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Resolved] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir resolved SOLR-2567.
-------------------------------

    Resolution: Fixed
      Assignee: Robert Muir

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>            Assignee: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042080#comment-13042080 ] 

Robert Muir commented on SOLR-2567:
-----------------------------------

the patch currently adjusts the default based on luceneMatchVersion, but this is confusing if we release 3.2 that "disagrees" with lucene's actual 3.2 defaults.

we could check onOrAfter 3.3 at least to be safe so we don't surprise anyone when 3.3 comes out

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042442#comment-13042442 ] 

Robert Muir commented on SOLR-2567:
-----------------------------------

Well, mostly here I was admitting that I screwed this up for 3.2

One of the major reasons we respun was to ensure solr used the most recent lucene version configuration so it had features like this... yet it still didnt enable TieredMP.

I guess what I'm saying is... I'm willing to respin if anyone thinks its a huge deal. In this case I honestly think our 3.2RC is a good release even though this isn't enabled yet, and we should just target 3.3.

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042413#comment-13042413 ] 

Michael McCandless commented on SOLR-2567:
------------------------------------------

Patch looks great -- thanks Robert!

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042471#comment-13042471 ] 

Robert Muir commented on SOLR-2567:
-----------------------------------

{quote}
Then I saw that there would be some side affects to that based on this patch? I didn't really look closely, but from memory, I guess it would disable being able to set compound file? And you wouldn't be able to change the tiered policies settings? Or does Solr's config any given method voodoo work in this case?
{quote}

Right, this is definitely a downside to not having this patch, they cannot set compoundFile or mergeFactor. 

And you are also right about tiered policy settings... you will notice I didn't actually enable these in the patch. I guess thats because I thought it would be confusing to add "MP-specific" settings all piled in to the config. I was planning on opening another issue for this to allow for a factory configuration like other things, especially so I can pass a 'long' random seed so that tests can use MockRandomMergePolicy :)


> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042484#comment-13042484 ] 

Michael McCandless commented on SOLR-2567:
------------------------------------------

+1 for #1 too

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Mark Miller (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042461#comment-13042461 ] 

Mark Miller commented on SOLR-2567:
-----------------------------------

My initial reaction was it was not worth re-spinning for this either. But mostly based on the assumption that the user could just configure it, and at worst we could drop a note about it.

Then I saw that there would be some side affects to that based on this patch? I didn't really look closely, but from memory, I guess it would disable being able to set compound file? And you wouldn't be able to change the tiered policies settings? Or does Solr's config any given method voodoo work in this case?

Either way, I'd be fine if we didn't respin or if we did. It would still be an improvement, even if it didn't support compound, and then that can be another improvement.

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042658#comment-13042658 ] 

Robert Muir commented on SOLR-2567:
-----------------------------------

OK, I created SOLR-2572 to improve mergepolicy configuration. 

This way when we enable TieredMP, the user will be able to configure all of its options

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042465#comment-13042465 ] 

Robert Muir commented on SOLR-2567:
-----------------------------------

bq. Additionally, I dont think its a problem to respin because of that. 

You are right, its no problem at all to respin, I don't mind doing this at all. The only problem is that committers must spend their time to re-review the release candidate, but I suppose if they watch the commits list they can be more confident in their checking and not have to waste a lot of time, since its only this issue and maybe two other small things that were found.

In fact, Mike committed a "HuperDuper" automated-checker to do some of the grunt work of checking a release to luceneutil today: http://code.google.com/a/apache-extras.org/p/luceneutil/source/detail?r=5bf3a0ea4922bbeb38a0a16c503b42e07c028eab

So maybe its a good opportunity to use this utility to aid in easier review of release candidates.

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated SOLR-2567:
------------------------------

    Attachment: SOLR-2567.patch

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042457#comment-13042457 ] 

Uwe Schindler commented on SOLR-2567:
-------------------------------------

Additionally, I dont think its a problem to respin because of that. If we want consistency in Solr with Lucene (and I am huge +1 to be consistent in all case - this time against Yonik), we should respin and fix this (along with the small issues brought on the vote thread).

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Yonik Seeley (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042533#comment-13042533 ] 

Yonik Seeley commented on SOLR-2567:
------------------------------------

Yeah, our release process can be painful enough (esp given the 72 hr thing) that I don't think this should keep us from releasing 3.2.
I'm fine with #1 or #2

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042452#comment-13042452 ] 

Michael McCandless commented on SOLR-2567:
------------------------------------------

I don't think we should respin -- just make it the default MP for 3.3?

But, I think we should use luceneMatchVersion to conditionalize it.
It's a biggish change, that docIDs can now be "shuffled", so in case
there is some Solr app out there that relies on docIDs staying in order,
we should respect the luceneMatchVersion.

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Uwe Schindler (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042447#comment-13042447 ] 

Uwe Schindler commented on SOLR-2567:
-------------------------------------

I just wanted to remember that the matchVersion stuff this time is done without reparsing each time *duck*

I agree with Yonik, that in the case of Solr, we can easily change the default without matchVersion, as nothing in solr depends on docids in order. Solr always used real docids.

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042458#comment-13042458 ] 

Robert Muir commented on SOLR-2567:
-----------------------------------

bq. Solr always used real docids.

Even when you sort only by score? in this case the lucene docid is the "tiebreaker", no?

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Steven Rowe (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042479#comment-13042479 ] 

Steven Rowe commented on SOLR-2567:
-----------------------------------

+1 for #1 (release 3.2 as is, enable full TMP support in 3.3)

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Commented] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042475#comment-13042475 ] 

Robert Muir commented on SOLR-2567:
-----------------------------------

Anyway, I'm interested in what others think the right thing to do here is... we can bring it to the dev@ list if it will grab more attention.

the choices to me seem to be:
# release 3.2 as is, enable TieredMergePolicy in 3.3, using luceneMatchVersion >= 3.3
# release 3.2 as is, enable TieredMergePolicy in 3.3, just changing the default completely.
# respin and use this patch, with TieredMergePolicy defaulted on for luceneMatchVersion >= 3.2 (consistent with lucene), but you don't have total configuration over all its settings (just mergefactor and compoundfile).
# respin like the above, but also quickly try to add support for MergePolicyFactory or similar, so that all tieredMP settings are exposed

and maybe there are other ideas I haven't mentioned.

> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] [Updated] (SOLR-2567) Solr should default to TieredMergePolicy

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/SOLR-2567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated SOLR-2567:
------------------------------

    Attachment: SOLR-2567.patch

ok, here's a patch for committing.

After reviewing SOLR-2572, I think its overkill at the moment.

This is because SolrPluginUtils.applySetters takes care of all possible parameters we have in all of our mergepolicies (including contrib) available today: all the parameters are setters that take primitive types.

So, I'd like to commit this shortly and cancel SOLR-2572 as "won't fix".

I added a test that configures some tiered-mp specific stuff.


> Solr should default to TieredMergePolicy
> ----------------------------------------
>
>                 Key: SOLR-2567
>                 URL: https://issues.apache.org/jira/browse/SOLR-2567
>             Project: Solr
>          Issue Type: Bug
>          Components: update
>            Reporter: Robert Muir
>             Fix For: 3.3, 4.0
>
>         Attachments: SOLR-2567.patch, SOLR-2567.patch, SOLR-2567.patch
>
>
> even if we set a luceneMatchVersion to >= 3.2 (SOLR-2557),
> Solr still defaults to LogByte

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org