You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by "Michael McCandless (JIRA)" <ji...@apache.org> on 2010/08/03 22:52:17 UTC

[jira] Created: (LUCENE-2586) move intblock/sep codecs into test

move intblock/sep codecs into test
----------------------------------

                 Key: LUCENE-2586
                 URL: https://issues.apache.org/jira/browse/LUCENE-2586
             Project: Lucene - Java
          Issue Type: Improvement
    Affects Versions: 4.0
            Reporter: Michael McCandless
            Assignee: Michael McCandless
             Fix For: 4.0


The intblock and sep codecs in core exist to make it easy for people to try different low-level algos for encoding ints.

Sep breaks docs, freqs, pos, skip data, payloads into 5 separate files (vs 2 files that standard codec uses).

Intblock further enables the docs, freqs, pos files to encode fixed-sized blocks of ints at a time.

So an app can easily "subclass" these codecs, using their own int encoder.

But these codecs are now concrete, and they use dummy low-level block int encoder (eg encoding 128 ints as separate vints).

I'd like to change these to be abstract, and move these dummy codecs into test.

The tests would still test these dummy codecs, by rotating them in randomly for all tests.

I'd also like to rename IntBlock -> FixedIntBlock, because I'm trying to get a VariableIntBlock working well (for int encoders like Simple9, Simple16, whose block size varies depending on the particular values).


-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Updated: (LUCENE-2586) move intblock/sep codecs into test

Posted by "Robert Muir (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Muir updated LUCENE-2586:
--------------------------------

    Component/s: Index

> move intblock/sep codecs into test
> ----------------------------------
>
>                 Key: LUCENE-2586
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2586
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 4.0
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>             Fix For: 4.0
>
>         Attachments: LUCENE-2586.patch
>
>
> The intblock and sep codecs in core exist to make it easy for people to try different low-level algos for encoding ints.
> Sep breaks docs, freqs, pos, skip data, payloads into 5 separate files (vs 2 files that standard codec uses).
> Intblock further enables the docs, freqs, pos files to encode fixed-sized blocks of ints at a time.
> So an app can easily "subclass" these codecs, using their own int encoder.
> But these codecs are now concrete, and they use dummy low-level block int encoder (eg encoding 128 ints as separate vints).
> I'd like to change these to be abstract, and move these dummy codecs into test.
> The tests would still test these dummy codecs, by rotating them in randomly for all tests.
> I'd also like to rename IntBlock -> FixedIntBlock, because I'm trying to get a VariableIntBlock working well (for int encoders like Simple9, Simple16, whose block size varies depending on the particular values).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Resolved: (LUCENE-2586) move intblock/sep codecs into test

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless resolved LUCENE-2586.
----------------------------------------

    Resolution: Fixed

Forgot to resolve this...

> move intblock/sep codecs into test
> ----------------------------------
>
>                 Key: LUCENE-2586
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2586
>             Project: Lucene - Java
>          Issue Type: Improvement
>          Components: Index
>    Affects Versions: 4.0
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>             Fix For: 4.0
>
>         Attachments: LUCENE-2586.patch
>
>
> The intblock and sep codecs in core exist to make it easy for people to try different low-level algos for encoding ints.
> Sep breaks docs, freqs, pos, skip data, payloads into 5 separate files (vs 2 files that standard codec uses).
> Intblock further enables the docs, freqs, pos files to encode fixed-sized blocks of ints at a time.
> So an app can easily "subclass" these codecs, using their own int encoder.
> But these codecs are now concrete, and they use dummy low-level block int encoder (eg encoding 128 ints as separate vints).
> I'd like to change these to be abstract, and move these dummy codecs into test.
> The tests would still test these dummy codecs, by rotating them in randomly for all tests.
> I'd also like to rename IntBlock -> FixedIntBlock, because I'm trying to get a VariableIntBlock working well (for int encoders like Simple9, Simple16, whose block size varies depending on the particular values).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[jira] Updated: (LUCENE-2586) move intblock/sep codecs into test

Posted by "Michael McCandless (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCENE-2586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Michael McCandless updated LUCENE-2586:
---------------------------------------

    Attachment: LUCENE-2586.patch

Attached patch.

It can't be applied because it's a bunch of svn mv's...

But the gist is that intblock/sep in core are now "abstract", moved into test as "MockFixedIntBlock" and "MockSep".


> move intblock/sep codecs into test
> ----------------------------------
>
>                 Key: LUCENE-2586
>                 URL: https://issues.apache.org/jira/browse/LUCENE-2586
>             Project: Lucene - Java
>          Issue Type: Improvement
>    Affects Versions: 4.0
>            Reporter: Michael McCandless
>            Assignee: Michael McCandless
>             Fix For: 4.0
>
>         Attachments: LUCENE-2586.patch
>
>
> The intblock and sep codecs in core exist to make it easy for people to try different low-level algos for encoding ints.
> Sep breaks docs, freqs, pos, skip data, payloads into 5 separate files (vs 2 files that standard codec uses).
> Intblock further enables the docs, freqs, pos files to encode fixed-sized blocks of ints at a time.
> So an app can easily "subclass" these codecs, using their own int encoder.
> But these codecs are now concrete, and they use dummy low-level block int encoder (eg encoding 128 ints as separate vints).
> I'd like to change these to be abstract, and move these dummy codecs into test.
> The tests would still test these dummy codecs, by rotating them in randomly for all tests.
> I'd also like to rename IntBlock -> FixedIntBlock, because I'm trying to get a VariableIntBlock working well (for int encoders like Simple9, Simple16, whose block size varies depending on the particular values).

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org