You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucy.apache.org by "Marvin Humphrey (JIRA)" <ji...@apache.org> on 2010/05/20 04:52:54 UTC

[jira] Created: (LUCY-103) Snapshot improvements

Snapshot improvements
---------------------

                 Key: LUCY-103
                 URL: https://issues.apache.org/jira/browse/LUCY-103
             Project: Lucy
          Issue Type: Improvement
          Components: Core - Index
            Reporter: Marvin Humphrey
            Assignee: Marvin Humphrey


Add the ability to write Snapshot files, encoded as JSON, along with tests and
minor cosmetic changes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (LUCY-103) Snapshot improvements

Posted by "Marvin Humphrey (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCY-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marvin Humphrey updated LUCY-103:
---------------------------------

    Attachment: snap_tests.patch

The third diff, snap_tests.patch, provides unit tests.

> Snapshot improvements
> ---------------------
>
>                 Key: LUCY-103
>                 URL: https://issues.apache.org/jira/browse/LUCY-103
>             Project: Lucy
>          Issue Type: Improvement
>          Components: Core - Index
>            Reporter: Marvin Humphrey
>            Assignee: Marvin Humphrey
>         Attachments: filename_to_path.patch, read_write_file.patch, snap_tests.patch
>
>
> Add the ability to write Snapshot files, encoded as JSON, along with tests and
> minor cosmetic changes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (LUCY-103) Snapshot improvements

Posted by "Marvin Humphrey (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCY-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marvin Humphrey updated LUCY-103:
---------------------------------

    Attachment: filename_to_path.patch

The first diff, "filename_to_path.patch", is cosmetic; it changes out
"filename" for "path" where appropriate, bringing Snapshot into line with
usage in the rest of the library.

> Snapshot improvements
> ---------------------
>
>                 Key: LUCY-103
>                 URL: https://issues.apache.org/jira/browse/LUCY-103
>             Project: Lucy
>          Issue Type: Improvement
>          Components: Core - Index
>            Reporter: Marvin Humphrey
>            Assignee: Marvin Humphrey
>         Attachments: filename_to_path.patch
>
>
> Add the ability to write Snapshot files, encoded as JSON, along with tests and
> minor cosmetic changes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (LUCY-103) Snapshot improvements

Posted by "Marvin Humphrey (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCY-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marvin Humphrey updated LUCY-103:
---------------------------------

    Attachment: snapshot_set_path.patch
                snapshot_perl_binding.patch

The diff "snapshot_set_path.diff" makes Set_Path() public.

The diff "snapshot_perl_binding.patch" exposes Snapshot via the Perl API and adds tests for the bound methods.

> Snapshot improvements
> ---------------------
>
>                 Key: LUCY-103
>                 URL: https://issues.apache.org/jira/browse/LUCY-103
>             Project: Lucy
>          Issue Type: Improvement
>          Components: Core - Index
>            Reporter: Marvin Humphrey
>            Assignee: Marvin Humphrey
>         Attachments: filename_to_path.patch, read_write_file.patch, snap_tests.patch, snapshot_perl_binding.patch, snapshot_set_path.patch
>
>
> Add the ability to write Snapshot files, encoded as JSON, along with tests and
> minor cosmetic changes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (LUCY-103) Snapshot improvements

Posted by "Marvin Humphrey (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCY-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marvin Humphrey resolved LUCY-103.
----------------------------------

    Resolution: Fixed

Committed as r949415, r949416, r949418, r949427, and r949428.

> Snapshot improvements
> ---------------------
>
>                 Key: LUCY-103
>                 URL: https://issues.apache.org/jira/browse/LUCY-103
>             Project: Lucy
>          Issue Type: Improvement
>          Components: Core - Index
>            Reporter: Marvin Humphrey
>            Assignee: Marvin Humphrey
>         Attachments: filename_to_path.patch, read_write_file.patch, snap_tests.patch, snapshot_perl_binding.patch, snapshot_set_path.patch
>
>
> Add the ability to write Snapshot files, encoded as JSON, along with tests and
> minor cosmetic changes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (LUCY-103) Snapshot improvements

Posted by "Marvin Humphrey (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/LUCY-103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Marvin Humphrey updated LUCY-103:
---------------------------------

    Attachment: read_write_file.patch

This second diff, read_write_file.patch, adds the Write_File() and Read_File()
methods.  They write a JSON file which encodes a hash of key-value pairs.  At
present, there are only two keys: a "format" integer, and an array of
filepaths under "entries".  

The role of the "entries" array has changed subtly since Snapshot was first
committed: including a folder name in a snapshot implicitly includes all of
its contents as well.  It is the role of the forthcoming FilePurger module to
implement this semantic change.

Before:

{code:none}
{
   "entries" : [ 
      "schema_1.json",
      "seg_3",
      "seg_3/lexicon-3.dat",
      "seg_3/lexicon-3.ix",
      "seg_3/lexicon-3.ixix",
      "seg_3/postings-3.dat",
      "seg_3/postings.skip",
      "seg_3/records.dat",
      "seg_3/records.ix",
      "seg_3/segmeta.json",
      "seg_3/term_vectors.dat",
      "seg_3/term_vectors.ix"
   ],  
   "format" : "1" 
}
{code}

After:

{code:none}
{
   "entries" : [ 
      "schema_1.json",
      "seg_3",
   ],  
   "format" : "1" 
}
{code}

Having segment directory names represent their contents by proxy frees index
subcomponents from having to manage their files manually so long as those
subcomponents work entirely within the segment system.

> Snapshot improvements
> ---------------------
>
>                 Key: LUCY-103
>                 URL: https://issues.apache.org/jira/browse/LUCY-103
>             Project: Lucy
>          Issue Type: Improvement
>          Components: Core - Index
>            Reporter: Marvin Humphrey
>            Assignee: Marvin Humphrey
>         Attachments: filename_to_path.patch, read_write_file.patch, snap_tests.patch
>
>
> Add the ability to write Snapshot files, encoded as JSON, along with tests and
> minor cosmetic changes.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.