[jira] [Comment Edited] (JENA-977) tdbloader2 script refactoring

["Rob Vesse (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/JENA-977?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14603058#comment-14603058 ] 

Rob Vesse edited comment on JENA-977 at 6/26/15 3:39 PM:
---------------------------------------------------------

Current progress:

- Data and Index phase split into separate scripts
- Main script invokes the desired phases (defaults to all) - Known Bug - Main script doesn't check for errors from the scripts yet
- Proper usage summaries
- Mostly using options instead of environment variables (still need to cover SORT_ARGS and JVM_ARGS)
- Progress monitoring for sort if {{pv}} (Pipe Viewer) is available on a system
- Warn if sort temporary disk has <= 10% free space

Currently the scripts have been hacked slightly:

- Using Jena 2.13 package names so I can have {{JENA_HOME}} set to a 2.13.0 release
- Ignoring {{JENA_HOME}} for location the new scripts so I can work on them directly

If there is an easy way to get the {{lib/}} folder built under the apache-jena/ folder for testing that would be great to know


was (Author: rvesse):
Current progress:

- Data and Index phase split into separate scripts
- Main script invokes the desired phases (defaults to all) - Known Bug - Main script doesn't check for errors from the scripts yet
- Proper usage summaries
- Mostly using options instead of environment variables (still need to cover SORT_ARGS and JVM_ARGS)
- Progress monitoring for sort if {{pv}} (Pipe Viewer) is available on a system
- Warn if sort temporary disk has <= 10% free space

Currently the scripts have been hacked slightly:

- Using Jena 2.13 package names so I can have JENA_HOME set to a 2.13.0 release
- Ignoring JENA_HOME for location the new scripts so I can work on them directly

If there is an easy way to get the lib/ folder built under the apache-jena/ folder for testing that would be great to know

> tdbloader2 script refactoring
> -----------------------------
>
>                 Key: JENA-977
>                 URL: https://issues.apache.org/jira/browse/JENA-977
>             Project: Apache Jena
>          Issue Type: Improvement
>          Components: TDB
>    Affects Versions: Jena 2.13.0
>            Reporter: Rob Vesse
>            Assignee: Rob Vesse
>             Fix For: Jena 2.13.1, Jena 3.0.0
>
>
> As noted on the dev list the current scripts are a little rough around the edges, work items include:
> - Splitting data and index phase into separate scripts
> - Being able to restart a build from a later phase
> - Progress monitoring for the sort portion of indexing
> - Warning if sort is using a disk where you may have insufficient space
> - Better usage summaries
> - Better argument handling (avoid relying on magic environment variables wherever possible)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)