You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@batchee.apache.org by "Mark Struberg (JIRA)" <ji...@apache.org> on 2014/05/11 00:06:09 UTC

[jira] [Created] (BATCHEE-37) provide a CheckpointAlgorithm which can be set from the ItemReader or Processor

Mark Struberg created BATCHEE-37:
------------------------------------

             Summary: provide a CheckpointAlgorithm which can be set from the ItemReader or Processor
                 Key: BATCHEE-37
                 URL: https://issues.apache.org/jira/browse/BATCHEE-37
             Project: BatchEE
          Issue Type: New Feature
          Components: batchee-extensions
    Affects Versions: 0.1-incubating
            Reporter: Mark Struberg


We have a batch which has a huge amount of work to do. Usually this batch processes in a day-by-day manner which means that we cannot use a fixed item-count and we need a custom CheckpointAlgorithm.

The problem with CheckpointAlgorithm is that it doesn't have any info about the data it processes. So what about supplying a CheckpointAlgorithm which uses a @StepScoped holder which just contains a boolean. This might then be either set by the ItemReader or ItemProcessor to signal that a certain point is reached and the chunk shall be committed.



--
This message was sent by Atlassian JIRA
(v6.2#6252)