[jira] [Updated] (APEXMALHAR-1600) Investigate if we can seek efficiently to the correct location when we restart after failure for ftp and fs scan operators

["Chandni Singh (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/APEXMALHAR-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chandni Singh updated APEXMALHAR-1600:
--------------------------------------
    Assignee:     (was: Chandni Singh)

> Investigate if we can seek efficiently to the correct location when we restart after failure for ftp and fs scan operators
> --------------------------------------------------------------------------------------------------------------------------
>
>                 Key: APEXMALHAR-1600
>                 URL: https://issues.apache.org/jira/browse/APEXMALHAR-1600
>             Project: Apache Apex Malhar
>          Issue Type: Improvement
>            Reporter: Pramod Immaneni
>
> Currently when the fs scan operator fails and restarts it seeks to the starting location by asking for the previous entries and discarding them. Can this be done in a more efficient manner in a case-by-case basis, for example a sub class of the operator can keep a count of the file read offset after returning an entry and that can be used to seek directly to checkpointed offset.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)