[jira] [Updated] (FLINK-4800) Refactor the ContinuousFileMonitoringFunction code and the related tests.

["Kostas Kloudas (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-4800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Kostas Kloudas updated FLINK-4800:
----------------------------------
    Description: 
Introduce the TimestampedFileInputSplit which extends the class FileInputSplit and also contains:
i) the modification time of the file the split belongs to and also, and
ii) when checkpointing, the point the reader is currently reading from.

The latter will be useful for rescaling. With this addition, the ContinuousFileMonitoringFunction sends TimestampedFileInputSplits 
to the Readers, and the Readers' state now contain only TimestampedFileInputSplits.



  was:
Currently the code in the FileMonitoringFunction can be simplified.
The same holds for the test code. 
This is the goal of this issue.


> Refactor the ContinuousFileMonitoringFunction code and the related tests.
> -------------------------------------------------------------------------
>
>                 Key: FLINK-4800
>                 URL: https://issues.apache.org/jira/browse/FLINK-4800
>             Project: Flink
>          Issue Type: Bug
>          Components: Streaming Connectors
>            Reporter: Kostas Kloudas
>            Assignee: Kostas Kloudas
>            Priority: Minor
>
> Introduce the TimestampedFileInputSplit which extends the class FileInputSplit and also contains:
> i) the modification time of the file the split belongs to and also, and
> ii) when checkpointing, the point the reader is currently reading from.
> The latter will be useful for rescaling. With this addition, the ContinuousFileMonitoringFunction sends TimestampedFileInputSplits 
> to the Readers, and the Readers' state now contain only TimestampedFileInputSplits.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)