You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "goutamadwant (via GitHub)" <gi...@apache.org> on 2026/08/15 13:38:01 UTC

Re: [I] [Connector] Capture log files using streaming mode, but the process stops after capturing a file. [seatunnel]

goutamadwant commented on issue #10225:
URL: https://github.com/apache/seatunnel/issues/10225#issuecomment-5302480278

   @davidzollo @DanielLeens I would like to work on this issue
   
   I checked the current file source path and BaseFileSource is still bounded. FileSourceSplitEnumerator discovers the configured files once and signals no more splits, so appended bytes are not discovered again
   
   For the first slice I propose supporting append-only LocalFile text input. The source would poll file size, emit only the newly appended byte range, and checkpoint the file identity and consumed offset so restore does not duplicate data
   
   I would keep file rotation, truncation and in-place modification outside the first slice unless you prefer those semantics to be included now
   
   Does this scope look reasonable? thanks! 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org