You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@seatunnel.apache.org by "EricJoy2048 (via GitHub)" <gi...@apache.org> on 2023/09/12 09:09:47 UTC

[GitHub] [seatunnel] EricJoy2048 commented on issue #5452: [Feature][LocalFile Source] Can you develop a real-time collection of file components, functions similar to Flume's TailSource

EricJoy2048 commented on issue #5452:
URL: https://github.com/apache/seatunnel/issues/5452#issuecomment-1715322317

   1. Because synchronization tasks must run on the synchronization engine node, rather than the node where the log files are located, the prerequisite for implementing this function is for the log files to be written to a distributed file system or cloud storage, such as HDFS, OSS, S3, etc.
   2. We can extend File Source to support real-time streaming reading of files.
   
   Are you willing to give it a try?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org