Flume FTP Source - Configure Dynamic directory name

[vignesh <vi...@gmail.com>]

Hi,

I would get a requestID from HTTP source and based on that requestID i
will have to form the directory structure/name. Under that directory
there would be many files available in a remote server and need to
fetch all the files from that directory and has to be put in HDFS. We
would not be able to run flume agent in that remote server. So i took
help of flume-ftp-source.

The problem now is that how do i pass a requestID which i get from
HTTP source to custom flume-ftp-source and form the directory
name(parameter:). This seems to be a

HTTP source -> Custom FTP Source -> HDFS Sink

problem. But i understand that two sources could not be connected. Is
there any other way i could accomplish this.

Thanks and Regards,
Vignesh