files in the “spooling” directory only can transfer to sink one by one.

[周庆发 <qi...@sohu-inc.com>]

Dear flumeNG development group

why only can the files in the “spooling” directory transfer to sink one 
by one? In case there files are very big and growthing real-time,then 
other files can not transfer to sink.why thread pool only has one thread 
instead of multiple?Could you consider 
"Executors.newScheduledThreadPool()" instead of 
"Executors.newSingleThreadScheduledExecutor()"? I believe there could be 
a good a reason why it was originally designed this way.


Look forward to your reply



Sincerely  yours

qingfa zhou

Re: files in the “spooling” directory only can transfer to sink one by one.

[Roshan Naik <ro...@hortonworks.com>]

Is this for performance ? I dont think reading multiple files in parallel
which actually help performance. it will most likely hurt it.
-roshan


On Wed, Apr 10, 2013 at 7:39 PM, 周庆发 <qi...@sohu-inc.com> wrote:

> Dear flumeNG development group
>
> why only can the files in the “spooling” directory transfer to sink one by
> one? In case there files are very big and growthing real-time,then other
> files can not transfer to sink.why thread pool only has one thread instead
> of multiple?Could you consider "Executors.**newScheduledThreadPool()"
> instead of "Executors.**newSingleThreadScheduledExecut**or()"? I believe
> there could be a good a reason why it was originally designed this way.
>
>
> Look forward to your reply
>
>
>
> Sincerely  yours
>
> qingfa zhou
>
>
>