You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flume.apache.org by Rani Yaroshinski <ra...@gmail.com> on 2016/02/29 09:00:42 UTC

.tmp files are left forever if flume is crushing

Hi,

we face issues with "orphan" .tmp files, which are leftovers from
HDFS-Sink, in the case that flume crushes before the roll conditions are
met.

I am trying to find some way to deal with those files, since it seems that
the mechanism is not complete.

Regards,
Rani

Re: .tmp files are left forever if flume is crushing

Posted by Thomas Larsson <th...@klarna.com>.

+1.

On Mon, Feb 29, 2016 at 9:00 AM, Rani Yaroshinski <
rani.yaroshinski@gmail.com> wrote:

> Hi,
>
> we face issues with "orphan" .tmp files, which are leftovers from
> HDFS-Sink, in the case that flume crushes before the roll conditions are
> met.
>
> I am trying to find some way to deal with those files, since it seems that
> the mechanism is not complete.
>
> Regards,
> Rani
>



-- 

*Thomas Larsson*
Senior developer
Odin - Backoffice core

Klarna AB
Sveavägen 46, 111 34 Stockholm
Tel: +46 8 120 120 00
Reg no: 556737-0431
klarna.com