You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Shady Xu <sh...@gmail.com> on 2015/07/13 10:17:47 UTC
Flume Sink stop working after disabling source
I have to move my Flume agent to another machine, so I comment the source
to disable it in my configuration file. And I leave other configurations as
they are to let the sink finish uploading the data stored in the channel to
HDFS.
However, several days passed, there are still the same amount of data in
the channel, the sink seems have stopped working too. What may be the
problem?
Re: Flume Sink stop working after disabling source
Posted by Hari Shreedharan <hs...@cloudera.com>.
Do you have logs you can share?
Thanks,
Hari
On July 13, 2015 at 11:48:19 PM, Shady Xu (shadyxu@gmail.com) wrote:
But there are still data in the channel, shouldn't the sink pull all the data from the channel?
2015-07-14 11:09 GMT+08:00 Balasubramanian Jayaraman <ba...@autodesk.com>:
If you change the configurations, the flume will automatically restart the sources, channels and sinks. Since the source is commented the flume agent is not receiving the data and hence no data is received in Sink
From: Shady Xu [mailto:shadyxu@gmail.com]
Sent: Tuesday, July 14, 2015 10:19 AM
To: user@flume.apache.org
Subject: Re: Flume Sink stop working after disabling source
P.S. I'm using Flume 1.5.2.
2015-07-13 16:17 GMT+08:00 Shady Xu <sh...@gmail.com>:
I have to move my Flume agent to another machine, so I comment the source to disable it in my configuration file. And I leave other configurations as they are to let the sink finish uploading the data stored in the channel to HDFS.
However, several days passed, there are still the same amount of data in the channel, the sink seems have stopped working too. What may be the problem?
Re: Flume Sink stop working after disabling source
Posted by Shady Xu <sh...@gmail.com>.
But there are still data in the channel, shouldn't the sink pull all the
data from the channel?
2015-07-14 11:09 GMT+08:00 Balasubramanian Jayaraman <
balasubramanian.jayaraman@autodesk.com>:
> If you change the configurations, the flume will automatically restart
> the sources, channels and sinks. Since the source is commented the flume
> agent is not receiving the data and hence no data is received in Sink
>
>
>
> *From:* Shady Xu [mailto:shadyxu@gmail.com]
> *Sent:* Tuesday, July 14, 2015 10:19 AM
> *To:* user@flume.apache.org
> *Subject:* Re: Flume Sink stop working after disabling source
>
>
>
> P.S. I'm using Flume 1.5.2.
>
>
>
> 2015-07-13 16:17 GMT+08:00 Shady Xu <sh...@gmail.com>:
>
> I have to move my Flume agent to another machine, so I comment the source
> to disable it in my configuration file. And I leave other configurations as
> they are to let the sink finish uploading the data stored in the channel to
> HDFS.
>
>
>
> However, several days passed, there are still the same amount of data in
> the channel, the sink seems have stopped working too. What may be the
> problem?
>
>
>
RE: Flume Sink stop working after disabling source
Posted by Balasubramanian Jayaraman <ba...@autodesk.com>.
If you change the configurations, the flume will automatically restart the sources, channels and sinks. Since the source is commented the flume agent is not receiving the data and hence no data is received in Sink
From: Shady Xu [mailto:shadyxu@gmail.com]
Sent: Tuesday, July 14, 2015 10:19 AM
To: user@flume.apache.org
Subject: Re: Flume Sink stop working after disabling source
P.S. I'm using Flume 1.5.2.
2015-07-13 16:17 GMT+08:00 Shady Xu <sh...@gmail.com>>:
I have to move my Flume agent to another machine, so I comment the source to disable it in my configuration file. And I leave other configurations as they are to let the sink finish uploading the data stored in the channel to HDFS.
However, several days passed, there are still the same amount of data in the channel, the sink seems have stopped working too. What may be the problem?
Re: Flume Sink stop working after disabling source
Posted by Shady Xu <sh...@gmail.com>.
P.S. I'm using Flume 1.5.2.
2015-07-13 16:17 GMT+08:00 Shady Xu <sh...@gmail.com>:
> I have to move my Flume agent to another machine, so I comment the source
> to disable it in my configuration file. And I leave other configurations as
> they are to let the sink finish uploading the data stored in the channel to
> HDFS.
>
> However, several days passed, there are still the same amount of data in
> the channel, the sink seems have stopped working too. What may be the
> problem?
>