End-to-End Encryption using flume

[Sharninder <sh...@gmail.com>]

Hi,

I'm trying to send a file (or events) over flume to a remote file store
(could be HDFS too, later) with the only condition that the entire
transmission be encrypted. The topology looks something like this:

file source->encrypted avro sink -> avro source -> file sink

This is failing at the second avro source and I have to add a decrypting
source to enable this topology to work. Is this how flume encryption works?

How can I make sure that the file/events encrypted at the first sink
remains encrypted even when being written to disk at the end? Is this even
possible ?

Hope my description was clear enough?

--
Sharninder

Re: End-to-End Encryption using flume

[Roshan Naik <ro...@hortonworks.com>]

you could encrypt the data before it is fed into the file source.
-roshan


On Wed, Jun 25, 2014 at 9:18 PM, Sharninder <sh...@gmail.com> wrote:

> Hi,
>
> I'm trying to send a file (or events) over flume to a remote file store
> (could be HDFS too, later) with the only condition that the entire
> transmission be encrypted. The topology looks something like this:
>
> file source->encrypted avro sink -> avro source -> file sink
>
> This is failing at the second avro source and I have to add a decrypting
> source to enable this topology to work. Is this how flume encryption works?
>
> How can I make sure that the file/events encrypted at the first sink
> remains encrypted even when being written to disk at the end? Is this even
> possible ?
>
> Hope my description was clear enough?
>
> --
> Sharninder
>
>

-- 
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to 
which it is addressed and may contain information that is confidential, 
privileged and exempt from disclosure under applicable law. If the reader 
of this message is not the intended recipient, you are hereby notified that 
any printing, copying, dissemination, distribution, disclosure or 
forwarding of this communication is strictly prohibited. If you have 
received this communication in error, please contact the sender immediately 
and delete it from your system. Thank You.