data encryption while in transit

[Jay Sen <ja...@apache.org>]

Hi Gobblin dev team,

I am looking at a way to encrypt the data traffic or secure the overall
connection while reading data from hadoop for the Gobblin distcp job.

I see currently Gobblin only support encryption while writing, do anybody
has idea on how can this be achieved with Gobblin or a feature like this
would be helpful ?

Thanks
Jay

Re: data encryption while in transit

[Sudarshan Vasudevan <su...@linkedin.com.INVALID>]

@Jay Sen<ma...@apache.org>
There are multiple options for encrypting Hadoop data during reads and writes.

  1.  Use swebhdfs
  2.  By enabling Wire encryption support in Hadoop RPCs

Both of these should be transparent to Gobblin and should not require code changes.

Sudarshan
________________________________
From: Jay Sen <ja...@apache.org>
Sent: Monday, November 18, 2019 3:08 PM
To: dev@gobblin.incubator.apache.org <de...@gobblin.incubator.apache.org>
Subject: data encryption while in transit

Hi Gobblin dev team,

I am looking at a way to encrypt the data traffic or secure the overall
connection while reading data from hadoop for the Gobblin distcp job.

I see currently Gobblin only support encryption while writing, do anybody
has idea on how can this be achieved with Gobblin or a feature like this
would be helpful ?

Thanks
Jay

Re: data encryption while in transit

[Jay Sen <ja...@apache.org>]

Ping....

On Mon, Nov 18, 2019 at 3:08 PM Jay Sen <ja...@apache.org> wrote:

> Hi Gobblin dev team,
>
> I am looking at a way to encrypt the data traffic or secure the overall
> connection while reading data from hadoop for the Gobblin distcp job.
>
> I see currently Gobblin only support encryption while writing, do anybody
> has idea on how can this be achieved with Gobblin or a feature like this
> would be helpful ?
>
> Thanks
> Jay
>