You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Narender Reddy <na...@gmail.com> on 2014/04/07 17:02:30 UTC

data security

how data is secure by using HADOOP

Re: data security

Posted by Abhay Dandekar <da...@gmail.com>.
Yes, there indeed is a lot of traction going on in Hadoop security space.

N yaa, the typical workloads I saw, the data comes in encrypted and then
HDFS decrypts it in a controlled execution environment. I think intel's
solution is already doing it in this fashion. One can explore and move
ahead.

Feel free to drop me a mail, in case one needs any more information. Would
be happy to help :)

Warm Regards,
Abhay Dandekar
 Hadoop Enthusiast ...


On Thu, Apr 10, 2014 at 11:31 AM, Matt Fellows <
matt.fellows@bespokesoftware.com> wrote:

> There are quite a few projects that are looking into this.  I myself am
> part of a TSB (part government funded research) project involving securing
> data in the cloud.  Generally the data is secured in a layer on top of
> hadoop rather than specifically as part of hadoop itself.
>
>
> Our solution essentially involves encrypting data within the HDFS and
> providing mechanisms for hadoop to decrypt, use, then re-encrypt the
> results.  It also provides mechanisms for secure deletion of data when it's
> not required anymore (that's actually a minor patch within HDFS, rather
> than on top if it though)
>
>
>
>
> Contact me if you need more information, we are about to start trials in
> the next few months.
> --
> Sent from Mailbox for iPhone
>
> On Thu, Apr 10, 2014 at 5:36 AM, Abhay Dandekar <da...@gmail.com>
> wrote:
>
> > Data security is one of the major challenges being faced for Hadoop
> > computing. And now, when people have started using more of public clouds
> > OVER private hadoop clusters, the concerns have gained a priority.
> > There is a good demo from intel below. Might give you more insights :
> > http://hadoop.intel.com/demos/security-for-hadoop
> > Warm Regards,
> > Abhay Dandekar
> > *Hadoop Enthusiast .. *
> > On Mon, Apr 7, 2014 at 8:57 PM, Juan Carlos <jc...@redoop.org>
> wrote:
> >> Data are secured only if you are using kerberos authentication. Also is
> it
> >> possible to enable ssl encryption (although I had somy issues with QJM
> and
> >> data encryption)
> >>
> >>
> >> 2014-04-07 17:02 GMT+02:00 Narender Reddy <na...@gmail.com>:
> >>
> >> > how data is secure by using HADOOP
> >> >
> >>
> --
> ____________________________________________________
>
> This is confidential, non-binding and not company endorsed - see full terms
> at www.fosolutions.co.uk/emailpolicy.html
> First Option Software Ltd Registered No. 06340261
> Signal House, Jacklyns Lane, Alresford, Hampshire, SO24 9JJ, U.K.
> ____________________________________________________
>
>

Re: data security

Posted by Matt Fellows <ma...@bespokesoftware.com>.
There are quite a few projects that are looking into this.  I myself am part of a TSB (part government funded research) project involving securing data in the cloud.  Generally the data is secured in a layer on top of hadoop rather than specifically as part of hadoop itself. 


Our solution essentially involves encrypting data within the HDFS and providing mechanisms for hadoop to decrypt, use, then re-encrypt the results.  It also provides mechanisms for secure deletion of data when it's not required anymore (that's actually a minor patch within HDFS, rather than on top if it though)




Contact me if you need more information, we are about to start trials in the next few months.
—
Sent from Mailbox for iPhone

On Thu, Apr 10, 2014 at 5:36 AM, Abhay Dandekar <da...@gmail.com>
wrote:

> Data security is one of the major challenges being faced for Hadoop
> computing. And now, when people have started using more of public clouds
> OVER private hadoop clusters, the concerns have gained a priority.
> There is a good demo from intel below. Might give you more insights :
> http://hadoop.intel.com/demos/security-for-hadoop
> Warm Regards,
> Abhay Dandekar
> *Hadoop Enthusiast .. *
> On Mon, Apr 7, 2014 at 8:57 PM, Juan Carlos <jc...@redoop.org> wrote:
>> Data are secured only if you are using kerberos authentication. Also is it
>> possible to enable ssl encryption (although I had somy issues with QJM and
>> data encryption)
>>
>>
>> 2014-04-07 17:02 GMT+02:00 Narender Reddy <na...@gmail.com>:
>>
>> > how data is secure by using HADOOP
>> >
>>
-- 
____________________________________________________

This is confidential, non-binding and not company endorsed - see full terms 
at www.fosolutions.co.uk/emailpolicy.html 
First Option Software Ltd Registered No. 06340261
Signal House, Jacklyns Lane, Alresford, Hampshire, SO24 9JJ, U.K.
____________________________________________________


Re: data security

Posted by Abhay Dandekar <da...@gmail.com>.
Data security is one of the major challenges being faced for Hadoop
computing. And now, when people have started using more of public clouds
OVER private hadoop clusters, the concerns have gained a priority.

There is a good demo from intel below. Might give you more insights :

http://hadoop.intel.com/demos/security-for-hadoop


Warm Regards,
Abhay Dandekar

*Hadoop Enthusiast .. *



On Mon, Apr 7, 2014 at 8:57 PM, Juan Carlos <jc...@redoop.org> wrote:

> Data are secured only if you are using kerberos authentication. Also is it
> possible to enable ssl encryption (although I had somy issues with QJM and
> data encryption)
>
>
> 2014-04-07 17:02 GMT+02:00 Narender Reddy <na...@gmail.com>:
>
> > how data is secure by using HADOOP
> >
>

Re: data security

Posted by Juan Carlos <jc...@redoop.org>.
Data are secured only if you are using kerberos authentication. Also is it
possible to enable ssl encryption (although I had somy issues with QJM and
data encryption)


2014-04-07 17:02 GMT+02:00 Narender Reddy <na...@gmail.com>:

> how data is secure by using HADOOP
>