You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by abhishek <ab...@gmail.com> on 2013/02/14 17:35:12 UTC
Fwd: How to handle sensitive data
> Hi all,
>
> we are having some sensitive data, in some particular fields(columns). Can I know how to handle sensitive in Hadoop.
>
> How do different people handle sensitive data in Hadoop.
>
> Thanks
> Abhi
Re: How to handle sensitive data
Posted by abhishek <ab...@gmail.com>.
Michael,
So as you said, do you want the upstream to encrypt data before sending it to HDFS.
Regards
Abhishek
On Feb 15, 2013, at 8:47 AM, Michael Segel <mi...@hotmail.com> wrote:
> Simple, have your app encrypt the field prior to writing to HDFS.
>
> Also consider HBase.
>
> On Feb 14, 2013, at 10:35 AM, abhishek <ab...@gmail.com> wrote:
>
>>
>>> Hi all,
>>>
>>> we are having some sensitive data, in some particular fields(columns). Can I know how to handle sensitive in Hadoop.
>>>
>>> How do different people handle sensitive data in Hadoop.
>>>
>>> Thanks
>>> Abhi
>
> Michael Segel | (m) 312.755.9623
>
> Segel and Associates
>
>
> --
>
>
>
Re: How to handle sensitive data
Posted by Robert Marshall <ro...@gmail.com>.
For the longer term, Project
Rhino<https://github.com/intel-hadoop/project-rhino> is
an attempt to add additional security features to the open source of
Hadoop, as opposed to several companies that have advertised end-to-end
encryption (for a price).
On Fri, Mar 1, 2013 at 9:32 AM, abhishek <ab...@gmail.com> wrote:
> Marcos,
>
> Encryption from upstream is that what you are talking about
>
> Regards
> Abhishek
>
> On Feb 15, 2013, at 1:28 PM, " Marcos Ortiz Valmaseda" <ml...@uci.cu>
> wrote:
>
> > Regards, abhishek.
> > I´m agree with Michael. You can encrypt your incoming data from your
> application.
> > I recommend to use HBase too.
> >
> > De: "Michael Segel" <mi...@hotmail.com>
> > Para: common-user@hadoop.apache.org
> > CC: cdh-user@cloudera.org
> > Enviados: Viernes, 15 de Febrero 2013 8:47:16
> > Asunto: Re: How to handle sensitive data
> >
> > Simple, have your app encrypt the field prior to writing to HDFS.
> >
> > Also consider HBase.
> >
> > On Feb 14, 2013, at 10:35 AM, abhishek <ab...@gmail.com>
> wrote:
> >
> > >
> > >> Hi all,
> > >>
> > >> we are having some sensitive data, in some particular
> fields(columns). Can I know how to handle sensitive in Hadoop.
> > >>
> > >> How do different people handle sensitive data in Hadoop.
> > >>
> > >> Thanks
> > >> Abhi
> > >
> >
> > Michael Segel | (m) 312.755.9623
> >
> > Segel and Associates
> >
> >
> >
> >
> >
> > --
> > Marcos Ortiz Valmaseda,
> > Product Manager && Data Scientist at UCI
> > Blog: http://marcosluis2186.posterous.com
> > LinkedIn: http://www.linkedin.com/in/marcosluis2186
> > Twitter: @marcosluis2186
>
Re: How to handle sensitive data
Posted by abhishek <ab...@gmail.com>.
Marcos,
Encryption from upstream is that what you are talking about
Regards
Abhishek
On Feb 15, 2013, at 1:28 PM, " Marcos Ortiz Valmaseda" <ml...@uci.cu> wrote:
> Regards, abhishek.
> I´m agree with Michael. You can encrypt your incoming data from your application.
> I recommend to use HBase too.
>
> De: "Michael Segel" <mi...@hotmail.com>
> Para: common-user@hadoop.apache.org
> CC: cdh-user@cloudera.org
> Enviados: Viernes, 15 de Febrero 2013 8:47:16
> Asunto: Re: How to handle sensitive data
>
> Simple, have your app encrypt the field prior to writing to HDFS.
>
> Also consider HBase.
>
> On Feb 14, 2013, at 10:35 AM, abhishek <ab...@gmail.com> wrote:
>
> >
> >> Hi all,
> >>
> >> we are having some sensitive data, in some particular fields(columns). Can I know how to handle sensitive in Hadoop.
> >>
> >> How do different people handle sensitive data in Hadoop.
> >>
> >> Thanks
> >> Abhi
> >
>
> Michael Segel | (m) 312.755.9623
>
> Segel and Associates
>
>
>
>
>
> --
> Marcos Ortiz Valmaseda,
> Product Manager && Data Scientist at UCI
> Blog: http://marcosluis2186.posterous.com
> LinkedIn: http://www.linkedin.com/in/marcosluis2186
> Twitter: @marcosluis2186
Re: How to handle sensitive data
Posted by Marcos Ortiz Valmaseda <ml...@uci.cu>.
Regards, abhishek.
I´m agree with Michael. You can encrypt your incoming data from your application.
I recommend to use HBase too.
----- Mensaje original -----
De: "Michael Segel" <mi...@hotmail.com>
Para: common-user@hadoop.apache.org
CC: cdh-user@cloudera.org
Enviados: Viernes, 15 de Febrero 2013 8:47:16
Asunto: Re: How to handle sensitive data
Simple, have your app encrypt the field prior to writing to HDFS.
Also consider HBase.
On Feb 14, 2013, at 10:35 AM, abhishek <ab...@gmail.com> wrote:
>
>> Hi all,
>>
>> we are having some sensitive data, in some particular fields(columns). Can I know how to handle sensitive in Hadoop.
>>
>> How do different people handle sensitive data in Hadoop.
>>
>> Thanks
>> Abhi
>
Michael Segel | (m) 312.755.9623
Segel and Associates
--
Marcos Ortiz Valmaseda,
Product Manager && Data Scientist at UCI
Blog : http://marcosluis2186.posterous.com
LinkedIn: http://www.linkedin.com/in/marcosluis2186
Twitter : @marcosluis2186
Re: How to handle sensitive data
Posted by Michael Segel <mi...@hotmail.com>.
Simple, have your app encrypt the field prior to writing to HDFS.
Also consider HBase.
On Feb 14, 2013, at 10:35 AM, abhishek <ab...@gmail.com> wrote:
>
>> Hi all,
>>
>> we are having some sensitive data, in some particular fields(columns). Can I know how to handle sensitive in Hadoop.
>>
>> How do different people handle sensitive data in Hadoop.
>>
>> Thanks
>> Abhi
>
Michael Segel | (m) 312.755.9623
Segel and Associates