You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by arekanderu <ar...@gmail.com> on 2010/10/10 23:16:30 UTC
encrypted data and mcrypt plugin
Hello,
I have a users mysql table and one of the columns is the email address of
the user. For security reasons all emails are kept encrypted (with the use
of mcrypt library) inside the database.
Unfortunately this creates a problem when solr indexes the user data. The
solution i can think of is to create a solr plugin/filter to decrypt the
email address before indexing but that kinda defeats the whole purpose of
the encryption in the first place.
The other thing i thought of is to encrypt the email before i submit it to
solr for querying but in that way i can only search for exact matches.
I am looking for any input on this and I am also willing to pay for the
development of a plugin which will handle the decryption of the email before
it gets indexed - if that's a good idea in the first place -.
Thank you for any replies
Re: encrypted data and mcrypt plugin
Posted by arekanderu <ar...@gmail.com>.
Thanks for the fast reply first of all. I will have a look at the
TokenFilter you mentioned but will it cover the asterisk case as well? Why
is it different from encrypting the email on client side and submitting to
solr (even though i get parser exceptions; apparently the string contains
illegal characters that they need to be escaped).
Regards,
Alex
On Mon, Oct 11, 2010 at 12:35 AM, Uwe Schindler <uw...@thetaphi.de> wrote:
> The idea would be to create an own TokenFilter that encrypt the email
> tokens. If you use this filter in addition to the other TokenFilter only for
> the query side, but not the indexing chain, you can easiliy do this. During
> indexing, the tokens are left unchanged (encrypted). On the search side, the
> user input for that field is automatically encrypted during tokenization and
> the index is searched for the encrypted email.
>
>
>
> -----
>
> Uwe Schindler
>
> H.-H.-Meier-Allee 63, D-28213 Bremen
>
> http://www.thetaphi.de
>
> eMail: uwe@thetaphi.de
>
>
>
> *From:* arekanderu [mailto:arekanderu@gmail.com]
> *Sent:* Sunday, October 10, 2010 5:17 PM
> *To:* dev@lucene.apache.org
> *Subject:* encrypted data and mcrypt plugin
>
>
>
> Hello,
>
> I have a users mysql table and one of the columns is the email address of
> the user. For security reasons all emails are kept encrypted (with the use
> of mcrypt library) inside the database.
>
> Unfortunately this creates a problem when solr indexes the user data. The
> solution i can think of is to create a solr plugin/filter to decrypt the
> email address before indexing but that kinda defeats the whole purpose of
> the encryption in the first place.
>
> The other thing i thought of is to encrypt the email before i submit it to
> solr for querying but in that way i can only search for exact matches.
>
> I am looking for any input on this and I am also willing to pay for the
> development of a plugin which will handle the decryption of the email before
> it gets indexed - if that's a good idea in the first place -.
>
> Thank you for any replies
>
RE: encrypted data and mcrypt plugin
Posted by Uwe Schindler <uw...@thetaphi.de>.
The idea would be to create an own TokenFilter that encrypt the email
tokens. If you use this filter in addition to the other TokenFilter only for
the query side, but not the indexing chain, you can easiliy do this. During
indexing, the tokens are left unchanged (encrypted). On the search side, the
user input for that field is automatically encrypted during tokenization and
the index is searched for the encrypted email.
-----
Uwe Schindler
H.-H.-Meier-Allee 63, D-28213 Bremen
http://www.thetaphi.de <http://www.thetaphi.de/>
eMail: uwe@thetaphi.de
From: arekanderu [mailto:arekanderu@gmail.com]
Sent: Sunday, October 10, 2010 5:17 PM
To: dev@lucene.apache.org
Subject: encrypted data and mcrypt plugin
Hello,
I have a users mysql table and one of the columns is the email address of
the user. For security reasons all emails are kept encrypted (with the use
of mcrypt library) inside the database.
Unfortunately this creates a problem when solr indexes the user data. The
solution i can think of is to create a solr plugin/filter to decrypt the
email address before indexing but that kinda defeats the whole purpose of
the encryption in the first place.
The other thing i thought of is to encrypt the email before i submit it to
solr for querying but in that way i can only search for exact matches.
I am looking for any input on this and I am also willing to pay for the
development of a plugin which will handle the decryption of the email before
it gets indexed - if that's a good idea in the first place -.
Thank you for any replies