You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@spot.apache.org by Cesar B <ce...@apache.org> on 2017/03/22 06:44:10 UTC
FW: [Collaboration proposal] - MafDet
Hello Guys!
I’m sharing Alejandro’s proposal for extended discussion, its worth for brainstorming, as this implementation is focused on OpenFlow, used broadly on SDN for communication between the controller and switches.
Part of the pathfinding job that serves as support of the code development and mentioned on the code repo can be found here:
http://ieeexplore.ieee.org/document/5735752/?reload=true
The noise patterns based on the findings from the paper can be caught definitely by ML, and specially if patterns present a volumetric behavior.
So lets get discussion rolling.
Thoughts?
Thanks,
Cesar
On March 16, 2017 at 12:21:19 PM, () wrote:
From: Alejandro Alcalde [mailto:algui91@gmail.com]
Sent: Wednesday, March 8, 2017 7:41 AM
Subject: [Collaboration proposal] - MafDet
Hi, I was developing a system very similar to yours, but only for detecting DDoS. I want to collaborate in Apache Spot, right now I am reading the documentation to learn how Spot works.
But since I've been developing my system for a few months, may be some of the code or ideas can be interesting to spot. The project is at https://github.com/algui91/MafDet
Basically it aims to detect DDoS using SDNs and the Ryu controller for collecting OpenFlow Statistics. That part is totally completed, what is left is The MachineLearning, I've planned to use SOM for the anomaly detection.
Let me know what you think.
Best regards
--
Alejandro Alcalde - elbauldelprogramador.com
My public key: https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B
Re: FW: [Collaboration proposal] - MafDet
Posted by Alejandro Alcalde <al...@gmail.com>.
Sorry, here it is:
https://drive.google.com/file/d/0Bxaeesule1PgVEw2UjhNUS00d1E/view?usp=sharing
On Fri, Mar 24, 2017 at 6:10 PM Mark Grover <ma...@apache.org> wrote:
> Yeah, I couldn't, nor do attachments work here - a public google drive or
> dropbox link may be best.
>
> On Fri, Mar 24, 2017 at 3:07 AM, Alejandro Alcalde <al...@gmail.com>
> wrote:
>
> > Hello all, maybe some of you don't have access to the paper, here it is:
> >
> > Regards
> >
> > On Wed, Mar 22, 2017 at 7:44 AM Cesar B <ce...@apache.org> wrote:
> >
> >> Hello Guys!
> >>
> >> I’m sharing Alejandro’s proposal for extended discussion, its worth for
> >> brainstorming, as this implementation is focused on OpenFlow, used
> broadly
> >> on SDN for communication between the controller and switches.
> >>
> >> Part of the pathfinding job that serves as support of the code
> >> development and mentioned on the code repo can be found here:
> >>
> >> http://ieeexplore.ieee.org/document/5735752/?reload=true
> >>
> >>
> >> The noise patterns based on the findings from the paper can be caught
> >> definitely by ML, and specially if patterns present a volumetric
> behavior.
> >>
> >> So lets get discussion rolling.
> >>
> >> Thoughts?
> >>
> >> Thanks,
> >> Cesar
> >> On March 16, 2017 at 12:21:19 PM, () wrote:
> >>
> >>
> >>
> >> From: Alejandro Alcalde [mailto:algui91@gmail.com]
> >> Sent: Wednesday, March 8, 2017 7:41 AM
> >> Subject: [Collaboration proposal] - MafDet
> >>
> >>
> >>
> >> Hi, I was developing a system very similar to yours, but only for
> >> detecting DDoS. I want to collaborate in Apache Spot, right now I am
> >> reading the documentation to learn how Spot works.
> >>
> >>
> >>
> >> But since I've been developing my system for a few months, may be some
> of
> >> the code or ideas can be interesting to spot. The project is at
> >> https://github.com/algui91/MafDet
> >>
> >>
> >>
> >> Basically it aims to detect DDoS using SDNs and the Ryu controller for
> >> collecting OpenFlow Statistics. That part is totally completed, what is
> >> left is The MachineLearning, I've planned to use SOM for the anomaly
> >> detection.
> >>
> >>
> >>
> >> Let me know what you think.
> >>
> >>
> >>
> >> Best regards
> >>
> >> --
> >>
> >> Alejandro Alcalde - elbauldelprogramador.com
> >>
> >>
> >>
> >> My public key: https://keyserver.ubuntu.com/pks/lookup?op=get&search=
> >> 0x333395FF3326824B
> >
> > --
> >
> > Alejandro Alcalde - elbauldelprogramador.com
> >
> >
> > My public key: https://keyserver.ubuntu.com/pks/lookup?op=get&search=
> > 0x333395FF3326824B
> >
>
--
Alejandro Alcalde - elbauldelprogramador.com
My public key:
https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B
Re: FW: [Collaboration proposal] - MafDet
Posted by Mark Grover <ma...@apache.org>.
Yeah, I couldn't, nor do attachments work here - a public google drive or
dropbox link may be best.
On Fri, Mar 24, 2017 at 3:07 AM, Alejandro Alcalde <al...@gmail.com>
wrote:
> Hello all, maybe some of you don't have access to the paper, here it is:
>
> Regards
>
> On Wed, Mar 22, 2017 at 7:44 AM Cesar B <ce...@apache.org> wrote:
>
>> Hello Guys!
>>
>> I’m sharing Alejandro’s proposal for extended discussion, its worth for
>> brainstorming, as this implementation is focused on OpenFlow, used broadly
>> on SDN for communication between the controller and switches.
>>
>> Part of the pathfinding job that serves as support of the code
>> development and mentioned on the code repo can be found here:
>>
>> http://ieeexplore.ieee.org/document/5735752/?reload=true
>>
>>
>> The noise patterns based on the findings from the paper can be caught
>> definitely by ML, and specially if patterns present a volumetric behavior.
>>
>> So lets get discussion rolling.
>>
>> Thoughts?
>>
>> Thanks,
>> Cesar
>> On March 16, 2017 at 12:21:19 PM, () wrote:
>>
>>
>>
>> From: Alejandro Alcalde [mailto:algui91@gmail.com]
>> Sent: Wednesday, March 8, 2017 7:41 AM
>> Subject: [Collaboration proposal] - MafDet
>>
>>
>>
>> Hi, I was developing a system very similar to yours, but only for
>> detecting DDoS. I want to collaborate in Apache Spot, right now I am
>> reading the documentation to learn how Spot works.
>>
>>
>>
>> But since I've been developing my system for a few months, may be some of
>> the code or ideas can be interesting to spot. The project is at
>> https://github.com/algui91/MafDet
>>
>>
>>
>> Basically it aims to detect DDoS using SDNs and the Ryu controller for
>> collecting OpenFlow Statistics. That part is totally completed, what is
>> left is The MachineLearning, I've planned to use SOM for the anomaly
>> detection.
>>
>>
>>
>> Let me know what you think.
>>
>>
>>
>> Best regards
>>
>> --
>>
>> Alejandro Alcalde - elbauldelprogramador.com
>>
>>
>>
>> My public key: https://keyserver.ubuntu.com/pks/lookup?op=get&search=
>> 0x333395FF3326824B
>
> --
>
> Alejandro Alcalde - elbauldelprogramador.com
>
>
> My public key: https://keyserver.ubuntu.com/pks/lookup?op=get&search=
> 0x333395FF3326824B
>
Re: FW: [Collaboration proposal] - MafDet
Posted by Alejandro Alcalde <al...@gmail.com>.
I do not think implementing from scratch is a good idea, when I was
developing that system, I found this SOM library:
https://github.com/ShokuninSan/som quoting the repo description:
a self organizing map for scala and spark
Best.
On Sat, Mar 25, 2017 at 4:07 PM Segerlind, Nathan L <
nathan.l.segerlind@intel.com> wrote:
> Are you proposing that we implement our own self-organizing maps or do you
> have an implementation in mind?
>
> I strongly prefer keeping the ML layer implementations in Spark/Scala if
> possible.
>
> From: Alejandro Alcalde [mailto:algui91@gmail.com]
> Sent: Friday, March 24, 2017 4:08 AM
> To: dev@spot.incubator.apache.org
> Subject: Re: FW: [Collaboration proposal] - MafDet
>
> Hello all, maybe some of you don't have access to the paper, here it is:
>
> Regards
>
> On Wed, Mar 22, 2017 at 7:44 AM Cesar B <cesar@apache.org<mailto:
> cesar@apache.org>> wrote:
> Hello Guys!
>
> I’m sharing Alejandro’s proposal for extended discussion, its worth for
> brainstorming, as this implementation is focused on OpenFlow, used broadly
> on SDN for communication between the controller and switches.
>
> Part of the pathfinding job that serves as support of the code development
> and mentioned on the code repo can be found here:
>
> http://ieeexplore.ieee.org/document/5735752/?reload=true
>
>
> The noise patterns based on the findings from the paper can be caught
> definitely by ML, and specially if patterns present a volumetric behavior.
>
> So lets get discussion rolling.
>
> Thoughts?
>
> Thanks,
> Cesar
> On March 16, 2017 at 12:21:19 PM, () wrote:
>
>
>
> From: Alejandro Alcalde [mailto:algui91@gmail.com<mailto:algui91@gmail.com
> >]
> Sent: Wednesday, March 8, 2017 7:41 AM
> Subject: [Collaboration proposal] - MafDet
>
>
>
> Hi, I was developing a system very similar to yours, but only for
> detecting DDoS. I want to collaborate in Apache Spot, right now I am
> reading the documentation to learn how Spot works.
>
>
>
> But since I've been developing my system for a few months, may be some of
> the code or ideas can be interesting to spot. The project is at
> https://github.com/algui91/MafDet
>
>
>
> Basically it aims to detect DDoS using SDNs and the Ryu controller for
> collecting OpenFlow Statistics. That part is totally completed, what is
> left is The MachineLearning, I've planned to use SOM for the anomaly
> detection.
>
>
>
> Let me know what you think.
>
>
>
> Best regards
>
> --
>
> Alejandro Alcalde - elbauldelprogramador.com<
> http://elbauldelprogramador.com>
>
>
>
> My public key:
> https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B
> --
>
> Alejandro Alcalde - elbauldelprogramador.com<
> http://elbauldelprogramador.com>
>
>
>
> My public key:
> https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B
>
--
Alejandro Alcalde - elbauldelprogramador.com
My public key:
https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B
RE: FW: [Collaboration proposal] - MafDet
Posted by "Segerlind, Nathan L" <na...@intel.com>.
Are you proposing that we implement our own self-organizing maps or do you have an implementation in mind?
I strongly prefer keeping the ML layer implementations in Spark/Scala if possible.
From: Alejandro Alcalde [mailto:algui91@gmail.com]
Sent: Friday, March 24, 2017 4:08 AM
To: dev@spot.incubator.apache.org
Subject: Re: FW: [Collaboration proposal] - MafDet
Hello all, maybe some of you don't have access to the paper, here it is:
Regards
On Wed, Mar 22, 2017 at 7:44 AM Cesar B <ce...@apache.org>> wrote:
Hello Guys!
I’m sharing Alejandro’s proposal for extended discussion, its worth for brainstorming, as this implementation is focused on OpenFlow, used broadly on SDN for communication between the controller and switches.
Part of the pathfinding job that serves as support of the code development and mentioned on the code repo can be found here:
http://ieeexplore.ieee.org/document/5735752/?reload=true
The noise patterns based on the findings from the paper can be caught definitely by ML, and specially if patterns present a volumetric behavior.
So lets get discussion rolling.
Thoughts?
Thanks,
Cesar
On March 16, 2017 at 12:21:19 PM, () wrote:
From: Alejandro Alcalde [mailto:algui91@gmail.com<ma...@gmail.com>]
Sent: Wednesday, March 8, 2017 7:41 AM
Subject: [Collaboration proposal] - MafDet
Hi, I was developing a system very similar to yours, but only for detecting DDoS. I want to collaborate in Apache Spot, right now I am reading the documentation to learn how Spot works.
But since I've been developing my system for a few months, may be some of the code or ideas can be interesting to spot. The project is at https://github.com/algui91/MafDet
Basically it aims to detect DDoS using SDNs and the Ryu controller for collecting OpenFlow Statistics. That part is totally completed, what is left is The MachineLearning, I've planned to use SOM for the anomaly detection.
Let me know what you think.
Best regards
--
Alejandro Alcalde - elbauldelprogramador.com<http://elbauldelprogramador.com>
My public key: https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B
--
Alejandro Alcalde - elbauldelprogramador.com<http://elbauldelprogramador.com>
My public key: https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B
Re: FW: [Collaboration proposal] - MafDet
Posted by Alejandro Alcalde <al...@gmail.com>.
Hello all, maybe some of you don't have access to the paper, here it is:
Regards
On Wed, Mar 22, 2017 at 7:44 AM Cesar B <ce...@apache.org> wrote:
> Hello Guys!
>
> I’m sharing Alejandro’s proposal for extended discussion, its worth for
> brainstorming, as this implementation is focused on OpenFlow, used broadly
> on SDN for communication between the controller and switches.
>
> Part of the pathfinding job that serves as support of the code development
> and mentioned on the code repo can be found here:
>
> http://ieeexplore.ieee.org/document/5735752/?reload=true
>
>
> The noise patterns based on the findings from the paper can be caught
> definitely by ML, and specially if patterns present a volumetric behavior.
>
> So lets get discussion rolling.
>
> Thoughts?
>
> Thanks,
> Cesar
> On March 16, 2017 at 12:21:19 PM, () wrote:
>
>
>
> From: Alejandro Alcalde [mailto:algui91@gmail.com]
> Sent: Wednesday, March 8, 2017 7:41 AM
> Subject: [Collaboration proposal] - MafDet
>
>
>
> Hi, I was developing a system very similar to yours, but only for
> detecting DDoS. I want to collaborate in Apache Spot, right now I am
> reading the documentation to learn how Spot works.
>
>
>
> But since I've been developing my system for a few months, may be some of
> the code or ideas can be interesting to spot. The project is at
> https://github.com/algui91/MafDet
>
>
>
> Basically it aims to detect DDoS using SDNs and the Ryu controller for
> collecting OpenFlow Statistics. That part is totally completed, what is
> left is The MachineLearning, I've planned to use SOM for the anomaly
> detection.
>
>
>
> Let me know what you think.
>
>
>
> Best regards
>
> --
>
> Alejandro Alcalde - elbauldelprogramador.com
>
>
>
> My public key:
> https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B
--
Alejandro Alcalde - elbauldelprogramador.com
My public key:
https://keyserver.ubuntu.com/pks/lookup?op=get&search=0x333395FF3326824B