Applying DataMining on Network Packets

[Sarath P R <sa...@gmail.com>]

I am monitoring packet flow in a Network Interface .  Now i want to make
some predictions. Actually i am not sure about what algorithm i should use
and what kind of predictions i may need. I just want to know is it possible
to classify network packets using Mahout Classification algorithm. Can
anyone make some comments. Thanks in advance

-- 
Thank You
Sarath P Ramachandran
+91 99 95 02 4287

Re: Applying DataMining on Network Packets

[Isabel Drost <is...@apache.org>]

Sorry - sent too early - missing information below.


On 04.10.2011 Isabel Drost wrote:
> On 04.10.2011 Sarath P R wrote:
> A really nice explanation of this concept is explained in the Mahout in
> Action book. You can also take a quick look at the following slides for a
> general outline:

<https://github.com/MaineC/aim3-tu-
berlin/blob/master/slides/03_dataPreparation.odp>


Another starting point with information on what can be done with machine 
learning in the area of network monitoring/ intrusion detection and malware 
detection that might help: 

> http://www.user.tu-berlin.de/konrad.rieck/pubs.html

Isabel

Re: Applying DataMining on Network Packets

[Sarath P R <sa...@gmail.com>]

Thank You Isabel. I think you have said it. I have to find out features and
create vectors.

On Tue, Oct 4, 2011 at 12:16 PM, Isabel Drost <is...@apache.org> wrote:

> On 04.10.2011 Sarath P R wrote:
> > I am monitoring packet flow in a Network Interface .  Now i want to make
> > some predictions.
>
> What kind of prediction do you want to make?
>
>
> > Actually i am not sure about what algorithm i should use
> > and what kind of predictions i may need. I just want to know is it
> possible
> > to classify network packets using Mahout Classification algorithm. Can
> > anyone make some comments.
>
> The classification algorithms of Mahout are based on the idea of
> classifying
> items that have to be represented as multidimensional vectors and as a
> result
> are not bound to be used for just one domain.
>
> Put more simply: First think of what kinds of predictions you want to make.
> Then
> think of features that contain information on which prediction is more
> likely.
> Code these features as vectors and continue from there.
>
> A really nice explanation of this concept is explained in the Mahout in
> Action
> book. You can also take a quick look at the following slides for a general
> outline:
>
>
> http://www.user.tu-berlin.de/konrad.rieck/pubs.html
>



-- 
Thank You
Sarath P Ramachandran
+91 99 95 02 4287

Re: Applying DataMining on Network Packets

[Isabel Drost <is...@apache.org>]

On 04.10.2011 Sarath P R wrote:
> I am monitoring packet flow in a Network Interface .  Now i want to make
> some predictions.

What kind of prediction do you want to make?


> Actually i am not sure about what algorithm i should use
> and what kind of predictions i may need. I just want to know is it possible
> to classify network packets using Mahout Classification algorithm. Can
> anyone make some comments.

The classification algorithms of Mahout are based on the idea of classifying 
items that have to be represented as multidimensional vectors and as a result 
are not bound to be used for just one domain.

Put more simply: First think of what kinds of predictions you want to make. Then 
think of features that contain information on which prediction is more likely. 
Code these features as vectors and continue from there.

A really nice explanation of this concept is explained in the Mahout in Action 
book. You can also take a quick look at the following slides for a general 
outline:


http://www.user.tu-berlin.de/konrad.rieck/pubs.html

Re: Applying DataMining on Network Packets

[JAGANADH G <ja...@gmail.com>]

On Tue, Oct 4, 2011 at 9:51 AM, Sarath P R <sa...@gmail.com> wrote:

> I am monitoring packet flow in a Network Interface .  Now i want to make
> some predictions. Actually i am not sure about what algorithm i should use
> and what kind of predictions i may need. I just want to know is it possible
> to classify network packets using Mahout Classification algorithm. Can
> anyone make some comments. Thanks in advance
>
>


Hi
I think you need to look some un-supervised algos for prediction .
-- 
**********************************
JAGANADH G
http://jaganadhg.freeflux.net/blog
*ILUGCBE*
http://ilugcbe.techstud.org