You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "seekerak (JIRA)" <ji...@apache.org> on 2015/10/04 20:32:26 UTC
[jira] [Created] (FLUME-2807) Add a simple split interceptor
seekerak created FLUME-2807:
-------------------------------
Summary: Add a simple split interceptor
Key: FLUME-2807
URL: https://issues.apache.org/jira/browse/FLUME-2807
Project: Flume
Issue Type: Improvement
Components: Sinks+Sources
Affects Versions: v1.6.0
Reporter: seekerak
Fix For: v1.6.0
a simple split interceptor , aims to deal with the situation as follows:
the source data like this:
“
1,tom,boy,13
2,lili,girl,14
3,jack,boy,10
...
”
and i hope to sink source data into two different hdfs directories named by boy and girl like this:
“
hdfs://xxxx/sink/boy/....
hdfs://xxxx/sink/girl/....
”
we can use this interceptor to accomplish this goal.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: [jira] [Created] (FLUME-2807) Add a simple split interceptor
Posted by IT CTO <go...@gmail.com>.
I think you can achive this with the Regex interceptor.
https://flume.apache.org/FlumeUserGuide.html
בתאריך יום א׳, 4 באוק׳ 2015, 21:32 מאת seekerak (JIRA) <ji...@apache.org>:
> seekerak created FLUME-2807:
> -------------------------------
>
> Summary: Add a simple split interceptor
> Key: FLUME-2807
> URL: https://issues.apache.org/jira/browse/FLUME-2807
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: v1.6.0
> Reporter: seekerak
> Fix For: v1.6.0
>
>
> a simple split interceptor , aims to deal with the situation as follows:
>
> the source data like this:
> “
> 1,tom,boy,13
> 2,lili,girl,14
> 3,jack,boy,10
> ...
> ”
> and i hope to sink source data into two different hdfs directories named
> by boy and girl like this:
> “
> hdfs://xxxx/sink/boy/....
> hdfs://xxxx/sink/girl/....
> ”
>
> we can use this interceptor to accomplish this goal.
>
>
>
> --
> This message was sent by Atlassian JIRA
> (v6.3.4#6332)
>
--
Eran | "You don't need eyes to see, you need vision" (Faithless)