You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by Jamaal Taylor <j....@gmail.com> on 2012/02/16 23:22:52 UTC
How do you create multiple outputs?
Hello, I am trying to figure out how to configure an oozie workflow so that
it creates multiple outputs. I've gotten my workflow to run when my job had
only one input and one output and a config file that I packaged with my jar
ex.
<name>mapred.input.dir</name>
<value>${inputDir}</value>
</property>
<property>
<name>mapred.output.dir</name>
<value>${outputDir}</value>
</property>
<property>
<name>processor.config.url</name>
<value>documenSplitJSon_contactinfo_bags.txt,documenSplitJSon_document_bags.txt</value>
</property>
<property>
<name>mapred.input.key.class</name>
<value>org.apache.hadoop.io.Text</value>
</property>
Now, I'm trying to figure out how to get the workflow to produce multiple
outputs. I know that you can configure M/R jobs to do this via the hadoop
api (
http://hadoop.apache.org/mapreduce/docs/r0.21.0/api/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.html)
but how can I do the same thing with a workflow
--
https://github.com/jjerrodtaylor
@interface you: Person{
NSString *name;
theChangeYouWantToSee *typeOfChange
}
-(theChangeYouWantToSee*)be;
@end
Re: How do you create multiple outputs?
Posted by Harsh J <ha...@cloudera.com>.
Jamaal,
You will have to configure your MR action to suit MultipleOutputs
usage. I've explained one way here
http://search-hadoop.com/m/gR0Vh2ve12V
On Fri, Feb 17, 2012 at 3:52 AM, Jamaal Taylor
<j....@gmail.com> wrote:
> Hello, I am trying to figure out how to configure an oozie workflow so that
> it creates multiple outputs. I've gotten my workflow to run when my job had
> only one input and one output and a config file that I packaged with my jar
> ex.
>
> <name>mapred.input.dir</name>
> <value>${inputDir}</value>
> </property>
> <property>
> <name>mapred.output.dir</name>
> <value>${outputDir}</value>
> </property>
> <property>
> <name>processor.config.url</name>
>
> <value>documenSplitJSon_contactinfo_bags.txt,documenSplitJSon_document_bags.txt</value>
> </property>
> <property>
> <name>mapred.input.key.class</name>
> <value>org.apache.hadoop.io.Text</value>
> </property>
>
> Now, I'm trying to figure out how to get the workflow to produce multiple
> outputs. I know that you can configure M/R jobs to do this via the hadoop
> api (
> http://hadoop.apache.org/mapreduce/docs/r0.21.0/api/org/apache/hadoop/mapreduce/lib/output/MultipleOutputs.html)
> but how can I do the same thing with a workflow
>
>
> --
> https://github.com/jjerrodtaylor
>
> @interface you: Person{
>
> NSString *name;
>
> theChangeYouWantToSee *typeOfChange
>
> }
>
> -(theChangeYouWantToSee*)be;
>
> @end
--
Harsh J
Customer Ops. Engineer
Cloudera | http://tiny.cloudera.com/about