You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by rajeev gupta <gr...@yahoo.com> on 2009/04/27 14:13:49 UTC
Database access in 0.18.3
I need to write output of reduce in database. There is support for this in 0.19 but I am using 0.18.3. Any suggestion?
I tried to process output myself in the reduce() function by writing some System.out.println; but it is writing output in userlogs corresponding to the map function (intermediate output).
-rajeev
Re: Database access in 0.18.3
Posted by Aaron Kimball <aa...@cloudera.com>.
Should also say, the link to CDH is http://www.cloudera.com/hadoop
- Aaron
On Tue, Apr 28, 2009 at 5:06 PM, Aaron Kimball <aa...@cloudera.com> wrote:
> Cloudera's Distribution for Hadoop is based on Hadoop 0.18.3 but includes a
> backport of HADOOP-2536. You could switch to this distribution instead.
> Otherwise, download the 18-branch patch from issue HADOOP-2536 (
> http://issues.apache.org/jira/browse/hadoop-2536) and apply it to your
> local copy and recompile.
>
> System.out.println() (and System.err) are writen to separate files for each
> map and reduce task on each machine; there is not a common console.
> - Aaron
>
>
>
> On Mon, Apr 27, 2009 at 9:13 PM, rajeev gupta <gr...@yahoo.com> wrote:
>
>>
>> I need to write output of reduce in database. There is support for this in
>> 0.19 but I am using 0.18.3. Any suggestion?
>>
>> I tried to process output myself in the reduce() function by writing some
>> System.out.println; but it is writing output in userlogs corresponding to
>> the map function (intermediate output).
>>
>> -rajeev
>>
>>
>>
>>
>>
>
Re: Database access in 0.18.3
Posted by Aaron Kimball <aa...@cloudera.com>.
Cloudera's Distribution for Hadoop is based on Hadoop 0.18.3 but includes a
backport of HADOOP-2536. You could switch to this distribution instead.
Otherwise, download the 18-branch patch from issue HADOOP-2536 (
http://issues.apache.org/jira/browse/hadoop-2536) and apply it to your local
copy and recompile.
System.out.println() (and System.err) are writen to separate files for each
map and reduce task on each machine; there is not a common console.
- Aaron
On Mon, Apr 27, 2009 at 9:13 PM, rajeev gupta <gr...@yahoo.com> wrote:
>
> I need to write output of reduce in database. There is support for this in
> 0.19 but I am using 0.18.3. Any suggestion?
>
> I tried to process output myself in the reduce() function by writing some
> System.out.println; but it is writing output in userlogs corresponding to
> the map function (intermediate output).
>
> -rajeev
>
>
>
>
>