ColumnFamilyOutputFormat?

[Utku Can Topçu <ut...@topcu.gen.tr>]

Hey All,

I've been looking at the documentation and related articles about Cassandra
and Hadoop integration, I'm only seeing ColumnFamilyInputFormat for now.
What if I want to write directly to cassandra after a reduce?

What comes to my mind is, in the Reducer's setup I'd initialize a Cassandra
client so that rather than emitting the results to the MR framework, it
would be possible to output them to the Cassandra in a simple way.

Can you think of any other high level solutions like an OutputFormat or so?

Best Regards,
Utku

Re: ColumnFamilyOutputFormat?

[Johan Oskarsson <jo...@oskarsson.nu>]

I wrote this CassandraOutputFormat last year. It is most likely not working against newer/current versions of Cassandra, but if you want something to work with it can be used as a starting point.

http://github.com/johanoskarsson/cassandraoutputformat

/Johan

On 30 apr 2010, at 14.14, Utku Can Topçu wrote:

> Hey All,
> 
> I've been looking at the documentation and related articles about Cassandra and Hadoop integration, I'm only seeing ColumnFamilyInputFormat for now.
> What if I want to write directly to cassandra after a reduce?
> 
> What comes to my mind is, in the Reducer's setup I'd initialize a Cassandra client so that rather than emitting the results to the MR framework, it would be possible to output them to the Cassandra in a simple way.
> 
> Can you think of any other high level solutions like an OutputFormat or so?
> 
> Best Regards,
> Utku

Re: ColumnFamilyOutputFormat?

[Jonathan Ellis <jb...@gmail.com>]

On Fri, Apr 30, 2010 at 7:14 AM, Utku Can Topçu <ut...@topcu.gen.tr> wrote:
> Hey All,
>
> I've been looking at the documentation and related articles about Cassandra
> and Hadoop integration, I'm only seeing ColumnFamilyInputFormat for now.
> What if I want to write directly to cassandra after a reduce?

Then you just do it normally.  There's no real need for an OutputFormat.

-- 
Jonathan Ellis
Project Chair, Apache Cassandra
co-founder of Riptano, the source for professional Cassandra support
http://riptano.com