trevni support

[Joseph Adler <jo...@gmail.com>]

Does Crunch work with Trevni files right now? If not, is anyone else
interested in adding Trevni support?

-- Joe

Re: trevni support

[Joseph Adler <jo...@gmail.com>]

Old APIs.

However... Trevni is very, very similar to Avro, so it's likely that we
could reuse a lot of existing code


On Mon, Dec 17, 2012 at 12:24 PM, Josh Wills <jo...@gmail.com> wrote:

> I wrote Trevni Sources and Targets files as a test a couple of months ago,
> right when it first came out. I don't think we can putting it into Crunch
> core until Hadoop-2.0.x upgrades from Avro 1.5.4 to a version that includes
> Trevni support, but I would be glad to have it as a github module.
>
> Does Trevni MR support the new mapreduce.* APIs? I think it was still
> using mapred.* when I was playing around, which meant I had to roll my own
> to make it work with Crunch. If it does, the impl should be very simple.
>
> Josh
>
>
> On Mon, Dec 17, 2012 at 12:15 PM, Joseph Adler <jo...@gmail.com>wrote:
>
>> Does Crunch work with Trevni files right now? If not, is anyone else
>> interested in adding Trevni support?
>>
>> -- Joe
>>
>
>

Re: trevni support

[Josh Wills <jo...@gmail.com>]

I wrote Trevni Sources and Targets files as a test a couple of months ago,
right when it first came out. I don't think we can putting it into Crunch
core until Hadoop-2.0.x upgrades from Avro 1.5.4 to a version that includes
Trevni support, but I would be glad to have it as a github module.

Does Trevni MR support the new mapreduce.* APIs? I think it was still using
mapred.* when I was playing around, which meant I had to roll my own to
make it work with Crunch. If it does, the impl should be very simple.

Josh


On Mon, Dec 17, 2012 at 12:15 PM, Joseph Adler <jo...@gmail.com>wrote:

> Does Crunch work with Trevni files right now? If not, is anyone else
> interested in adding Trevni support?
>
> -- Joe
>