New Configuration package

[Hari Shreedharan <hs...@cloudera.com>]

Hi guys, 

I have created a patch which basically moves much of the configuration of Flume's core components out into a separate maven submodule, which is independent of Flume itself. I will add support for the other sinks and channels, like jdbc, hdfs too. I am pretty sure this will need a few iterations before we can finalize the implementation. This would allow validation of the configuration files for known class types without dependance on Flume-core package itself, since it is likely that configurations will be deployed onto all Flume agents from only a handful of hosts.

The review is here: https://reviews.apache.org/r/4115/ 

Thanks,
Hari
-- 
Hari Shreedharan

Re: New Configuration package

[Eric Sammer <es...@cloudera.com>]

I haven't looked at the patch yet but I see us breaking a lot of
things out into separate modules. Please be 100% sure this doesn't
create any circular dependencies between modules. Also, let's make
sure we have damn good reasons for doing this.

Thanks.

On Feb 29, 2012, at 8:19 PM, Hari Shreedharan <hs...@cloudera.com> wrote:

> Nope. I had forked my branch more than a day ago and didn't pull since then. I will rebase the batch once I get some feedback. I actually moved Context to a new package, so there will be some more changes to make.
>
> Thanks
> Hari
>
> --
> Hari Shreedharan
>
>
> On Wednesday, February 29, 2012 at 7:53 PM, Brock Noland wrote:
>
>> Hi,
>>
>> I don't have time at the moment for a proper review, but it doesn't
>> look like the recently checked in Context changes did not make it to
>> the new Context?
>>
>> Brock
>

Re: New Configuration package

[Hari Shreedharan <hs...@cloudera.com>]

Nope. I had forked my branch more than a day ago and didn't pull since then. I will rebase the batch once I get some feedback. I actually moved Context to a new package, so there will be some more changes to make. 

Thanks
Hari

-- 
Hari Shreedharan


On Wednesday, February 29, 2012 at 7:53 PM, Brock Noland wrote:

> Hi,
> 
> I don't have time at the moment for a proper review, but it doesn't
> look like the recently checked in Context changes did not make it to
> the new Context?
> 
> Brock

Re: New Configuration package

[Brock Noland <br...@cloudera.com>]

Hi,

I don't have time at the moment for a proper review, but it doesn't
look like the recently checked in Context changes did not make it to
the new Context?

Brock

On Thu, Mar 1, 2012 at 8:02 AM, Hari Shreedharan
<hs...@cloudera.com> wrote:
> Hi guys,
>
> I have created a patch which basically moves much of the configuration of Flume's core components out into a separate maven submodule, which is independent of Flume itself. I will add support for the other sinks and channels, like jdbc, hdfs too. I am pretty sure this will need a few iterations before we can finalize the implementation. This would allow validation of the configuration files for known class types without dependance on Flume-core package itself, since it is likely that configurations will be deployed onto all Flume agents from only a handful of hosts.
>
> The review is here: https://reviews.apache.org/r/4115/
>
> Thanks,
> Hari
> --
> Hari Shreedharan
>



-- 
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/