You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Deepak Subhramanian <de...@gmail.com> on 2013/10/02 22:25:20 UTC
Extending HTTPHandler in Flume
Hi ,
Has anyone extended HTTPHandler in Flume . I am trying to add an extension
to recieve xml documents and convert it to Avro. Appreciate any inputs
Thanks,
Deepak Subhramanian
Re: Extending HTTPHandler in Flume
Posted by Deepak Subhramanian <de...@gmail.com>.
Sorry. I missed out that information finally found the info on internet.
Thanks for pointing it out.
On Thu, Oct 3, 2013 at 9:33 PM, Hari Shreedharan
<hs...@cloudera.com>wrote:
> Deepak,
>
> That info is there in the Flume User Guide:
> http://flume.apache.org/FlumeUserGuide.html#installing-third-party-plugins
>
>
> Thanks,
> Hari
>
> On Thursday, October 3, 2013 at 6:26 AM, Deepak Subhramanian wrote:
>
> Thanks Dave. I got it done extended. I struggled for sometime since I put
> the jar in the wrong directory. It will be good to have the documentation
> updated with this information.
>
> For the Source to pick up the new java class , the jar needs to be in the
> plugins.d/<flumesrcname>/lib directory. I put directly in the plugins.d
> directory.
>
>
> On Thu, Oct 3, 2013 at 2:06 PM, David Sinclair <
> dsinclair@chariotsolutions.com> wrote:
>
> Hi Deepak,
>
> You just need to provide an implementation of the HTTPSourceHandler
> interface and set the *handler* to the fully qualified class name of your
> class. Additional parameters will be given to your handle on the configure
> method. The properties will be anything that starts with *handler.*.*
> *
> *
> hope that helps,
>
> dave
>
>
> On Wed, Oct 2, 2013 at 4:25 PM, Deepak Subhramanian <
> deepak.subhramanian@gmail.com> wrote:
>
> Hi ,
>
> Has anyone extended HTTPHandler in Flume . I am trying to add an
> extension to recieve xml documents and convert it to Avro. Appreciate any
> inputs
>
> Thanks,
> Deepak Subhramanian
>
>
>
>
>
> --
> Deepak Subhramanian
>
>
>
--
Deepak Subhramanian
Re: Extending HTTPHandler in Flume
Posted by Hari Shreedharan <hs...@cloudera.com>.
Deepak,
That info is there in the Flume User Guide: http://flume.apache.org/FlumeUserGuide.html#installing-third-party-plugins
Thanks,
Hari
On Thursday, October 3, 2013 at 6:26 AM, Deepak Subhramanian wrote:
> Thanks Dave. I got it done extended. I struggled for sometime since I put the jar in the wrong directory. It will be good to have the documentation updated with this information.
>
> For the Source to pick up the new java class , the jar needs to be in the plugins.d/<flumesrcname>/lib directory. I put directly in the plugins.d directory.
>
>
> On Thu, Oct 3, 2013 at 2:06 PM, David Sinclair <dsinclair@chariotsolutions.com (mailto:dsinclair@chariotsolutions.com)> wrote:
> > Hi Deepak,
> >
> > You just need to provide an implementation of the HTTPSourceHandler interface and set the handler to the fully qualified class name of your class. Additional parameters will be given to your handle on the configure method. The properties will be anything that starts with handler.*.
> >
> > hope that helps,
> >
> > dave
> >
> >
> > On Wed, Oct 2, 2013 at 4:25 PM, Deepak Subhramanian <deepak.subhramanian@gmail.com (mailto:deepak.subhramanian@gmail.com)> wrote:
> > > Hi ,
> > >
> > > Has anyone extended HTTPHandler in Flume . I am trying to add an extension to recieve xml documents and convert it to Avro. Appreciate any inputs
> > >
> > > Thanks, Deepak Subhramanian
>
>
>
> --
> Deepak Subhramanian
Re: Extending HTTPHandler in Flume
Posted by Deepak Subhramanian <de...@gmail.com>.
Thanks Dave. I got it done extended. I struggled for sometime since I put
the jar in the wrong directory. It will be good to have the documentation
updated with this information.
For the Source to pick up the new java class , the jar needs to be in the
plugins.d/<flumesrcname>/lib directory. I put directly in the plugins.d
directory.
On Thu, Oct 3, 2013 at 2:06 PM, David Sinclair <
dsinclair@chariotsolutions.com> wrote:
> Hi Deepak,
>
> You just need to provide an implementation of the HTTPSourceHandler
> interface and set the *handler* to the fully qualified class name of your
> class. Additional parameters will be given to your handle on the configure
> method. The properties will be anything that starts with *handler.*.*
> *
> *
> hope that helps,
>
> dave
>
>
> On Wed, Oct 2, 2013 at 4:25 PM, Deepak Subhramanian <
> deepak.subhramanian@gmail.com> wrote:
>
>> Hi ,
>>
>> Has anyone extended HTTPHandler in Flume . I am trying to add an
>> extension to recieve xml documents and convert it to Avro. Appreciate any
>> inputs
>>
>> Thanks,
>> Deepak Subhramanian
>>
>
>
--
Deepak Subhramanian
Re: Extending HTTPHandler in Flume
Posted by David Sinclair <ds...@chariotsolutions.com>.
Hi Deepak,
You just need to provide an implementation of the HTTPSourceHandler
interface and set the *handler* to the fully qualified class name of your
class. Additional parameters will be given to your handle on the configure
method. The properties will be anything that starts with *handler.*.*
*
*
hope that helps,
dave
On Wed, Oct 2, 2013 at 4:25 PM, Deepak Subhramanian <
deepak.subhramanian@gmail.com> wrote:
> Hi ,
>
> Has anyone extended HTTPHandler in Flume . I am trying to add an
> extension to recieve xml documents and convert it to Avro. Appreciate any
> inputs
>
> Thanks,
> Deepak Subhramanian
>