You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Otis Gospodnetic <ot...@gmail.com> on 2014/12/05 17:08:45 UTC
Flume for JavaScript / NodeJS ?
Hi,
Perhaps a bit of a strange question here, but does anyone know of anything
Flume-like for NodeJS?
Specifically, I'd love to find/reuse something that acts like Flume's
Spillover Channel (combines MemoryChannel and FileChannel), but in
JavaScript land, so I can use it from NodeJS.
Any pointers would be greatly appreciated.
Thanks,
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
Re: Flume for JavaScript / NodeJS ?
Posted by Otis Gospodnetic <ot...@gmail.com>.
Hi Ahmed,
Thanks, although this doesn't really deal with what I'd really like to find
in order not to reinvent, which is the in-memory buffer combined with
on-disk fallback, with ability to define limits for each, and ship events
from there to arbitrary destinations/sinks. Googling didn't reveal
anything like it existing in the JS / NodeJS world, yet, so I was hoping
somebody in the Flume user community knows of any JS projects out there
that have MemoryChannel+FileChannel like logic.
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Fri, Dec 5, 2014 at 11:14 AM, Ahmed Vila <av...@devlogic.eu> wrote:
> Hi Otis,
>
> There are couple implementations of Avro for NodeJS, so you can use it to
> pass events to AvroSource in Flume.
> I haven't took a look at those implementations, so you'll need to check
> out their maturity.
>
> On Fri, Dec 5, 2014 at 5:08 PM, Otis Gospodnetic <
> otis.gospodnetic@gmail.com> wrote:
>
>> Hi,
>>
>> Perhaps a bit of a strange question here, but does anyone know of
>> anything Flume-like for NodeJS?
>>
>> Specifically, I'd love to find/reuse something that acts like Flume's
>> Spillover Channel (combines MemoryChannel and FileChannel), but in
>> JavaScript land, so I can use it from NodeJS.
>>
>> Any pointers would be greatly appreciated.
>>
>> Thanks,
>> Otis
>> --
>> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
>> Solr & Elasticsearch Support * http://sematext.com/
>>
>>
>
>
> --
>
> Best regards,
> Ahmed Vila | Senior software developer
> DevLogic | Sarajevo | Bosnia and Herzegovina
>
> Office : +387 33 942 123
> Mobile: +387 62 139 348
>
> Website: www.devlogic.eu
> E-mail : avila@devlogic.eu
> ---------------------------------------------------------------------
> This e-mail and any attachment is for authorised use by the intended
> recipient(s) only. This email contains confidential information. It should
> not be copied, disclosed to, retained or used by, any party other than the
> intended recipient. Any unauthorised distribution, dissemination or copying
> of this E-mail or its attachments, and/or any use of any information
> contained in them, is strictly prohibited and may be illegal. If you are
> not an intended recipient then please promptly delete this e-mail and any
> attachment and all copies and inform the sender directly via email. Any
> emails that you send to us may be monitored by systems or persons other
> than the named communicant for the purposes of ascertaining whether the
> communication complies with the law and company policies.
>
> ---------------------------------------------------------------------
> This e-mail and any attachment is for authorised use by the intended
> recipient(s) only. This email contains confidential information. It should
> not be copied, disclosed to, retained or used by, any party other than the
> intended recipient. Any unauthorised distribution, dissemination or copying
> of this E-mail or its attachments, and/or any use of any information
> contained in them, is strictly prohibited and may be illegal. If you are
> not an intended recipient then please promptly delete this e-mail and any
> attachment and all copies and inform the sender directly via email. Any
> emails that you send to us may be monitored by systems or persons other
> than the named communicant for the purposes of ascertaining whether the
> communication complies with the law and company policies.
Re: Flume for JavaScript / NodeJS ?
Posted by Ahmed Vila <av...@devlogic.eu>.
Hi Otis,
There are couple implementations of Avro for NodeJS, so you can use it to
pass events to AvroSource in Flume.
I haven't took a look at those implementations, so you'll need to check out
their maturity.
On Fri, Dec 5, 2014 at 5:08 PM, Otis Gospodnetic <otis.gospodnetic@gmail.com
> wrote:
> Hi,
>
> Perhaps a bit of a strange question here, but does anyone know of anything
> Flume-like for NodeJS?
>
> Specifically, I'd love to find/reuse something that acts like Flume's
> Spillover Channel (combines MemoryChannel and FileChannel), but in
> JavaScript land, so I can use it from NodeJS.
>
> Any pointers would be greatly appreciated.
>
> Thanks,
> Otis
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>
--
Best regards,
Ahmed Vila | Senior software developer
DevLogic | Sarajevo | Bosnia and Herzegovina
Office : +387 33 942 123
Mobile: +387 62 139 348
Website: www.devlogic.eu
E-mail : avila@devlogic.eu
---------------------------------------------------------------------
This e-mail and any attachment is for authorised use by the intended
recipient(s) only. This email contains confidential information. It should
not be copied, disclosed to, retained or used by, any party other than the
intended recipient. Any unauthorised distribution, dissemination or copying
of this E-mail or its attachments, and/or any use of any information
contained in them, is strictly prohibited and may be illegal. If you are
not an intended recipient then please promptly delete this e-mail and any
attachment and all copies and inform the sender directly via email. Any
emails that you send to us may be monitored by systems or persons other
than the named communicant for the purposes of ascertaining whether the
communication complies with the law and company policies.
--
---------------------------------------------------------------------
This e-mail and any attachment is for authorised use by the intended
recipient(s) only. This email contains confidential information. It should
not be copied, disclosed to, retained or used by, any party other than the
intended recipient. Any unauthorised distribution, dissemination or copying
of this E-mail or its attachments, and/or any use of any information
contained in them, is strictly prohibited and may be illegal. If you are
not an intended recipient then please promptly delete this e-mail and any
attachment and all copies and inform the sender directly via email. Any
emails that you send to us may be monitored by systems or persons other
than the named communicant for the purposes of ascertaining whether the
communication complies with the law and company policies.