You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@metron.apache.org by Hema malini <nh...@gmail.com> on 2019/12/10 14:40:36 UTC
How can i send batch of data to MaaS
Hi,
Is there any way to pass a batch of data to Metron MaaS. We have some
models like LSTM, which requires data to be aggregated and passed to model
.Can you please suggest whether is it possible.
Thanks and Regards,
Hema
Re: How can i send batch of data to MaaS
Posted by Hema malini <nh...@gmail.com>.
Thanks Simon..will explore Metron profiler
On Tue, 10 Dec, 2019, 9:00 PM Simon Elliston Ball, <
simon@simonellistonball.com> wrote:
> If you’re looking to send sequences to an LSTM model, you are probably
> looking for the profiler, which can assemble sequential features such as
> those that would go into an LSTM. You would then use the triage output
> method from the profiler to pass a stream of batches to MaaS.
>
> Simon
>
> On Tue, 10 Dec 2019 at 16:16, Hema malini <nh...@gmail.com> wrote:
>
>> Thanks Otto for the confirmation.
>>
>> On Tue, 10 Dec, 2019, 8:46 PM Otto Fowler, <ot...@gmail.com>
>> wrote:
>>
>>> As Metron is a streaming system, it doesn’t send batches as part of
>>> normal in flow operation. MAAS is called through stellar, which operates on
>>> a per message basis.
>>>
>>> The batching we *do* have is at the termination of the stream, at the
>>> indexing where we batch writes out of the pipeline. This won’t help you
>>> with stellar however.
>>>
>>>
>>>
>>>
>>> On December 10, 2019 at 09:39:27, Hema malini (nhemamalini11@gmail.com)
>>> wrote:
>>>
>>> Hi,
>>>
>>> Is there any way to pass a batch of data to Metron MaaS. We have some
>>> models like LSTM, which requires data to be aggregated and passed to model
>>> .Can you please suggest whether is it possible.
>>>
>>> Thanks and Regards,
>>> Hema
>>>
>>> --
> --
> simon elliston ball
> @sireb
>
Re: How can i send batch of data to MaaS
Posted by Simon Elliston Ball <si...@simonellistonball.com>.
If you’re looking to send sequences to an LSTM model, you are probably
looking for the profiler, which can assemble sequential features such as
those that would go into an LSTM. You would then use the triage output
method from the profiler to pass a stream of batches to MaaS.
Simon
On Tue, 10 Dec 2019 at 16:16, Hema malini <nh...@gmail.com> wrote:
> Thanks Otto for the confirmation.
>
> On Tue, 10 Dec, 2019, 8:46 PM Otto Fowler, <ot...@gmail.com>
> wrote:
>
>> As Metron is a streaming system, it doesn’t send batches as part of
>> normal in flow operation. MAAS is called through stellar, which operates on
>> a per message basis.
>>
>> The batching we *do* have is at the termination of the stream, at the
>> indexing where we batch writes out of the pipeline. This won’t help you
>> with stellar however.
>>
>>
>>
>>
>> On December 10, 2019 at 09:39:27, Hema malini (nhemamalini11@gmail.com)
>> wrote:
>>
>> Hi,
>>
>> Is there any way to pass a batch of data to Metron MaaS. We have some
>> models like LSTM, which requires data to be aggregated and passed to model
>> .Can you please suggest whether is it possible.
>>
>> Thanks and Regards,
>> Hema
>>
>> --
--
simon elliston ball
@sireb
Re: How can i send batch of data to MaaS
Posted by Hema malini <nh...@gmail.com>.
Thanks Otto for the confirmation.
On Tue, 10 Dec, 2019, 8:46 PM Otto Fowler, <ot...@gmail.com> wrote:
> As Metron is a streaming system, it doesn’t send batches as part of normal
> in flow operation. MAAS is called through stellar, which operates on a per
> message basis.
>
> The batching we *do* have is at the termination of the stream, at the
> indexing where we batch writes out of the pipeline. This won’t help you
> with stellar however.
>
>
>
>
> On December 10, 2019 at 09:39:27, Hema malini (nhemamalini11@gmail.com)
> wrote:
>
> Hi,
>
> Is there any way to pass a batch of data to Metron MaaS. We have some
> models like LSTM, which requires data to be aggregated and passed to model
> .Can you please suggest whether is it possible.
>
> Thanks and Regards,
> Hema
>
>
Re: How can i send batch of data to MaaS
Posted by Otto Fowler <ot...@gmail.com>.
As Metron is a streaming system, it doesn’t send batches as part of normal
in flow operation. MAAS is called through stellar, which operates on a per
message basis.
The batching we *do* have is at the termination of the stream, at the
indexing where we batch writes out of the pipeline. This won’t help you
with stellar however.
On December 10, 2019 at 09:39:27, Hema malini (nhemamalini11@gmail.com)
wrote:
Hi,
Is there any way to pass a batch of data to Metron MaaS. We have some
models like LSTM, which requires data to be aggregated and passed to model
.Can you please suggest whether is it possible.
Thanks and Regards,
Hema