You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Santosh Pingale <pi...@gmail.com> on 2017/04/07 14:04:56 UTC
Local Mode - Kafka Streamer unable to write data
Hi guys
I am running Ignite in local mode and trying to write data with the help of
Kafka Streamer but it turns out data is not put into the cache no matter
how you try to do it. On the other hand, cache.put works just fine. At
moment, I am doing cache.put with MultipleTupleExtractor, but that
completely misses the point of Streamer implementation. I am not sure whats
wrong.
Ignite version : 1.9.0
Minimal Configs:
grid.name = "triggers"
client.mode = false
discovery.addresses = "127.0.0.1"
cache mode = "LOCAL"
and other configurations like names and statistics.
Some help will be hugely appreciated.
Re: Local Mode - Kafka Streamer unable to write data
Posted by Santosh Pingale <pi...@gmail.com>.
Hi Andrey
Thanks for taking out some time to answer this. I will keep that in mind.
There was a silly mistake in the code. We also had a receiver on the cache
somewhere which did not put messages into the cache after processing.
Adding that put statement solved the issue.
On Mon, Apr 10, 2017 at 5:37 PM, Andrey Mashenkov <
andrey.mashenkov@gmail.com> wrote:
> Hi Santosh,
>
> KafkaStreamer has 10 seconds retry timeout. Try to reduce it.
> Please, share you config and sample code if it would not helpful.
>
>
> On Fri, Apr 7, 2017 at 5:12 PM, Santosh Pingale <pi...@gmail.com>
> wrote:
>
>> To add to this, I have set autoFlushFrequency to 10. This frequency is
>> really high. I also tried calling flush manually in the code. Nothing
>> happens.
>>
>> On Fri, Apr 7, 2017 at 4:04 PM, Santosh Pingale <pingalesantosh@gmail.com
>> > wrote:
>>
>>> Hi guys
>>>
>>> I am running Ignite in local mode and trying to write data with the help
>>> of Kafka Streamer but it turns out data is not put into the cache no matter
>>> how you try to do it. On the other hand, cache.put works just fine. At
>>> moment, I am doing cache.put with MultipleTupleExtractor, but that
>>> completely misses the point of Streamer implementation. I am not sure whats
>>> wrong.
>>>
>>> Ignite version : 1.9.0
>>> Minimal Configs:
>>> grid.name = "triggers"
>>> client.mode = false
>>> discovery.addresses = "127.0.0.1"
>>> cache mode = "LOCAL"
>>>
>>> and other configurations like names and statistics.
>>>
>>> Some help will be hugely appreciated.
>>>
>>
>>
>
>
> --
> Best regards,
> Andrey V. Mashenkov
>
Re: Local Mode - Kafka Streamer unable to write data
Posted by Andrey Mashenkov <an...@gmail.com>.
Hi Santosh,
KafkaStreamer has 10 seconds retry timeout. Try to reduce it.
Please, share you config and sample code if it would not helpful.
On Fri, Apr 7, 2017 at 5:12 PM, Santosh Pingale <pi...@gmail.com>
wrote:
> To add to this, I have set autoFlushFrequency to 10. This frequency is
> really high. I also tried calling flush manually in the code. Nothing
> happens.
>
> On Fri, Apr 7, 2017 at 4:04 PM, Santosh Pingale <pi...@gmail.com>
> wrote:
>
>> Hi guys
>>
>> I am running Ignite in local mode and trying to write data with the help
>> of Kafka Streamer but it turns out data is not put into the cache no matter
>> how you try to do it. On the other hand, cache.put works just fine. At
>> moment, I am doing cache.put with MultipleTupleExtractor, but that
>> completely misses the point of Streamer implementation. I am not sure whats
>> wrong.
>>
>> Ignite version : 1.9.0
>> Minimal Configs:
>> grid.name = "triggers"
>> client.mode = false
>> discovery.addresses = "127.0.0.1"
>> cache mode = "LOCAL"
>>
>> and other configurations like names and statistics.
>>
>> Some help will be hugely appreciated.
>>
>
>
--
Best regards,
Andrey V. Mashenkov
Re: Local Mode - Kafka Streamer unable to write data
Posted by Santosh Pingale <pi...@gmail.com>.
To add to this, I have set autoFlushFrequency to 10. This frequency is
really high. I also tried calling flush manually in the code. Nothing
happens.
On Fri, Apr 7, 2017 at 4:04 PM, Santosh Pingale <pi...@gmail.com>
wrote:
> Hi guys
>
> I am running Ignite in local mode and trying to write data with the help
> of Kafka Streamer but it turns out data is not put into the cache no matter
> how you try to do it. On the other hand, cache.put works just fine. At
> moment, I am doing cache.put with MultipleTupleExtractor, but that
> completely misses the point of Streamer implementation. I am not sure whats
> wrong.
>
> Ignite version : 1.9.0
> Minimal Configs:
> grid.name = "triggers"
> client.mode = false
> discovery.addresses = "127.0.0.1"
> cache mode = "LOCAL"
>
> and other configurations like names and statistics.
>
> Some help will be hugely appreciated.
>