You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@streampipes.apache.org by "Patrick Wiener (Jira)" <ji...@apache.org> on 2020/07/20 06:01:00 UTC

[jira] [Resolved] (STREAMPIPES-179) Cannot start multiple instances of processor

     [ https://issues.apache.org/jira/browse/STREAMPIPES-179?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Patrick Wiener resolved STREAMPIPES-179.
----------------------------------------
    Resolution: Fixed

set Kafka consumer *group.id* when calling __init__()

> Cannot start multiple instances of processor
> --------------------------------------------
>
>                 Key: STREAMPIPES-179
>                 URL: https://issues.apache.org/jira/browse/STREAMPIPES-179
>             Project: StreamPipes
>          Issue Type: Sub-task
>          Components: Pipeline Elements
>            Reporter: Patrick Wiener
>            Assignee: Patrick Wiener
>            Priority: Major
>
> There is bug with starting multiple instances of the same processor. The problem is that we assign a static Kafka consumer *group.id* in the default consumer dict. This is should be unique over all instances.
>  
> {code:python}
>     _DEFAULT_KAFKA_CONSUMER_CONFIG = {        'bootstrap.servers': 'kafka:9092',        'enable.auto.commit': True,        'auto.commit.interval.ms': 10000,        'session.timeout.ms': 30000,        'fetch.max.bytes': 5000012,        'auto.offset.reset': 'latest',        'group.id': 'streampipes_python_' + str(uuid.uuid4()),    }
> {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)