You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@kafka.apache.org by Srinivasa Balaji <sr...@trimble.com> on 2018/03/02 04:58:10 UTC
Burrow V3 - going down with memory issues
We are running burrow version3 for kafka consumer lag monitoring,
Issue is burrow service is getting down frequently which is every 1hr,
Command used to start the burrow service
# nohup $GOPATH/bin/Burrow --config-dir /opt/work/src/github.com/
linkedin/Burrow/config 1>&2 &
We are seeing the below mentioned error in log
<SNIP>
panic: interface conversion: interface {} is nil, not *storage.brokerOffset
goroutine 85 [running]:
github.com/linkedin/Burrow/core/internal/storage.(*
InMemoryStorage).fetchTopic(0xc4201d65a0, 0xc42100b8f0, 0xc42034d800)
/opt/work/src/github.com/linkedin/Burrow/core/internal/
storage/inmemory.go:611 +0x3c8
github.com/linkedin/Burrow/core/internal/storage.(*
InMemoryStorage).(github.com/linkedin/Burrow/core/internal/
storage.fetchTopic)-fm(0xc42100b8f0, 0xc42034d800)
/opt/work/src/github.com/linkedin/Burrow/core/internal/
storage/inmemory.go:182 +0x3e
github.com/linkedin/Burrow/core/internal/storage.(*InMemoryStorage).
requestWorker(0xc4201d65a0, 0x11, 0xc4201d4900)
/opt/work/src/github.com/linkedin/Burrow/core/internal/
storage/inmemory.go:190 +0x105b
created by github.com/linkedin/Burrow/core/internal/storage.(*
InMemoryStorage).Start
/opt/work/src/github.com/linkedin/Burrow/core/internal/
storage/inmemory.go:144 +0x28b
</SNIP>
Kindly let us know your thoughts on this to fix it.
———————————————-
<http://www.trimble.com/>
Srinivasa Balaji L
Principal Architect Cloud & DevOPS - TPaaS
10368, Westmoor Drive, Westminster, CO 80021
*M*: +1(303) 324-9822 <+919790804422>
*Email*: lsbalaji@trimble.com
Re: Burrow V3 - going down with memory issues
Posted by Todd Palino <tp...@gmail.com>.
Hey, Srinivasa. It sounds like you’re running an intermediate version of
the master branch (I remember that specific error as I was making some
changes). It should be resolved with the latest version of master. Can you
try pulling the latest master?
We’ll be cutting a new release version soon, as there have been a number of
changes and updates that are useful. In the meantime, you may find more
help if you post to our Gitter:
https://gitter.im/linkedin-Burrow/Lobby
-Todd
On Thu, Mar 1, 2018 at 11:58 PM, Srinivasa Balaji <
srinivasa_balaji@trimble.com> wrote:
> We are running burrow version3 for kafka consumer lag monitoring,
>
> Issue is burrow service is getting down frequently which is every 1hr,
>
> Command used to start the burrow service
>
> # nohup $GOPATH/bin/Burrow --config-dir /opt/work/src/github.com/
> linkedin/Burrow/config 1>&2 &
>
> We are seeing the below mentioned error in log
>
> <SNIP>
>
> panic: interface conversion: interface {} is nil, not *storage.brokerOffset
>
> goroutine 85 [running]:
> github.com/linkedin/Burrow/core/internal/storage.(*
> InMemoryStorage).fetchTopic(0xc4201d65a0, 0xc42100b8f0, 0xc42034d800)
> /opt/work/src/github.com/linkedin/Burrow/core/internal/
> storage/inmemory.go:611 +0x3c8
> github.com/linkedin/Burrow/core/internal/storage.(*
> InMemoryStorage).(github.com/linkedin/Burrow/core/internal/
> storage.fetchTopic)-fm(0xc42100b8f0, 0xc42034d800)
> /opt/work/src/github.com/linkedin/Burrow/core/internal/
> storage/inmemory.go:182 +0x3e
> github.com/linkedin/Burrow/core/internal/storage.(*InMemoryStorage).
> requestWorker(0xc4201d65a0, 0x11, 0xc4201d4900)
> /opt/work/src/github.com/linkedin/Burrow/core/internal/
> storage/inmemory.go:190 +0x105b
> created by github.com/linkedin/Burrow/core/internal/storage.(*
> InMemoryStorage).Start
> /opt/work/src/github.com/linkedin/Burrow/core/internal/
> storage/inmemory.go:144 +0x28b
>
>
> </SNIP>
>
>
> Kindly let us know your thoughts on this to fix it.
>
> ———————————————-
> <http://www.trimble.com/>
> Srinivasa Balaji L
> Principal Architect Cloud & DevOPS - TPaaS
> 10368, Westmoor Drive, Westminster, CO 80021
> *M*: +1(303) 324-9822 <+919790804422>
> *Email*: lsbalaji@trimble.com
>
--
*Todd Palino*
Senior Staff Engineer, Site Reliability
Data Infrastructure Streaming
linkedin.com/in/toddpalino