You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by "J.R. Pauley" <jr...@gmail.com> on 2017/07/07 11:42:49 UTC

access-drpc-logs full of ThriftAccessLogger logs

the DRPC logs are overrun by gigs of following:

ThriftAccessLogger [INFO] Request ID: 3 access from:  principal:
 operation: fetchRequest

DRPC working fine otherwise. Is there some missing config I need to specify
to control thrift?

using storm 1.0.2
storm.yaml:

 storm.zookeeper.servers:
     - "127.0.0.1"
#     - "server2"
#
 nimbus.seeds: ["127.0.0.1"]
 drpc.servers:
#    -  "127.0.0.1"
    -  "10.78.17.219"

 drpc.http.port: 8087

Re: access-drpc-logs full of ThriftAccessLogger logs

Posted by Bobby Evans <ev...@yahoo-inc.com>.
Yes I have fixed it in master as a part of https://github.com/apache/storm/pull/2183.  The issue is that we were using a generic class for access logging in thrift, but each spout will poll the DRPC server up to 1000 times a second.  I updated the access log to only be triggered if something is returned by the poll request.


- Bobby


On Friday, July 7, 2017, 6:42:56 AM CDT, J.R. Pauley <jr...@gmail.com> wrote:

the DRPC logs are overrun by gigs of following:
ThriftAccessLogger [INFO] Request ID: 3 access from:  principal:  operation: fetchRequest

DRPC working fine otherwise. Is there some missing config I need to specify to control thrift?
using storm 1.0.2storm.yaml:
 storm.zookeeper.servers:     - "127.0.0.1"#     - "server2"#  nimbus.seeds: ["127.0.0.1"] drpc.servers:#    -  "127.0.0.1"    -  "10.78.17.219"
 drpc.http.port: 8087