You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@airavata.apache.org by "Lahiru Gunathilake (JIRA)" <ji...@apache.org> on 2016/08/29 14:20:20 UTC
[jira] [Resolved] (AIRAVATA-2068) Pump logs to kafka topic
[ https://issues.apache.org/jira/browse/AIRAVATA-2068?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lahiru Gunathilake resolved AIRAVATA-2068.
------------------------------------------
Resolution: Fixed
Kafka logging is turned off by default, following are the kafka properties need to configure.
# Kafka Logging related configuration
isRunningOnAws= false
kafka.broker.list= 54.8.14.132:9092
kafka.topic.prefix= local
enable.kafka.logging= true
If you setup a kafka cluster and listen to the topic airavata is pushing (Its created dynamically based on airavata role and kafka.topic.prefix configured) you'll see logs are published like this.
{"serverId":{"serverId":"192.168.0.14","hostName":"192.168.0.14","version":"airavata-0.16-128-g415e9b7","roles":["all"]},"message":"Reading configuration from: /Users/lahiru/iu/airavata/modules/distribution/target/apache-airavata-server-0.17-SNAPSHOT/bin/zoo.cfg","timestamp":"2016-08-29T14:13:35.185Z","level":"INFO","loggerName":"org.apache.zookeeper.server.quorum.QuorumPeerConfig","mdc":{},"threadName":"main"}
{"serverId":{"serverId":"192.168.0.14","hostName":"192.168.0.14","version":"airavata-0.16-128-g415e9b7","roles":["all"]},"message":"Airavata server instance starting...","timestamp":"2016-08-29T14:13:35.552Z","level":"INFO","loggerName":"org.apache.airavata.server.ServerMain","mdc":{},"threadName":"main"}
{"serverId":{"serverId":"192.168.0.14","hostName":"192.168.0.14","version":"airavata-0.16-128-g415e9b7","roles":["all"]},"message":"Server environment:zookeeper.version\u003d3.4.0-1202560, built on 11/16/2011 07:18 GMT","timestamp":"2016-08-29T14:13:35.592Z","level":"INFO","loggerName":"org.apache.zookeeper.server.ZooKeeperServer","mdc":{},"threadName":"Thread-1"}
{"serverId":{"serverId":"192.168.0.14","hostName":"192.168.0.14","version":"airavata-0.16-128-g415e9b7","roles":["all"]},"message":"Server environment:java.version\u003d1.8.0_45","timestamp":"2016-08-29T14:13:35.594Z","level":"INFO","loggerName":"org.apache.zookeeper.server.ZooKeeperServer","mdc":{},"threadName":"Thread-1"}
{"serverId":{"serverId":"192.168.0.14","hostName":"192.168.0.14","version":"airavata-0.16-128-g415e9b7","roles":["all"]},"message":"Server environment:java.home\u003d/Library/Java/JavaVirtualMachines/jdk1.8.0_45.jdk/Contents/Home/jre","timestamp":"2016-08-29T14:13:35.596Z","level":"INFO","loggerName":"org.apache.zookeeper.server.ZooKeeperServer","mdc":{},"threadName":"Thread-1"}
{"serverId":{"serverId":"192.168.0.14","hostName":"192.168.0.14","version":"airavata-0.16-128-g415e9b7","roles":["all"]},"message":"Server environment:java.library.path\u003d/Users/lahiru/Library/Java/Extensions:/Library/Java/Extensions:/Network/Library/Java/Extensions:/System/Library/Java/Extensions:/usr/lib/java:.","timestamp":"2016-08-29T14:13:35.602Z","level":"INFO","loggerName":"org.apache.zookeeper.server.ZooKeeperServer","mdc":{},"threadName":"Thread-1"}
{"serverId":{"serverId":"192.168.0.14","hostName":"192.168.0.14","version":"airavata-0.16-128-g415e9b7","roles":["all"]},"message":"Server environment:java.compiler\u003d\u003cNA\u003e","timestamp":"2016-08-29T14:13:35.603Z","level":"INFO","loggerName":"org.apache.zookeeper.server.ZooKeeperServer","mdc":{},"threadName":"Thread-1"}
> Pump logs to kafka topic
> -------------------------
>
> Key: AIRAVATA-2068
> URL: https://issues.apache.org/jira/browse/AIRAVATA-2068
> Project: Airavata
> Issue Type: Sub-task
> Reporter: Lahiru Gunathilake
> Assignee: Lahiru Gunathilake
>
> Make kafka logging configuration (turn it off by default)
> Configure kafka configurations
> Set the appender to org.apache.airavata
> Use logback instead of log4j
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)