You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by GitBox <gi...@apache.org> on 2021/01/27 03:48:35 UTC
[GitHub] [skywalking] wu-sheng opened a new issue #6264: Introduce LAL(Log Analysis Language)
wu-sheng opened a new issue #6264:
URL: https://github.com/apache/skywalking/issues/6264
Hi @arugal @EvanLjp @hanahmily @kezhenxu94 and other contributors.
I want to bring the highest priority feature of the 8.5.0. Here is the proposal.
SkyWalking has 2 languages targeting the analysis related features.
1. OAL introduced in 6.x and is enhanced w/ time to support language-agent tracer and service mesh telemetry analysis to get metrics.
2. MAL introduced in 8.2 and 8.3 to adopt the native and 3rd party meter system, including Prometheus, MicroMeter, Zabbix(WIP)
With the incoming 8.4.0 release, we have logging collection, persistent, and query capability. Now, we should focus on enhancing the analysis feature. That is where LAL stands on.
The LAL should be able to provide the following features.
1. It should be defined in the config file, like OAL script, and MAL YAML. It is usable by the end users.
2. Support structure unify log data content. Especially for TEXT format log. Should be able to convert it to the JSON, or something for further process.
3. Support TEXT, YAML, JSON formats
4. Filter logs based on conditions
5. Build new meter(metrics) based on the match conditions of structured log. Such as, you could set a business error metrics if there is a specific text(`xyz fails`) detected in the logs.
6. Build collaboration with trace context. Such as isolate text(trace_id) from the text by using some split/regex mechanism.
7. Entity assignment mechanism. Build the connection between entity(service/instance/endpoint) with the log contents.
From the tech perspective, this could reference from the MAL tech stack. If anyone of @apache/skywalking-committers will lead this, please reply here.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] kezhenxu94 closed issue #6264: Introduce LAL(Log Analysis Language)
Posted by GitBox <gi...@apache.org>.
kezhenxu94 closed issue #6264:
URL: https://github.com/apache/skywalking/issues/6264
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #6264: Introduce LAL(Log Analysis Language)
Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #6264:
URL: https://github.com/apache/skywalking/issues/6264#issuecomment-782574101
> please send me a document link ,I don't know how to config ,it do not work and have no error log
> need to install filebeat,logstash?
You are asking at wrong place. We don't support those yet. You need to read doc of agent application toolkit.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] kezhenxu94 commented on issue #6264: Introduce LAL(Log Analysis Language)
Posted by GitBox <gi...@apache.org>.
kezhenxu94 commented on issue #6264:
URL: https://github.com/apache/skywalking/issues/6264#issuecomment-774086911
Since my #6322 will leverage some features described in this issue, I’ll take this issue if there is no one already works on it.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wangruice commented on issue #6264: Introduce LAL(Log Analysis Language)
Posted by GitBox <gi...@apache.org>.
wangruice commented on issue #6264:
URL: https://github.com/apache/skywalking/issues/6264#issuecomment-783008942
> @wangruice you opened this issue #6405 and I answered there, you have obvious error in configuration, please check there, don't ask here and there
thanks
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] kezhenxu94 commented on issue #6264: Introduce LAL(Log Analysis Language)
Posted by GitBox <gi...@apache.org>.
kezhenxu94 commented on issue #6264:
URL: https://github.com/apache/skywalking/issues/6264#issuecomment-782574211
@wangruice you opened this issue https://github.com/apache/skywalking/issues/6405 and I answered there, you have obvious error in configuration, please check there, don't ask here and there
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wangruice commented on issue #6264: Introduce LAL(Log Analysis Language)
Posted by GitBox <gi...@apache.org>.
wangruice commented on issue #6264:
URL: https://github.com/apache/skywalking/issues/6264#issuecomment-782573277
please send me a document link ,I don't know how to config ,it do not work and have no error log
need to install filebeat,logstash?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org