You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@skywalking.apache.org by GitBox <gi...@apache.org> on 2021/07/05 17:54:34 UTC
[GitHub] [skywalking] StayTherapy opened a new issue #7250: How to push log to SkyWalking with fluent-bit?
StayTherapy opened a new issue #7250:
URL: https://github.com/apache/skywalking/issues/7250
Please answer these questions before submitting your issue.
- Why do you submit this issue?
- [X] Question or discussion
- [ ] Bug
- [ ] Requirement
- [ ] Feature or performance improvement
___
### Question
- What do you want to know?
For simple, I want collect JSON log with `fluent-bit` and direct push to SkyWalking .
Follow [Log Collecting And Analysis](https://skywalking.apache.org/docs/main/latest/en/setup/backend/log-analyzer/), I setup a `fluent-bit` in docker like this:
**fluent-bit.conf**
```bash
[SERVICE]
Flush 5
Daemon Off
Log_Level warn
Parsers_File fluent-bit-parser.conf
[INPUT]
Name tail
Path /logs/*.log
Parser my-log-format
[OUTPUT]
Name stdout
Match *
Format json
[OUTPUT]
Name http
Match *
Host oap
Port 12800
URI /v3/logs
Format json
```
**fluent-bit-parser.conf**
```bash
[PARSER]
Name my-log-format
Format json
```
The log of `fluent-bit` is fine, JSON log printed. **But** there is nothing in `log` page in SkyWalking UI ,it's always `No Data`.
Is there any configuration of `skywalking-oap-server` should be update?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #7250:
URL: https://github.com/apache/skywalking/issues/7250#issuecomment-874363699
https://github.com/apache/skywalking/tree/5dd56a5ca45c1bc423af71dc0829aed1221621ac/test/e2e/e2e-test/docker/log/fluent-bit Are you using this setup? We have tested in the e2e for every commit.
Your description is hard to reply.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng closed issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
wu-sheng closed issue #7250:
URL: https://github.com/apache/skywalking/issues/7250
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] StayTherapy commented on issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
StayTherapy commented on issue #7250:
URL: https://github.com/apache/skywalking/issues/7250#issuecomment-880067755
@wu-sheng Thanks, problem resolved.
I think the key point is : [log-data-protocol](https://skywalking.apache.org/docs/main/latest/en/protocols/log-data-protocol/#http-api)
Before push log , we can POST to http://OAP:12800/v3/logs , and check the JSON body.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] zhujinhu21 edited a comment on issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
zhujinhu21 edited a comment on issue #7250:
URL: https://github.com/apache/skywalking/issues/7250#issuecomment-888909417
@StayTherapy I use https://github.com/apache/skywalking/tree/5dd56a5ca45c1bc423af71dc0829aed1221621ac/test/e2e/e2e-test/docker/log/fluent-bit confi file. but fluent-bit tell me " [ warn] [router] NO match for stdout.0 output instance"
my fluent-bit.conf file
![Uploading 企业微信截图_16275469854216.png…]()
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] zhujinhu21 commented on issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
zhujinhu21 commented on issue #7250:
URL: https://github.com/apache/skywalking/issues/7250#issuecomment-888909417
@StayTherapy I use https://github.com/apache/skywalking/tree/5dd56a5ca45c1bc423af71dc0829aed1221621ac/test/e2e/e2e-test/docker/log/fluent-bit confi file. but fluent-bit tell me " [ warn] [router] NO match for stdout.0 output instance"
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] zhujinhu21 commented on issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
zhujinhu21 commented on issue #7250:
URL: https://github.com/apache/skywalking/issues/7250#issuecomment-889796305
@wu-sheng , hi can i use skywalking 8.6.0 version with fluent-bit
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng closed issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
wu-sheng closed issue #7250:
URL: https://github.com/apache/skywalking/issues/7250
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] wu-sheng commented on issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
wu-sheng commented on issue #7250:
URL: https://github.com/apache/skywalking/issues/7250#issuecomment-874363699
https://github.com/apache/skywalking/tree/5dd56a5ca45c1bc423af71dc0829aed1221621ac/test/e2e/e2e-test/docker/log/fluent-bit Are you using this setup? We have tested in the e2e for every commit.
Your description is hard to reply.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [skywalking] zhujinhu21 edited a comment on issue #7250: How to push log to SkyWalking with fluent-bit?
Posted by GitBox <gi...@apache.org>.
zhujinhu21 edited a comment on issue #7250:
URL: https://github.com/apache/skywalking/issues/7250#issuecomment-888909417
@StayTherapy I use https://github.com/apache/skywalking/tree/5dd56a5ca45c1bc423af71dc0829aed1221621ac/test/e2e/e2e-test/docker/log/fluent-bit confi file. but fluent-bit tell me " [ warn] [router] NO match for stdout.0 output instance"
my fluent-bit.conf file
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@skywalking.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org