You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@inlong.apache.org by GitBox <gi...@apache.org> on 2022/08/30 11:47:47 UTC
[GitHub] [inlong] gosonzhang opened a new issue, #5745: [Improve] Align the indicator data reported to the audit module
gosonzhang opened a new issue, #5745:
URL: https://github.com/apache/inlong/issues/5745
### Description
During the whole chain test, it was found that the indicator data reported by each module to the audit module was inconsistent, such as data time, data number, and data size, which could not be aligned in a one-time unit.
How should we handle it more appropriately?
### InLong Component
Other for not specified component
### Are you willing to submit PR?
- [X] Yes, I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] GanfengTan commented on issue #5745: [Improve] Align the indicator data reported to the audit module
Posted by GitBox <gi...@apache.org>.
GanfengTan commented on issue #5745:
URL: https://github.com/apache/inlong/issues/5745#issuecomment-1232355064
@gosonzhang @EMsnap @dockerzhang @healchow Hi guys, I have an idea for the question.
The reason :
1. The reads and writes are asynchronous and the times are randomly generated for audit data.
2. The DataProxy compresses data and the times are randomly generated for audit data.
Anwser to the question:
1. Uniformly defined as data collection time.
2. The DataProxy gets data collection time and report to audit data for Non-compression data.
Update code Java Bean
The data of message:
public interface Message {
byte[] getBody();
Map<String, String> getHeader();
}
To
public interface Message {
byte[] getBody();
Map<String, String> getHeader();
Long getTime;
}
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] github-actions[bot] commented on issue #5745: [Improve] Align the indicator data reported to the audit module
Posted by GitBox <gi...@apache.org>.
github-actions[bot] commented on issue #5745:
URL: https://github.com/apache/inlong/issues/5745#issuecomment-1296450336
This issue is stale because it has been open for 60 days with no activity.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] gosonzhang commented on issue #5745: [Improve] Align the indicator data reported to the audit module
Posted by GitBox <gi...@apache.org>.
gosonzhang commented on issue #5745:
URL: https://github.com/apache/inlong/issues/5745#issuecomment-1232371636
@GanfengTan, from the perspective of DataProxy, will also receive the data reported by the SDK and HTTP methods. Such reported messages do not have the concept of the data collection time of the Agent. Should the definition be supplemented:
If DataProxy cannot obtain the data collection time from the received message, the time when the message is received shall prevail.
Then, when the Agent reports the information, what is the field name that carries the information, and does the information already exist in the existing field set?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] gosonzhang commented on issue #5745: [Improve] Align the indicator data reported to the audit module
Posted by GitBox <gi...@apache.org>.
gosonzhang commented on issue #5745:
URL: https://github.com/apache/inlong/issues/5745#issuecomment-1324672758
This issue is finished
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [inlong] gosonzhang closed issue #5745: [Improve] Align the indicator data reported to the audit module
Posted by GitBox <gi...@apache.org>.
gosonzhang closed issue #5745: [Improve] Align the indicator data reported to the audit module
URL: https://github.com/apache/inlong/issues/5745
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@inlong.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org