You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@ozhera.apache.org by "wtt40122 (via GitHub)" <gi...@apache.org> on 2025/06/18 07:30:58 UTC
[I] 🚀 Feature: Add Node Collection Information Monitoring for Log Agent [ozhera]
wtt40122 opened a new issue, #588:
URL: https://github.com/apache/ozhera/issues/588
**Labels:** `enhancement`, `logging`, `monitoring`
## 📋 Feature Description
This PR introduces a new node collection information monitoring feature for the OzHera log agent system. The feature allows real-time monitoring and collection of log processing status across different nodes in the distributed logging infrastructure.
## 🎯 What's New
### New Components Added:
1. **NodeCollInfoProcessor** - RPC processor for handling node collection information requests
2. **NodeCollInfo** model - Data structure for node collection information
3. **MachineCollInfo** model - Machine-specific collection information (replaced by NodeCollInfo)
### Key Features:
- **Real-time Node Monitoring**: Monitor log collection progress across different nodes
- **Tail Collection Status**: Track individual log tail collection information including:
- Tail ID and name
- File collection progress
- Current and maximum file pointers
- Collection timestamps
- **Host Information**: Capture host IP and hostname for each node
- **RPC Communication**: Efficient communication between log agent server and agents
## 🔧 Technical Implementation
### Core Classes:
- `NodeCollInfoProcessor`: Handles RPC requests for node collection info
- `NodeCollInfo`: Main data model containing host info and tail collection details
- `ChannelEngine.getNodeCollInfo()`: Collects and aggregates node information
- `DefaultLogProcessCollector.getNodeCollInfo()`: Server-side collection method
### Data Structure:
```java
NodeCollInfo {
String hostIp;
String hostName;
List<TailCollInfo> tailCollInfos;
TailCollInfo {
Long tailId;
String tailName;
List<CollInfo> collInfos;
}
CollInfo {
String fileName;
String fileNode;
String collProgress;
Long maxPointer;
Long currentPointer;
Long currentNumber;
Long collTime;
}
}
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@ozhera.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@ozhera.apache.org
For additional commands, e-mail: commits-help@ozhera.apache.org