You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@pulsar.apache.org by GitBox <gi...@apache.org> on 2020/05/25 06:08:56 UTC
[GitHub] [pulsar] Anonymitaet commented on a change in pull request #7031: Add pulsar SQL woker metrics to repo
Anonymitaet commented on a change in pull request #7031:
URL: https://github.com/apache/pulsar/pull/7031#discussion_r429744614
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
Review comment:
```suggestion
| split_bytes_read | Counter | Number of bytes read from BookKeeper. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
+| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spend waiting to get entry from entry queue per query. |
+| split_message_queue_dequeue_wait_time_per_query | Summary | Time spent waiting to dequeue from message queue because its empty per query. |
+| split_message_queue_enqueue_wait_time | Summary | Time spent waiting for message queue enqueue because message queue is full. |
+| split_message_queue_enqueue_wait_time_per_query | Summary | Time spent waiting for message queue enqueue because message queue is full per query. |
+| split_num_entries_per_batch | Summary | Number of entries per batch. |
+| split_num_entries_per_query | Summary | Number of entries per query. |
+| split_num_messages_deserialized_per_entry | Summary | Number of messages deserialized per entry. |
+| split_num_messages_deserialized_per_query | Summary | Number of messages deserialized per query. |
+| split_read_attempts | Summary | Number of read attempts(will fail if queues are full). |
+| split_read_attempts_per_query | Summary | Number of read attempts per query. |
+| split_read_latency_per_batch | Summary | Latency of reads per batch. |
+| split_read_latency_per_query | Summary | Total read latency per query. |
+| split_record_deserialize_time | Summary | Time spent deserializing message to record e.g. avro, json, etc. |
Review comment:
```suggestion
| split_record_deserialize_time | Summary | Time spent on deserializing message to record. For example, Avro, JSON, and so on. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
Review comment:
```suggestion
| split_entry_deserialize_time | Summary | Time spent on derserializing entries. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
+| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spend waiting to get entry from entry queue per query. |
+| split_message_queue_dequeue_wait_time_per_query | Summary | Time spent waiting to dequeue from message queue because its empty per query. |
+| split_message_queue_enqueue_wait_time | Summary | Time spent waiting for message queue enqueue because message queue is full. |
+| split_message_queue_enqueue_wait_time_per_query | Summary | Time spent waiting for message queue enqueue because message queue is full per query. |
+| split_num_entries_per_batch | Summary | Number of entries per batch. |
+| split_num_entries_per_query | Summary | Number of entries per query. |
+| split_num_messages_deserialized_per_entry | Summary | Number of messages deserialized per entry. |
+| split_num_messages_deserialized_per_query | Summary | Number of messages deserialized per query. |
+| split_read_attempts | Summary | Number of read attempts(will fail if queues are full). |
+| split_read_attempts_per_query | Summary | Number of read attempts per query. |
+| split_read_latency_per_batch | Summary | Latency of reads per batch. |
+| split_read_latency_per_query | Summary | Total read latency per query. |
+| split_record_deserialize_time | Summary | Time spent deserializing message to record e.g. avro, json, etc. |
+| split_record_deserialize_time_per_query | Summary | Time spent deserializing message to record per query. |
Review comment:
```suggestion
| split_record_deserialize_time_per_query | Summary | Time spent on deserializing message to record per query. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
Review comment:
```suggestion
| split_num_record_deserialized | Counter | Number of records deserialized. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
+| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spend waiting to get entry from entry queue per query. |
Review comment:
```suggestion
| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spent on waiting to get entry from entry queue per query. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
+| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spend waiting to get entry from entry queue per query. |
+| split_message_queue_dequeue_wait_time_per_query | Summary | Time spent waiting to dequeue from message queue because its empty per query. |
+| split_message_queue_enqueue_wait_time | Summary | Time spent waiting for message queue enqueue because message queue is full. |
+| split_message_queue_enqueue_wait_time_per_query | Summary | Time spent waiting for message queue enqueue because message queue is full per query. |
+| split_num_entries_per_batch | Summary | Number of entries per batch. |
+| split_num_entries_per_query | Summary | Number of entries per query. |
+| split_num_messages_deserialized_per_entry | Summary | Number of messages deserialized per entry. |
+| split_num_messages_deserialized_per_query | Summary | Number of messages deserialized per query. |
+| split_read_attempts | Summary | Number of read attempts(will fail if queues are full). |
+| split_read_attempts_per_query | Summary | Number of read attempts per query. |
+| split_read_latency_per_batch | Summary | Latency of reads per batch. |
+| split_read_latency_per_query | Summary | Total read latency per query. |
+| split_record_deserialize_time | Summary | Time spent deserializing message to record e.g. avro, json, etc. |
+| split_record_deserialize_time_per_query | Summary | Time spent deserializing message to record per query. |
+| split_total_execution_time | Summary | Total time spent execution time . |
Review comment:
```suggestion
| split_total_execution_time | Summary | Total execution time. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
Review comment:
```suggestion
| split_entry_queue_dequeue_wait_time | Summary | Time spent on waiting to get entry from entry queue because it is empty. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
Review comment:
```suggestion
| split_entry_deserialize_time_per_query | Summary | Time spent on derserializing entries per query. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
+| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spend waiting to get entry from entry queue per query. |
+| split_message_queue_dequeue_wait_time_per_query | Summary | Time spent waiting to dequeue from message queue because its empty per query. |
+| split_message_queue_enqueue_wait_time | Summary | Time spent waiting for message queue enqueue because message queue is full. |
+| split_message_queue_enqueue_wait_time_per_query | Summary | Time spent waiting for message queue enqueue because message queue is full per query. |
+| split_num_entries_per_batch | Summary | Number of entries per batch. |
+| split_num_entries_per_query | Summary | Number of entries per query. |
+| split_num_messages_deserialized_per_entry | Summary | Number of messages deserialized per entry. |
+| split_num_messages_deserialized_per_query | Summary | Number of messages deserialized per query. |
+| split_read_attempts | Summary | Number of read attempts(will fail if queues are full). |
Review comment:
```suggestion
| split_read_attempts | Summary | Number of read attempts (fail if queues are full). |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
Review comment:
```suggestion
| split_entry_deserialize_time_per_query | Summary | Time spent on derserializing entries per query. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
+| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spend waiting to get entry from entry queue per query. |
+| split_message_queue_dequeue_wait_time_per_query | Summary | Time spent waiting to dequeue from message queue because its empty per query. |
Review comment:
```suggestion
| split_message_queue_dequeue_wait_time_per_query | Summary | Time spent on waiting to dequeue from message queue because it is empty per query. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
+| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spend waiting to get entry from entry queue per query. |
+| split_message_queue_dequeue_wait_time_per_query | Summary | Time spent waiting to dequeue from message queue because its empty per query. |
+| split_message_queue_enqueue_wait_time | Summary | Time spent waiting for message queue enqueue because message queue is full. |
Review comment:
```suggestion
| split_message_queue_enqueue_wait_time | Summary | Time spent on waiting for message queue because the message queue is full. |
```
##########
File path: site2/docs/reference-metrics.md
##########
@@ -359,6 +360,34 @@ All the proxy metrics are labelled with the following labels:
| pulsar_proxy_binary_ops | Counter | Counter of proxy operations. |
| pulsar_proxy_binary_bytes | Counter | Counter of proxy bytes. |
+# Pulsar SQL Worker
+
+| Name | Type | Description |
+|---|---|---|
+| split_bytes_read | Counter | Number of bytes read from bookkeeper. |
+| split_num_messages_deserialized | Counter | Number of messages deserialized. |
+| split_num_record_deserialized | Counter | Number of record deserialized. |
+| split_bytes_read_per_query | Summary | Total number of bytes read per query. |
+| split_entry_deserialize_time | Summary | Time spent derserializing entries. |
+| split_entry_deserialize_time_per_query | Summary | Time spent derserializing entries per query. |
+| split_entry_queue_dequeue_wait_time | Summary | Time spend waiting to get entry from entry queue because it is empty. |
+| split_entry_queue_dequeue_wait_time_per_query | Summary | Total time spend waiting to get entry from entry queue per query. |
+| split_message_queue_dequeue_wait_time_per_query | Summary | Time spent waiting to dequeue from message queue because its empty per query. |
+| split_message_queue_enqueue_wait_time | Summary | Time spent waiting for message queue enqueue because message queue is full. |
+| split_message_queue_enqueue_wait_time_per_query | Summary | Time spent waiting for message queue enqueue because message queue is full per query. |
Review comment:
```suggestion
| split_message_queue_enqueue_wait_time_per_query | Summary | Time spent on waiting for message queue because the message queue is full per query. |
```
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org