You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "martin-g (via GitHub)" <gi...@apache.org> on 2026/05/01 12:44:22 UTC
[I] [TUI] Render Executor's system & process metrics [datafusion-ballista]
martin-g opened a new issue, #1642:
URL: https://github.com/apache/datafusion-ballista/issues/1642
```
➜ ~ curl -s http://localhost:50050/api/executors | jq
[
{
"id": "aa68ce95-4175-404e-a036-db12d7399e79",
"host": "127.0.0.1",
"port": 50051,
"last_seen": 1777154502000,
"specification": {
"task_slots": 14
},
"metrics": [
{
"type": "proc_physical_memory",
"value": 34521088
},
{
"type": "proc_virtual_memory",
"value": 454171721728
}
]
}
]
```
```
➜ ~ curl -s http://localhost:50050/api/executor/aa68ce95-4175-404e-a036-db12d7399e79 | jq
{
"executor_info": {
"id": "aa68ce95-4175-404e-a036-db12d7399e79",
"host": "127.0.0.1",
"port": 50051,
"last_seen": 1777154562000,
"specification": {
"task_slots": 14
},
"metrics": [
{
"type": "proc_physical_memory",
"value": 36339712
},
{
"type": "proc_virtual_memory",
"value": 454207553536
}
]
},
"os_info": {
"system_name": "Darwin",
"kernel_ver": "Darwin 25.4.0",
"os_ver": "26.4.1",
"os_ver_long": "macOS 26.4.1",
"physical_cores": 14,
"num_disks": 2,
"total_disk_space": 1989325168640,
"total_available_disk_space": 1342051923950,
"open_files_limit": 10240
}
}
```
one note, @sandugood peak memory disappeared from this version, not sure if i'm doing something wrong ?
we had a
```
"peaks": {
"physical_memory": 0,
"virtual_memory": 0
}
```
previously and we said we're going to merge it with metrics adding `peak_physical_memory` and `peak_virtual_memory` ?
_Originally posted by @milenkovicm in https://github.com/apache/datafusion-ballista/issues/1547#issuecomment-4320686016_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [TUI] Render Executor's system & process metrics [datafusion-ballista]
Posted by "sandugood (via GitHub)" <gi...@apache.org>.
sandugood commented on issue #1642:
URL: https://github.com/apache/datafusion-ballista/issues/1642#issuecomment-4359366180
Just checked it and it works(?)
```
curl -s localhost:50050/api/executor/b052ff6d-af2a-4b5e-ac1b-b8f410cfac5c | jq
{
"executor_info": {
"id": "b052ff6d-af2a-4b5e-ac1b-b8f410cfac5c",
"host": "127.0.0.1",
"port": 50051,
"last_seen": 1777640106000,
"specification": {
"task_slots": 8
},
"metrics": [
{
"type": "proc_physical_memory",
"value": 62033920
},
{
"type": "proc_virtual_memory",
"value": 1845534720
},
{
"type": "peak_physical_memory",
"value": 62033920
},
{
"type": "peak_virtual_memory",
"value": 1845534720
}
]
},
"os_info": {
"system_name": "Ubuntu",
"kernel_ver": "Linux 6.17.0-22-generic",
"os_ver": "24.04",
"os_ver_long": "Linux (Ubuntu 24.04)",
"physical_cores": 4,
"num_disks": 4,
"total_disk_space": 471356895232,
"total_available_disk_space": 31161225216,
"open_files_limit": 1024
}
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [TUI] Render Executor's system & process metrics [datafusion-ballista]
Posted by "martin-g (via GitHub)" <gi...@apache.org>.
martin-g closed issue #1642: [TUI] Render Executor's system & process metrics
URL: https://github.com/apache/datafusion-ballista/issues/1642
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [TUI] Render Executor's system & process metrics [datafusion-ballista]
Posted by "milenkovicm (via GitHub)" <gi...@apache.org>.
milenkovicm commented on issue #1642:
URL: https://github.com/apache/datafusion-ballista/issues/1642#issuecomment-4359325431
I believe peak memory came back, at least it was there yesterday 😀
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org