...
| Code Block | ||
|---|---|---|
| ||
- targets:
- localhost:9191
to
- targets:
- wolf-118:9191
- wolf-119:9191
- wolf-120:9191
- wolf-121:9191 |
(mjmac) It's worth noting here that if you add the hosts to your ~/.daos_control.yml or some other control config file that you use with dmg -o /path/to/config.yml, they will automatically be added to your prometheus configuration.
Starting Prometheus
| Note |
|---|
due to DAOS-8104 ; prometheus should be manually started with ./prometheus --config_file=~/.prometheus.yml; |
...
| Note |
|---|
Prometheus does not start on boot so will need to manaually re-start |
Starting Grafana on a wolf daos admin node:
In order to monitor metrics on wolf and running grafana from windows you will need to setup port forwarding. Install Firefox on windows machine and setup a manual proxy in network settings Port must match the forwarded port in putty setup below
Startup Grafana dashboard and import DAOS-Grafana-Dashboard.json from github https://github.com/daos-stack/daos/tree/master/utils/grafana
...
| language | text |
|---|
...
Use putty to setup port forwarding/tunnel
Open the connection to wolf and login as you would normally log into wolf
Open a connection to the wolf node running the Grafana service using the FireFox browser
Startup Grafana dashboard using FireFox
| Code Block | ||
|---|---|---|
| ||
http://wolf-xx:3000
Login with admin/admin. It will prompt you to change the admin password |
...
| Code Block |
|---|
NOTE: Prometheus uses port 9090 wolf-xx:9090 |
Add prometheus data source
import grafana metrics in the Prometheus Dashbord
import DAOS-Grafana-Dashboard.json from github https://github.com/daos-stack/daos/tree/master/utils/grafana
Open the daos dashboard and the monitor should start collecting metrics when the daos servers have started
This is a snapshot of daos metrics while soak was runing on shared cluster 8 servers (4 nodes) and 5 clients
