Outages like: |
[db-postgresql1] cpu usage is over 99%
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 19:06 (5 minutes)
|
Found similar: |
[backend1] cpu usage is over 99%
2021-05-09 17:58 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 16:41 (16 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 14:41 (21 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 13:12 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 12:41 (15 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 11:27 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 10:41 (15 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 10:31 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 09:04 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 08:41 (10 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 07:31 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 07:05 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 06:41 (12 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 06:31 (3 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 06:21 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 06:12 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 06:01 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 05:33 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 05:23 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 05:02 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 04:41 (13 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 04:35 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 04:22 (2 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 03:24 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 03:13 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 02:41 (15 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 02:17 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 01:38 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-09 00:41 (13 minutes)
|
[backend1] cpu usage is over 99%
2021-05-09 00:18 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 23:18 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 23:13 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 22:41 (18 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 22:06 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 21:57 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 21:34 (7 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 21:16 (3 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 20:41 (19 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 20:34 (3 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 20:26 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 20:17 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 19:53 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 19:46 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 19:38 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 19:30 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 19:11 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 19:03 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 18:41 (10 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 17:43 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 17:32 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 17:08 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 17:01 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 16:41 (10 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 15:45 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 14:58 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 14:41 (12 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 12:41 (13 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 10:40 (18 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 10:28 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 09:45 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 08:41 (15 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 08:31 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 08:26 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 08:20 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 07:26 (7 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 07:02 (2 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 06:38 (17 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 06:06 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 05:41 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 05:05 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 04:38 (17 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 04:27 (7 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 04:20 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 04:09 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 03:39 (21 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 03:23 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 02:41 (19 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 01:10 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 00:37 (20 minutes)
|
[backend1] cpu usage is over 99%
2021-05-08 00:28 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-08 00:00 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 23:36 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 23:22 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 23:06 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 22:41 (13 minutes)
|
[backend1] cpu usage is over 99%
2021-05-07 22:32 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 22:25 (3 minutes)
|
[backend1] cpu usage is over 99%
2021-05-07 22:16 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 22:03 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-07 21:29 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 21:04 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 20:34 (25 minutes)
|
[backend1] cpu usage is over 99%
2021-05-07 20:23 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 20:11 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 19:58 (9 minutes)
|
[backend1] cpu usage is over 99%
2021-05-07 19:34 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-07 19:27 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 19:06 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-07 18:41 (13 minutes)
|
[backend1] cpu usage is over 99%
2021-05-07 17:41 (1 minute)
|