Outages like: |
[db-postgresql1] cpu usage is over 99%
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 19:06 (5 minutes)
|
Found similar: |
[backend1] cpu usage is over 99%
2021-05-13 18:28 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 17:49 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 17:24 (6 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 17:15 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 16:31 (31 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 16:20 (7 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 16:06 (3 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 15:55 (6 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 15:34 (9 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 15:29 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 15:22 (3 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 15:12 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 14:41 (17 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 13:36 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 12:38 (43 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 12:13 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 10:41 (11 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 08:41 (20 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 07:58 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 07:41 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 07:26 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 07:07 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 06:37 (20 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 06:22 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 05:31 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 05:06 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 04:41 (17 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 04:28 (9 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 04:22 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 03:58 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 03:51 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 03:45 (2 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 03:33 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 03:28 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 03:22 (2 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 02:41 (23 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 01:08 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 01:00 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-13 00:42 (14 minutes)
|
[backend1] cpu usage is over 99%
2021-05-13 00:26 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 22:38 (18 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 22:30 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 22:16 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 22:11 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 21:30 (14 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 21:18 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 20:39 (13 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 20:31 (4 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 20:20 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 19:57 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 19:10 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 18:41 (25 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 18:18 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 17:07 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 16:41 (19 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 15:48 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 14:41 (18 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 13:57 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 12:41 (18 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 12:06 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 11:33 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 10:41 (17 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 10:32 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 09:36 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 09:31 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 09:11 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 08:37 (22 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 08:23 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 08:07 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 07:26 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 07:11 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 06:37 (16 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 06:28 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 05:28 (5 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 05:08 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 04:41 (17 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 04:34 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 04:01 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 03:55 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 03:29 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 03:23 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 02:41 (14 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 02:31 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 02:08 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 00:41 (18 minutes)
|
[backend1] cpu usage is over 99%
2021-05-12 00:36 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-12 00:24 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 23:04 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 22:41 (16 minutes)
|
[backend1] cpu usage is over 99%
2021-05-11 22:30 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 22:11 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 22:02 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 21:20 (8 minutes)
|
[backend1] cpu usage is over 99%
2021-05-11 20:41 (18 minutes)
|
[backend1] cpu usage is over 99%
2021-05-11 20:35 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 20:27 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 20:20 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 20:11 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 20:01 (1 minute)
|
[backend1] cpu usage is over 99%
2021-05-11 19:56 (1 minute)
|