Outages like: |
elasticsearch 'demo-cluster' unassigned shards count is 76.0
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 17:38 (3 minutes)
|
Found similar: |
elasticsearch 'demo-cluster' unassigned shards count is 5
Alert is in progress for 2 years, 8 months.
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-14 01:10 (8 months, 2 weeks)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-14 00:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 21:11 (2 hours, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 20:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 17:11 (2 hours, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 16:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 15:12 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 13:10 (1 hour, 57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 10:13 (2 hours, 53 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 06:11 (3 hours, 57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-13 02:08 (3 hours, 58 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 23:11 (2 hours, 54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 22:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 21:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 19:12 (1 hour, 54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 18:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 17:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 16:11 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 14:11 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 12:11 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 08:08 (3 hours, 58 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 07:08 (57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 05:11 (1 hour, 54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 04:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 03:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 02:08 (59 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-12 00:10 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 23:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 22:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 21:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 20:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 19:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 18:10 (57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 17:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 16:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 15:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 14:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 13:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 12:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 11:11 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 10:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 09:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 08:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 07:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 03:11 (3 hours, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 02:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 01:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-11 00:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 23:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 3.0
2021-09-10 22:11 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 21:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 19:10 (1 hour, 57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 18:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 17:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 16:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 14:11 (1 hour, 56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 2.0
2021-09-10 11:10 (2 hours, 56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 10:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 09:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 07:10 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 05:11 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 04:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 03:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 02:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-10 01:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 22:12 (2 hours, 53 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 21:13 (53 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 20:12 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 18:10 (1 hour, 57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 16:11 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 14:10 (1 hour, 56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 13:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 12:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 11:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 10:11 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 09:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 08:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 06:11 (1 hour, 54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 05:10 (57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 04:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 03:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 02:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 01:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-09 00:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 22:13 (1 hour, 52 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 21:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 20:13 (52 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 19:12 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 17:11 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 16:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 15:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 13:11 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 12:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 11:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 10:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 09:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 08:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 05:10 (2 hours, 56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 04:09 (58 minutes)
|