Outages like: |
elasticsearch 'demo-cluster' unassigned shards count is 56.0
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 19:38 (3 minutes)
|
Found similar: |
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 03:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 02:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-08 00:11 (1 hour, 54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 21:11 (2 hours, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 19:10 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 17:10 (1 hour, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 16:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 11:11 (4 hours, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 10:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 09:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 08:11 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 07:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 04:11 (2 hours, 54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 03:11 (54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 02:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-07 00:10 (1 hour, 56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-06 23:10 (55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-06 22:10 (57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-06 19:11 (2 hours, 54 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-02 21:11 (3 days, 21 hours)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-09-02 20:10 (56 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-09-02 19:48 (2 minutes)
|
no data on trigger elasticsearch-health from demo-cluster for more than 5m
2021-09-01 14:33 (11 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-16 05:42 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-15 11:01 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-15 03:31 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-15 01:01 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-14 19:21 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-14 15:42 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 55.0
2021-06-14 05:39 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-06-14 04:59 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-06-14 04:39 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-13 21:42 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-13 18:41 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-13 10:51 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-13 06:31 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-13 01:41 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-06-12 08:39 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-06-12 07:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-06-11 05:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-06-11 04:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 55.0
2021-06-11 04:39 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-10 03:47 (7 hours, 31 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 5.0
2021-06-10 03:43 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-09 18:59 (8 hours, 30 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-09 06:39 (12 hours, 17 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-08 12:39 (17 hours, 57 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-08 09:39 (2 hours, 55 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 3.0
2021-06-07 22:59 (10 hours, 33 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-07 18:41 (4 hours, 9 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-07 12:57 (5 hours, 35 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 7.0
2021-06-06 06:33 (1 day, 6 hours)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-03 20:39 (2 days, 9 hours)
|
elasticsearch 'demo-cluster' unassigned shards count is 8.0
2021-06-03 06:57 (13 hours, 35 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-06-03 06:39 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 2.0
2021-06-02 20:57 (9 hours, 36 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-06-02 20:39 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 42.0
2021-06-02 19:52 (11 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 27.0
2021-06-02 19:39 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-06-02 18:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 9.0
2021-06-02 18:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-06-02 17:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 17:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 50.0
2021-06-02 16:58 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 16:52 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-06-02 16:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 16:33 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 16:21 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 50.0
2021-06-02 15:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 15:52 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 18.0
2021-06-02 15:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 3.0
2021-06-02 14:58 (20 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 14:51 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 2.0
2021-06-02 14:39 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-06-02 13:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 15.0
2021-06-02 13:39 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-06-02 12:58 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-06-02 12:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-06-02 11:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-06-02 11:38 (7 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-06-02 10:58 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 2.0
2021-06-02 10:39 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-06-02 09:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 6.0
2021-06-02 09:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 08:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 14.0
2021-06-02 08:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-06-02 07:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-06-02 07:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-06-02 06:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-06-02 06:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 06:32 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-06-02 05:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-06-02 05:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-06-02 04:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-06-02 04:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 88.0
2021-06-02 03:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 50.0
2021-06-02 03:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 03:34 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 3.0
2021-06-02 03:08 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-06-02 02:58 (4 minutes)
|