Outages like: |
elasticsearch 'demo-cluster' unassigned shards count is 64.0
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 18:38 (3 minutes)
|
Found similar: |
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 02:51 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 32.0
2021-06-02 02:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-06-02 01:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-02 01:38 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-06-02 00:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 28.0
2021-06-02 00:38 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 23:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 23:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-06-01 22:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 22:51 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-06-01 22:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-06-01 21:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 21:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 88.0
2021-06-01 20:55 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 20:51 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 12.0
2021-06-01 20:38 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-06-01 19:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 63.0
2021-06-01 19:39 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-06-01 18:59 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 35.0
2021-06-01 18:39 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 3.0
2021-06-01 18:08 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-06-01 17:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 35.0
2021-06-01 17:38 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-06-01 16:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 50.0
2021-06-01 16:39 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 3.0
2021-06-01 15:59 (9 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 28.0
2021-06-01 15:38 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 14:58 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-06-01 14:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-06-01 13:58 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
possible false positive due to
okmeter outage
2021-06-01 13:32 (10 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 13:21 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 3.0
2021-06-01 12:58 (20 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 12:38 (7 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-06-01 11:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-06-01 11:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 30.0
2021-06-01 10:58 (7 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 10:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 15.0
2021-06-01 09:59 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-06-01 09:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 56.0
2021-06-01 08:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-06-01 08:38 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 25.0
2021-06-01 07:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-06-01 07:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-06-01 06:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 06:51 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-06-01 06:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 3.0
2021-06-01 06:31 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-06-01 05:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-06-01 05:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 05:33 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-06-01 04:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 04:53 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-06-01 04:39 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-06-01 03:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 03:38 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 15.0
2021-06-01 02:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-06-01 02:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 32.0
2021-06-01 01:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 01:51 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 50.0
2021-06-01 01:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-06-01 00:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 88.0
2021-06-01 00:39 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-06-01 00:31 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-31 23:58 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-05-31 23:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-31 22:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-05-31 22:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 32.0
2021-05-31 21:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-05-31 21:39 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-31 20:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 55.0
2021-05-31 20:38 (6 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-05-31 19:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 30.0
2021-05-31 19:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-31 18:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-05-31 18:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-31 17:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-05-31 17:39 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 32.0
2021-05-31 16:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 15.0
2021-05-31 16:39 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 88.0
2021-05-31 15:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 15.0
2021-05-31 15:39 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-31 14:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 2.0
2021-05-31 14:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-31 13:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 55.0
2021-05-31 13:38 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-31 12:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-31 12:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-31 11:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-31 11:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-05-31 11:21 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-05-31 10:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 1.0
2021-05-31 10:52 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 84.0
2021-05-31 10:39 (5 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-31 09:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-05-31 09:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 30.0
2021-05-31 08:58 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-31 08:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-31 07:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 50.0
2021-05-31 07:38 (6 minutes)
|