| Outages like: |
|---|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-06-01 00:58 (3 minutes)
|
| Found similar: |
|---|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-27 22:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-05-27 21:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
possible false positive due to
okmeter outage
2021-05-27 21:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
possible false positive due to
okmeter outage
2021-05-27 20:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-27 20:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 35.0
possible false positive due to
okmeter outage
2021-05-27 19:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 56.0
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 19:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 32.0
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 18:59 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 18:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 17:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 76.0
possible false positive due to
На ноде cl1ojovqhk3qm0ungvip-ujoh были ошибки udp пакетов.
Помог перезапуск collectorov на этой node.
Полезные график;
https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=group_by%3A%20source_hostname%0Aoptions%3A%0A%20%20y_title%3A%20connections%0Alines%3A%0A%20%20-%20expression%3A%20%22sum_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.count%27))%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27)))%22%0A%20%20%20%20type%3A%20area%0A%20%20-%20expression%3A%20%22sum(max_by(instance%2C%20metric(name%3D%27collector.tcp_collector.connections.threshold%27))%20%20*%20max_by(instance%2C%20defined(metric(name%3D%27collector.tcp_collector.connections.gc.time.sum%27))))%22%0A%20%20%20%20legend%3A%20configured%20threshold%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Active%20connections%0A
https://alfa.okmetric.com/okmeter/hosts/cl1ojovqhk3qm0ungvip-ujoh/netstat?&duration=1h
2021-05-27 17:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 76.0
2021-05-27 16:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 76.0
2021-05-27 16:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-05-27 15:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
possible false positive due to
okmeter outage
2021-05-27 15:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 28.0
2021-05-27 14:59 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 92.0
2021-05-27 14:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 44.0
2021-05-27 13:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 84.0
2021-05-27 13:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-27 12:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 52.0
2021-05-27 12:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 44.0
2021-05-27 11:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 92.0
2021-05-27 11:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 84.0
possible false positive due to
Кратковременная потеря метрик. https://alfa.okmetric.com/okmeter/graph?duration=1h&graph_config=options%3A%0A%20%20y_title%3A%20metrics%2Fsecond%0Alines%3A%0A%20%20-%20expression%3A%20%27top(5%2C%20sum_by(site_name%2C%20metric(name%3D%5B%22gokserver.collector.metrics_written%22%2C%20%22gokserver.tcp_collector.metrics_written.rate%22%2C%20%22collector.tcp_collector.metrics_written.rate%22%5D)))%27%0A%20%20%20%20type%3A%20area%0A%20%20%20%20legend%3A%20%27%25(site_name)s%27%0Aevents%3A%0A%20%20-%20collector-errors%0A%20%20-%20tcp_collector_critical%0Atitle%3A%20Metrics%20written%0A
2021-05-27 10:59 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 92.0
2021-05-27 10:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 88.0
2021-05-27 09:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 84.0
2021-05-27 09:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-27 08:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 28.0
2021-05-27 08:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 84.0
2021-05-27 07:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 84.0
2021-05-27 07:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 52.0
2021-05-27 06:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 92.0
2021-05-27 06:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-27 05:59 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 36.0
possible false positive due to
был какой-то скачок на графиках, но сейчас все ровно и хорошо
2021-05-27 05:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 84.0
possible false positive due to
был какой-то скачок на графиках, но сейчас все ровно и хорошо
2021-05-27 04:59 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
possible false positive due to
был какой-то скачок на графиках, но сейчас все ровно и хорошо
2021-05-27 04:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 28.0
2021-05-27 03:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-05-27 03:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-27 02:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-27 02:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-27 01:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 52.0
2021-05-27 01:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-05-27 00:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-05-27 00:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 28.0
2021-05-26 23:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 76.0
2021-05-26 23:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-05-26 22:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-05-26 22:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-26 21:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 52.0
2021-05-26 21:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 28.0
2021-05-26 20:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 60.0
2021-05-26 20:39 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 44.0
2021-05-26 19:59 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 92.0
2021-05-26 19:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 84.0
2021-05-26 18:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 28.0
2021-05-26 18:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 20.0
2021-05-26 17:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-26 17:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 32.0
2021-05-26 16:59 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 56.0
2021-05-26 15:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-05-26 15:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-05-26 14:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-05-26 14:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-26 13:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-05-26 13:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-26 12:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 32.0
2021-05-26 12:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-05-26 11:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-26 11:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 56.0
2021-05-26 10:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-05-26 10:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-05-26 09:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-26 09:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-26 08:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-05-26 08:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-26 07:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-26 07:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-26 06:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-05-26 06:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-05-26 05:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-26 05:38 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-26 04:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 88.0
2021-05-26 04:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-05-26 03:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-26 03:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-26 02:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 88.0
2021-05-26 02:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-26 01:58 (3 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-26 01:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 88.0
2021-05-26 00:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 48.0
2021-05-26 00:38 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 40.0
2021-05-25 23:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 45.0
2021-05-25 23:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 72.0
2021-05-25 22:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 30.0
2021-05-25 22:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 64.0
2021-05-25 21:59 (1 minute)
|
elasticsearch 'demo-cluster' unassigned shards count is 80.0
2021-05-25 21:38 (4 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 96.0
2021-05-25 20:58 (2 minutes)
|
elasticsearch 'demo-cluster' unassigned shards count is 24.0
2021-05-25 20:38 (4 minutes)
|