I kinda struggle understanding what happens in our AWS CloudWatch alarms setup.
We're watching the number of available nodes in ElasticSearch. The goal is to raise an alarm when available nodes is less than three for more than 2 hours.
But still the alarm is triggered even when the available nodes number drops down for just a while:
When period is set to 1 hour the graph looks as follows:
According to the AWS documentation I'd expect the alarm to be triggered when the available nodes is <= 2 for two periods (2 hours).
Can anyone explain what is wrong here?