How do we evict in-memory caches at different instances?
We have a scale-out architecture, multiple instances service requests simultaneously. Each one of them has in-memory cache attached to it.
We need eviction accross all instance, at once.
Why NOT Memcache/Redis or Other Provider? Calls to Redis/Memcache creates network latency. Apart from its speed, our data size is much smaller that can easily fit within an instance [Max 100MB]
Temporary Solution As a temporary solution, we have time based eviction, time being relatively lower 2.5Minute. But for 2.5 minute, It can each instance can serve own copy of data, that can lead to Inconsistency. How do we keys of cache at multiple instances at once?