Suppose we have N identical windows services (developed in C#/.NET) running at same time on N application servers. 'Unfortunately', every service has its own in-memory states (say, "at 10:00 PM I need to execute a job").
Through a frontend web UI user may change the state (say, change job start time from 10 to 12) of one of these services.
My question: what is the best practice to synchronize the states between these services after user changes states? (Preferably in .NET platform).
p.s. you may wonder why we bother run the same service on different servers. That's because managers think redundant prevents single point failure. But it also brings up above issue when the service instance holds its own in-memory states that can be changed by user through a UI.
Any suggestion here is appreciated!