I've only had to do about 4-5 big renumbering projects so take all of this with a bucket of salt :)
I always start with a reboot test of the current environment: If you can't bring it all down and back up again in working order migration is a pipe dream.
Following the reboot test is an extensive firewall audit (assuming your network is divided up & everything isn't living on the same segment/subnet): Figure out which servers need to talk to each other and make sure you thoroughly understand the firewall rules that let that communication happen.
The firewall audit should also include things like NAT/Bidirectional NAT/Port Mappings (for things like publicly accessible mail/web servers).
From that firewall audit & a good understanding of your environment you can come up with new firewall rules for the new IP space. If the environment you're migrating has been up for a while often you'll probably also find (and close) a bunch of holes that crept in over the years.
For migrating individual applications (and the OS configuration), your Apache example generalizes very well. As OS/Application agnostic as I can make it:
- Back up everything you're going to touch (configuration files, DNS, etc.) to offline storage.
(If you're not sure what's going to be touched take a full backup of the whole damn environment!)
- Update firewall rules.
- Update name services (DNS, NIS,
/etc/hosts
& the like).
If you're not using DNS, now may be a good time to deploy it...
- Edit system configuration files (and don't forget things like resolv.conf)
(Make a local copy of every file before you edit it in case you screw up, especially if you ignored #2 above!)
- Edit app configuration files, with the same caveats as #3
(Postgres sites especially take note of IP restrictions in pg_hba.conf
)
- Reboot the machine at least once to make sure it survives a reboot.
- After everything is migrated bring the environment down & back up again
(Including the firewalls -- just in case you missed something in #5)
As a general order, I migrate network stuff (switch/router/fw configs) first, followed by name services (DNS) and Authentication/Authorization (LDAP, NIS, AD etc.), then "everything else in the order it should come up during a restart", which usually works out pretty well.