I have a dev server in house that I run phpmyadmin on and then have ssh tunnels from a random high ports on the dev server to port 3306 on each production server. I then point phpmyadmin at the local high number port.
autossh -C -M 0 -f -N -L 7650:localhost:3306 pmauser@www.example.com
This is myphpmyadmin config for each host. You can duplicate this as many times as you need changing the host and port. When you go to the phpmyadmin page you will have a drop down list that lets you select which host you want to connect to. Just make sure each one is in your hosts file and points at localhost.
/*
MySite
*/
$i++;
$cfg['Servers'][$i]['auth_type'] = 'cookie';
$cfg['Servers'][$i]['host'] = 'MySite';
$cfg['Servers'][$i]['port'] = '7650';
$cfg['Servers'][$i]['connect_type'] = 'tcp';
$cfg['Servers'][$i]['compress'] = false;
$cfg['Servers'][$i]['extension'] = 'mysql';
$cfg['Servers'][$i]['AllowNoPassword'] = false;
$cfg['Servers'][$i]['bs_garbage_threshold'] = 50;
$cfg['Servers'][$i]['bs_repository_threshold'] = '32M';
$cfg['Servers'][$i]['bs_temp_blob_timeout'] = 600;
$cfg['Servers'][$i]['bs_temp_log_threshold'] = '32M';