The server that failed, all checks come up clean on it so it appears that, as far as I can tell it was a freak incident of a filesystem/volume corruption. Every check passed otherwise and I'm re-installing it now to clean the system up.