well, I went and picked up a PSU tester and checked both my PSU in the computer and my spare PSU and they both check fine.
I also pulled the power switch plug on at the mobo and that didn't have any effect on the computer.
Any ideas what I should check next?