Remove as much as you can, so boot with just:
Motherboard, cpu, 1 stick of ram, video card, power supply.
It sounds like you have the power switch thing plugged in correctly to the motherboard, but double-check to make sure. You can also unplug all of the other motherboard connections just...