The BIOS is good, and the CPU runs fine, both cores detected, and I'm playing with it now at around 2.7 Ghz.
Once I put all 4 sticks of RAM in though, the system doesn't boot, just give me a memory detection error. I can run all 4 sticks 2 at a time with no problem whatsoever. I can boot with three sticks, but it (or I) corrupted my OS. That may also have been due to the fact that I changed CPUs and did not do a clean install, but I haven't tried three sticks again.
I also just realized that while I tried reseating all of my connections, I didn't try reseating the power connector.
The supply itself is a "Turbolink" ATX-CW500P4
Like this It's 500w max.
I started a thread over in CPU and overclocking first, and it kinda came down to a power supply possible issue, like that last stick of RAM is just kicking it over the edge.
I figured it would be better to ask than just go run out and buy a new PSU or the wrong size.