Any PC shop can test it. I'm pretty sure BestBuy, CircuitCity, etc could test it too, although they will probably charge a fee and the local PC shop might not, especially if you bought the cpu from them.
I agree that the CPU is most likely not the culprit (especially if the PC was ever able...