In my opinion...which is my opinion, EVERYONE, including you should overclock.
I am going to break down what you listed as personal reasons not to real quick <3 I am not nitpicking just giving my 2 cents and informing you in the process.
Heat - SB chips can run EXTREMELY cool. For example my 25 dollars cooler *hyper 212+* runs COOLER while overclocked then the stock cooler does at stock speeds. For example I run 4.5ghz at roughly 60c while the stock cooler does 3.4 at 75+c.
Power - SB chips can downclock to 1600mhz while at idle whether they are overclocked or not. You are only using the power when you need it aka either loading up an application, gaming etc. The difference between power used from 3.4ghz to 4.5ghz is minimal and the power used at idle is the exact same. So the majority of the time, power isn't a concern and in the "long run" the increase in performance outweighs the 1 cent a month.
Noise - This isn't an issue as any decent cooler these days will be 100% better then the stock heatsink/fan combo and are generally QUIETER then stock. My pc is 99.99% quiet, I hear my case fans juuuuust a little bit which I like it that way
Stability - You are either stable or you are not. Stability can be found by running a few different programs. LinX, memtest86+, prime95, IntelBurnTest, OCCT. This is something EVERY builder should do whether they are stock or overclocked to test for stability. You are either 100% stable, or you are not. There is no half way of doing it IN MY OPINION. Some people are "stable enough" to do the job. For example if they are running the program folding at home, they might overclock there 2500k to 5ghz with a low voltage that passes that program, but would fail a stability test.
Stability can be achieved very easily though, and its quick and simple to find out if you are stable. I have NEVER received a BSOD or ANY type of hang/issue after finding a stable overclock. GENERALLY speaking overclocking would help to resolve any hangs/slowdowns/chokes etc that a system could experience.
Overclocking is kind of like modding a car for more horsepower. It might not be needed but there is a HUGE market out there for it and A LOT of people ENJOY doing it because its more POWER for the same cash.
One more thing I want to note is the simplicity to overclocking. You can literally change ONE number in your bios and have a 100% stable overclock. You can take a 2500k and instead of the turbo multiplier being 34, you change it to 40 and BAM you have a 4ghz 2500k that is stable all day long Some people want 4.5, some want 5.0 and some push it as hard as they can aka 6ghz.
Stability is not tricky in any way shape or form however. Either you are stable or you are not. Either the system can do EVERYTHING it needs to do, or it can't. It will either pass the hardest most grueling applications or it can not. Nothing a person ever does on there pc for daily functions will ever be even remotely close to as hard as LinX/IBT pushes there computers. This is also why these 2 programs can increase the heat output much more than any other stability testing programs. Both stock and overclocked heat will increase no matter what with those 2 programs.
Either way, I don't understand why you are so against overclocking and I want to show you the light haha