The housing problem is comfort greed, not interest rates. Most everybody I knew grew up (and still live ) in 1,000-1,500 square foot homes, some with 5 or 6 kids. A couple of bedrooms, a kitchen, a living room, maybe a dining room and a basement for a rec area.
Interest rates were 10% or more. I remember when I was happy to refi to the amazingly low rate of 9%.
Now everybody wants a 4,000 square foot mini mansion for 1 or 2 people that may never have kids. Great rooms, entry halls, add-on and bonus rooms, 3 bathrooms and a kitchen bigger than some of the houses we grew up in.
I've never paid more than $40K for a house. The one I'm sitting in now, I bought outright for under $30K. Now you can't hardly get a garage built for that.