Anyone who's been involved with church planting would know the truth. Most increases in churches are transfers, not new converts. The actual numbers are pretty bad.
The reality is that what most atheists believe is true. People use religion as a crutch. It becomes something they feel expected to do every Sunday. After a while some start to wonder why they bother, their life is not impacted in any way by going. Thus church attendance falls.
"But the Lord honestly spoke to me. And he took me to Moses standing at the burnish bush. And the Lord said, "I have one question for you." And I said, "What is that Lord?" "The bush is burning but it was not consumed, why do you think that was?" I said, "I don't know." He said, "Because that bush was burning with the right fire."
Link
One of the most important confrontations that Jesus had during his ministry was on the topic of Sabbath where he said some famous words: "The Sabbath was made for man, not man for the Sabbath."(Mark 2:27) So the same could be said of religion. God didn't make men to sit in pews, say preset prayers, and wear fancy robes with pointy hats. Religion was made by men to offer a comfort other than what God offers. The biggest example of this psychological affect was when Moses brought men from Egypt. Despite the miracles and constant presence of God, the men still turned to ritual and tradition when Moses was gone for a short time. Needless to say, both God and Moses were frustrated.
This too shall pass. As bad as it ever gets, we survive. So history has shown and prophecy foretells. Even if I should stand alone, I have no reason not to.