Yes, I gathered that. He mentioned she had said she didn't feel right even before she drown the kids and he brushed it off.
Yep, that's what I got. He was overcome with guilt due to not helping his wife get help prior to her murdering the children. I'm assuming he also felt fairly shitty about offing his wife afterward.