It sounds like you will have to patch the drywall after removal anyway. So why not go ahead and cut an extra couple inches of drywall around the bolt for easier access. Perhaps the removal method will be clearer to you once you can see the lay of the land...