There are a coupla places that you probably don't want to be in the middle of the night.
There are only a couple places in Manhattan you'd actually have trouble with. Maybe Harlem, washington heights.
In Brooklyn, stay out of Brownsville, east bed-stuy, maybe crown heights, east flatbrush.