The right thing to do would be to give it back. The smart thing would be to just keep it. Sounds like these guys aren't all that bright and are just looking for trouble. Giving the watch back may just cause them to kick your ass, but in their eyes it will be weakness and then they will probably just give you crap until you break.