Actually you pretty much gotta rip it off however you can without damaging the card...
I had to do that on a TNT2 without wrecking it and I ended up putting down some rag between the board and the hsf and prying with a screw-driver.. freezing did not help me either..
i ended up getting it off and all was fine... but it put up a good fight!