I had the same problem and then I read somewhere to do this:
Pull the 2 little silver tabs to the side a little bit and use a jewelers screw driver underneath it and pop the battery out with force. Mine went flying so be careful, but this is actually how you get it out.
Edit:
Also, pay attention to which side the positive side is on before removing.