IE worked fine for me, but I prefer the extra features of Firefox - tabbed browsing, adblock, a simple search bar that you can add any search engine you want to it (even dictionary, wikipedia etc). It also feels faster (especially on a friend's laptop, as having multiple tabs in firefox uses a lot less ram than multiple windows in IE), and then there's the 'better security' issue.
Firefox is intentionally non-bloated and comes with only a solid browser and the major features. Then there are a huge number of
extensions with which you can personalise extra features to suit you.
Installing Firefox automatically imports your bookmarks and stuff, so it's pretty painless just to install it to have a try. Browser choice is as much abotu personal preference as anything, so give it a go and simply go back if you dont prefer it.