You don't delete, Bill Gates won't let you!!!
What I have done is you go and get the PowerTools for Windows XP, this includes TweakUI and this gives you the option for turning the Links folder off in the Favorites. Under Explorer in TweakUI you have a checkbox that says, "Show Links on Favorite Menu"