Typing Apostrophes?

I have Windows XP on my laptop, but every time I want to put in an apostrophe or quotation marks, I have to press it twice. If I put an apostrophe before a vowel, it makes it an umlaut. It is quite annoying. Someone please help me!!!!!!!!!!!!!!!!