The vast majority of people — including language experts — use “aggravate” to mean “irritate.”
Grammar Girl says it’s totally acceptable, but she does caution that there’s a small majority that will argue against it.
She explains why and offers a handy mental trick for remembering how to avoid aggravating — er, provoking — those folks on her blog.