How to remove an autocomplete email address from Apple's Mail app

Anyone who has used Apple's Mail app has likely experienced an embarrassing failure of its usually helpful autocomplete feature for email addresses. Sometimes, either old or seldom-used addresses for your contacts will sneak into your address book (within Mail, that is, not in your actual Address Book app). All it takes is collaborating with Google Docs for me to get someone's personal gmail.com address to override their preferred business oreilly.com address. As has been pointed out to me on more than one occasion, this is not good. I finally investigated how to solve the problem.

Within Mail, choose Window->Previous Recipients:



Search for the offending address and choose Remove From List:


And that's it. No more embarrassing autocompletes for that address (until the next time it sneaks into your address book, that is).