Rob,
One question that may help... are you using Universal Email in a way where the emails are coming from form submission and therefore different people every time - or - is the email always coming from something like "admin@yoursite.com"? If it is always coming from the same place, you could add the address as a contact.
Another trick - even if you need to reply to various people - is to actually make the From address ALWAYS come from one standard address such as mentioned above in the example. Then, set the From Name to the Name in the form collection process and the important part - set the ReplyTo address to be the email from the person submitting. That way when you get the email, you can just press reply and then be sending to the right person. This method, though, will allow the email to always be sent from a trusted contact in your Outlook.
Best regards,
Brian