yes, leave the redirect empty in universal email, then use an if statement to show the thank you message based on a post value from the form.
for example, if the form contains an element named "firstName" you could show a thank you message if the firstName post element is set:
<?php if(isset($_POST['firstName']) && $_POST['firstName'] != "") { ?>
Thank you for contacting us!
<?php } ?>