set the redirect page to go to the same page universal email is on and pass querystring variable:
page.php?sent=true
then put a PHP if statement around the confirm div:
<?php if(isset($_GET['sent']) && $_GET['sent'] == "true") { ?>
<div class="confirm">Your message</div>
<?php } ?>