I tried it using UE without FormMail, It returns to the same page with ?invalid=true at the end. And no email sent.
This is the same page but both show regions missing. That suggests the show region utility is causing a problem?
I can get the captcha to work on it's own on a test page, just not in the "show region" and with the add to cart button.