It appears that there is a bug and the autoreturn setting is being ignored.
To fix the problem update the authentication.php page manually.
On or around line 89 you will see:
if (isset($_SESSION["WA_FAIL_".$this->Name])) {
change it to:
if ($this->AutoReturn && isset($_SESSION["WA_FAIL_".$this->Name])) {