This normally happens with PayPal Payments Standard as the gateway.
What gateway are you using?
If you are using PayPal Payments Standard as the domain, I suggest changing to Express Checkout instead. It is also a free service with PayPal and offers the same checkout experience.