In the server validation for the phone number, you can set the phone number format to allow.
you can add additional validations for the fields to the server validation behavior.
for each validation that you add, make sure to add a validation show if to the checkout page so that you know which form fields are failing validation.
It sounds to me like you have some validations in place that do not have a corresponding validation show if to show what is failing validation.