You could do it with validation toolkit... basically create a recordset that filters by those values and then use validation toolkit to validate that the number of results is zero.
Or just write the code to check it and redirect to prevent insert if you are familiar with php and don't own validation toolkit.