This is a limitation to the product option lists. The option lists are not dependent, so you cannot define color that are dependent on the size that was chosen.
Th only way to workaround this would be to have one list that showed each Color - Size Option.
So you would have one list that showed:
Red - Small
Red - Larg
Blue - Med
Blue - Large