I would imagine that your product, no matter what colour, is using the same unique ID in the database.
In the Add to Cart behaviour there is an option to tell the cart what to do if the same product ID is added (i.e. Sum, Add new item etc).
Try that.