Yes, unfortunately you can't have a subset of size options display based on the category. I think the only solution in this case would be to put the product in again.
Your friends over here at WebAssist! These Dreamweaver extensions will assist you in building unlimited, custom websites.
These out-of-the-box solutions provide you proven, tested applications that can be up and running now. Build a store, a gallery, or a web-based email solution.