Solved
Because a user can only select 1 of any type of product in this solution I reverted the AddIfIn field to "0" and set the second form with the hidden Quantity value of "-1". When it adds 1 and -1 it gets 0 and removes the product from the cart and all my other calculations on that page work now!
Thank you for the nudge in the right direction!!