a better strategy would be to add a column to mark items that will have shipping applied.
for example sake, call the column shippable.
in tha add to cart button, set the value to 1 if it should remove the shipping and 0 if it should not, then use that column in the shipping rule.