ok, so multiply the price * quantity in the calculation:
(abs([Quantity] >= 5 && [Quantity] < 10)?([Price] * [Quantity]) * 0.05:0) + (abs([Quantity] >= 10 && [Quantity] < 20)?([Price] * [Quantity]) * 0.1:0)
send a copy ofd the cart display page please.