No, the display manager is applied to the entire cart.
If only one item is showing in the cart display, make sure that you do not have multiple cart objects defined.
it could be that you have the add to cart button for the first item set to use one cart object and the second add to cart button set t use a different cart object.
If that's not the case, make sure that the ID's being used for each add to cart button are unique.