When you assign products to a category, you need to also select the parent category if you them to show for the parent category.
the category selection is a multiple select list, you need to select the parent and child categories that the product should associate to.