That isn't an arrow to show that there are more submenus underneath it, it is just a part of the design for that menu type.
To only have the arrow on some of the menu items, you would have to create a new css class that applies the background image:
background-image: url("../cssmw_images/arrow.gif");
And then you would have to apply that class to only the menu items that have submenus manually.