Hi Lynn,
There are two ways to do this, either using just css, or by adding background-images to divs that have rounded corners themselves.
There is an example here (which won't currently show in IE Browsers). Most other modern browsers will be fine with it.
If you have a specific design in mind or a page you can link to for more advice, post back.
Edit:
Also see here