I do have to quit DW and restart each time I want to create a brand new sitemap. After the sitemap is created, I have to quit and restart again and then surveyor submits the sitemap. If I don't restart, it won't do anything, it sits doing nothing, not even an error message. This time it submitted to all, even to Yahoo with no complaints!
Although it works if I do that, it'd be nice if I didn't have to quit and restart each time.