The configuration folder gets created when you open Dreamweaver. To make this quicker, when you browse to the Dreamweaver CS4 folder, there should be an Extension Manager or it could be called "Extension Manager2". Inside the folder there is another configuration folder. Try renaming that configuration folder to configuration_old, and then open the extension manager again, all the extensions should have been removed.
let me know if you still have any issues.