Yes, you can remove all the extension by deleting the configuration folder, located under:
C:\Users\username\AppData\Roaming\Adobe\Dreamweaver CS4\en_US
and delete the extension manager configuration under:
C:\Users\username\AppData\Roaming\Adobe\Extension Manager2