Tried what you suggested. Nope, it didn't create a new folder with "1" at the end.
I happened to have used another template for this test site and the layout broke again without CSS Menu Writer. It's probably one of the stylesheets overwritten again.
Why does it do it? It seems like I will have to keep renaming all the css files potentially gets overwritten before doing anything.