The text is only used for Preview purposes with HTMLEditor, it does not get inserted when you insert the image. I guess it wants to show you an example of how the image looks with text around it.
I'm glad you found how to remove the text.
Your friends over here at WebAssist! These Dreamweaver extensions will assist you in building unlimited, custom websites.
These out-of-the-box solutions provide you proven, tested applications that can be up and running now. Build a store, a gallery, or a web-based email solution.