The edit button shows if you are logged in.
if you want to disable that, you can edit the CSM code that is added to your page. for example, the code to show the CMS on your page will look similar to this:
echo WA_getCMSContent($database_PowerCMSConnection, $PowerCMSConnection, 'testing', 'testing', false);
change the lat parameter to true:
echo WA_getCMSContent($database_PowerCMSConnection, $PowerCMSConnection, 'testing', 'testing', true);
to hide the edit button