It was a permissions problem with the file: Connections/installed_cms.txt
That is the file it uses to keep track of the last activation date so that it will only run once per month. That file was updated recently to not have write access, so it couldn't record the fact that it had already activated and it was trying to re-activate with each visit to the site.
I updated the permissions on that file and it appears to be working correctly now. You can try doing the same for other sites. If you open that file and the last date listed isn't from this month it means there was an issue and it isn't working correctly.