Yes, you will need to update locally and FTP your changes to the live server. Upload everything except your connection file.
I usually create a backup of my live and local connection folder, that way if I accidentally overwrite one or the other I can quickly copy and paste to fix it.