Ok.. My bad.. Got that to work. I was running the 'simulate query' when it gave the error.. Actually running it succeeded.
Got rid of the .. Found another character I need to get rid of. It is the  character. Doing some searching it seems to have something to do with the collation. It is set as latin1_swedish_ci . Should I change that to a different collation and will that mess up the db by doing so.
If I do the same UPDATE with that character (Â) it does not find it so I cant get rid of it.