Unfortunately there is no easy way to do that without using the mailer since it sends an encrypted link that can't be generated easily outside of the system.
You could give them a link to the login page where they could log in and then unsubscribe from their profile page.