I did a quick test, and i was able to send emails to different email addresses that are coming from a record set. similar to what you have done.
In order for my to debug this further i will need a dump of your database. If your database contain personal information please let me know so i can open a private ticket.