Thanks for the input, we'll take a look into that if the problem persists. From doing more investigation, it seems that there might just be some sight map submission issues in general.
If you run into this issue, try submitting to yahoo directly:
Go to the "submit site feed" section to submit. If it doesn't submit there then it is most likely an issue with yahoo.