Not sure what billing agreement you mean. I've cruised through the sandbox store settings and don't see a billing agreement. Everything seems pretty normal and complete.
I've gotten new credentials, killed and restarted sandbox accounts. Very frustrating, particularly since I have to have a test site setup for prospective customers of my client to use. I can't easily get around not having a sandbox store.