it's very difficult to try to give advice on intermittent problems, there are many things that can be going on.
it could be that one of the images on the site is taking a long time to download and causing the server to time out or any number of other issues like a javascript timeout.