Crawling before doing lots of updates?

Hello,

I was about to create my xml sitemap file but it is goin gto take quite a long time because there are thousands of pages to my site. Soon, I will be changing the main menu out on each page to a different template. This will effect each and every page on my site. Is this something I should do before using the Surveyor? I don't want to have to crawl the site again.

Thanks for your help.

Unfortunately if you change the site structure, you will have to run through Surveyor again to generate the sitemap correctly. There isn't any way for Surveyor to know what changes you made and just make those modifications to the existing sitemap. If you're changing the menu structure soon, you might want to wait until you've done that before generating the site map.

Thank you for your advice. I decided to hold off on the updates and to go ahead and start Surveyor. Unfortunately it runs fast in the beginning but now a couple hours later, everything keeps freezing up. Is this normal?

If your site has a lot of pages and links from different pages, then Surveyor has to keep track of a lot of files in memory, so it slows down when there are a lot of pages in the queue to be surveyed still. Unfortunately, there's nothing that can be done about that.