The most recent version of the extension should automatically cache the geocoded coordinates so that this won't happen after the first view of the page.
It is possible you are using an older version or the permissions are not set properly on the cache file and it isn't being stored correctly. This issue should have been fixed in the most recent version by creating the cache file.