Yeah it looks like the map stays visible in ie6 and ie7. I'm not that familiar with the spry accordian panel, but you could probably find the code that would work to properly set display:none or visibility:hidden for that layer with a bit of debugging.
The map is shown in a layer that should be able to be hidden with script in those browsers.