the idea is that you have an image tag with an id set up like:
<img src="blankimage.jpg" id="imageid" />
then in the link, you use the onmouseover event to reset the src attribute of the image tag:
onmouseover="document.getElementById('imageid').src = '<?php echo($row_rs['artist_image_location]); ?>'
the image should be coming from the same recordset as the names
If you send a link where i can see what you have tried and a copy of the page so i can see the code, i can probably tell what is not being set up correctly.