If you put a caption directly into the image, it will fallow the image when you move it.