I have hunted with my Zouave for a few years as has my buddy. Neither of us has had a minie move in the bore, even in very cold weather.
If you are concerned about it you can always pull the ramrod and check if the bullet is seated. It would only take a few seconds. If nothing else that would...