There are two reasons for elongating the holes.
As was mentioned, heat is one reason.
Lets say you build your gun in a 70 degree F room and drill the forward pin hole without clearance.
Now, your gun is sitting on a bench in the sun and the barrel temperature has risen to 140 degrees F. If the breech of the barrel is held in place with a tight tang screw, the barrel will expand towards the muzzle. At that temperature, if the pin is 40 inches from the breech, the hole will move forward .027 relative to the wood.
The barrel would shrink by the same .027 if the gun was carried around in 0 degree F weather.
The other reason for elongating the holes is humidity. I don't have any growth/shrinkage factors for this but wood is greatly affected by high/low humidity and moves a great deal.
I have heard of wooden stocks growing enough to actaully bend the barrel pins so they couldn't be removed. In other cases, they just split out the wood on the forstock.