I wouldn't use brass pins for several reasons.
As was mentioned, they would tend to mushroom when you drive them in and remove them. If they mushroom, their larger diameter will tend to lock them in the hole resulting in possible splitting of the wood.
The caliber shouldn't really matter because what the pins are really doing is to nail the wood forestock to the barrel rather than nail the barrel to the wood.
If any of the pins take a shear load during firing, it would be the pin closest to the breech but IMO, if you inletted the barrel in properly the tang will take most of the upwards motion of the barrel at that time.
Not to sound different, but I would suggest using a 5/64 (.078) diameter pin rather than either the 1/16 or 3/32 size.
My reason for saying this is the 5/64 pin, being larger allows the use of a 1/16 diameter pin to knock it out for taking the gun apart.
The 5/64 dia drill, being larger tends to "walk" less than a 1/16 inch bit does when it hits the metal of the underlug. There is also less chanch of breaking the bit during the drilling process (talk about ruining a good day!).
I think the 5/64 pin also beats the 3/32 pin because it is smaller. That gives a little more "wall" to the underlug between the hole and the edge.
I have had several cases where the drilled hole in the underlug was marginally ok (it didn't break thru the wall) but if I had used a larger drill, it would have broken thru leaving a partial diameter.
Zonie