Well, a 10 gauge shotgun has a NOMINAL bore size of .775". You are not going to be able to fit two .50 caliber RBs side by side in that barrel. Even .45 RBs will not fit. If you use balls that are so large that they stagger, you will need to find a very light weight filler to use to fill the voids between the balls, to keep them from being mishapened when the gun fires. Puf-Lon was the product available from Ballistic Products, but I am not sure its still being sold.
You can use a light corn flower, like the corn bread mix you buy in a box, but you need to be mindful that such a fine powder will absorb water from the air, making the use of it on damp days doubtful. Using such a mix as a filler could result in a tremendous increase in chamber pressures, and damage to the gun and shooter, IF IT TAKES ON MOISTURE. Tht is why a synthetic filler like Puf-lon is preferred: It won't soak up anything.
The 10 gauge will shoot 00 buckshot, and probably even O buckshot. 3 pellets should be able to fit in the bore in one tier, or row, with another three pellets fitting on top of these first three, but off-centered to rest in the arcs between the underlying balls. 9 or 12 pellet are typical, but I have seen shooters load as many as 15 and 18 buckshot in these large guns. The recoil becomes rather sharp, and bruised shouders are the norm, with these heavy loads. But out to 30 yards, depending on whether the barrel is choked, they throw a pretty good pattern.