If what you're shooting is light like a tennis ball, and there is a loose fit with no wad, then this is more of a fireworks mortar instead of a artillery mortar.
^ note proviso's on weight and loose fit above ^
The 300 grain charge = 19.44 grams
If you're lifting a tennis ball then you have something close to a 3" mortar which has a standard lift charge ~ 17 grams BP.
The fireworks industry has given up on steel tubes for standard shells for safely reasons, they use HDPE(plastic sewer pipe) or fiberglass now.
(Note HDPE is not PVC, PVC or other types of plastic pipes would actually be much more dangerous than steel)
When they do use one for extremely heavy shells, or for salutes they bury them in the ground.
They also have double layer welded bottoms.
A loose fit and light projectile would mean you're probably safe, but do you want to risk your life on probably?
Note that packing a wad to increase pressure and send the ball further greatly increases the risk.