Just for the record, the Lyman "BLACK POWDER HANDBOOK & LOADING MANUAL" 2nd Ed., shows the velocities and pressures for a .54 caliber 8 inch barreled single shot pistol shooting a roundball patched with .015 patches.
The loads they show range from 35 to 50 grains of GOEX 2Fg powder.
The velocities achieved with these loads vary from 792 fps to 939 fps with breech pressures ranging from 4,600 psi to 5,900 psi.
The book also shows the velocities and pressures produced by GOEX 3Fg powder in loads from 35 grains to 50 grains.
Using this powder produced velocities ranging from 909 fps to 1044 fps with breech pressures from 6,400 psi to 9,700 psi.
IMO, any of these loads could be used in your pistol but IMO I would stick to something around 45 grains max.
The barrel should be safe with these loads but with some single shot pistols the strength of the stock is not.
More than one single shot pistol has ended up with its stock damaged by someone who was trying to make a Magnum out of their gun.
Also, you will read about people using .018 thick patches in their rifles to get good accuracy.
Rifles are heavy and quite strong so ramming these tight fitting patch/ball combinations doesn't create a problem.
Pistols are another matter.
Using the butt of the grip to support the gun while ramming a tight fitting ball/patch can easily crack the stock.
I suggest that pistol shooters leave the tight fitting ball/patch to the riflemen and use patches more in the .010-.015 thick range.
Use the thinnest patch that gives good accuracy.