Have you tried reducing the powder in the pan? It doesn’t take very much to ignite a charge, a few grains actually will do the job.
When I was out squirrel hunting last year, I had to reload quickly, when I done that I noticed in my hurry I put way too much pan primer in, I was in such a hurry...