Small bores are more sensitive to things like powder, patching, fouling, and even cap strength. Large bores often don't even change point of aim much at 50 yards with a five grain powder change, changing lubes, patching, or changing caps.
Outside in the real world with a breeze blowing, the 54 will eat the 36 for lunch on the target range simply because it bucks the wind better and more predictably. In a tunnel or on a still day, the 36 will hold it's own.
In the hunting fields, the 54 is better across the board for everything after you get past jack rabbits or foxes, and it can be loaded down for them too. The 36 is better for small game, but illegal for most larger game virtually everywhere.
At the range, the 54 thumps those knockdown plates right on over. The 36 has problems a lot of the time past 50 yards on the bigger plates.
The 36, a can of powder, and five pounds of 000 buck is a lot of shooting for little money. The 54 costs about five times as much to shoot with average loads.
The 36 doesn't kick. The 54 depends on build and load on how much it does.
In the the end, you need one of both! The 36 is a nice economical range gun for practice and is great for squirrels and such. The 54 does everything else, including winning the match at the local club!