Before you finish the inlet to full depth consider using lamp black on the barrel to show high spots.
It can hep getting a close fit.
also before you modify a rasp try a large dowel with coarse sandpaper or a scraper. For what it is worth I laid a rasp in the channel as well as using a dowel and a large sharp chisel as a scraper after spotting the barrel channel with the barrel covered in lamp black.