Got a bit more to add.
Recently purchased a book by Daniel E. Williams, Jr. called The Whitney Navy Revolver. On page 15 he included a review/advertisement from the New York Times.
View attachment 370884
The Remington Old and New model Army revolvers were essentially clones of the Whitney that took the cylinder swapping mechanism even further.
I think an article like this one, alongside the progression of the cylinder swapping mechanism make it quite obvious that swapping cylinders was in the designers intentions. It would have also been a feature the general public was aware of, and would have wanted to have.