You can do a pretty good job by just using a strip of abrasive paper in a shoe-shine motion with the armature held in a vise or clamped to something convenient. I did quite a few motors that way before I got a lathe. It works because you're not really removing much metal & the natural tendency is to automatically? make repeated motions the same way.
Roy