Also it didn't mater because in a perfect world nothing rides on that. Notice it isn't polished/worn at all? A drive plug riding there would have buffed up somewhere, but its not. Only the hole is polished out.
Its just a clearance cut so the finish matters none at all. The dull cutter cuts slower, but if its still cutting maybe you can get a few more before grinding the bit. This one was probably a semi-dull cutter and a very heavy feed rate. Slower feed makes for a better finish too.
People sometimes sand the back of cabinets they build. Drawer bottoms, undersides of tables etc. etc.
This is the mark of an amateur. Professionals waste no particle of time futzing where the sun don't shine.
yours Scott