Wheel bearing seal
 

I noticed on my wheel bearing seal surface on the spindle that there is a scratch on one and a scratch and another spot on the other spindle. I can catch my fingernail on the scratches, but they are not sharp. The other spot is a little sharp. I was going to hit all the spots with some sand paper and work my way up to ~600 but if I cant get the spots out completely is it going to chew up the seals?