I often get those. It's maddening, especially in sunlight. I get all paranoid about the shadows they create! You might have some luck with an AHA (Alpha Hydroxy Acid - a chemical defoliation). I think Dan sells some. It can irritate less than a traditional scrub. I don't know where to buy one in a store, but I'm sure that other members will be able to hop in here soon and give you some good recommendations!
I use to get those bumps from shaving and than my derm told me to try just a beard trimmer and poof, the bumps vanished.
I do the same set the beard trimmer to its lowest setting shaving causes these through irritation.
Aha would help clear them I use a small amount daily brightens your face up too, you can buy it from dans store or 10% aha from Paula's choice before that