I have these!!! I'm currently trying not to use any harsh products (maybe stupidly) because I think it's all to do with oil production. Our skin is creating excess oil, I think this is due to not hydrating in some way (long term moisturising, not enough water) HOWEVER - the periods of time I haven't had these bumps are when I've been using benzoyl peroxide or been in the sun- both very drying, so I think this has been a topical, short term treatment, will probably work for you! But I'm just experimenting with the underlying cause at the moment. Hope this helps in any way x
I have those irritating bumps as well!!!!! I think it was because I added a new product to my routine and I stopped using it! It helped a ton, and your acne should go away soon, they won't last long. Make sure to exfoliate and moisturize a lot. Drink lots of water and eat healthy foods! HOPE THIS HELPED!!! 
I'd suggest a sacilyic acid astrigent. I used to have a similar situation and used: Clean and Clear blackhead removing astrigent (1% sacilyic acid). I dont just use it for blackheads, I use it for everything. You may read mixed reviews on this product but for me, it has worked for many years. Sacilyic acid is great at formulating new skin cells and leaving you with softer and clearer skin. Best of luck!