If you're gonna stop, then do it gradually and see the changes. Worst mistake people make is stop what they are doing cold turkey (unless they know what's up).
But it's absolutely a good idea to minimize the use of products. The most effective treatments are BHA, differin (retinol), AHA and benzoyl and a cleanser. Some products require you to moisturize initially. Topical vitamin C is alsoan alternative.
Get a non irritating cleanser, cleanse the face (rub it in a little), and then a product of your choice. Depending on the type of bumps, you should choose bha+, aha+ and retinol. I use all of them, but at different days. All of them have advantages. Always start new product out extremely slow.
Btw, don't let my profile picture discourage you from what I'm saying; it's from 2011 or something.