When to change an acne routine

I've been seeing a dermatologist for about 2 years, for mild/moderate acne. He put me on a pretty intense acne routine. I've been following it religiously. But my acne only started to truly improve after I went on Yaz, birth control.

Now I feel like my skin is WAY too dry and my routine needs to change. I still have blemishes but hardly ever have bad breakouts anymore. This is what it is now:

-Cetaphil face wash
-Benzoyl Peroxide Pad (6%)
-MGM Erythromycin topical solution (morning) or Differin (night)
-Olay moisturizer

I'm thinking about changing the BP pad at night to a salicylic pad. Good/bad idea? Any other suggestions?

Hello

I've been dealing with acne for a couple years now, it's finally improving, but there's certain questions I have. You guys seem very knowledgeable, and hopefully I can share what I know, too. See you around. :]