Benzoylperoxide or birth control?

Two and a half years ago I stopped using contraceptives (NuvaRing), and all of a sudden my skin broke out like never before, on my forehead, chest and upper back. I have never had skin problems before, and it struck me really hard.
Having tried everything (besides benzoylperoxide), I decided to start using contraceptives again this February, but my skin did not improve much, but I guess this could take months to kick in. In May I tried benzoylperoxide for the first time, and I could see a slight difference overnight. Gradually my acne disappeared, and my skin is now clear, but I'm not really sure what did the trick!
As I'm suffering from various side effects from the hormones I really want to quit, but I'm a bit reluctant because I don't want my skin to break out again. What to do? I'm still using benzoylperoxide to prevent future breakouts, but will this effect last if I quit using the hormones?