Baking soda exfoliation

I'm using benzoyl peroxide and neutrogena moisturizer. I'm applying it every night following Dan's instruction very carefully. I'm getting cleared but I'm I'm being left with pimple scars. I want to get rid of it and I've thought of using baking soda exfoliant to lighten pimple scars. You think exfoliating 3 times week with baking soda will help me? or will it irritate my skin and cause breakouts? P.S. I will also appreciate if you can give me other suggestions how to lighten pimple scars but I prefer for you to answer my questions first before you suggest anything. Thank you so much.