Believe it or not, alot of noncomedegenic products still break people out. It's basically all about experimenting and finding what is best for your skin. It wouldn't hurt to buy a new sponge. You can get new sponges/puffs in the makeup section for cheap.They usually come in multi-packs.
It also wouldn't hurt to invest in a powder brush just for the sake of application. A great one is the ELF Studio flat top powder brush. It's like $3 bucks at Target and I love it.