Acne.org Products
So my skin is pretty much 98% clear except that I constantly get cysts in my sideburn area! Even if I don't shave the little bit in front of my ear so it's an extension of my hairline it'll turn into a horrible cyst and end up with a clump of hair coming out and just being generally disgusting.
Any advice on how to stop/prevent this? 
Hey! Cysts on your sideburns and around jaw line comes from hormonal acne.
You can get it gone completely but it may be hard for you particularly if you like dairy products.
Dairy products need to be cut to a minimum and milk cut altogether.
Read my post 'Change your life' and do some research, but I guarantee this is your problem. 
Hair comes out of the cyst? That sounds like an ingrown hair if so
I've read that if a cyst is bad enough it forces surrounding hairs to go into telogen; which are then easily plucked out.
Hey! Cysts on your sideburns and around jaw line comes from hormonal acne.
You can get it gone completely but it may be hard for you particularly if you like dairy products.
Dairy products need to be cut to a minimum and milk cut altogether.
Read my post 'Change your life' and do some research, but I guarantee this is your problem.
See I'm not 100% sure it's milk which is the problem; this week I've been only eating and drinking dairy products because my wisdom teeth are coming from; so loads of smoothies, milkshakes and icecream. I haven't broken out as of yet though.
Every glass of milk or bit of dairy has a varied amount of hormones. Nonetheless, as you wouldn't expect some tablets you take for a specific problem to start working day one or even after a fortnight, neither should you expect to see a breakout from something you did the yesterday or even a week ago.
It takes quite some time for your body to pass all these things through and milk and dairy is literally the hardest thing for our bodies to digest because it is not for humans! You can expect a breakout soon if you were going from no dairy to all that dairy for a week, but realize that if you've been having milk or dairy as a part of your diet for quite some time, putting in even more hormones on top of the skyrocketing ones in your system that have been in your body for so long, really won't make much of a difference.
Still, you said you aren't 100% sure, so give that 1-99% chance a chance and cut the dairy out and see the results!
And please don't run back after a day to post results.
Patience and consistency is the key and it will take a little time to clear yourself of these abnormally large amounts of hormones and then, hormonal acne which you clearly have.
I am only advice, but I can assure you I have the right answer. Soy milk and dairy substitutes aren't that bad, and you will surely be healthier!