Yes, it can help. As can borage oil. Both contain gamma-linolenic acid, which help in balancing hormonal fluctuations and helping to moisturize the skin. Many women who suffer from painful menstruation don't get enough GLA from their diet. If you suffer from hormonal acne (like me), it would be invaluable for you to avoid drinking milk and eating refined sugars and white foods (bread, cake, cereal, etc), as insulin spikes can affect hormone levels and cause acne.
I've been taking evening primrose oil supplements since september, and it helped me get over the worst cystic breakout ever. It has helped with non-inflammatory acne, and has reduced the number of cysts I get during that time of the month.. but it has not cleared my acne by all means. Also, note it took me a few months to see a noticeable difference.