Pictures?

It sounds like it could be a cyst. To draw it out, you can use a cotton ball or clean wash cloth soaked in warm (not too hot that it will burn you but on the side of hot) sea salt water periodically every few hours for several minutes at a time.

Ice can help inflammation temporarily but it usually sort of slows healing because the inflammation is from increased blood flow, so reducing it stops the white blood cells from attacking the acne... I believe...

Basically got this weird, hard red lump under my skin. It feels like a ball, but its not painful. I iced it a little bit and it got smaller and less red. Is this a cyst?

 

I've never gotten a cyst in my life..

 

EDIT: Let me add that it was super small yesterday, and it got bigger today. Took like 10 hours to develop to the size that it is now, but its shrinking.

It does sound like a cyst, except that it isn't painful. Cysts are typically pretty painful. If it is already shrinking, it may just be a regular old pimple that just hasn't come to a head yet. Try the method the poster above said if you like, but otherwise just try to leave it alone.

It wasn't a cyst, thank the Lord. Just a blind, painless inflammation that is going down slowly.

I get those too! Particularly on my chin. Annoying. They usually hurt though.