I am 5'10", 180 lbs and I got a medium. It fits perfectly, not too tight, not to loose. It is VERY high waisted so if you're shorter, it might be uncomfortable.
I love it so much. I wanted some thing I could sleep in but could get away with wearing to the grocery store with some tennies. LOVE!