Is this jacket sized to go over a couple other layers (Fleece and soft shell jacket) or do I need to size up to get it to fit?

I'm 6ft tall and 165lbs. I wear a medium.