Not To WorryStress In Your Forties Can Shrink Your Brain And Affect Memory Study finds higher cortisol levels lead to lower brain volume and impaired memory. By Nadia Nooreyezdan