CEOs are often the face of the organizations they run. Even when they know it's time to move on, letting go can be hard.