Going say somewhere in their 30's.
Sex and athletics performance would see a decline in the athlete faster as you mention the median age of 24 for Olympic athletes. But I feel that sex performance really does drop at that age no matter if flab starts or a performer gave birth.