Some who had hoped to compete in this year's games have found the mental challenges of COVID-19 disruption more taxing than its impact on their physical training.