Many of Japan's top para athletes are staying away from the event over fears that infections could lead to even more severe illnesses.