The possibility of the 2020 Games' cancellation and the economic fallout created by the pandemic could deal a blow to Abe's legacy.