On the building's 50th anniversary, those with memories and knowledge of the Japanese architect say recognition of his achievements is long-overdue.