Prime Minister Shinzo Abe on Thursday expressed "deep remorse" over World War II, stressing the path Japan has taken as a peaceful nation since its defeat in the war.