The heads of the Pentagon and the U.S. intelligence community have recommended to President Barack Obama that the director of the National Security Agency, Adm. Michael Rogers, be removed from his position, sources familiar with the matter said on Saturday.