Short-lived White House communications director Anthony Scaramucci said that Steve Bannon is hurting President Donald Trump's ability to move his agenda forward, and suggested the administration move toward the political "mainstream."