The Trump administration wants to work with Congress on freeing Fannie Mae and Freddie Mac from government control, though it's considering pursuing some changes on its own, Treasury Secretary Steven Mnuchin said Tuesday.

"I would like to get them out of conservatorship," Mnuchin said during a roundtable interview at Bloomberg's Washington office. "My preference would be to do something that has bipartisan legislative support."

Fannie and Freddie rose after Bloomberg reported the Treasury secretary's comments.