A lawyer for the Trump administration said Friday that its attempts to expand the president’s power to fire people may not extend to the ability to fire the head of the Federal Reserve Board.

“Nothing that we do here dictates what happens to the Fed, full stop,” Harry Graver, a lawyer for the Department of Justice, said Friday under questioning from judges from the U.S. Court of Appeals for the D.C. Circuit.

Trump fired members of National Labor Relations Board and the Merit Systems Protection Board, which handle worker complaints in the private and public sectors, despite laws protecting their jobs while they serve set terms. The Trump administration says those protections are unconstitutional.

The Trump administration has already asked the Supreme Court to take up the case promptly, causing concern over whether the head of the Federal Reserve Board, who has similar job protections, could be at risk should the Supreme Court rule in the administration’s favor.

Trump has a long history of attacking Federal Reserve Chair Jerome Powell. Trump said in April that Powell’s “termination cannot come fast enough!” and called Powell “a major loser.” Trump backed off days later as financial markets went into a frenzy, but lashed out again this month after Powell declined to cut interest rates.

“The Federal Reserve I think presents a distinct constitutional question not before this court,” Graver told the judges, who said they have received multiple arguments from outside parties saying the case affects the central bank.

Judge Florence Pan pressed Graver to explain why the Federal Reserve should be carved out as an exception to boards Trump should have control over, but the labor boards should not.